Remove repeated words from text
This can help clean keyword lists, tags or vocabulary when you want only unique values.
Are “Hello” and “hello” the same?
By default yes. Enable case-sensitive mode to treat them as different.
Remove repeated words while keeping the first occurrence of each one.
This can help clean keyword lists, tags or vocabulary when you want only unique values.
By default yes. Enable case-sensitive mode to treat them as different.
Paste a passage and remove repeated whitespace-separated words. Choose case-sensitive comparison if 'Apple' and 'apple' should be treated as different entries.
Example: in a rough keyword list such as 'blue blue red green red', the cleaned output is 'blue red green'.
This works best for keyword lists, not ordinary paragraphs: repeated common words may be essential to a sentence. Punctuation stays attached to words, so 'word' and 'word,' may be considered different tokens.