Text Dedupe & Sort
Free text dedupe and sort tool: remove duplicate lines, drop empty lines and trim whitespace in one click, with case-insensitive dedupe, ascending/descending sort, and a count of lines removed.
How to Use
- Paste your text
Put the content to clean into the box, one item per line.
- Tick the options
Choose trim, drop empty lines, remove duplicates and case-insensitive matching as needed.
- Sort and review
Pick a sort order; the panel reports input, output and removed line counts, and copies with one click.
FAQ
Can dedupe ignore case?
Yes. Tick 'Case-insensitive dedupe' and Apple and apple count as the same line, keeping whichever appeared first.
Which duplicate is kept?
The first one. The tool scans in original order, keeps the first occurrence of each value and drops later repeats, so the output follows the input order.
Does sorting break my dedupe?
Sorting runs after dedupe. You can keep the original order, sort ascending or descending, and Chinese text sorts using locale rules that follow pinyin.
How many lines can it handle?
It depends on browser memory, but tens of thousands of lines are usually fine. For very large files, split them first or use command-line sort and uniq.