Text Diff Checker
★★★★★★★★★★5.0(0 ratings)👁 1❤ 0
Compare two pieces of text and see line-by-line additions and deletions, like a Git diff. Highlights every change.
Remove Duplicate Lines
★★★★★★★★★★5.0(0 ratings)👁 2❤ 0
Remove duplicate lines from any list. Options for case sensitivity, trimming whitespace, and preserving order.
Remove Duplicate Lines
0
Original
0
Unique
0
Removed
About This Tool
What This Tool Does
Paste any list — emails, URLs, words, anything line-by-line — and the tool removes repeated lines instantly. You choose whether to keep the first or last occurrence, ignore case, and trim whitespace before comparing.
Common Uses
- Cleaning up email lists before sending campaigns
- Deduplicating SEO keyword research
- Removing duplicates from log files
- Cleaning up exported data from spreadsheets
What Counts as a Duplicate
By default, two lines are duplicates if they’re character-for-character identical. Toggle ‘Ignore case’ to treat ‘Apple’ and ‘apple’ as the same. Toggle ‘Trim whitespace’ to ignore leading/trailing spaces and tabs.
Frequently Asked Questions
Does it preserve the original order?
Yes by default u2014 the first occurrence of each unique line is kept in the order it appeared. Enable 'Sort alphabetically' if you'd rather have an alphabetized result.
How does this handle very large files?
The tool runs entirely in your browser. Modern browsers comfortably handle lists of 100,000+ lines. For files over a few megabytes, processing may pause for a moment u2014 that's normal.
Can I dedupe by a column instead of full line?
Not directly. For column-based deduplication of CSV data, copy the column you want to compare, dedupe it here, then merge it back with the original file using a spreadsheet.