Remove Duplicate Lines and Sort
Remove duplicate lines, sort and clean a list in your browser, with a count of what was removed and nothing uploaded.
- Runs in your browser, files never leave your device
- Free, open source, no account, no ads
- Works offline after the first visit
Remove duplicate lines and sort
Drop a .txt, .csv or .log file or choose a file
Up to 50 MB. Read on this device, never uploaded.
Removed lines 0
Each line that was dropped, with how many times it appeared in the input.
How it works
- Paste or drop your list. Paste one item per line, or drop a .txt, .csv or .log file. The text is read in this browser tab only.
- Pick how lines are compared. Ignore case, trim spaces, drop blank lines, keep the first or last copy, and sort A to Z, naturally, by length or at random. The output updates as you type.
- Check, then copy or download. The counts and the Removed lines panel show exactly what was dropped. Copy the clean list or save it as unique-lines.txt.
Questions, answered
Is my list uploaded anywhere?
No. Remove Duplicate Lines and Sort runs entirely in your browser. Your text is processed with JavaScript on your device and never sent to a server, so it is safe for customer emails, internal hostnames or ID lists. You can disconnect from the internet and it keeps working.
Why are "Apple" and "apple" or "butter" and "butter " treated as the same line?
Ignore case and Trim spaces are on by default, because that is what people usually mean by a duplicate. Untick them to compare lines exactly. The first copy is kept as written, so the output never changes the spelling of your lines. Composed and decomposed accents (crème written two ways) always match.
What does natural sort do?
A plain A to Z sort compares character by character, so item10 lands before item2. Natural sort reads the numbers as numbers, giving item1, item2, item10, item20. Both use your browser's collator, so accented letters sort next to their plain versions.
How big a list can it handle?
Files up to about 50 MB, which is millions of short lines. Lists over 200,000 lines are processed in a background worker with a progress bar. For very long results the output box previews the first 5,000 lines, while Copy and Download always use the full result.
Is it really free, and does it work offline?
Yes to both. It is open source under the MIT license, with no account, no limits and no ads. After your first visit the page is cached by a service worker, so it loads without a connection, and you can install it from your browser's menu as an app.
Was this written by AI?
Yes. Remove Duplicate Lines and Sort was generated by Claude Code from a written specification inside an automated pipeline, with a test suite that runs in a real browser. The full source is on GitHub, so you can read every line before you trust it with your data.
Built by one person, given away for free
Remove Duplicate Lines and Sort is a free alternative to paid tools like Dedupelist and TextFixer Remove Duplicate Lines. If it earns a place in your bookmarks, a coffee keeps the updates coming.
☕ Support Or on Ko-fi