How the remove duplicate lines works
Last updated 10 November 2026
Lists of names, emails or items often contain repeats. This tool cleans them in one step.
How it works
- Each line is compared with the lines before it.
- Options let you ignore case and spaces, sort the result and drop empty lines.
What it does
Paste a list with one item on each line and the tool keeps the first copy of each line and removes the repeats. It is a quick way to clean up a list of names, email addresses, product codes or website addresses that was joined together from several sources.
Options
- Ignore capital letters: treats Smith and smith as the same line.
- Ignore extra spaces: treats lines with spaces at the ends as the same.
- Remove empty lines: drops blank lines from the result.
- Sort the result: puts the remaining lines in alphabetical order.
Which copy is kept
Each line is compared with the lines above it. The first time a line appears it is kept. Later copies are removed. If you also sort the list, the first copy is kept before sorting, so the choice of copy does not depend on the sort order.
When lines look the same but are not
Two lines can look identical and still differ. A trailing space, a different kind of space, a hidden character or a different capital letter will make them count as different lines. If the tool leaves a repeat in the list, turn on the options above or run the text through the text cleaner first.
Private by design
The list never leaves your browser. That matters when it holds customer names or email addresses. Close the page and the list is gone. Check the result before you use it, especially for lists used in mailings.
Things to watch
- Check the result if lines differ only by invisible characters. Use the text cleaner to remove those.
Everything runs in your browser. Your text never leaves your device.
Like every tool on MoneyMzansi, this one runs entirely in your browser. There is no account, no upload and no sign-up, so it keeps working even if your connection drops once the page has loaded.