textcleanups

Remove duplicate lines

Paste a list and keep only the first copy of each line, in the original order.

Options

Your text stays in your browser. Nothing is uploaded or saved.

How to remove duplicate lines

  1. Paste your list into the first box, one item per line.
  2. Choose whether lines that differ only in capitals or spacing count as duplicates.
  3. Copy the deduplicated list from the result box.

The first time a line appears, it stays. Every later copy is removed. Your list keeps its original order, which matters when the order means something, like a ranked list or a log. If you'd rather have it alphabetical too, run the result through the sort lines tool.

When lines count as duplicates

LinesDefault settingsWith both options off
Apple and appleDuplicateDifferent
apple and apple  DuplicateDifferent
green apple and green  appleDuplicateDifferent

Ignoring case is right for email addresses, names, keywords and most lists people type by hand. Turn it off for things where capitals matter, such as passwords, product codes or case-sensitive file paths.

Common uses

  • Cleaning email lists before importing them into a newsletter tool
  • Deduplicating keyword lists for SEO or ad campaigns
  • Merging two lists and removing the overlap
  • Finding the unique values in a column copied from a spreadsheet

Questions

Does this change the order of my list?

No. The first copy of each line stays where it was, and later repeats are removed. Sort the list separately if you want it in alphabetical order.

Which copy is kept when there are duplicates?

The first one, exactly as you typed it. If Anna@Example.com appears before anna@example.com, the capitalized version is kept.

How many lines can it handle?

Hundreds of thousands. Everything runs in your browser, so the limit is your device's memory rather than an upload size.

Can I remove duplicates in Excel instead?

Yes, with Data > Remove Duplicates, but it works on whole columns and treats extra spaces as different values. Pasting the column here is often quicker for a one-off list.