Remove Duplicate Lines

Remove duplicate lines from a list in one step and see how many lines were kept and removed. You can also check how often each entry was repeated.

0Original lines
0Lines kept
0Lines removed

About the Remove Duplicate Lines

This tool keeps the first occurrence of every line and deletes the repeats. Use it to clean up email or phone lists, keyword lists, attendee lists or a column copied from a spreadsheet. The original order is preserved.

How to use

  1. Paste your list into the box, one item per line. A column copied from Excel or Google Sheets works too.
  2. Turn Ignore leading/trailing spaces, Ignore case or Keep empty lines on or off as needed.
  3. Check the deduplicated list and tap Copy.
  4. Tap Duplicates to see which lines appeared more than once and how often.

What the options do

OptionWhen onExample
Ignore leading/trailing spacesSpaces at the start and end of a line are removed before comparing"apple " and "apple" count as the same
Ignore caseUpper- and lowercase are treated alikeApple = apple
Keep empty linesBlank lines stay where they areKeeps paragraph breaks

When case is ignored, the spelling of the first occurrence is kept.

Using it with Excel or Google Sheets

Select the column, copy it (Ctrl+C or โŒ˜C) and paste it into the box. Copy the result and paste it back into the sheet: each line goes into its own cell. Inside the apps you can also use Data โ†’ Remove Duplicates in Excel or the =UNIQUE(A:A) function in Google Sheets and Excel 365.

FAQ

Does the order change?

No. Each line stays where it first appeared. To sort the list alphabetically, use the Sort Lines tool afterwards.

How many lines can it handle?

Everything runs in your browser, so even tens of thousands of lines are processed instantly. Nothing is uploaded.

Does it work with comma-separated lists?

Lines are compared one by one, so replace the commas with line breaks first.