Remove duplicate lines cleanly

For people cleaning exports, responses or pasted lists before reuse, Remove duplicates leaves one dependable line for each entry.

Remove repeated lines from a list and keep one clean copy of each distinct entry for checking or reuse. No upload or storage is involved.

How to use

Paste your list into the input area with one value per line, or import an accepted text, CSV, JSON, Markdown, XML or YAML file.
Choose whether the tool should keep the first or the last occurrence of each duplicate.
Turn on ignore case or ignore spaces if you want lines that differ only by those details to be treated as the same.
Run the cleanup and read the resulting list, with duplicates removed or with the counting option you selected.
Copy the output, then clear the areas before processing another list.

Example

Someone is cleaning a list of product codes exported from a spreadsheet. They paste the lines, choose to keep the first occurrence, enable ignore spaces, run the cleanup and get a shorter list ready for review before reuse.

Input

apple
banana
apple
cherry
banana

Output

apple
banana
cherry

Limits and formats

The operation works line by line; it does not merge two lines that contain different pieces of information.
It does not understand CSV columns like a spreadsheet: a whole line is compared with another whole line.
Ignore case and ignore spaces change the comparison, so review the result when those details matter in your data.
The tool does not guarantee removal of empty lines if they are part of your list; inspect the output.
Keep a copy of the original file before replacing important data.

Where processing happens

The cleanup runs inside your browser. The lines you paste or import are not sent outside. Once you copy the result, you can erase the page or close the tab.

Frequently asked questions

What is the difference between keeping the first and the last occurrence?

Keeping the first preserves the initial position of the duplicate in the list. Keeping the last uses the most recent version encountered. The text of both lines must match to be treated as duplicates, unless you enable comparison options.

Can I count occurrences instead of removing them?

Yes, a counting option shows how many times each value appears. This is useful when you want to analyse a list before deciding which lines to keep or remove.

Does the tool preserve the order of my list?

It keeps the order of the retained lines according to the chosen mode, but removed duplicates disappear from the output. Always review the result, because the final order depends on whether you kept the first or last occurrence.