Remove duplicate lines

Take repeated lines out of a list and keep everything else exactly as it was.

The text is read in this browser tab and kept only while the page is open. Nothing is uploaded or stored.

List & Data Cleaner

Paste a list here

Opening List & Data Cleaner…Not responding? Reload the page.

How it works

Three steps, all in your browser

  1. Step 1Paste the listOne item per line
  2. Step 2Repeats are removedThe first of each stays, in order
  3. Step 3Copy the listThe removed row numbers are listed

Good to know

The honest limits, before you spend time on it

Exact repeats only

A line is a duplicate only when it is exactly the same as an earlier one — same letters, same case, same spacing. Ada and ada, or a line with a trailing space, are different lines; tidy the spacing first to catch those.

Order and blank lines

The first occurrence stays where it was and the list keeps its order. Blank lines are left in place; Remove blank lines drops them.

Checked, with row numbers

Before the result is shown, every kept line is checked against the original and every removed one against the line it repeats. The removed row numbers are listed.

Limits

Up to 1,000,000 characters of text, or a text file up to 2 MB.

Beyond this one task

Give AMGlide the text. It works out the rest.

Smart Drop reads what you brought and suggests what fits — then carries it into the next step without asking for it again.