How do I compare two URL lists from crawls?

Put the baseline crawl in List A and the new crawl in List B. A only shows URLs that disappeared; B only shows new URLs.

Should http and https count as the same URL?

ListDiff compares exact lines. Normalize schemes and trailing slashes in your export first if you want them treated as the same key.

Compare URL or domain lists from two exports

Last updated: 2026-09-03

Paste an older crawl or sitemap into A and a newer one into B. You’ll see which URLs dropped off, which ones are new, and which stayed—without leaving the browser.

Common setups

Old sitemap vs new crawl → A only shows dropped URLs.
Two domain lists → Intersection shows shared hosts.
Two referring-domain exports → Union combines them without repeats.

Before you paste, make trailing slashes and http vs https consistent if those shouldn’t count as different.

Paste URL or domain lists

Loading compare tool…

FAQ

How do I compare two crawl URL lists?

Baseline in A, newer in B; A only = removed, B only = new.

Keyword lists instead?

See compare keyword lists.