Manual URL lists are accurate on day one and incomplete by week three. Discovery exists so monitoring tracks the site the client actually ships, not the spreadsheet you pasted at kickoff.

How lists rot

Campaign landing pages appear without a ticket. Product templates multiply. A locale launches. Someone renames a path and the old URL keeps returning 200 with a thin redirect story. If your speed tool only knows what a human typed, your reports optimise for nostalgia.

Sitemap and HTML crawl

Automated discovery pulls candidates from sitemaps and follows HTML links within agreed bounds. You still curate: monitoring budgets are finite, and not every blog tag page deserves a weekly Lighthouse run. The win is that candidates show up for review instead of staying invisible until a client complaint.

Apogee Watcher uses sitemap plus HTML crawl for that onboarding path. GTmetrix-style workflows that expect you to paste every URL remain fine for deep diagnostics on a known set. They are a weak primary system when the set changes every sprint.

Onboarding without the paste marathon

A practical agency flow: connect the domain, let discovery propose pages, pin the templates that match the retainer (home, listing, product, checkout, key landing pages), schedule those, and leave the long tail for spot checks. When a new money page ships, discovery shortens the time between deploy and first dated lab run.