How SuperSchema finds your pages

The old crawl-your-whole-site "Discover URLs" flow has been retired. Today your pages come in through the free Site Scan and by setting up individual URLs, and everything lands on your domain page under Your Pages.

There used to be a "Discover URLs" tool that crawled your entire site and dumped every page it found into a separate Library. That standalone crawl flow has been retired. Today pages enter SuperSchema in two simpler ways: the free Site Scan surfaces your key pages when you first add a domain, and Page Setup lets you add any single page by its URL. Everything you work on then lives in one place, on the domain page under Your Pages.

How pages get into SuperSchema now #

Run a Site Scan: When you scan a domain, SuperSchema samples your most important pages the way an AI crawler would, starting from your sitemap.xml (and the Sitemap line in robots.txt). Those pages show up on the domain page so you can see them and act on them.
Add a page with Page Setup: Paste a single URL and SuperSchema reads that real page, generates its schema and AI-readable files, and adds it to Your Pages. This is the everyday way to bring in a specific page you care about.

Note The retired crawl feature is why you may still see a collapsible "Saved for Later" section on some domains. Those are leftover URLs from the old Discover-URLs flow. They are covered in the section below.

Adding a page by URL #

Open the domain you want to work on.
Paste the full page URL into the URL field at the top of the domain page.
Start Page Setup for that URL.
SuperSchema reads the live page and generates its schema plus AI-readable Markdown and plain-text versions.
The page appears under Your Pages, where you can verify, monitor, and re-generate it.

Tip You do not have to add every page. Focus on the pages that matter most for AI answers and search: your money pages, cornerstone guides, product and service pages, and anything you want AI engines to cite.

What the Site Scan can and cannot reach #

When SuperSchema samples your site, it reads public pages the way a search engine or AI bot would. It starts from your sitemap and follows what is publicly linked. That means some pages will never be found automatically:

Pages behind a login or paywall are not reachable, because the scan never signs in.
Orphan pages that nothing links to and that are missing from your sitemap can be missed.
Pages your robots.txt disallows are respected and skipped.
Utility URLs such as admin panels, login, cart, checkout, and raw media files are treated as non-content and ignored.

Warning If a page you care about is missing, the fastest fix is to add it directly with Page Setup using its exact URL. That bypasses discovery entirely and reads the page you actually want.

Tip A clean, complete sitemap.xml is the single biggest thing you can do to help SuperSchema (and every AI crawler) find your content. Make sure your important pages are listed and that robots.txt points to the sitemap.

Saved for Later: leftover URLs from the old flow #

If you used SuperSchema before the crawl feature was retired, your domain page may show a collapsible "Saved for Later" card. It holds URLs the old Discover-URLs tool crawled but that you never set up. The card explains itself: "URLs saved from an older flow, use Page Setup to generate schema and AI-readable files."

The section is collapsed by default and only appears when a domain still has these leftover URLs.
Each row has a Set Up button that starts Page Setup for that URL, promoting it into Your Pages once schema is generated.
Each row also has a Remove button to delete a single URL you no longer want.
Select multiple rows to reveal a bulk bar with Clear and Remove Selected, so you can clear out a backlog in one action.

Note Saved for Later shrinks over time. Every URL you set up moves into Your Pages, and every URL you remove disappears. Once the list is empty, the card no longer shows.

Where your pages live #

There is no separate Library page anymore. The old /library route now sends you to your dashboard. Every page you scan, set up, or monitor lives on its domain page under Your Pages, alongside a coverage summary so you can see progress at a glance. See Managing your pages for how that view works.