Extract a site

Discovery order: sitemap → robots.txt hints → RSS/Atom → link crawl fallback.

Site URL

Extraction schema

LLM provider

Model override

Max pages (blank = whole site)

Concurrency

Run LLM extraction Crawl fallback RSS/Atom discovery Respect robots.txt

Providers

gemini · gemini-2.5-flash · ready openai · gemini-2.5-flash · no key anthropic · gemini-2.5-flash · no key echo · gemini-2.5-flash · ready

Set LLM_PROVIDER and the matching API key in .env. Without a key the pipeline still runs and falls back to JSON-LD / meta extraction.

Site	Status	Schema	Provider	Routes	Extracted	Failed
https://zeesy.pk	cancelled	ecommerce	gemini	50	0	0