SEO CrawlerCrawl your site and see every SEO problem in one report
Enter a domain and the crawler visits every URL on it, checks status codes, titles, meta descriptions, headings and response times, then scores each page from 0 to 10.
- No sign-up
- Local only, reports stay in your browser
- Nothing to install
What the crawler checks
One crawl covers the technical issues that keep pages out of search results or drag their rankings down.
Broken links
Every internal page and outgoing link is requested, so 404s, 500s and dead external links show up with the pages that point to them.
Redirect chains and loops
Redirects are followed to the page they end at. Chains that never settle are flagged as loops.
Duplicate titles and descriptions
Pages sharing a title or meta description are grouped together, along with pages that have none at all.
Slow pages
Response time is measured for every URL. Anything over 600 ms is listed, slowest first.
Indexability
robots.txt, X-Robots-Tag headers and robots meta tags are read, and non-indexable pages are kept apart from the rest.
Sitemap coverage
The sitemap is found through /sitemap.xml or robots.txt, indexes are followed, and orphan URLs nothing links to are crawled too.
http, https and www
All four address variants are checked to confirm they lead to one canonical address over HTTPS.
Headings and structured data
Missing or multiple H1s are reported, and each page shows its canonical URL and JSON-LD schema.
PDF reports
Download the whole report or a single page as a PDF to share with a client or your team.
How it works
Enter a domain
Type any site address. The http, https and www variants are checked first to find the one address everything should lead to.
Watch the crawl
Results stream in live as pages are fetched, following internal links and sitemap URLs while respecting robots.txt.
Fix what matters
Findings are sorted into Good and Bad. Open any URL to see its title, H1, canonical, schema and the pages that link to it.
Your reports stay in your browser
There is no login and no server-side storage. Every report gets its own id and is kept in this browser's IndexedDB, so you can reopen past crawls any time and export them as PDF when you want to share them.
Frequently asked questions
Is the SEO crawler free?
Yes. There is no account, no limit on the number of reports and nothing to install. Enter a domain and the crawl starts right away.
Where are my reports stored?
Only in your own browser, in IndexedDB. Nothing is saved on the server, so a report link works for you but not for anyone else unless you send them the PDF.
Can I move a report to another browser or share it?
Yes. Export downloads the full report as a JSON file. Import it from the Past reports list on the crawler page, in any browser, and it opens as a new report with every page and link intact.
How is the 0–10 page score calculated?
Every indexable page starts at 10 and loses points for problems such as a missing or duplicate title, a missing meta description, no H1, slow response times and links to broken pages. Broken pages score 0.
Does it follow external links?
External links are checked once to see whether they work, but the crawler never follows them onto other sites. Only URLs on the host you entered are crawled.
Does it respect robots.txt?
Yes. robots.txt is read before crawling, and pages blocked by it or marked noindex are listed separately and left out of the scoring.
Ready to audit your site?
Found a bug, or want help fixing your site's SEO? Email info@sitemule.com