A free crawler.
Built to be trusted.
WebCrawler.buzz is an open-source domain crawler that discovers every page of any site. No signup, no page limits, no data retention beyond an hour.
A domain crawler, in one paste
Paste a URL. Every reachable page on the same root domain is discovered breadth-first. For each page, you get the URL, title, meta description, H1, HTTP status, response time, content type, word count, and indexability signals.
Why you can trust it
Open source
100% of the code is on GitHub. Audit it, fork it, run it yourself.
No data retention
Crawls auto-delete after one hour. We don't keep your data around.
Free forever
No signup, no limits, no paywalls. Just paste a URL.
How it's built
Boring, reliable technology. Nothing exotic.
Node 22 + TypeScript
Express web server, BullMQ workers, and a single-process architecture for simple ops.
PostgreSQL 16
Persistent storage for crawls, pages, and exports. Redis backs the job queue.
Cloudflare
SSL termination, DDoS protection, and edge caching. All on the free tier.