See how Google, Bing and AI crawlers really use your site.
CrawlBoost reads your server logs and shows you what every bot actually did — what they fetched, what they wasted time on, and where your crawl budget is going. Works alongside any SEO plugin, never modifies your site.
What CrawlBoost does
Five diagnostic tools that read your logs and your site — never touching your sitemap, robots.txt, canonicals or meta robots.
Crawler log analyzer
Upload an Apache or Nginx access log (plain or .gz). Parsed on your own server. Shows which bots crawled you, what they fetched most, status codes served, and crawl budget waste.
Page inventory health
Scans every published page and flags what's empty, thin, or set to noindex — with edit links so you can act. Understands WPBakery, Elementor, Divi, GoodLayers and other page builders.
Status integrity
Finds soft-404 risks (pages that return 200 but look missing to crawlers) and audits your sitemap in-process, without a single loopback request that could stall on shared hosting.
URL waste radar
Detects wasteful internal links — tracking parameters, feeds, add-to-cart URLs, REST endpoints, trackbacks — and names the plugin, theme or setting that owns each fix.
HTTP 304 validator
Checks whether your homepage returns 304 Not Modified on revalidation. When it doesn't, crawlers re-download the full page every visit — a quiet crawl-budget drain most sites never notice.
IndexNow notifications
Tells Bing, Yandex, Seznam, Naver and Yep the moment you publish, update or delete a page — so participating engines re-crawl within minutes instead of days.
Free and Pro
The free plugin is fully functional. Pro adds automation, history and agency tools on top.
Free
Everything you need to see what crawlers are doing.
- Crawler log analyzer (single upload)
- Page inventory health
- Status integrity & soft-404 detection
- URL waste radar
- HTTP 304 validator
- IndexNow notifications
Solo
One site. Full automation and history.
- Everything in Free
- Scheduled log ingestion (cloud)
- Historical crawl trends
- AI-assisted crawl diagnosis
- Email & Slack alerts
- One site
Team
For small teams and in-house SEO.
- Everything in Solo
- Up to 5 sites
- Shared team dashboard
- Comparative site reporting
- Priority email support
Agency
For agencies managing multiple client sites.
- Everything in Team
- Up to 25 sites
- White-label client PDF reports
- Multisite & agency dashboard
- Priority support
Prices exclude VAT. Tax is calculated at checkout based on your location. Annual licence, cancel any time.
Questions
I already have SEOPress, Yoast or Rank Math. Does CrawlBoost conflict with them?
No. CrawlBoost is read-only by design — it never touches your sitemap, robots.txt, canonical tags or meta robots. It detects which SEO plugin you're running and works alongside it, adding the diagnostic layer none of them provide.
Where do I find my server log to upload?
Most hosts expose it in cPanel under "Raw Access" or in your host panel under "Access Logs". CrawlBoost reads Apache and Nginx combined-format logs, plain or gzipped. The file never leaves your server — parsing happens locally.
Can CrawlBoost break my site or my rankings?
No. CrawlBoost is a diagnostic tool — it reads, measures and reports. It does not modify any files, headers, or database content that affects how crawlers see your site. The worst it can do is show you an issue you didn't know existed.
Does it work with page builders like Elementor, WPBakery or GoodLayers?
Yes. Page inventory and soft-404 detection understand every major page builder by reading the WordPress render pipeline plus builder meta signatures, so builder-driven pages are not falsely flagged as empty.
Does it need an AI API key?
Not for the free plugin — everything works out of the box. Pro's AI-assisted diagnosis uses Anthropic's Claude, running through your own key so you pay the provider directly at cost, with no markup.
How large a log file can it handle?
The free plugin caps a single upload to keep parsing within a typical PHP execution window on shared hosting. Pro's cloud ingestion runs on our servers, so it handles multi-gigabyte logs and trend history across scans without touching your site's resources.
Not sure crawl budget is your bottleneck?
Run a free site analysis and we'll tell you what's actually slowing indexing down — including when the answer is something else entirely.
Analyse my site