Free SEO Log File Analyzer Tool
Upload your server access log to discover how 84 AI crawlers — GPTBot, ClaudeBot, PerplexityBot, Grok, DeepSeek and more — are indexing your site. Get your GEO Score™ in seconds. 100% free, runs in your browser.
/home/username/logs/domain-ssl_log
Enterprise or via API
s3://your-bucket/cf-logs/
| gzip > access_log.gz
Why use our free tool?
Everything Screaming Frog's Log File Analyser offers — and much more AI intelligence — at zero cost. No install, no account, no data sent to any server.
100% Free Forever
Screaming Frog Log File Analyser costs €99/year. Our tool is completely free — no licence, no subscription, no paywall.
↓ Save €99 vs Screaming FrogUp to 1 GB & 5 Million Rows
Handle large enterprise log files up to 1 GB in size with up to 5 million rows — all processed locally inside your browser. No upload limits.
84 AI Bots · 20 LLM Platforms
Detect every major AI crawler: OpenAI, Anthropic, Google, Perplexity, xAI, Meta, Mistral, DeepSeek, Cohere, Kagi, Brave, Exa, Qwen and more — by name and product.
Native .log & .gz Support
Drop in raw .log, compressed .gz, .txt, .csv or .tsv — no conversion needed. Your data never leaves your device.
How it works
Analyse millions of log rows in seconds — completely in your browser. No data leaves your device.
Upload Your Log File
Drag and drop or browse for any server access log — Apache, Nginx, Cloudflare, AWS, cPanel. Supports .log, .gz, .txt, .csv up to 1 GB.
Instant Analysis
Our browser-side engine parses every row, identifies 84 AI bot patterns across 20 LLM platforms, calculates your GEO Score™, builds 20+ charts and surfaces key recommendations.
Export Your Report
Download a full PDF report with charts, scores and action items — ready to share with clients or your team. No account required.
Why GEO & AI SEO require log file analysis
Log analysis has always been a technical SEO skill. In the GEO era, it becomes indispensable — because AI platforms have no equivalent of Google Search Console. Your server logs are the only source of truth.
AI search has no Search Console.
Google gives you Search Console — impressions, clicks, index coverage, crawl stats. ChatGPT, Perplexity, Claude, Grok and every other AI platform give you nothing. No dashboard. No reports. No API. Your server access log is the only place you can see whether GPTBot, ClaudeBot or PerplexityBot has ever visited your site — and what happened when they did. If you're not reading your logs, you're flying blind in the most important new channel in search.
The AI discovery pipeline
Before an AI platform can cite your content in an answer, it must first crawl it. Log analysis is the only way to verify where your content sits in this pipeline.
AI Bot Crawls Your Page
GPTBot, ClaudeBot or PerplexityBot visits your URL. Visible only in your server logs. If blocked by robots.txt, WAF, or rate limiting — nothing else in the pipeline fires.
Content Gets Indexed / Trained
The AI platform processes your content into its knowledge base or live index. Log frequency, recrawl rate and status codes all influence how much of your content is absorbed.
AI Cites Your Content
Your brand, article or expertise surfaces in ChatGPT, Perplexity or Claude answers. This is the GEO goal — and it starts at Step 01. No crawl = no citation.
What only your log file can tell you
No third-party tool, no rank tracker, no AI visibility monitor can give you this data. It lives only on your server.
Which AI bots are actually crawling you — right now
Not estimates. Not averages. Real bot names, real timestamps, real IPs. You'll know if GPTBot crawled your site yesterday, which 14 pages it read, and whether it got a 200 or a 403.
Whether your robots.txt rules are working for AI bots
You might have Allow: / for GPTBot — but is it actually crawling? Or is a WAF rule, IP block or rate limit silently rejecting every request? Logs expose the truth robots.txt validation tools can't see.
Which pages AI bots ignore — your GEO coverage gap
Google might index 3,000 of your pages. GPTBot might only be reading 12. The pages AI bots never visit are your GEO dead zones — no crawl means no training data means no citations. Logs are the only way to find them.
How AI crawler behaviour is changing over time
Is PerplexityBot crawling you more this month than last? Did ClaudeBot suddenly stop after a server change? Trend data from logs lets you correlate technical events with changes in AI crawl activity — before it hits your citation rate.
The real cost of errors to your AI visibility
Every 404 or 500 that an AI bot hits wastes its crawl budget on your site and teaches it your content is unreliable. Logs quantify exactly how much of your AI crawl budget is being destroyed by errors — and on which pages.
AI referral traffic — proof that GEO is working
When someone clicks a citation in Perplexity or a ChatGPT link and lands on your site, that referral appears in your logs. It's the clearest signal that your GEO efforts are converting into real traffic.
Traditional SEO vs GEO: a new diagnostic skill
Log analysis existed in technical SEO — but GEO makes it a front-line skill, not a specialist one. Here's how the mindset shifts.
- Check Google Search Console for coverage
- Monitor Googlebot crawl stats dashboard
- Fix 404s to protect Google crawl budget
- Optimise for one primary crawler (Googlebot)
- Log files = occasional advanced audit
- Rank tracking tells you if SEO is working
- No Search Console exists — logs are your only data
- Monitor 84 AI bot patterns across 20 LLM platforms
- Fix errors to protect crawl budget across all AI platforms
- Optimise for 196 total bot patterns simultaneously
- Log files = weekly core GEO health check
- AI referral traffic & citation tracking shows GEO ROI
Which bots are tracked?
196 user-agent patterns across every category — AI crawlers, search engines, social media bots and SEO tools. All detected and classified automatically.
All Features
A professional-grade log analyser with 8 analysis tabs, 20+ interactive charts, and PDF export — all running client-side.
- 84 AI bot patterns across 20 LLM platforms
- Grouped by company & product name
- Per-bot request counts, success rates
- URL-level breakdown by bot
- AI bot share trend over time (daily %)
- Top AI crawler identification
- Composite score 0–100 (A–F grade)
- 6-component breakdown visualisation
- AI crawl frequency analysis
- Content diversity score
- Crawler diversity score
- AI referral traffic detection
- Traffic-over-time line chart
- AI bot share trend chart
- Traffic mix bar (AI / Search / Human)
- Response status code doughnut
- Top 10 AI-crawled URLs bar chart
- Crawl heatmap (hour × day of week)
- Weekly trend & AI vs Search comparison
- URL depth analysis & revisit frequency
- Googlebot, Bingbot, Baidu, Yandex etc.
- Search bot activity over time
- SEO tool bots (Ahrefs, Semrush, Moz…)
- Social media scrapers
- Link checkers & archivers
- Browser traffic vs bot separation
- Crawl budget efficiency score
- Error waste ratio (4xx/5xx budget leak)
- Crawl frequency by content type
- URL filter: bot, status, content type
- Avg daily crawl rate per URL
- Redirect chain detection
- Full PDF report with charts & scores
- Auto-generated recommendations
- robots.txt fix suggestions
- Date range filter (custom from/to)
- 100% browser-side — no data uploaded
- No account or login required
20+ Charts & Insights
From high-level traffic mix to per-bot URL breakdowns — every chart you need to understand how AI is discovering your content.
Compare: Our Tool vs Screaming Frog
Screaming Frog Log File Analyser is a great product — but it costs €99/year, requires a desktop install, and has no AI-specific intelligence. We built something better, and it's free.
| Feature | AI Log Analyzer (This Tool) | Screaming Frog Log Analyser |
|---|---|---|
| Price | Free — €0 | €99 / year |
| Install required | No — runs in browser | Yes — Windows / Mac / Linux |
| Max file size | Up to 1 GB | Depends on RAM |
| Max rows | 5 million rows | Limited by licence tier |
| AI bot detection | 84 AI patterns · 20 LLM platforms | Basic user-agent matching |
| GEO Score™ | Yes — 0–100 with grade | No |
| AI vs Search comparison | Yes — side-by-side bot compare | No |
| Crawl heatmap | Yes — hour × day of week | No |
| Compressed .gz support | Yes — native | Yes |
| PDF export | Yes — full report | No (CSV only) |
| Data privacy | 100% browser-side — no upload | Desktop only — no cloud |
| Recommendations | Yes — with robots.txt fixes | No |
Frequently Asked Questions
Everything you need to know before you upload your first log file.
gzip -c /var/log/nginx/access.log > access_log.gzStart analysing your AI traffic now
Upload your log file above — results in seconds. No account, no install, no cost.
- Top AI Crawler—
- Most Crawled—
- AI Success Rate—
- Date Range—
- AI Referrals—
| Bot | Company | Product | Requests | Share | URLs | Success Rate |
|---|
| URL | Type | AI Requests | Avg/Day | Crawled By | Status |
|---|
Search Engine Crawlers
| Bot | Search Engine | Requests | Share | URLs | Success Rate |
|---|
| URL | Type | Search Requests | Crawled By | Status |
|---|
Other Bots — SEO tools · social media scrapers · link checkers · archivers
| Bot | Category | Requests | Share | URLs | Success Rate |
|---|
| URL | Type | Bot Requests | Crawled By | Status |
|---|
Browser Traffic — requests not matching any known bot pattern; likely real visitors but may include unlisted bots
| URL | Type | Browser Requests | Unique IPs | Status |
|---|
AI Bot vs Search Bot
Select one bot from each side to compare which URLs they crawl, how much they overlap, and where each focuses its budget. Googlebot and Bingbot appear on the Search side.
| URL | Requests |
|---|---|
| Select an AI bot above | |
| URL | Requests |
|---|---|
| Select a search bot above | |
| URL | Days Crawled | Type |
|---|
Crawl Budget Analysis
Understand how AI crawlers spend their budget on your site — identify waste, protect content pages, and ensure your most important URLs get indexed.
| Bot | Company | Requests | Budget Share | URLs Crawled | Success Rate | Daily Avg |
|---|
| URL | Type | Requests | % of Budget | Avg/Day | Crawled By | Status |
|---|