📊 SEO Log File & URL Frequency Engine
Upload CSV or Server Access Logs
Upload your website's server access logs or CSV crawl report to generate the technical SEO dashboard. Inspect URL request frequency, Googlebot vs Bingbot activity, 404 dead links, and response latency.
Drag & drop your CSV or access log file here
Supports .csv, .tsv, .log, .txt, .jsonl, or .gz (up to 50MB)
✓ CSV Spreadsheets
✓ Nginx / Apache Combined
✓ Cloudflare WAF Logs
✓ AWS CloudFront
✓ JSON Lines
Total Requests
0🔍 View URLs
All recorded access rows
Unique URLs
0🔍 View URLs
Distinct requested paths
Googlebot Crawls
0🔍 View URLs
Verified Googlebot requests
Googlebot Share
Of total server requests
2xx Success
0🔍 View URLs
Healthy HTTP responses
3xx Redirects
0🔍 View URLs
Permanent & temp redirects
4xx Client Errors
0🔍 View URLs
404 dead pages / 410 / 403
5xx Server Errors
0🔍 View URLs
500 crash / 502 / 504 timeouts
Avg Response Time
0 ms🔍 View URLs
Server response latency
Data Transferred
0 MB
Total outbound bandwidth
Crawl Activity Over Time (Daily Trend)
Requests by Crawler Type
HTTP Status Code Distribution
Resource Classification (HTML vs Assets)
Crawl Intensity Heatmap (Day of Week × Hour of Day UTC)
Darker cells indicate peak crawl frequency
| Requested URL ↕ | Total Req ↕ | Googlebot ↕ | Bingbot ↕ | Other Search ↕ | AI Bots ↕ | Human/Browser ↕ | Unique UAs ↕ | 2xx ↕ | 3xx ↕ | 4xx ↕ | 5xx ↕ | First Requested ↕ | Last Requested ↕ | Avg Duration ↕ | Total Size ↕ |
|---|
Showing 1 to 25 of requested URLs
🏆 Top Requested URLs (Overall)
| # | URL | Requests | Share |
|---|
🤖 Top Googlebot Requested URLs
| # | URL | Googlebot | Share |
|---|
🧠 Top AI Bot Requested URLs (GPT, Claude, Perplexity)
| # | URL | AI Req | Share |
|---|
✕ Top 404 Not Found Dead URLs
| # | URL | 404 Hits | Share |
|---|
↳ Top 3xx Redirect URLs (Crawl Waste)
| # | URL | Redirects | Share |
|---|
⚡ Top 5xx Server Error URLs
| # | URL | 5xx Errors | Share |
|---|
Verified Googlebot✓
0
Verified against Google CIDR IP blocks
Unverified / Fake Bot⚠
0
Googlebot UA originating from spoofed IPs
Crawler Registry & IP Verification Status
Automated forward DNS & IP prefix verification
| Crawler Name | Classification | Observed Requests | Verification State |
|---|
2xx Success
View URLs ↗
0
3xx Redirects
View URLs ↗
0
4xx Client Errors
View URLs ↗
0
5xx Server Errors
View URLs ↗
0
HTTP Response Code Breakdown
| Status Code | RFC Meaning | Requests | Percentage |
|---|
Total Waste Requests
View URLs ↗
0
Requests on tracking/session parameters
Crawl Budget Waste %
Percentage of server requests wasted
Tracking Params (utm_*)
View URLs ↗
0
utm_source, gclid, fbclid hits
Session Parameters
View URLs ↗
0
session_id, phpsessid hits
Tracking Parameter Waste Examples
Session Parameter Waste Examples
Average Latency
0 ms
Median (p50)
0 ms
75th Percentile (p75)
0 ms
90th Percentile (p90)
0 ms
95th Percentile (p95)
View URLs ↗
0 ms
99th Percentile (p99)
View URLs ↗
0 ms
Slowest Crawled URLs (>1000ms latency)
| URL | Avg Duration | Total Requests | Googlebot Hits |
|---|
XML Sitemap & URL Inventory Reconciliation
Compare canonical sitemap URLs with actual observed crawl requests