Top-line counts
| Metric | What it means |
|---|---|
| Total events | Every request Rankly captured: bot crawls, plus humans referred from an LLM, plus direct humans if you capture them. |
| Bot crawls | All automated agent requests (everything that isn’t a human visit). |
| LLM referrals | Real people who clicked through to your site from an AI answer (ChatGPT, Perplexity, Claude, and so on). |
| Pages crawled | The number of distinct URLs agents fetched. |
| Unique bots | How many distinct named agents you saw. |
| Agents vs humans | The split between automated traffic and real visitors. |
Verification
| Metric | What it means |
|---|---|
| Verified | Share of bot hits whose identity was proven, by signature or by published IP range. See Verification. |
| Unverified | Recognized bots whose identity couldn’t be proven. |
| Spoofed | Requests that claimed a vendor but failed every identity check. Broken out in forensics. |
Purpose mix
For AI bots, the split by why they fetched the page:| Metric | What it means |
|---|---|
| Training | Crawls collecting content to train or improve a model. |
| Search index | Crawls building a search or retrieval index that powers AI answers. |
| Live fetch | Real-time fetches to answer a specific user question, the highest-intent crawls. |
Compliance and humanity signals
| Metric | What it means |
|---|---|
| robots.txt fetchers | Share of bot IPs that read your robots.txt before crawling. See Robots.txt violations. |
| robots.txt violations | Requests that fetched a path the crawler was told to avoid. |
| Favicon humans | IPs whose traffic included favicon fetches, evidence of a real browser. |
| Disguised hits flagged | Requests caught mimicking a browser but failing a coherence check. See The humanity check. |
| Cleared as human | Flagged requests cleared because the same IP also fetched a favicon. |
Forensics
| View | What it shows |
|---|---|
| Disguised bots breakdown | Flagged hits grouped by reason (outdated browser, fake OS details, not a real browser, and so on). |
| Claimed browser versions | The browser versions user-agents claim, with very old versions highlighted. |
| Top crawlers | Your most active agents, each with a verification badge and the change since the last period. |
| Top pages | Your most-crawled URLs. |
| Top LLM sources | Where your LLM-referred humans came from. |