Skip to content

IP lookups now recognise verified bots

An address that belongs to a known crawler or monitoring service, such as Googlebot or Bingbot, is now labelled a verified bot instead of a risky datacenter address.

By New feature Updated

What changed

Many companies publish the IP ranges their bots use. We now load those lists every day, from 22 published sources run by operators such as Google, Microsoft (Bingbot), Apple, OpenAI, Perplexity, DuckDuckGo, Anthropic, Common Crawl, Ahrefs, UptimeRobot, Pingdom, Stripe and GitHub. When you look up an address in one of these ranges, the result names the bot and the company that runs it, and the Type row reads “Verified bot”.

What it means for you

Crawlers run from data centres, so they used to look like any other datacenter address and pick up points in the risk score. Now a verified bot is never marked anonymous, and its datacenter, VPN or proxy listings no longer raise its score. Abuse lists still count: if a verified bot’s address also appears on one, the score shows it.

For you this means fewer false alarms. If you block or challenge traffic based on our risk score, the crawlers, uptime monitors and payment webhooks on these lists no longer score as risky for being in a data centre.

How to use it

  • Look up any address on the IP lookup page. A verified bot shows its name and operator.
  • To check whether a visitor that claims to be a crawler is real, use the verified bot check.
  • On Pro and above, the API‘s security group carries is_verified_bot, bot_name and bot_operator.

Some operators, such as Yandex, Meta and Semrush, publish no list, so their bots are not labelled this way. The full list of sources is on our data sources page.

More from the changelog

The whole changelog