Meta
meta-externalfetcher
About this crawler
Meta fetcher used when a person requests or shares a specific URL.
Usually means: A person asked an AI assistant a question, and the assistant fetched this URL to answer with fresh context or citations.
User agent
meta-externalfetcherDataFast matches these as user-agent tokens, not full browser strings. Providers may add surrounding version or product text.
IP verification
Verified when user agent and IP range both match
DataFast first matches the crawler user-agent token, then compares the request IP with published ranges from the crawler operator when those ranges exist.
User agent
Request user agent contains meta-externalfetcher.
Request IP
Server-side tracking forwards the crawler IP seen by your backend.
Range check
The IP is compared with published CIDR ranges or JSON range endpoints.
Sample IP ranges
157.240.14.0/2431.13.73.0/242a03:2880:f235::/482a03:2880:f048::/482a03:2880:f24d::/482a03:2880:f134::/482a03:2880:f352::/482a03:2880:f23a::/482a03:2880:ff10::/472a03:2880:f329::/48Showing up to 10 ranges from the configured official sources.
Discover when bots and AI assistants crawl your website.
Install the server-side tracker to see which AI assistants, search engines, and training crawlers request your pages. It helps you understand what bots are trying to find, including pages that return 404.