FAST-WebCrawler — What It Is and How to Handle It

FAST-WebCrawler is Microsoft FAST's web crawler for enterprise search solutions.

Operator: Microsoft | Type: Search Engine | Category: Search Engine

FAST-WebCrawler is a search engine crawler. Blocking it may affect your visibility in its associated search engine. Most publishers choose to allow verified search engine crawlers.

Centinel automatically detects FAST-WebCrawler using behavioral fingerprinting. When detected, you can allow it, block it, challenge it with an interstitial page, or set a per-request licensing fee — all enforced in real-time with under 2ms latency.