Antibot DetectionPRO
Know exactly who blocked your request and why. Microlink detects antibot and CAPTCHA challenges from 30+ providers using response signals — then you can decide what to do next.
Why
When a request fails, know who stopped it.
Microlink handles +700M requests every month. When you build infrastructure that takes a URL as input, you are constantly interacting with defenses designed to stop you.
A request can experience
Followed by a challenge page. A captcha. A JavaScript puzzle.
Modern antibot systems operate at multiple layers, often before your request even reaches application code. Detection does something fundamental: it tells you when a non-success resolution happens and who triggered it, so you can make a better decision about what to do next.
Common signals include:
- IP reputation: Data-center IPs are flagged by default. Residential traffic behaves differently.
- HTTP consistency: Headers must match a real browser profile — not just User-Agent, but the full set.
- TLS fingerprints (JA3): The way a client negotiates TLS leaks whether it is a browser or a script.
- Behavioral heuristics: Timing, navigation order, and interaction patterns matter.
- JavaScript fingerprinting: Canvas, WebGL, fonts, screen size — small inconsistencies are enough.
Based on these signals, a request is either:
- Allowed: Heuristics indicate a legitimate visitor — the request passes through to the target.
- Blocked: The request looks highly suspicious and is refused immediately with 403 or 429.
- Challenged: The system is unsure and serves a CAPTCHA or JavaScript interstitial before content.
How it works
Classify the challenge. Name the provider.
At a high level, Microlink classifies challenge responses using the HTTP response itself — no headless browser required for detection. Each provider leaves a distinct combination of signals. Providers are checked in priority order; the first match wins.
- HTTP status patterns — LinkedIn can return 999; Reddit can return 403 on challenge flows
- Known challenge signatures — CAPTCHA widgets, interstitial templates, verification scripts
- Response headers and body markers — mitigation headers, challenge tokens, provider script references
- Provider-specific fingerprints — for example Cloudflare commonly surfaces cf-mitigated: challenge
Providers
30+ providers across antibot, CAPTCHA, and platforms.
Use this coverage map when building retry logic, escalation rules, or provider-specific analytics in your scraping pipeline.
- AkamaiAntibot · 3 signalsHeadersCookiesHTML
- AliExpress CAPTCHACAPTCHA · 2 signalsHTMLURL
- AmazonPlatform-specific · 2 signalsHeadersHTML
- AnubisAntibot · 1 signalHTML
- AWS WAFAntibot · 3 signalsHeadersCookiesHTML
- Captcha.euCAPTCHA · 2 signalsHTMLURL
- CheqAntibot · 2 signalsHTMLURL
- CloudflareAntibot · 2 signalsHeadersCookies
- Cloudflare TurnstileCAPTCHA · 2 signalsHTMLURL
- DataDomeAntibot · 2 signalsHeadersCookies
- DoubanPlatform-specific · 1 signalStatus Code
- DribbblePlatform-specific · 1 signalStatus Code
- Friendly CaptchaCAPTCHA · 2 signalsHTMLURL
- FullStory ChallengeAntibot · 2 signalsCookiesHTML
- FunCaptcha (Arkose Labs)CAPTCHA · 2 signalsHTMLURL
- GeeTestCAPTCHA · 2 signalsHTMLURL
- GooglePlatform-specific · 1 signalURL
- hCaptchaCAPTCHA · 2 signalsHTMLURL
- HouzzPlatform-specific · 1 signalStatus Code
- Imperva / IncapsulaAntibot · 3 signalsHeadersCookiesHTML
- InstagramPlatform-specific · 1 signalHTML
- KasadaAntibot · 2 signalsHeadersHTML
- LinkedInPlatform-specific · 1 signalStatus Code
- MeetricsAntibot · 2 signalsHTMLURL
- OculeAntibot · 2 signalsHTMLURL
- PerimeterXAntibot · 3 signalsHeadersCookiesHTML
- QCloud CaptchaCAPTCHA · 2 signalsHTMLURL
- ReblazeAntibot · 2 signalsCookiesHTML
- reCAPTCHACAPTCHA · 2 signalsHTMLURL
- RedditPlatform-specific · 2 signalsHTMLStatus Code
- Shape SecurityAntibot · 2 signalsHeadersHTML
- SucuriAntibot · 1 signalHTML
- ThreatMetrixAntibot · 2 signalsHTMLURL
- VercelAntibot · 1 signalHeaders
- WeiboPlatform-specific · 1 signalHTML
- YouTubePlatform-specific · 1 signalHTML
| Provider | Category | Signals | Detection methods |
|---|---|---|---|
| Akamai | Antibot | 3 | HeadersCookiesHTML |
| AliExpress CAPTCHA | CAPTCHA | 2 | HTMLURL |
| Amazon | Platform-specific | 2 | HeadersHTML |
| Anubis | Antibot | 1 | HTML |
| AWS WAF | Antibot | 3 | HeadersCookiesHTML |
| Captcha.eu | CAPTCHA | 2 | HTMLURL |
| Cheq | Antibot | 2 | HTMLURL |
| Cloudflare | Antibot | 2 | HeadersCookies |
| Cloudflare Turnstile | CAPTCHA | 2 | HTMLURL |
| DataDome | Antibot | 2 | HeadersCookies |
| Douban | Platform-specific | 1 | Status Code |
| Dribbble | Platform-specific | 1 | Status Code |
| Friendly Captcha | CAPTCHA | 2 | HTMLURL |
| FullStory Challenge | Antibot | 2 | CookiesHTML |
| FunCaptcha (Arkose Labs) | CAPTCHA | 2 | HTMLURL |
| GeeTest | CAPTCHA | 2 | HTMLURL |
| Platform-specific | 1 | URL | |
| hCaptcha | CAPTCHA | 2 | HTMLURL |
| Houzz | Platform-specific | 1 | Status Code |
| Imperva / Incapsula | Antibot | 3 | HeadersCookiesHTML |
| Platform-specific | 1 | HTML | |
| Kasada | Antibot | 2 | HeadersHTML |
| Platform-specific | 1 | Status Code | |
| Meetrics | Antibot | 2 | HTMLURL |
| Ocule | Antibot | 2 | HTMLURL |
| PerimeterX | Antibot | 3 | HeadersCookiesHTML |
| QCloud Captcha | CAPTCHA | 2 | HTMLURL |
| Reblaze | Antibot | 2 | CookiesHTML |
| reCAPTCHA | CAPTCHA | 2 | HTMLURL |
| Platform-specific | 2 | HTMLStatus Code | |
| Shape Security | Antibot | 2 | HeadersHTML |
| Sucuri | Antibot | 1 | HTML |
| ThreatMetrix | Antibot | 2 | HTMLURL |
| Vercel | Antibot | 1 | Headers |
| Platform-specific | 1 | HTML | |
| YouTube | Platform-specific | 1 | HTML |