Proxy
Proxy use cases
Recipes for reaching the pages that refuse a headless browser: Cloudflare-protected sites, 403 and 429 errors, geo-blocked content, prices by country, antibot detection and bring-your-own proxy. On Pro plans the proxy is automatic, so most recipes are about what to expect and how to confirm the route. One problem per page, with code you can paste and the limits to plan for.
Use cases
Pick the problem you are solving
Scrape Cloudflare-protected websites
Get the real page instead of “Just a moment”: on Pro plans, blocked requests escalate through proxy tiers up to residential IPs.
Fix 403 and 429 scraping errors
Tell an antibot 403, a throttling 429 and your own quota apart, then route, cache or wait accordingly.
Bring your own proxy
Pass your authenticated proxy URL per request and every redirect, asset and fetch of the page goes through it.
Rotating proxy alternative
Skip the proxy pool: the API escalates to residential IPs only when a site blocks you and remembers what works per domain.
Fetch geo-blocked websites
Route any request through one of 181 countries with a two-letter code, and verify the exit before you trust the page.
Scrape prices by country
One extraction request per market, pinned to its country, merged into a table of comparable prices and currencies.
Detect antibot protection
Name the provider behind a block, from Cloudflare to DataDome to reCAPTCHA, with the open-source is-antibot library.
Ready to reach the pages that block you?
Every recipe on this page runs on the same endpoint. Proxy resolution is included on Pro plans, with no proxy list to buy or rotate.
Other use cases
Explore the other Microlink APIs
Mobile screenshots at any viewport
Emulate an iPhone, a Pixel, an iPad or any custom viewport and capture the page exactly as those visitors see it.
Screenshots without cookie banners or ads
Ads, trackers and consent popups are blocked before the page renders, and one option dismisses first-party banners.
PDF invoices from authenticated pages
Print the invoice page your app already renders: forward the session, hide the chrome, name the file.
Clean PDFs without ads or banners
Get a document, not a browser tab: ads and consent popups blocked by default, sticky chrome removed with one CSS rule.
Markdown with metadata frontmatter
Get each page as Markdown with a YAML frontmatter block: title, author, date, word count and reading time.
Clean Markdown, no boilerplate
Convert only the article body: one selector keeps navigation, ads and widgets out of the Markdown.
Custom fields alongside metadata
Get prices, ratings, headings or any CSS selector, typed and returned next to the normalized metadata.
Fix missing or wrong og:image
Override any normalized field with a rule and chain fallbacks so link previews never render empty.
Any website to JSON
Declare the fields you want as CSS selector rules and get typed JSON back, with null for anything the page does not have.
Product prices and stock
Read prices as numbers and stock as text from any product page, with fallback rules that survive template changes.
Brand and media monitoring from Google News
Query Google News by brand, country and time window and get headline, publisher and ISO 8601 date for every article.
Price comparison from Google Shopping
Get every merchant Google Shopping lists for a product, with a numeric price, the merchant name and the rating, per country.