ScrapeNinja

FREEMIUM
Durch Anthony | Aktualisiert 25일 전 | Data
Popularität

9.9 / 10

Latenz

3,767ms

Service Level

98%

Health Check

N/A

Zurück zu allen Diskussionen

Cloudflare Challenge

Rapid account: Luxint 66
luxint66
일 년 전

I’m using your api to scrape an api page behind CF that I can get without using js. Occasionally CF seems to catch an IP and flag it and throws back a challenge page.

Is there anyway to capture the cf http error that triggers the challenge page so that I can then retry with scrape-js?

Thanks for your very useful api

Lux

Rapid account: Luxint 66
luxint66 Commented 일 년 전

I’d already considered parsing the return html and calling the api again, but I was wondering if there was a more elegant way to do it. No worries. Changing geo wouldn’t help in my situation as I need to be calling the api from the US to get the correct pricing.

Thanks anyway

Lux

Rapid account: Restyler
restyler Commented 일 년 전

Hi! Thank you!
There is no way to do this using crapeninja options, but of course you can implement such logic in your code. did you try to switch “geo” parameter instead?

Nehmen Sie an der Diskussion teil - fügen Sie unten einen Kommentar hinzu:

Anmelden / Registrieren, um neue Kommentare zu veröffentlichen