Cloudflare Challenge

Question

I'm using your api to scrape an api page behind CF that I can get without using js. Occasionally CF seems to catch an IP and flag it and throws back a challenge page.

Is there anyway to capture the cf http error that triggers the challenge page so that I can then retry with scrape-js?

Thanks for your very useful api

Lux

luxint66 · Answer

I'd already considered parsing the return html and calling the api again, but I was wondering if there was a more elegant way to do it. No worries. Changing geo wouldn't help in my situation as I need to  be calling the api from the US to get the correct pricing.

Thanks anyway

Lux

Anthony · Answer

Hi! Thank you!
There is no way to do this using crapeninja options, but of course you can implement such logic in your code. did you try to switch "geo" parameter instead?

ScrapeNinja

9.9 / 10

3,767ms

98%

N/A

Cloudflare Challenge