ScrapeNinja

FREEMIUM
By Anthony | Updated 5 days ago | Data
Popularity

9.9 / 10

Latency

2,898ms

Service Level

98%

Health Check

N/A

Back to All Discussions

Cloudflare Challenge

Rapid account: Luxint 66
luxint66
a year ago

I’m using your api to scrape an api page behind CF that I can get without using js. Occasionally CF seems to catch an IP and flag it and throws back a challenge page.

Is there anyway to capture the cf http error that triggers the challenge page so that I can then retry with scrape-js?

Thanks for your very useful api

Lux

Rapid account: Luxint 66
luxint66 Commented a year ago

I’d already considered parsing the return html and calling the api again, but I was wondering if there was a more elegant way to do it. No worries. Changing geo wouldn’t help in my situation as I need to be calling the api from the US to get the correct pricing.

Thanks anyway

Lux

Rapid account: Restyler
restyler Commented a year ago

Hi! Thank you!
There is no way to do this using crapeninja options, but of course you can implement such logic in your code. did you try to switch “geo” parameter instead?

Join in the discussion - add comment below:

Login / Signup to post new comments