ScrapeNinja

FREEMIUM
Por Anthony | Atualizado 25 days ago | Data
Popularidade

9.9 / 10

Latência

3,767ms

Nível de serviço

98%

Health Check

N/A

Voltar para todas as discussões

Cloudflare Challenge

Rapid account: Luxint 66
luxint66
a year ago

I’m using your api to scrape an api page behind CF that I can get without using js. Occasionally CF seems to catch an IP and flag it and throws back a challenge page.

Is there anyway to capture the cf http error that triggers the challenge page so that I can then retry with scrape-js?

Thanks for your very useful api

Lux

Rapid account: Luxint 66
luxint66 Commented a year ago

I’d already considered parsing the return html and calling the api again, but I was wondering if there was a more elegant way to do it. No worries. Changing geo wouldn’t help in my situation as I need to be calling the api from the US to get the correct pricing.

Thanks anyway

Lux

Rapid account: Restyler
restyler Commented a year ago

Hi! Thank you!
There is no way to do this using crapeninja options, but of course you can implement such logic in your code. did you try to switch “geo” parameter instead?

Junte-se à discussão - adicione o comentário abaixo:

Efetue login / inscreva-se para postar novos comentários