ScrapeNinja

FREEMIUM
Par Anthony | Mise à jour 25日前 | Data
Popularité

9.9 / 10

Latence

3,767ms

Niveau de service

98%

Health Check

N/A

Retour à toutes les discussions

Cloudflare Challenge

Rapid account: Luxint 66
luxint66
1年前

I’m using your api to scrape an api page behind CF that I can get without using js. Occasionally CF seems to catch an IP and flag it and throws back a challenge page.

Is there anyway to capture the cf http error that triggers the challenge page so that I can then retry with scrape-js?

Thanks for your very useful api

Lux

Rapid account: Luxint 66
luxint66 Commented 1年前

I’d already considered parsing the return html and calling the api again, but I was wondering if there was a more elegant way to do it. No worries. Changing geo wouldn’t help in my situation as I need to be calling the api from the US to get the correct pricing.

Thanks anyway

Lux

Rapid account: Restyler
restyler Commented 1年前

Hi! Thank you!
There is no way to do this using crapeninja options, but of course you can implement such logic in your code. did you try to switch “geo” parameter instead?

Participez à la discussion - ajoutez un commentaire ci-dessous:

Connectez-vous / Inscrivez-vous pour publier de nouveaux commentaires