ScrapeNinja

부분 유료
분류별 Anthony | 업데이트됨 5 days ago | Data
인기

9.9 / 10

지연 시간

2,898ms

서비스 수준

98%

Health Check

N/A

모든 토론으로 돌아가기

Need to follow a redirect

Rapid account: Patricknn
patricknn
a year ago
I'm scraping a website that has a sequential ID, but everytime that I change the ID in the URL I'm redirected to the canonical url
Scrapeninja is not following the 301 code, is there anyway a set an argument to follow these redirects?

Thank you
Rapid account: Restyler
restyler Commented a year ago

Hi! I am glad to announce that new setting for /scrape endpoint was implemented. Pass followRedirects: 1 to the payload to make ScrapeNinja follow redirects. The final destination url will be available in .info.finalUrl JSON property.

Rapid account: Restyler
restyler Commented a year ago

Hi!
For the /scrape endpoint of Scrapeninja, there is no way to follow redirects now, though I am probably going to implement this in future.
For /scrape-js, all the redirects are followed automatically.

Thanks!

아래에 의견을 추가하고 토론에 참여하세요.

새 댓글을 게시하려면 로그인 / 가입