Hello. I am modifying a script whose purpose is to scrap urls shown after google search query. I want to add IP address rotation to avoid being blocked by Google. But for some reason it gives me an error:
HTTPSConnectionPool(host=‘scrapingant.p.rapidapi.com’, port=443): Read timed out. (read timeout=10)
Please find a full file code in my github profile by clicking the link and navigate to /googlesearch/init.py
아래에 의견을 추가하고 토론에 참여하세요.
Try out increasing timeout to 60 seconds.
Also, I’d suggest opting out to scrapingant.com, which is more versative version of ScrapingAnt API.
At scrapingant.com you can set parameters browser=true and return_page_source=true to get the best Google scraping results.