Hello. I am modifying a script whose purpose is to scrap urls shown after google search query. I want to add IP address rotation to avoid being blocked by Google. But for some reason it gives me an error:
HTTPSConnectionPool(host=โscrapingant.p.rapidapi.comโ, port=443): Read timed out. (read timeout=10)
Please find a full file code in my github profile by clicking the link and navigate to /googlesearch/init.py
Doe mee aan de discussie - voeg hieronder een opmerking toe
Try out increasing timeout to 60 seconds.
Also, Iโd suggest opting out to scrapingant.com, which is more versative version of ScrapingAnt API.
At scrapingant.com you can set parameters browser=true and return_page_source=true to get the best Google scraping results.