Thank you for your clarification. I am currently looking for a way to either scrape, or utilize an api-as-a-service such as yours to get job data from , not only Indeed, but other Job posting bulletin boards as well.

I tinkered with your sample code, and changed python programmer to machine learning engineer and got an error though

{2 items
"error":{3 items
"message":""
“error_type”:“AlgorithmError”
“stacktrace”:“Traceback (most recent call last):
File “/opt/algorithm/bin/pipe.py”, line 45, in get_response
result = call_algorithm(request)
File “/opt/algorithm/bin/pipe.py”, line 93, in call_algorithm
return algorithm.apply(data)
File “/opt/algorithm/src/Extract_From_Indeed_Job_Scraper.py”, line 236, in apply
proxy = next(proxy_pool)
StopIteration”
}
“metadata”:{2 items
"request_id":"req-961b5241-d67d-42bd-ad88-b23d2096c7e0"
“duration”:6.325275236
}
}

We are a data scraping company, the data that you see is scraped in real time and shown to the user; We have scrapers that fetch data from Indeed in our data marketplace (https://www.specrom.com/data-marketplace/) and this API is just a synchronous version of that.

One of the issues is that websites like Indeed will block a certain amount of requests, and our servers will continue to retry using IP rotation etc. Hence, there is a much higher success rate when the API is used asynchronously or in batch like we do in our data marketplace.

However, some use cases are incompatible with asynchronous API or batch processing, and hence we provide this API here as an alternative.