SM is a RESTful web scraping API. You can build your own bot, defining custom scraping pipelines.
This tool is mainly built for data scientists, students and web-app testers.
Results are returned in a well structured JSON. Run automation tasks or simply scrape elements by id, class, selector, etc.
API is new and I am open to suggestions!
SM is now running on AWS cloud infrastructure with nodes spread worldwide!
Postman doc: https://documenter.getpostman.com/view/18991871/UVXdNeAq
You can find the official ScrapingMonkey doc, with detailed description of the endpoints and examples, right here on github: https://masc-it.github.io/ScrapingMonkey/#/
ScrapingMonkey has proxies included in every plan.
Meant for testing purposes, just to give you a taste of what it can do for you!
Every plan has a relaxed threshold, choose the one tailored to your traffic per month.
Soft limits allows the API to stay operative even when you overcome the threshold for your plan! Do some maths and you’ll realise that is quite convenient. Otherwise, just choose another plan!
If you have the PRO plan and you’ve reached your monthly max quota, you’ll be charged $0.002 for each extra request.
i.e. extra 100 requests = extra fee of 20cents.
If you realize that you need more juice, just switch to another plan!
For technical requests contact me via mail: firstname.lastname@example.org