Sorry for the late reply Karl, I somehow missed your last message!

The API is designed to scrape data from a product page (i.e a webpage for a specific product, not multiple products), which means that currently the API doesn’t fully support search result pages like the one you showed (but this may be supported in the future).

So you would have to send each of the URLs for those 24 products to the API separately.

Does that make sense?

Our (Shwoop It) Data collecting prototype was able to do a dynamic collect on that page (it’s a .ca, Canadian site) . It’s actually quite friendly in allowing data collects without any html GET response refusals to date.

sounds good!

Do you have an idea how MLScrape would handle this page of 24 products?

https://www.rona.ca/webapp/wcs/stores/servlet/RonaAjaxCatalogSearchView?navDescriptors=&catalogId=10051&searchKey=RonaEN&langId=-1&keywords=power+drills&storeId=10151&pageSize=24&content=Products&navRangeFilters=&page=1

Thanks for the quick reply!

~Karl

Hello Karl,

Yes that’s correct, the new version (v1) provides more information than the old version (beta), such as stock availability, structured price information, description if detected, etc.

Happy to answer any other questions about the API!