DataStack Web Reader
FREEMIUM
By forthwall
Updated a year ago

DataStack Web Reader API Documentation

This is a special endpoint for people who want to easily scrape websites. This endpoint is API is utilized in DataStack's source kit for retrieving data on particular websites.

Learn more about this API
GET/find
GET/find
Header Parameters
X-RapidAPI-HostSTRING
REQUIRED
X-RapidAPI-KeySTRING
REQUIRED
isPlainTextSTRING
OPTIONALOptional, set to true if you want the data returned to be in plain text, rather than in HTML.
ToggleQuickParserSTRING
REQUIREDSet to true if you are parsing websites that don't load content dynamically. Reduces request times by a significant period if set to true.
filtersSTRING
REQUIREDComma seperated, can be either an html tag (div, table) or a class (.content, .class).
Required Parameters
urlSTRING
REQUIREDURL of the website to scrape.
Code Snippet
Install SDK
HTTP/1.1 200 OK Connection: keep-alive Content-Length: 6806 Content-Type: application/json; charset=utf-8 Date: Sat, 04 Jul 2015 21:22:44 GMT Etag: "-634750613" Server: Mashape/5.0.6 X-Powered-By: Express { "data": [ { "p": " Scrape and Parse websites with a single Endpoint.

Scrape and Parse websites with a single Endpoint.

" }, { "p": "This is a special endpoint for people who want to easily scrape websites. This endpoint is API is utilized in DataStack's source kit for retrieving data on particular websites.

This is a special endpoint for people who want to easily scrape websites. This endpoint is API is utilized in DataStack's source kit for retrieving data on particular websites.

" }, { "p": "To use the following endpoint, please sign up for our developer program.

To use the following endpoint, please sign up for our developer program.

" }, { "p": "This method is capped at 1,000 calls per day - perfect for hobbies and tests. For extended use, check out our section on rate limits.

This method is capped at 1,000 calls per day - perfect for hobbies and tests. For extended use, check out our section on rate limits.

" }, { "p": "http://api.datastack.co/reader/find?url={url}

http://api.datastack.co/reader/find?url={url}

" }, { "p": "GET

GET

" }, { "p": "undefined

" }, { "p": "
http://api.datastack.co/reader/find?url=http://startupstudygroup.com/ Authorization: Bearer {your-api-key}
Filters: .entry-title,.entry-content
ToggleQuickParser: trueResults\"data\": [
{
\"entry-title\": \" founder interview – MacLane Wilkison (ZeroDB) Intro founder interview – MacLane Wilkison (ZeroDB) Intro\",
\"entry-content\": \" MacLane Wilkison (ZeroDB) Intro forward...\"
},
{
\"entry-title\": \"...\",
\"entry-content\": \"...\"


http://api.datastack.co/reader/find?url=http://startupstudygroup.com/ Authorization: Bearer {your-api-key}
Filters: .entry-title,.entry-content
ToggleQuickParser: trueResults\"data\": [
{
\"entry-title\": \" founder interview – MacLane Wilkison (ZeroDB) Intro founder interview – MacLane Wilkison (ZeroDB) Intro\",
\"entry-content\": \" MacLane Wilkison (ZeroDB) Intro forward...\"
},
{
\"entry-title\": \"...\",
\"entry-content\": \"...\"

" }, { "p": "
...
]Rate LimitsWe would love to give you infinite access to our endpoint, but because hosting costs money, we have capped requests at 1,000 per day per user (so around 40 an hour).

If you would like a higher cap, send us a message at [email protected].


...
]Rate LimitsWe would love to give you infinite access to our endpoint, but because hosting costs money, we have capped requests at 1,000 per day per user (so around 40 an hour).

If you would like a higher cap, send us a message at [email protected].

" }, { "p": "To ensure you have the fastest response times per request, you should plan to scrape websites that do not load webpages dynamically and set ToggleQuickParser to true.

To ensure you have the fastest response times per request, you should plan to scrape websites that do not load webpages dynamically and set ToggleQuickParser to true.

" }, { "p": "If your request scrapes a dynamic website, we suggest that you load this data preemptively and store it on your own database for users to access.

If your request scrapes a dynamic website, we suggest that you load this data preemptively and store it on your own database for users to access.

" }, { "p": "This core process for the API was created in 3 hours, it has some limitations and bugs, but we want to defeat them as much as you do. The biggest issue we want to tackle currently is the sluggishness of parsing dynamic websites. Currently this API does not work with websites that render objects with javascript. We're planning to tackle that soon.

Send us a mail if you found a bug or have a suggestion at [email protected].

This core process for the API was created in 3 hours, it has some limitations and bugs, but we want to defeat them as much as you do. The biggest issue we want to tackle currently is the sluggishness of parsing dynamic websites. Currently this API does not work with websites that render objects with javascript. We're planning to tackle that soon.

Send us a mail if you found a bug or have a suggestion at [email protected].

" }, { "p": "You must comply with DataStack's general terms plus:

You must comply with DataStack's general terms plus:

" }, { "p": "We will not be held responsible for legal liabilities incurred through the use or misuse of data obtained through our service, we reseve the right to cut you off of our API through our own volition or by the request of a content provider (a service you are scraping data from) with reasonable cause.

We will not be held responsible for legal liabilities incurred through the use or misuse of data obtained through our service, we reseve the right to cut you off of our API through our own volition or by the request of a content provider (a service you are scraping data from) with reasonable cause.

" }, { "p": "You also agree to comply with all copyright laws and rules covering such data including (but not limited to) the reproduction and resale of such data.

You also agree to comply with all copyright laws and rules covering such data including (but not limited to) the reproduction and resale of such data.

" }, { "p": "We will always attempt to give you a reason for a cut on your API priviliges.

We will always attempt to give you a reason for a cut on your API priviliges.

" }, { "p": "These terms are in effect as soon as you use this platform and are subject to change.

These terms are in effect as soon as you use this platform and are subject to change.

" } ] }

Install SDK for (Node.js)Unirest

OAuth2 Authentication
Client ID
Client Secret
OAuth2 Authentication