Webkrawler

FREEMIUM
By safu92
Updated 4 months ago
Data
2.3/10
Popularity Score
4471ms
Latency
100%
Success Rate

Webkrawler API Documentation

Using this API you can scrape the data from other websites. This API gives you back the Title, Meta Tags, All the images on the webpage and the Html Source Code. You can use the title, meta tags, images, html source code for your use by parsing it in your application.

View API Details
POSTGetWebPageDetails
POSTGetWebPageDetails

Get Title, Images, MetaTags and Html Source of a webpage.

Header Parameters
X-RapidAPI-HostSTRING
REQUIRED
X-RapidAPI-KeySTRING
REQUIRED
Required Parameters
urlJSON_STRING
REQUIREDEnter url in double quotes without http and www. For e.g. google.com
Code Snippet
unirest.post("https://safu92-webkrawler-v1.p.rapidapi.com/")
.header("X-RapidAPI-Host", "safu92-webkrawler-v1.p.rapidapi.com")
.header("X-RapidAPI-Key", "SIGN-UP-FOR-KEY")
.header("Content-Type", "application/json")
.send("google.com")
.end(function (result) {
  console.log(result.status, result.headers, result.body);
});
Sample Response
General
Request URL: https://safu92-webkrawler-v1.p.rapidapi.com/
Request Method: POST
Response Headers
Response Body

Install SDK for NodeJS

Installing

To utilize unirest for node.js install the the npm module:

$ npm install unirest

After installing the npm package you can now start simplifying requests like so:

var unirest = require('unirest');

Creating Request

unirest.post("https://safu92-webkrawler-v1.p.rapidapi.com/")
.header("X-RapidAPI-Host", "safu92-webkrawler-v1.p.rapidapi.com")
.header("X-RapidAPI-Key", "SIGN-UP-FOR-KEY")
.header("Content-Type", "application/json")
.send("google.com")
.end(function (result) {
  console.log(result.status, result.headers, result.body);
});
OAuth2 Authentication
Client ID
Client Secret
OAuth2 Authentication