Diffbot

App · 17 actions

Extract structured data from public webpages and query the Diffbot Knowledge Graph.

Actions

ActionWhat it does
Delete a crawl jobDelete a crawl job selected from your Diffbot account.
Detect and extract page contentExtract structured analyze data from a publicly accessible web page.
Extract a discussionExtract structured discussion data from a publicly accessible web page.
Extract a job listingExtract structured job data from a publicly accessible web page.
Extract a listExtract structured list data from a publicly accessible web page.
Extract an articleExtract structured article data from a publicly accessible web page.
Extract an eventExtract structured event data from a publicly accessible web page.
Extract imagesExtract structured image data from a publicly accessible web page.
Extract product informationExtract structured product data from a publicly accessible web page.
Extract videosExtract structured video data from a publicly accessible web page.
Get a crawl jobRead the state of a selected crawl job.
Get crawl resultsRead extracted pages from a crawl job, newest first.
List crawl jobsRead active and completed crawl jobs associated with your token.
Pause a crawl jobPause a crawl job selected from your Diffbot account.
Query the Knowledge GraphSearch Diffbot entities with a DQL query.
Resume a crawl jobResume a crawl job selected from your Diffbot account.
Start a crawl jobCrawl public pages and extract their content.

Delete a crawl job

Delete a crawl job selected from your Diffbot account.

Inputs

Job namejob_nametextRequired
Job name.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

Detect and extract page content

Extract structured analyze data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract a discussion

Extract structured discussion data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract a job listing

Extract structured job data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract a list

Extract structured list data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract an article

Extract structured article data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract an event

Extract structured event data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract images

Extract structured image data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract product information

Extract structured product data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Extract videos

Extract structured video data from a publicly accessible web page. Uses Diffbot credits.

Inputs

UrlurltextRequired
Url.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "objects": []
  }
}

Get a crawl job

Read the state of a selected crawl job.

Inputs

Job namejob_nametextRequired
Job name.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

Get crawl results

Read extracted pages from a crawl job, newest first.

Inputs

Job namejob_nametextRequired
Job name.
Limitlimitnumber
Limit.From 1 to 100.

Outputs

Response.

datalist
Data.
Example output
{
  "data": []
}

List crawl jobs

Read active and completed crawl jobs associated with your token.

Inputs

None.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

Pause a crawl job

Pause a crawl job selected from your Diffbot account.

Inputs

Job namejob_nametextRequired
Job name.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

Query the Knowledge Graph

Search Diffbot entities with a DQL query. Uses Knowledge Graph credits.

Inputs

QueryquerytextRequired
Query.
Sizesizenumber
Size.From 1 to 100.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "data": []
  }
}

Resume a crawl job

Resume a crawl job selected from your Diffbot account.

Inputs

Job namejob_nametextRequired
Job name.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

Start a crawl job

Crawl public pages and extract their content. Uses Diffbot credits.

Inputs

Job namejob_nametextRequired
Job name.
Seed urlsseed_urlslistRequired
Seed urls.
Extraction typeextraction_typetextRequired
Extraction type.One of: analyze, article, product, image, video, discussion, event, list, job.
Max pagesmax_pagesnumberRequired
Max pages.From 1 to 100.

Outputs

Response.

dataobject
Data.
Example output
{
  "data": {
    "jobs": []
  }
}

On this page