Other

Dataflow Kit Web Scraper

auto-generated

swirls add dataflowkit …

actionPOSTv1.0.0

Capture web page Screenshots.

Automate URL to Screenshot Conversion right in your application. Specify request parameters like URL, Proxy, and actions to convert web pages to screenshots using Headless Chrome. Get resulted pictures in JPG or PNG formats even from websites blocked in your area for some reason utilizing our worldwide pool of proxies. Simulate real-world human interaction with the page. For example, before capturing a web page, you may need to scroll it. Generate ready-to-run code for your favorite language at [https://dataflowkit.com/url-to-screenshot](https://dataflowkit.com/url-to-screenshot)

Source

actionPOSTv1.0.0

Collect search results from search engines

To crawl search engine result pages, you can use `/serp` endpoint. SERP collection service extracts a list of organic results, news, images, and more. Specify configuration parameters, such as country or languages, to customize output SERP data. The following search engines are supported - google - google-image - google-news - google-shopping - bing - duckduckgo - baidu - yandex Generate ready-to-run code for your favorite language at [https://dataflowkit.com/serp](https://dataflowkit.com/serp)

Source

actionPOSTv1.0.0

Extract structured data from web pages

Dataflow kit uses CSS selectors to find HTML elements in web pages for later data extraction. Open [visual point-and-click toolkit](https://dataflowkit.com/dfk) and click desired elements on a page to specify extracting data. Then you can send generated payload to `/parse` endpoint. We crawl web pages and extract data like text, links, or images for you following the specified rules. Extracted data is returned in CSV, MS Excel, JSON, JSON(Lines) or XML format.

Source

actionPOSTv1.0.0

Save web page as PDF

Automate URL to PDF Conversion right in your application. Specify request parameters like URL, Proxy, and actions to render web pages to PDF using Headless Chrome. Get resulted PDF even from websites blocked in your area for some reason utilizing our worldwide pool of proxies. Simulate real-world human interaction with the page. For example, before saving a web page to PDF, you may need to scroll it. Generate ready-to-run code for your favorite language at [https://dataflowkit.com/url-to-pdf](https://dataflowkit.com/url-to-pdf)

Source

Beyond the catalog

Any provider, on request.

Request it

Tell us which provider you need, and we will ship it in the registry.

Generate it

Point swirls add at an OpenAPI or GraphQL spec. Typed actions for any API you hold credentials for, today.

Request a provider Read the actions docs

acme · integrations

registry · live

terminal

~/acme $swirls add linear

✓ 12 typed actions · scopes and schemas included

~/acme $swirls add https://api.acme.dev/openapi.json

◆ Fetched spec · 38 operations

✓ 6 typed actions · generated from spec