Skill: Structured scrape

Bundled execution of the Structured scrape workflow — Pull structured data out of any web page deterministically — articles to clean text, tables to JSON rows, specific elements via CSS selector — without writing regex against raw HTML. One x402 payment runs 7 underlying tools (extract, render, html-select, html-table, html-strip, html-links, html-meta); partial-success per step.

Input

Field	Type	Description
url *	string	Page to scrape (e.g. https://example.com/product/42)
target *	string	What to extract — a price, a table, a list, a paragraph, etc.

Example output

{
  "pack": "structured-scrape",
  "args": {
    "url": "https://example.com/product/42",
    "target": "the price and SKU"
  },
  "steps": [
    {
      "slug": "extract",
      "ok": true,
      "result": {}
    },
    {
      "slug": "render",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-select",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-table",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-strip",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-links",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-meta",
      "ok": true,
      "result": {}
    }
  ],
  "summary": "7/7 steps succeeded"
}

Try it — see the 402 challenge (free)

curl -i -X POST https://agent402.tools/api/skill/structured-scrape \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com/product/42","target":"the price and SKU"}'

The response is HTTP 402 Payment Required with exact payment requirements. Any x402 v2 client pays automatically and retries:

Paid call (JavaScript agent)

import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client();
registerExactEvmScheme(client, { signer: privateKeyToAccount(KEY) });
const payFetch = wrapFetchWithPayment(fetch, client);

const res = await payFetch("https://agent402.tools/api/skill/structured-scrape", {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({
    "url": "https://example.com/product/42",
    "target": "the price and SKU"
  }),
});

Wallet-only. This tool reaches the network/browser/storage, so it is paid in USDC via x402 (no proof-of-work tier).

Related tools