Skill: Structured scrape

Pull structured data out of any web page deterministically - articles to clean text, tables to JSON rows, specific elements via CSS selector - without writing regex against raw HTML. Send POST /api/skill/structured-scrape with the required fields url and target and pay $0.023 per call over x402 or MPP (there is no free tier). It returns a JSON object with pack, args, steps and summary.

Structured scrape skill pack: one x402 payment runs 7 underlying tools (extract, render, html-select, html-table, html-strip, html-links, html-meta); partial-success per step.

Try in playground →

Parameters

Example request

curl -i -X POST https://agent402.tools/api/skill/structured-scrape \
  -H "Content-Type: application/json" \
  -d '{"url":"https://agent402.tools/leaderboard","target":"the price and SKU"}'

Without payment this returns HTTP 402 Payment Required with the exact price for skill-structured-scrape; any x402 v2 or MPP client pays it and retries.

Example response

{
  "pack": "structured-scrape",
  "args": {
    "url": "https://agent402.tools/leaderboard",
    "target": "the price and SKU"
  },
  "steps": [
    {
      "slug": "extract",
      "ok": true,
      "result": {}
    },
    {
      "slug": "render",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-select",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-table",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-strip",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-links",
      "ok": true,
      "result": {}
    },
    {
      "slug": "html-meta",
      "ok": true,
      "result": {}
    }
  ],
  "summary": "7/7 steps succeeded"
}

From an MCP client

catalog.call {
  "slug": "skill-structured-scrape",
  "params": {
    "url": "https://agent402.tools/leaderboard",
    "target": "the price and SKU"
  }
}

The hosted connector at https://agent402.tools/mcp needs a payment for skill-structured-scrape; the stdio package pays it from a wallet or from an AGENT402_CREDITS_KEY issued earlier. Local install: npx -y [email protected].

Errors and behavior

• Arguments left out fall back to the pack's own defaults. Each step reports on its own; the call succeeds when at least one step does, and a run where every step fails is refused (400 when the input caused it, 502 otherwise).
• A paid call that ends in any status of 400 or above is not charged over x402, MPP or a prepaid credits key: settlement runs after the tool and only on a successful response. The exception is a Tempo push credential, a transfer the buyer sent before the call: it settles before the tool runs, so if the tool then fails the payment is recorded as a refund owed to the paying wallet.
• Wallet-only: this tool reaches the network or stored state, so it has no proof-of-work tier. A prepaid card-credits key issued earlier (Authorization: Bearer a402_...) also pays it.
• A GET or HEAD to /api/skill/structured-scrape returns the same 402 quote, so the price can be read without a body.
• An Idempotency-Key header makes a retried paid call replay the first 200 instead of charging again (an answer larger than 1 MB is not replayed).

Paid call (JavaScript agent)

import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client();
client.setSpendControls?.({ maxAmountPerPayment: "$0.023" }); // refuse any quote above this tool's price
registerExactEvmScheme(client, { signer: privateKeyToAccount(KEY) });
const payFetch = wrapFetchWithPayment(fetch, client);

const res = await payFetch("https://agent402.tools/api/skill/structured-scrape", {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({
    "url": "https://agent402.tools/leaderboard",
    "target": "the price and SKU"
  }),
});

Related tools