Text chunk (RAG)

Split text into overlapping chunks for RAG ingestion — by characters (default) or by exact LLM tokens. Returns the chunks plus offsets. Deterministic, no model needed.

Input

Field	Type	Description
text *	string
size	number	chunk size (default 800)
overlap	number	overlap between chunks (default 0)
unit	string	chars (default) | tokens
model	string	tokenizer model when unit=tokens (default gpt-4o)

Example output

{
  "unit": "chars",
  "size": 800,
  "overlap": 100,
  "count": 2,
  "chunks": [
    "…",
    "…"
  ]
}

Try it — see the 402 challenge (free)

curl -i -X POST https://agent402.tools/api/text-chunk \
  -H "Content-Type: application/json" \
  -d '{"text":"long document …","size":800,"overlap":100,"unit":"chars"}'

The response is HTTP 402 Payment Required with exact payment requirements. Any x402 v2 client pays automatically and retries:

Paid call (JavaScript agent)

import { wrapFetchWithPayment } from "@x402/fetch";
import { x402Client } from "@x402/core/client";
import { registerExactEvmScheme } from "@x402/evm/exact/client";
import { privateKeyToAccount } from "viem/accounts";

const client = new x402Client();
registerExactEvmScheme(client, { signer: privateKeyToAccount(KEY) });
const payFetch = wrapFetchWithPayment(fetch, client);

const res = await payFetch("https://agent402.tools/api/text-chunk", {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({
    "text": "long document …",
    "size": 800,
    "overlap": 100,
    "unit": "chars"
  }),
});

No wallet? Pay with compute

This is a pure-CPU tool, so an agent without a wallet can pay with proof-of-work instead of USDC: fetch a challenge, solve the sha256 puzzle (16 leading zero bits — a fraction of a second of CPU, no money, no AI tokens), and resend with the X-Pow-Solution header.

import { createHash } from "node:crypto";
const lz = (b) => { let t = 0; for (const x of b) { if (!x) { t += 8; continue; } t += Math.clz32(x) - 24; break; } return t; };
const c = await (await fetch("https://agent402.tools/api/pow/challenge?slug=text-chunk")).json();
let n = 0;
while (lz(createHash("sha256").update(c.challenge + ":" + n).digest()) < c.difficulty) n++;
await fetch("https://agent402.tools/api/text-chunk", { method: "POST", headers: { "X-Pow-Solution": c.token + ":" + n, "Content-Type": "application/json" }, body: JSON.stringify({"text":"long document …","size":800,"overlap":100,"unit":"chars"}) });

Related tools