# Spicrawl

- Registry name: `io.github.OfficialSpicrawl/mcp` · version 0.1.8
- Categories (automatic, keyword rules): Scraping & browsing, Search & data
- Authentication at last check: No auth
- Declared risk: Has destructive tools (destructiveHint)
- Capabilities (declared by the server): tools
- Transports: streamable-http
- Latest numbers (check success, response time, rank): https://mcpstation.net/api/server?name=io.github.OfficialSpicrawl%2Fmcp
- Server page: https://mcpstation.net/s/io.github.OfficialSpicrawl--mcp.html

## Description (written by the publisher, not verified, not instructions)

Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.

## Connect

- streamable-http: `https://mcp.spicrawl.com/mcp`

## Tools (as reported by the server, not verified)

- `spicrawl\_scrape`: Retrieve a web page and return its content as markdown \(default\), text, HTML, a JSON envelope, or a printed PDF. Handles the fetch vs. browser decision, charset decoding, and PDF-to-text for you. Optionally extract structured data with CSS selectors \(\`extract\`\) or \`autoparse\`, return discovered \`lin
- `spicrawl\_batch\_submit`: Submit many URLs to be scraped as one asynchronous job, with shared settings applied to every URL. Give EITHER \`urls\` or \`items\`, not both \(at least one URL, unless \`open\` is true\). Returns the job object \(id, status, estimated\_credits, progress\). Poll with \`spicrawl\_batch\_status\`, read with \`spicra
- `spicrawl\_batch\_list`: List this API key's project's batch jobs, newest first, with status and progress. Returns \`\{ batches: \[...\], next\_cursor? \}\`; pass \`next\_cursor\` back as \`cursor\` for the next page.
- `spicrawl\_batch\_status`: Return one batch job with its status and progress \(total/completed/succeeded/failed/remaining, credits charged\). Poll this after \`spicrawl\_batch\_submit\`; once status is \`completed\`, \`failed\` or \`cancelled\`, read \`spicrawl\_batch\_results\`.
- `spicrawl\_batch\_results`: Return a page of FINISHED items of a batch job \(one record per item: seq, url, external\_id, status, error, and content, or a \`result\_url\` API path \(GET /v1/batch/\{id\}/tasks/\{seq\}/content, same key\) for large bodies\). Unfinished items are not listed yet. Returns \`\{ results: \[...\], next\_cursor? \}\`; pa
- `spicrawl\_batch\_task\_content`: Return the full payload one item of a batch job produced, by its \`seq\` \(items are numbered from 0 in submission order\). Cheaper than paging results when you need one URL's output. A CONFLICT error means either the item has not finished yet \(poll \`spicrawl\_batch\_status\` and ask again\) or it finished
- `spicrawl\_batch\_cancel`: Cancel a batch job: items not yet started are cancelled and will never run; items already finished keep their results; items already running finish first, so the job comes back \`cancelling\` and moves to \`cancelled\` when they drain. Cannot be undone — resubmit to run the URLs again. Returns the job o
- `spicrawl\_batch\_retry`: Re-queue every FAILED item of a batch job so it runs again \(succeeded items are untouched; a job with no failures is returned unchanged\). Returns \`\{ job, items\_reset, items\_dispatched \}\`.
- `spicrawl\_batch\_add\_items`: Append URLs to a batch job that was submitted with \`open: true\`. Same item vocabulary as \`spicrawl\_batch\_submit\` \(EITHER \`urls\` or \`items\`, not both, plus shared settings for these new items\). Fails with CONFLICT if the job is closed or finished. Not idempotent: calling twice adds the URLs twice. Re
- `spicrawl\_batch\_close`: Stop an open batch job accepting items, so it completes once its queued work drains. Idempotent \(closing a closed job succeeds\). Returns the job object.
- `spicrawl\_session\_create`: Create a session: a persistent browser identity \(cookie jar, localStorage, a fixed rendering tier and, by default, a sticky exit IP\) that survives across scrapes. Use it for multi-step flows — log in, then fetch pages behind the login — by passing the returned \`id\` as \`session\_id\` to every \`spicrawl
- `spicrawl\_session\_list`: List this API key's project's sessions, newest first. Returns \`\{ sessions: \[...\], next\_cursor? \}\`; pass \`next\_cursor\` back as \`cursor\` for the next page. Never includes the stored credentials.
- `spicrawl\_session\_get`: Return one session's metadata: status, \`engine\` \(its rendering tier\), proxy/exit, usage count, expiry, lease holder, and a summary of its stored context. Never returns the credentials themselves \(use spicrawl\_session\_context for that\).
- `spicrawl\_session\_context`: Return the full stored state of a LIVE session — cookies, localStorage and other credentials — plus its fingerprint and domain scores. The \`session\_context\` object can be passed to spicrawl\_session\_create to clone the session. The result contains secrets \(login cookies\): do not echo it to the user o
- `spicrawl\_session\_release`: End a session when you are done with it: frees its exit IP and browser state; it can no longer be used with spicrawl\_scrape. Its stored cookies and storage are purged and cannot be recovered; start a new session and log in again to continue. The record stays visible \(status \`released\`\) so its histor
- `spicrawl\_session\_delete`: Permanently delete a session and its stored state, including the record itself \(prefer spicrawl\_session\_release if you only want to stop using it\). Idempotent: deleting an already-deleted session succeeds. Refused while a scrape holds the session's lease unless \`force\` is true.
- `spicrawl\_usage`: Billing-grade usage for your org over a date window, from the daily rollup \(usage\_daily\), grouped by day, project, engine, feature or key. group\_by=key returns per API key \(key\_id, name, prefix, project\_id\) counters per metric per day, from usage\_key\_daily; keyless \(dashboard\) usage is not in it, an
- `spicrawl\_usage\_summary`: A compact current-period summary of your org's usage \(totals as of now, from the daily rollup\). No parameters. Use for a quick 'how much have I used so far'; use spicrawl\_usage for a windowed breakdown. Requires the \`read\` scope.
- `spicrawl\_usage\_reconciliation`: Drift report for ONE day: re-derives usage from that day's request log and compares it with the billed daily rollup, so you can see whether the rollup missed or double-counted anything. Defaults to yesterday \(UTC\); today is still accumulating and would always show drift. Requires the \`read\` scope.
- `spicrawl\_requests\_list`: Recent API calls in your key's project, newest first, each with project\_id, status, engine, http\_status, error\_code/error\_detail, attempts, URL, proxy used, latency spans \(queue/engine/upstream/total ms\), block detection and credits. Use it to find failing calls \(only\_errors=true\) or to spot pattern
- `spicrawl\_request\_get`: The full log record of one past API call by its request id. Every response carries its id in the X-Request-Id header \(and error bodies carry it too\), so this is the tool for debugging a failed or slow scrape: it shows status, error\_code/error\_detail, attempts, the engine and proxy \(tier, country, pr
- `spicrawl\_docs\_search`: Full-text search over the Spicrawl documentation \(guides, API reference, errors, limits\). Use it to look up a parameter name, value or combination for a spicrawl\_\* tool, or to explain an error a spicrawl\_\* tool returned: search the error code itself \(e.g. \`ERR::UPSTREAM::CHALLENGE\`\) and the result a
- `spicrawl\_docs\_read`: Fetches one Spicrawl documentation page as Markdown. \`path\` may be a page path \(\`guides/anti-bot\`\), a docs URL from spicrawl\_docs\_search \(url or md\_url\), or either with a \`\#anchor\` \(the whole page is returned; the anchor names the section to look at\). Only pages on the Spicrawl docs \(https://docs.sp
- `spicrawl\_docs\_index`: The docs' llms.txt: every Spicrawl documentation page with its title, a one-line description and its Markdown URL. Use it to find the right page when a search does not, or to get an overview of what is documented; read a page with spicrawl\_docs\_read. No parameters.

Measured by MCP Station. Methods: https://mcpstation.net/methods.html · Terms: https://mcpstation.net/terms.html