Guides

Offline testing

Inject fetch or use the local adapter.

import { createScrapeClient } from "scrape-sdk";
import { local } from "scrape-sdk/local";

const scraper = createScrapeClient({
  provider: local({
    fetch: async (url) => new Response("<html><article><h1>Hi</h1></article></html>", {
      headers: { "content-type": "text/html" },
    }),
  }),
});

const page = await scraper.scrape("https://example.com");

Every adapter accepts fetch in its config so tests can pin real request URLs and JSON shapes without the network.

Model Context Protocol

Full-page scrape, map, crawl, extract. Not a replacement for host WebSearch.

Machine-readable Scrape SDK docs

Give agents current Scrape SDK documentation without scraping rendered HTML.