Batch Scrape

Scrape many URLs in parallel under one job.

POST/api/v1/batch/scrape1 / URL

Submit a list of URLs and Peep scrapes them in parallel, rolling the results up under one job. Asynchronous — poll the job for progress.

Request

ParameterTypeDescription
urlsrequiredstring[]The URLs to scrape.
scrapeOptionsobjectApplied to every URL (see Scrape).
ignoreInvalidURLsbooleanDrop malformed URLs instead of failing the whole batch. Defaults to true.
appendToIdstringAppend these URLs to an existing batch job.
webhookobjectReceive per-URL and completion events.

Example

bash
curl -X POST https://peep.shownomore.com/api/v1/batch/scrape \
  -H "Authorization: Bearer peep_live_xxx" \
  -H "Content-Type: application/json" \
  -d '{
  "urls": [
    "https://example.com/a",
    "https://example.com/b"
  ],
  "scrapeOptions": {
    "formats": [
      "markdown"
    ]
  }
}'

Poll GET /api/v1/batch/scrape/{jobId} for status and the rolled-up results.