--crawl-concurrency

CLI: --crawl-concurrency
REST: crawl_concurrency

ValueN

Defaultthe number of CPUs

LicensePro

Sets the maximum number of concurrent browsers allowed to perform a link crawl’s or sitemap walk to N. The browsers share one cache and one set of cookies. These browsers are all affected by --crawl-delay: the entire set of browsers will wait for a new URL to become available after waiting for the crawl delay to pass.

Example

Run locally

zshot -f winnie-the-pooh.wacz \
  --crawl-links \
  --crawl-concurrency 4 \
  https://zshot-cli.com/example_assets/winnie-the-pooh/

{
  "url": "https://zshot-cli.com/example_assets/winnie-the-pooh/",
  "output_type": "wacz",
  "crawl_links": true,
  "crawl_concurrency": 4
}

curl -X POST http://127.0.0.1:3000/ \
  -H "Content-Type: application/json" \
  -d '{"url":"https://zshot-cli.com/example_assets/winnie-the-pooh/","output_type":"wacz","crawl_links":true,"crawl_concurrency":4}' \
  -o winnie-the-pooh.wacz