--crawl-deny-url

CLI: --crawl-deny-url
REST: crawl_deny_url

ValueGLOB

LicensePro

Skips URLs matching this glob during a link crawl or sitemap walk. Repeatable. --crawl-allow-url wins over a deny.

Glob	Skips
`/admin/`	A top-level `admin` on any host
`//admin/`	`admin` at any depth on any host
`:///admin/*`	A top-level `admin` on any host and scheme

Example

Run locally

zshot -f house-at-pooh-corner.wacz \
  --crawl-deny-url "*/**/chapter-*" \
  https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml

{
  "url": "https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml",
  "output_type": "wacz",
  "crawl_deny_url": ["*/**/chapter-*"]
}

curl -X POST http://127.0.0.1:3000/ \
  -H "Content-Type: application/json" \
  -d '{"url":"https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml","output_type":"wacz","crawl_deny_url":["*/**/chapter-*"]}' \
  -o house-at-pooh-corner.wacz