--crawl-url-is-sitemap
- CLI
- --crawl-url-is-sitemap
Treats the target URL as a list of URLs and captures each one into a single archive. A target that resolves to a sitemap under WARC or WACZ output is treated this way without the flag.
| Format | Reads |
|---|---|
auto | The format inferred from the target’s extension, then its Content-Type |
xml | A sitemap or sitemap index |
text | One URL per line. Never inferred |
Example
zshot -f house-at-pooh-corner.wacz \
--crawl-url-is-sitemap xml \
https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml{
"url": "https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml",
"output_type": "wacz",
"crawl_url_is_sitemap": "xml"
}curl -X POST http://127.0.0.1:3000/ \
-H "Content-Type: application/json" \
-d '{"url":"https://zshot-cli.com/example_assets/house-at-pooh-corner/sitemap.xml","output_type":"wacz","crawl_url_is_sitemap":"xml"}' \
-o house-at-pooh-corner.wacz