--server-queue-requests
- CLI
- --server-queue-requests
- REST
- CLI only
Sets how many requests wait when every --server-max-concurrency slot is busy. A waiting request starts when a slot frees and answers 408 if its timeout runs out first; a request that finds the queue full answers 429.
0 turns the queue off, so a request past the concurrency cap answers 429 at once. Any license that runs the server accepts 0.
Example
CLI
Run locally
zshot --server --server-max-concurrency 4 --server-queue-requests 20