Expand description
Wire shapes for POST /v1/cancel.
One request id in, one honest verdict out. The verdict is
deliberately not a bare ok: true: a client that cancels the moment
the last token arrives, or retries a cancel after the first one
worked, needs to be able to tell “I stopped a live generation” from
“there was nothing left to stop”. Both are fine outcomes; only one
of them saved any work, and a UI that cannot distinguish them will
claim it stopped something it did not.
Structs§
- Cancel
Generation Request - The body of
POST /v1/cancel. - Cancel
Generation Response - The answer to
POST /v1/cancel.