Skip to main content

Module request

Module request 

Source
Expand description

RequestActor — one per active client request. Doc §6.1, §6.2.

Owns the per-request Tokens accumulation and the streaming channel back to the gateway’s HTTP response. The actor is created by the gateway, asks the DpCoordinatorActor for a route, then tells the chosen engine an AddRequest. The engine writes chunks into the mpsc::Sender we provided; we forward them to the Tokens sender held by the gateway.

Structs§

RequestActor

Enums§

RequestMsg

Type Aliases§

Route
Public alias: RouteTarget exposed under the Route name so callers can hold typed targets without reaching into dp_coordinator.
StreamingResponse
Streaming response handed back to the gateway for forwarding into the HTTP body. The gateway pulls next() until it sees None.