Expand description
RequestActor — one per active client request. Doc §6.1, §6.2.
Owns the per-request Tokens accumulation and the streaming channel
back to the gateway’s HTTP response. The actor is created by the
gateway, asks the DpCoordinatorActor for a route, then tells
the chosen engine an AddRequest. The engine writes chunks into
the mpsc::Sender we provided; we forward them to the Tokens
sender held by the gateway.
Structs§
Enums§
Type Aliases§
- Route
- Public alias:
RouteTargetexposed under theRoutename so callers can hold typed targets without reaching intodp_coordinator. - Streaming
Response - Streaming response handed back to the gateway for forwarding into
the HTTP body. The gateway pulls
next()until it seesNone.