pub struct LlmInferenceHttpRequestStartRequest {
pub headers: HashMap<String, Vec<String>>,
pub method: String,
pub request_id: RequestId,
pub session_id: Option<SessionId>,
pub transport: Option<LlmInferenceHttpRequestStartTransport>,
pub url: String,
}Expand description
The head of an outbound model-layer HTTP request.
Fields§
§headers: HashMap<String, Vec<String>>§method: StringHTTP method, e.g. GET, POST.
request_id: RequestIdOpaque runtime-minted id, unique per in-flight request. The SDK uses this to correlate httpRequestChunk frames and to address its httpResponseStart / httpResponseChunk replies back to the runtime.
session_id: Option<SessionId>Id of the runtime session that triggered this request, when one is in scope. Absent for requests issued outside any session (e.g. startup model-catalog or capability resolution). This is a payload field — not a dispatch key — because the client-global API is registered process-wide rather than per session.
transport: Option<LlmInferenceHttpRequestStartTransport>Transport the runtime would otherwise use for this request. http (the default when absent) covers plain HTTP and SSE responses; websocket indicates a full-duplex message channel where each body chunk maps to one WebSocket message and the binary flag distinguishes text from binary frames. The SDK consumer uses this to decide whether to service the request with an HTTP client or a WebSocket client. It is the one piece of request metadata the consumer cannot reliably infer from the URL or headers alone.
url: StringAbsolute request URL.
Trait Implementations§
Source§impl Clone for LlmInferenceHttpRequestStartRequest
impl Clone for LlmInferenceHttpRequestStartRequest
Source§fn clone(&self) -> LlmInferenceHttpRequestStartRequest
fn clone(&self) -> LlmInferenceHttpRequestStartRequest
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more