Module response

Source
Expand description

§RSLLM Response Types

Response types for chat completions, embeddings, and other LLM operations. Supports both streaming and non-streaming responses with usage tracking.

Structs§

ChatResponse
Response from a chat completion request
CompletionResponse
Response from a completion request (non-chat)
EmbeddingResponse
Embedding response
LogProbs
Log probabilities for completion responses
StreamChunk
A single chunk in a streaming response
ToolCallDelta
Tool call delta for streaming responses
ToolFunctionDelta
Tool function delta for streaming responses
Usage
Usage statistics for API calls