Skip to main content

Module model

Module model 

Source
Expand description

Completion model trait: the core LLM abstraction.

A CompletionModel takes a prompt and returns a response, wrapped in Io for composable effect handling.

Structs§

CompletionRequest
A completion request.
CompletionResponse
A completion response.
Message
A message in a conversation.
StreamChunk
A token chunk from a streaming response.

Enums§

Role
The role of a message sender.

Traits§

CompletionModel
The core LLM abstraction: send a request, get a response.