pub struct CompletionRequest {
pub messages: Vec<Message>,
pub max_tokens: Option<u32>,
}Expand description
A request to a crate::ModelAdapter.
This is deliberately shaped like a chat completion, since every adapter
KOPITIAM plans to support (local Qwen, Claude, GPT, Gemini) speaks that
shape natively. messages is expected to already contain whatever
context kopitiam-workflow’s ContextBuilder assembled — adapters must
not go looking for additional context themselves.
Fields§
§messages: Vec<Message>§max_tokens: Option<u32>Upper bound on generated tokens, if the caller wants one. None
leaves the limit to the adapter/model’s own default.
Implementations§
Source§impl CompletionRequest
impl CompletionRequest
pub fn new(messages: impl IntoIterator<Item = Message>) -> Self
pub fn with_max_tokens(self, max_tokens: u32) -> Self
Trait Implementations§
Source§impl Clone for CompletionRequest
impl Clone for CompletionRequest
Source§fn clone(&self) -> CompletionRequest
fn clone(&self) -> CompletionRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CompletionRequest
impl Debug for CompletionRequest
Source§impl Default for CompletionRequest
impl Default for CompletionRequest
Source§fn default() -> CompletionRequest
fn default() -> CompletionRequest
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for CompletionRequest
impl<'de> Deserialize<'de> for CompletionRequest
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for CompletionRequest
impl PartialEq for CompletionRequest
Source§impl Serialize for CompletionRequest
impl Serialize for CompletionRequest
impl StructuralPartialEq for CompletionRequest
Auto Trait Implementations§
impl Freeze for CompletionRequest
impl RefUnwindSafe for CompletionRequest
impl Send for CompletionRequest
impl Sync for CompletionRequest
impl Unpin for CompletionRequest
impl UnsafeUnpin for CompletionRequest
impl UnwindSafe for CompletionRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more