pub struct GenerationCapabilities {
pub streaming: bool,
pub stop_sequences: bool,
pub seed: bool,
pub json_object: bool,
pub json_schema: bool,
pub tools: bool,
pub tool_choice: bool,
}Expand description
Optional features of a generation provider. The OpenAI-compatible adapter cannot discover these, so they are configured and enforced up front.
Fields§
§streaming: bool§stop_sequences: bool§seed: bool§json_object: bool§json_schema: bool§tools: boolTool definitions, assistant tool calls, and tool-result messages.
tool_choice: boolThe tool_choice control (auto / none / named tool).
Implementations§
Source§impl GenerationCapabilities
impl GenerationCapabilities
Sourcepub fn check(&self, request: &ChatRequest, stream: bool) -> RuntimeResult<()>
pub fn check(&self, request: &ChatRequest, stream: bool) -> RuntimeResult<()>
Rejects options the provider is not declared to support.
Trait Implementations§
Source§impl Clone for GenerationCapabilities
impl Clone for GenerationCapabilities
Source§impl Debug for GenerationCapabilities
impl Debug for GenerationCapabilities
Source§impl<'de> Deserialize<'de> for GenerationCapabilities
impl<'de> Deserialize<'de> for GenerationCapabilities
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for GenerationCapabilities
Source§impl PartialEq for GenerationCapabilities
impl PartialEq for GenerationCapabilities
Source§impl Serialize for GenerationCapabilities
impl Serialize for GenerationCapabilities
impl StructuralPartialEq for GenerationCapabilities
Auto Trait Implementations§
impl Freeze for GenerationCapabilities
impl RefUnwindSafe for GenerationCapabilities
impl Send for GenerationCapabilities
impl Sync for GenerationCapabilities
impl Unpin for GenerationCapabilities
impl UnsafeUnpin for GenerationCapabilities
impl UnwindSafe for GenerationCapabilities
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more