Struct GenericCompletionModel 

pub struct GenericCompletionModel<Ext = OpenAICompletionsExt, H = Client> {
    pub model: String,
    /* private fields */
}

A chat-completions model over any OpenAICompatibleProvider extension. This is the advertised path for OpenAI-compatible providers; see the provider checklist in crate::providers.

Fields

model: String

Implementations

impl<Ext, H> GenericCompletionModel<Ext, H>

where Client<Ext, H>: Debug + Clone + 'static, Ext: Provider + Clone + 'static,

pub fn new( client: Client<Ext, H>, model: impl Into<String>, ) -> GenericCompletionModel<Ext, H>

pub fn with_strict_tools(self) -> GenericCompletionModel<Ext, H>

Enable strict mode for tool schemas.

When enabled, tool schemas are automatically sanitized to meet OpenAI’s strict mode requirements:

• additionalProperties: false is added to all objects
• All properties are marked as required
• strict: true is set on each function definition

This allows OpenAI to guarantee that the model’s tool calls will match the schema exactly.

pub fn with_tool_result_array_content(self) -> GenericCompletionModel<Ext, H>

impl<H> GenericCompletionModel<OpenRouterExt, H>

pub fn with_prompt_caching(self) -> GenericCompletionModel<OpenRouterExt, H>

Enable explicit prompt caching for supported OpenRouter models.

Adds cache_control: {"type": "ephemeral"} to the system-prompt block so subsequent turns that share the same system prefix can be billed at the cache-hit rate when the selected model/provider supports explicit cache breakpoints.

Trait Implementations

impl<Ext, H> Clone for GenericCompletionModel<Ext, H>

where Ext: Clone, H: Clone,

fn clone(&self) -> GenericCompletionModel<Ext, H>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<Ext, H> CompletionModel for GenericCompletionModel<Ext, H>

where Client<Ext, H>: HttpClientExt + Clone + WasmCompatSend + WasmCompatSync + 'static, Ext: Provider + OpenAICompatibleProvider + DebugExt + Clone + WasmCompatSend + WasmCompatSync + 'static, H: Clone + Default + Debug + WasmCompatSend + WasmCompatSync + 'static,

type Response = <Ext as OpenAICompatibleProvider>::Response

The raw response type returned by the underlying completion model.

type StreamingResponse = StreamingCompletionResponse<<Ext as OpenAICompatibleProvider>::StreamingUsage>

The raw response type returned by the underlying completion model when streaming.

type Client = Client<Ext, H>

Provider client type used to construct this model.

fn make( client: &<GenericCompletionModel<Ext, H> as CompletionModel>::Client, model: impl Into<String>, ) -> GenericCompletionModel<Ext, H>

Construct a model handle from a provider client and model identifier.

fn composes_native_output_with_tools(&self) -> bool

Whether this provider’s native structured output (output_schema -> format/response_format) composes with tool calls in the same multi-turn request without suppressing them.

async fn completion( &self, completion_request: CompletionRequest, ) -> Result<CompletionResponse<<Ext as OpenAICompatibleProvider>::Response>, CompletionError>

Generates a completion response for the given completion request.

async fn stream( &self, request: CompletionRequest, ) -> Result<StreamingCompletionResponse<<GenericCompletionModel<Ext, H> as CompletionModel>::StreamingResponse>, CompletionError>

fn completion_request( &self, prompt: impl Into<Message>, ) -> CompletionRequestBuilder<Self>

Generates a completion request builder for the given prompt.