pub struct OpenAICompatible { /* private fields */ }openai only.Expand description
Shared OpenAI-compatible client implementation.
Implementations§
Source§impl OpenAICompatible
impl OpenAICompatible
Sourcepub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
Available on crate feature models only.
pub fn new(config: OpenAICompatibleConfig) -> Result<OpenAICompatible, AdkError>
models only.Create a new OpenAI-compatible client.
Sourcepub fn new_with_reasoning_effort(
config: OpenAICompatibleConfig,
reasoning_effort: Option<OpenAIReasoningEffort>,
) -> Result<OpenAICompatible, AdkError>
Available on crate feature models only.
pub fn new_with_reasoning_effort( config: OpenAICompatibleConfig, reasoning_effort: Option<OpenAIReasoningEffort>, ) -> Result<OpenAICompatible, AdkError>
models only.Create an OpenAI-compatible client with the complete OpenAI reasoning vocabulary.
This supports newer values such as none, xhigh, and max without changing
the backward-compatible OpenAICompatibleConfig::reasoning_effort field type.
Sourcepub fn with_default_headers(
self,
headers: HeaderMap,
) -> Result<OpenAICompatible, AdkError>
Available on crate feature models only.
pub fn with_default_headers( self, headers: HeaderMap, ) -> Result<OpenAICompatible, AdkError>
models only.Adds default HTTP headers to every request, replacing earlier defaults with the same name.
The bearer token and organization headers set per request take precedence, and
redirects stay disabled. Unlike builder methods that only store a value, this
method rebuilds the underlying reqwest client, so it returns Result.
§Example
use adk_model::{OpenAICompatible, OpenAICompatibleConfig};
use http::header::{HeaderMap, HeaderValue};
let mut headers = HeaderMap::new();
headers.insert("x-session-id", HeaderValue::from_static("conversation-1"));
let client = OpenAICompatible::new(OpenAICompatibleConfig::new("api-key", "model"))?
.with_default_headers(headers)?;§Errors
Returns an Internal error with code model.openai.http_client_init when the
HTTP client cannot be built.
Sourcepub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
Available on crate feature models only.
pub fn with_retry_config(self, retry_config: RetryConfig) -> OpenAICompatible
models only.Set the retry configuration (builder pattern).
Sourcepub fn with_request_adapter(
self,
adapter: Arc<dyn Fn(&mut Value, &mut HeaderMap) -> Result<(), AdkError> + Sync + Send>,
) -> OpenAICompatible
Available on crate feature models only.
pub fn with_request_adapter( self, adapter: Arc<dyn Fn(&mut Value, &mut HeaderMap) -> Result<(), AdkError> + Sync + Send>, ) -> OpenAICompatible
models only.Customize generation request fields and headers before each HTTP attempt.
The adapter runs under this client’s RetryConfig; see
RequestAdapter for an example.
Sourcepub fn set_retry_config(&mut self, retry_config: RetryConfig)
Available on crate feature models only.
pub fn set_retry_config(&mut self, retry_config: RetryConfig)
models only.Set the retry configuration (mutable reference).
Sourcepub fn retry_config(&self) -> &RetryConfig
Available on crate feature models only.
pub fn retry_config(&self) -> &RetryConfig
models only.Returns the current retry configuration.
Sourcepub fn with_reasoning_replay(self, enabled: bool) -> OpenAICompatible
Available on crate feature models only.
pub fn with_reasoning_replay(self, enabled: bool) -> OpenAICompatible
models only.Enables or disables assistant reasoning replay through reasoning_content.
Disabled by default. Passing true selects reasoning_content, replacing
any previous field selection; passing false clears the selection.
This controls history serialization, not whether the model thinks.
§Example
use adk_model::{OpenAICompatible, OpenAICompatibleConfig};
let client = OpenAICompatible::new(OpenAICompatibleConfig::new("key", "model"))?
.with_reasoning_replay(true);Sourcepub fn with_reasoning_replay_field(
self,
field: ReasoningReplayField,
) -> OpenAICompatible
Available on crate feature models only.
pub fn with_reasoning_replay_field( self, field: ReasoningReplayField, ) -> OpenAICompatible
models only.Enables assistant reasoning replay with an explicit provider field.
Newer vLLM servers use ReasoningReplayField::Reasoning. Older deployments
may still require reasoning_content; select the field the endpoint accepts.
The last call to either reasoning-replay builder determines the selection.
§Example
use adk_model::{
OpenAICompatible, OpenAICompatibleConfig, ReasoningReplayField,
};
let client = OpenAICompatible::new(OpenAICompatibleConfig::new("key", "model"))?
.with_reasoning_replay_field(ReasoningReplayField::Reasoning);Trait Implementations§
Source§impl Llm for OpenAICompatible
impl Llm for OpenAICompatible
Source§fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OpenAICompatible: 'async_trait,
Source§fn schema_adapter(&self) -> &dyn SchemaAdapter
fn schema_adapter(&self) -> &dyn SchemaAdapter
Source§fn uses_interactions_api(&self) -> bool
fn uses_interactions_api(&self) -> bool
true if this model is configured to use a server-managed
environment (e.g., Gemini Interactions API) where the provider owns
the tool-calling loop and filesystem. Read moreAuto Trait Implementations§
impl !RefUnwindSafe for OpenAICompatible
impl !UnwindSafe for OpenAICompatible
impl Freeze for OpenAICompatible
impl Send for OpenAICompatible
impl Sync for OpenAICompatible
impl Unpin for OpenAICompatible
impl UnsafeUnpin for OpenAICompatible
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> FmtForward for T
impl<T> FmtForward for T
Source§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.Source§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.Source§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.Source§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.Source§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.Source§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.Source§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.Source§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreimpl<T> MaybeSend for Twhere
T: Send,
Source§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
Source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
Source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
Source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
Source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.Source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.Source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<T> Tap for T
impl<T> Tap for T
Source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read moreSource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read moreSource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read moreSource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read moreSource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.Source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.Source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.Source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.Source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.