Skip to main content

HttpProvider

Struct HttpProvider 

Source
pub struct HttpProvider { /* private fields */ }
Expand description

Shared HTTP transport for OpenAI-compatible providers.

Holds a reqwest::Client, pre-built headers (auth + content-type), and the target endpoint URL.

Implementations§

Source§

impl HttpProvider

Source

pub fn bearer(client: Client, key: &str, endpoint: &str) -> Result<Self>

Create a provider with Bearer token authentication.

Source

pub fn no_auth(client: Client, endpoint: &str) -> Self

Create a provider without authentication (e.g. Ollama).

Source

pub fn custom_header( client: Client, header_name: &str, header_value: &str, endpoint: &str, ) -> Result<Self>

Create a provider with a custom header for authentication.

Used by providers that don’t use Bearer tokens (e.g. Anthropic uses x-api-key).

Source

pub fn anthropic(client: Client, key: &str, endpoint: &str) -> Result<Self>

Create a provider with Anthropic authentication headers.

Inserts x-api-key and anthropic-version in addition to the standard content-type and accept headers.

Source

pub async fn send(&self, body: &impl Serialize) -> Result<Response>

Send a non-streaming request and deserialize the response as JSON.

Source

pub fn stream_sse( &self, body: &impl Serialize, ) -> impl Stream<Item = Result<StreamChunk>> + Send

Stream an SSE response (OpenAI-compatible format).

Parses data: prefixed lines, skips [DONE] sentinel, and deserializes each chunk as StreamChunk.

Source

pub async fn send_raw(&self, body: &impl Serialize) -> Result<String>

Send a non-streaming request and return the raw response body text.

Unlike send(), the caller is responsible for deserialization. Used by providers whose response schema differs from the OpenAI format (e.g. Anthropic).

Source

pub fn stream_anthropic( &self, body: Value, ) -> impl Stream<Item = Result<StreamChunk>> + Send

Stream an SSE response in Anthropic block-buffer format.

Anthropic uses \n\n-delimited blocks each containing event: and data: lines, unlike OpenAI’s line-by-line data: prefix format. Takes the body as an owned serde_json::Value so the stream can be 'static without capturing a borrow.

Source

pub fn endpoint(&self) -> &str

Get the endpoint URL.

Source

pub fn headers(&self) -> &HeaderMap

Get a reference to the headers.

Trait Implementations§

Source§

impl Clone for HttpProvider

Source§

fn clone(&self) -> HttpProvider

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more