Struct OllamaConfig

pub struct OllamaConfig { /* private fields */ }

Ollama has OpenAI compatiblity, meaning that you can use it as an OpenAI API.

This struct implements the Config trait of OpenAI, and has the necessary setup for OpenAI configurations for you to use Ollama.

Example

let ollama = OpenAI::new(OllamaConfig::default()).with_model("llama3.2");
let response = ollama.invoke("Say hello!").await.unwrap();

Implementations

impl OllamaConfig

pub fn new() -> Self

pub fn with_api_key<S: Into<String>>(self, api_key: S) -> Self

pub fn with_api_base<S: Into<String>>(self, api_base: S) -> Self

Trait Implementations

impl Clone for OllamaConfig

fn clone(&self) -> OllamaConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for OllamaConfig

fn api_key(&self) -> &Secret<String>

fn api_base(&self) -> &str

fn headers(&self) -> HeaderMap

fn query(&self) -> Vec<(&str, &str)>

fn url(&self, path: &str) -> String

impl Debug for OllamaConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OllamaConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OllamaConfig

where OllamaConfig: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.