Struct Proxy

pub struct Proxy { /* private fields */ }

The Chronicle proxy object

Implementations

impl Proxy

pub fn builder() -> ProxyBuilder

Create a builder for the proxy

pub async fn record_event(&self, body: EventPayload) -> Uuid

Record an event to the database. This lets you have your LLM request events and other events in the same database table.

pub async fn record_workflow_event(&self, event: WorkflowEvent)

Record a step event to the database

pub async fn record_event_batch( &self, events: impl Into<SmallVec<[WorkflowEvent; 1]>>, )

Record multiple events, steps, and run updates

pub async fn send( &self, options: ProxyRequestOptions, body: ChatRequest, ) -> Result<StreamingResponseReceiver, Report<Error>>

pub fn set_provider(&self, provider: Arc<dyn ChatModelProvider>)

Add a provider to the system. This will replace any existing provider with the same name.

pub fn remove_provider(&self, name: &str)

Remove a provider. Any aliases that reference this provider’s name will stop working.

pub fn set_alias(&self, alias: AliasConfig)

Add an alias to the system. This will replace any existing alias with the same name.

pub fn remove_alias(&self, name: &str)

Remove an alias

pub fn set_api_key(&self, api_key: ApiKeyConfig)

Add an API key to the system. This will replace any existing API key with the same name.

pub fn remove_api_key(&self, name: &str)

Remove an API key. Any aliases that reference this API key’s name will stop working.

pub async fn shutdown(&mut self)

Shutdown the proxy, making sure to write any queued logging events

Trait Implementations

impl Debug for Proxy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.