Expand description
Chronicle LLM Proxy and Observability tool. This is the implementation of the proxy which can be embedded into a Rust application. For other uses you may want to try the full-fledged API application in the chronicle-api crate.
Re-exports§
pub use error::Error;
Modules§
- builder
- config
- database
- error
- format
- The common format for requests. This mostly hews to the OpenAI format except some response fields are made optional to accomodate different model providers.
- providers
- request
- Utilities for retrying a provider request as needed.
- workflow_
events
Structs§
- Collected
Response - Model
AndProvider - Proxied
Chat Response - Proxied
Chat Response Meta - Proxy
- The Chronicle proxy object
- Proxy
Request Internal Metadata - Metadata about the internal source of this request. Mostly useful for multi-tenant scenarios where one proxy server is handling requests from multiple unrelated applications.
- Proxy
Request Metadata - Metadata about the request and how it fits into the system as a whole. All of these
fields are optional, and the
extrafield can be used to add anything else that useful for your use case. - Proxy
Request Options
Functions§
- collect_
response - Collect a stream contents into a single response