union_square 0.2.0

A proxy/wire-tap service for making LLM calls and recording everything that happens in a session for later analysis and test-case extraction
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

//! AWS Bedrock provider implementation
//!
//! This module implements the Bedrock-specific provider as the MVP provider
//! that demonstrates the proxy pattern for future providers.
//!
//! ## Features
//!
//! - SigV4 authentication pass-through
//! - Support for InvokeModel and InvokeModelWithResponseStream
//! - Model-specific request/response handling
//! - Cost calculation based on token usage
//! - Zero-copy streaming for minimal latency

pub mod auth;
pub mod models;
pub mod provider;
pub mod types;

#[cfg(test)]
mod tests;

pub use provider::BedrockProvider;