atomr-infer-runtime-openai 0.8.0

OpenAI Chat Completions provider for atomr-infer — implements ModelRunner against api.openai.com, with cost table, error classification, and SSE streaming.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

//! # inference-runtime-openai
//!
//! OpenAI Chat Completions runtime + Azure OpenAI variant. Doc §10.3.
//!
//! Implements the [`atomr_infer_core::ModelRunner`] contract over
//! HTTP/2 (via `reqwest`). SSE chunks are parsed by
//! `inference-remote-core::sse` and lifted into provider-typed deltas
//! by [`wire`].

#![forbid(unsafe_code)]
#![deny(rust_2018_idioms)]

pub mod config;
pub mod cost;
pub mod error;
pub mod runner;
pub mod wire;

pub use config::{OpenAiConfig, OpenAiVariant};
pub use cost::OpenAiPricing;
pub use error::classify_openai_error;
pub use runner::OpenAiRunner;