solo-api 0.10.0

Solo: MCP and HTTP transports
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23

// SPDX-License-Identifier: Apache-2.0

//! `solo-api` LLM clients that depend on the MCP transport.
//!
//! Other LLM clients (Anthropic, OpenAI, Ollama) live in `solo-storage::llm`
//! because they're HTTP-only and storage-layer-callable. The
//! MCP-sampling client lives here because it needs `rmcp::Peer<RoleServer>`
//! — only available inside the MCP transport.
//!
//! v0.9.0 P2 ships [`sampling::SamplingLlmClient`] + the
//! [`sampling::SamplingClient`] trait the test fixture
//! ([`super::test_support::fake_mcp_client::FakeMcpClient`]) implements.

pub mod sampling;
pub mod sampling_coordinator;

pub use sampling::{
    SamplingClient, SamplingError, SamplingLlmClient, build_sampling_steward,
    DEFAULT_SAMPLING_TIMEOUT,
};
pub use sampling_coordinator::{
    DEFAULT_COALESCE_MAX_BATCH, DEFAULT_COALESCE_WINDOW, SamplingCoordinator,
};