Struct SamplingConfig 

pub struct SamplingConfig {
    pub coalesce_window_ms: u64,
    pub coalesce_max_requests: u32,
}

v0.9.0 P4d: coalesce knobs for SamplingCoordinator (in solo-api::llm::sampling_coordinator). Persisted under [sampling] in solo.config.toml.

Plan §4 P4d names: coalesce_window_ms (default 5000) + coalesce_max_requests (default 10). These collapse N concurrent per-cluster sampling calls (from the triples_batch_timer) into ONE coalesced peer.create_message, surfacing ONE approval prompt per coalesce window in the user’s MCP client instead of N.

Bypass for non-sampling backends: SamplingCoordinator is wired only when [llm] mode = "mcp_sampling". For Ollama / Anthropic / None, requests pass through to the underlying LlmClient unchanged.

Fields

coalesce_window_ms: u64

Upper bound (in milliseconds) the coordinator waits before flushing a non-empty buffer. Plan §4 P4d default: 5000.

coalesce_max_requests: u32

Buffer size that triggers an immediate flush regardless of the window timer. Plan §4 P4d default: 10.

Implementations

impl SamplingConfig

pub fn diagnostic(&self) -> SamplingConfigDiagnostic

v0.9.1 P1 Fix 5 (m3): classify the resolved settings without emitting any log line. Pure function; pinned by [tests::sampling_config_diagnostic_classifies_edge_values].

pub fn warn_on_edge_values(&self)

v0.9.1 P1 Fix 5 (m3): inspect the resolved settings and emit operator-visible warnings for edge values that disable coalescing without an outright error.

The coordinator’s with_settings constructor clamps coalesce_max_requests via max_batch.max(1), and a zero coalesce_window_ms makes the buffered-timer flush immediately — together they collapse the coordinator to a pass-through. That’s a legitimate operator choice (e.g. for debugging or to surface every approval prompt individually), so we don’t reject — but it’s surprising enough that v0.9.0 shipped without any signal, which led to the m3 audit finding.

Called from SoloConfig::read at startup so the warning lands in the daemon log once at process boot.

Trait Implementations

impl Clone for SamplingConfig

fn clone(&self) -> SamplingConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SamplingConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for SamplingConfig

fn eq(&self, other: &SamplingConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for SamplingConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for SamplingConfig

impl StructuralPartialEq for SamplingConfig