Skip to main content

Crate siumai_extras

Crate siumai_extras 

Source
Expand description

§Siumai Extras

Optional utilities for the siumai LLM library, including:

  • Schema Validation (schema feature): JSON Schema validation for structured outputs
  • Telemetry (telemetry feature): Advanced tracing and logging with tracing-subscriber
  • OpenTelemetry (opentelemetry feature): Full observability with distributed tracing and metrics
  • Server Adapters (server feature): Axum integration for streaming responses
  • MCP Integration (mcp feature): Model Context Protocol integration for dynamic tool discovery

§Features

  • schema - Enable JSON Schema validation utilities
  • telemetry - Enable tracing subscriber and logging utilities
  • opentelemetry - Enable OpenTelemetry distributed tracing and metrics
  • server - Enable server adapter utilities (Axum)
  • mcp - Enable MCP (Model Context Protocol) integration
  • all - Enable all features

§Example

[dependencies]
siumai = "0.11.0-beta.6"
siumai-extras = { version = "0.11.0-beta.6", features = ["schema", "telemetry", "mcp"] }

§MCP Integration

The mcp feature provides seamless integration with MCP servers:

use siumai::prelude::unified::*;
use siumai_extras::mcp::mcp_tools_from_stdio;

// Connect to MCP server and get tools
let (tools, resolver) = mcp_tools_from_stdio("node mcp-server.js").await?;

// Use with any Siumai model
let reg = registry::global();
let model = reg.language_model("openai:gpt-4o-mini")?;
let (response, _) = siumai_extras::orchestrator::generate(
    &model,
    messages,
    Some(tools),
    Some(&resolver),
    vec![siumai_extras::orchestrator::step_count_is(10)],
    Default::default(),
).await?;

Re-exports§

pub use siumai;

Modules§

analysis
Thinking/analysis utilities for model reasoning content. Analysis Tools (extras crate)
bridge
Closure-friendly bridge customization adapters. Closure-friendly adapters for bridge customization traits.
client
Client utilities such as client pools and managers. Client utilities for Siumai (extras crate)
error
Error types for siumai-extras Error types for siumai-extras
highlevel
High-level structured object helpers (provider-agnostic).
hosted_tools
Provider-hosted tools (web search, file search, code execution, etc.). Provider-defined tools (re-exported from the core siumai crate).
orchestrator
Orchestrator and agent utilities for multi-step tool calling. Orchestrator for multi-step tool calling.
performance
Performance metrics helpers and in-process monitoring. Performance Module - Metrics Collection and Monitoring (extras crate)