sombrax_agentic_core 0.1.1

SombraX Agentic Core (SAC) — a provider-agnostic Rust library for building LLM agents: content-modifying hooks, tool/MCP integration, and context optimization.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35

//! MLX-LM provider module
//!
//! Provides access to local MLX-LM server with support for custom chat templates.
//! MLX-LM is Apple's machine learning framework for running LLMs on Apple Silicon.
//!
//! # Chat Template Support
//!
//! MLX-LM servers can use custom Jinja chat templates. This provider supports:
//! - Standard OpenAI-compatible message format (default)
//! - Minimax chat template format with special delimiters
//!
//! # Usage
//!
//! ```rust,no_run
//! use sombrax_agentic_core::providers::{MlxLmClientBuilder, ChatTemplate};
//!
//! // Basic usage with local server
//! let client = MlxLmClientBuilder::new()
//!     .base_url("http://localhost:8080")
//!     .build();
//!
//! let model = client.completion_model("mlx-community/model");
//!
//! // With Minimax chat template
//! let client = MlxLmClientBuilder::new()
//!     .base_url("http://localhost:8080")
//!     .chat_template(ChatTemplate::Minimax)
//!     .build();
//! ```

pub mod client;
pub mod types;

pub use client::*;
pub use types::*;