Struct MaskedProvider 

pub struct MaskedProvider { /* private fields */ }

Wraps an AnyProvider so every outbound chat*/chat_with_tools* call masks message text via an OutboundMasker before delegating to the inner provider.

Examples

use std::sync::Arc;
use zeph_llm::any::AnyProvider;
use zeph_llm::masking::OutboundMasker;
use zeph_llm::ollama::OllamaProvider;

#[derive(Debug)]
struct UppercaseMasker;
impl OutboundMasker for UppercaseMasker {
    fn mask(&self, text: &str) -> Option<String> {
        if text.contains("secret") { Some(text.replace("secret", "***")) } else { None }
    }
}

let inner = AnyProvider::Ollama(OllamaProvider::new("http://localhost:11434", "m".into(), "e".into()));
let masked = inner.masked(Arc::new(UppercaseMasker));
assert_eq!(masked.name(), "ollama"); // delegation still works transparently

Implementations

impl MaskedProvider

pub fn new(inner: AnyProvider, masker: Arc<dyn OutboundMasker>) -> Self

Wrap inner with masker.

pub fn inner(&self) -> &AnyProvider

Return the wrapped provider, discarding the masking layer.

pub fn applied_count(&self) -> u64

Number of outbound calls (across every clone of this wrapper) that had at least one secret masked. Exposed for the secret_mask_applied observability metric.

Trait Implementations

impl Clone for MaskedProvider

fn clone(&self) -> MaskedProvider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MaskedProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LlmProvider for MaskedProvider

fn context_window(&self) -> Option<usize>

Report the model’s context window size in tokens.

async fn chat(&self, messages: &[Message]) -> Result<String, LlmError>

Send messages to the LLM and return the assistant response.

async fn chat_with_extras( &self, messages: &[Message], ) -> Result<(String, ChatExtras), LlmError>

Send messages and return the assistant response together with per-call extras.

async fn chat_stream( &self, messages: &[Message], ) -> Result<ChatStream, LlmError>

Send messages and return a stream of response chunks.

fn supports_streaming(&self) -> bool

Whether this provider supports native streaming.

async fn embed(&self, text: &str) -> Result<Vec<f32>, LlmError>

Generate an embedding vector from text.

async fn embed_batch(&self, texts: &[&str]) -> Result<Vec<Vec<f32>>, LlmError>

Embed multiple texts in a single API call.

fn supports_embeddings(&self) -> bool

Whether this provider supports embedding generation.

fn name(&self) -> &str

Provider name for logging and identification.

fn model_identifier(&self) -> &str

Model identifier string (e.g. gpt-4o-mini, claude-sonnet-5). Used by cost-estimation heuristics. Returns "" when not applicable.

fn effective_model_identifier(&self) -> &str

Model identifier that actually served the most recent dispatch.

fn supports_structured_output(&self) -> bool

Whether this provider supports native structured output.

fn supports_vision(&self) -> bool

Whether this provider supports image input (vision).

fn supports_tool_use(&self) -> bool

Whether this provider supports native tool_use / function calling.

async fn chat_with_tools( &self, messages: &[Message], tools: &[ToolDefinition], ) -> Result<ChatResponse, LlmError>

Send messages with tool definitions, returning a structured response.

fn last_cache_usage(&self) -> Option<(u64, u64)>

Return the cache usage from the last API call, if available. Returns (cache_creation_tokens, cache_read_tokens).

fn last_usage(&self) -> Option<(u64, u64)>

Return token counts from the last API call, if available. Returns (input_tokens, output_tokens).

fn last_reasoning_tokens(&self) -> Option<u64>

Return reasoning tokens from the last API call, if the provider reports them.

fn last_ttft_ms(&self) -> Option<u64>

Return the time-to-first-byte (milliseconds) of the last API call, if available.

fn debug_request_json( &self, messages: &[Message], tools: &[ToolDefinition], stream: bool, ) -> Value

Return the request payload that will be sent to the provider, for debug dumps.

fn take_compaction_summary(&self) -> Option<String>

Return the compaction summary from the most recent API call, if a server-side compaction occurred (Claude compact-2026-01-12 beta). Clears the stored value.

fn list_models(&self) -> Vec<String>

Return the list of model identifiers this provider can serve. Default: empty (provider does not advertise models).

async fn chat_typed<T>(&self, messages: &[Message]) -> Result<T, LlmError>

where T: DeserializeOwned + JsonSchema + 'static, Self: Sized,

Send messages and parse the response into a typed value T.