Struct OutputSafetyConfig 

pub struct OutputSafetyConfig {
    pub enabled: bool,
    pub toxicity_enabled: bool,
    pub toxicity_threshold: f32,
    pub block_on_critical: bool,
    pub hallucination_enabled: bool,
    pub hallucination_model: String,
    pub hallucination_threshold: f32,
    pub hallucination_min_response_length: usize,
}

Output safety configuration for response content analysis.

When enabled, the proxy analyses LLM response content for toxicity, PII leakage, secret exposure, and hallucination detection. This is a post-processing step that runs after the upstream response is received.

Example (YAML)

output_safety:
  enabled: true
  toxicity_enabled: true
  toxicity_threshold: 0.7
  block_on_critical: false
  hallucination_enabled: false
  hallucination_model: "vectara/hallucination_evaluation_model"
  hallucination_threshold: 0.5
  hallucination_min_response_length: 50

Fields

enabled: bool

Enable output safety analysis on LLM responses.

toxicity_enabled: bool

Enable toxicity detection on response content.

toxicity_threshold: f32

Confidence threshold for toxicity detection (0.0–1.0).

block_on_critical: bool

Block (replace) the response if critical toxicity is detected.

hallucination_enabled: bool

Enable hallucination detection on response content.

When enabled, response sentences are scored against the user’s prompt for factual consistency using a cross-encoder model.

hallucination_model: String

HuggingFace model ID for hallucination detection.

hallucination_threshold: f32

Threshold below which a sentence is considered potentially hallucinated (0.0–1.0). Sentences scoring below this are flagged.

hallucination_min_response_length: usize

Minimum response length (in characters) to run hallucination detection. Responses shorter than this are skipped to save compute.

Trait Implementations

impl Clone for OutputSafetyConfig

fn clone(&self) -> OutputSafetyConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OutputSafetyConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OutputSafetyConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OutputSafetyConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for OutputSafetyConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.