Expand description
Using the SDK, from loading a model to processing audio.
§SDK information
use aic_sdk;
// Get SDK version
println!("SDK version: {}", aic_sdk::get_sdk_version());
// Get compatible model version
println!("Compatible model version: {}", aic_sdk::get_compatible_model_version());§Loading models
Download models and find available IDs at https://artifacts.ai-coustics.io/.
§Load from file
use aic_sdk::Model;
let model = Model::from_file("path/to/model.aicmodel")?;§Embed at compile time
use aic_sdk::{Model, include_model};
static MODEL: &[u8] = include_model!("path/to/model.aicmodel");
let model = Model::from_buffer(MODEL)?;§Download from the CDN
Enable the download-model feature:
cargo add aic-sdk --features download-lib,download-modeluse aic_sdk::Model;
let model_path = Model::download("quail-vf-2.2-s-16khz", "./models")?;
let model = Model::from_file(&model_path)?;§Model information
// Get model ID
let model_id = model.id();
// Get optimal sample rate for the model
let optimal_rate = model.optimal_sample_rate();
// Get optimal block size for a specific sample rate
let optimal_block_size = model.optimal_block_size(48000);§Configuring the processor
use aic_sdk::{Processor, ProcessorConfig};
// Get optimal configuration for the model
let config = ProcessorConfig::optimal(&model).with_variable_block_size(false);
println!("{:?}", config); // ProcessorConfig { sample_rate: 48000, block_size: 480, variable_block_size: false }
// Or create from scratch
let config = ProcessorConfig {
sample_rate: 48000,
block_size: 480,
variable_block_size: false,
};
// Processor needs to be initialized before processing
// Option 1: Create and initialize in one step
let processor = Processor::new(&model, &license_key)?.with_config(&config)?;
// Option 2: Create first, then initialize separately
let mut processor = Processor::new(&model, &license_key)?;
processor.initialize(&config)?;§OpenTelemetry
By default, telemetry follows the SDK environment configuration, such as
AIC_SDK_OTEL_ENABLE. Use OtelConfig when a single processor or VAD needs an explicit
telemetry setting or session ID.
use aic_sdk::{OtelConfig, Processor};
let otel = OtelConfig::with_session_id("session-1");
let processor = Processor::with_otel_config(&model, &license_key, &otel)?
.with_config(&config)?;§Processing audio
let mut audio_block = vec![0.0f32; config.block_size];
processor.process(&mut audio_block)?;§Ending a session
A telemetry session is closed automatically when the processor is dropped. Call
terminate_session when the session has to end at a specific point instead, for example in
a lifecycle event. The processor cannot process audio afterwards.
processor.terminate_session()?;The same applies to Vad::terminate_session and Analyzer::terminate_session.
§Processor context
The processor context provides thread-safe access to processor parameters and state. You can create multiple contexts and move them to any thread for concurrent parameter updates.
use aic_sdk::ProcessorParameter;
// Get processor context
let proc_ctx = processor.context();
// Get the delay applied to the audio in samples
let delay = proc_ctx.audio_delay();
// Reset processor state (clears internal buffers)
proc_ctx.reset()?;
// Set enhancement parameters
proc_ctx.set_parameter(ProcessorParameter::EnhancementLevel, 0.8)?;
proc_ctx.set_parameter(ProcessorParameter::Bypass, 0.0)?;
// Get parameter values
let level = proc_ctx.parameter(ProcessorParameter::EnhancementLevel)?;
println!("Enhancement level: {}", level);§Voice activity detection
Voice activity detection runs on its own Vad instance, created from a dedicated VAD model
(e.g. vad-2.1-xxs-16khz). Enhancement models are rejected with
AicError::ModelTypeUnsupported.
use aic_sdk::{Model, ProcessorConfig, Vad};
let model = Model::from_file("path/to/vad_model.aicmodel")?;
let config = ProcessorConfig::optimal(&model);
let mut vad = Vad::new(&model, &license_key)?.with_config(&config)?;
// Feed mono audio to the detector. The audio block is not modified.
let audio_block = vec![0.0f32; config.block_size];
vad.process(&audio_block)?;When enhancement and VAD run together, feed the VAD the original input audio, not the processor’s enhanced output. Run both on the same block instead of chaining them:
let mut audio_block = vec![0.0f32; config.block_size];
vad.process(&audio_block)?; // reads the block, does not modify it
processor.process(&mut audio_block)?; // enhances the block in placeEnhancement is designed to change the signal, so running the VAD on its output means detecting speech in audio that no longer matches what the VAD model expects, and it stacks the processor’s audio delay on top of the VAD’s prediction delay.
The VAD context provides thread-safe access to the prediction, the VAD parameters and its state. You can create multiple contexts and move them to any thread for concurrent parameter updates.
use aic_sdk::VadParameter;
// Get VAD context from the VAD
let vad_ctx = vad.context();
// Configure VAD parameters. Sensitivity is the probability threshold of the model output.
vad_ctx.set_parameter(VadParameter::Sensitivity, 0.5)?;
vad_ctx.set_parameter(VadParameter::SpeechHoldDuration, 0.05)?;
vad_ctx.set_parameter(VadParameter::MinimumSpeechDuration, 0.0)?;
// Get parameter values
let sensitivity = vad_ctx.parameter(VadParameter::Sensitivity)?;
println!("VAD sensitivity: {}", sensitivity);
// How many samples the prediction lags behind the input. This delay is not applied to the
// audio, `Vad::process` leaves the buffer untouched.
let delay = vad_ctx.prediction_delay();
// Check for speech (after processing audio through the VAD)
if vad_ctx.is_speech_detected() {
println!("Speech detected!");
}
// Clear the prediction and all internal state, e.g. when the stream is interrupted
vad_ctx.reset()?;With the async feature, VadAsync mirrors ProcessorAsync for use in async contexts.
§Working with the analyzer
Instantiate an analyzer pair:
let (mut collector, mut analyzer) = aic_sdk::analyzer_pair(&model, &license_key)?;Initialize the collector, similar to the processor initialization:
let config = ProcessorConfig::optimal(&model);
collector.initialize(&config)?;Buffer the audio using Collector::buffer. It mirrors Processor::process; see
Processing audio.
Analyze the buffered audio in a separate thread:
let result = analyzer.analyze_buffered()?;
println!("Risk score: {}", result.risk_score);§Async processing
Enable the async feature to use ProcessorAsync, which offloads processing to a
background thread pool and returns a future. The implementation is runtime-agnostic and
works on any executor (tokio, smol, async-std, …). The pool defaults to one thread per
logical CPU; override with the AIC_NUM_THREADS environment variable.
cargo add aic-sdk --features asyncuse aic_sdk::{Model, ProcessorAsync, ProcessorConfig};
#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
let license_key = std::env::var("AIC_SDK_LICENSE")?;
let model = Model::from_file("path/to/model.aicmodel")?;
let config = ProcessorConfig::optimal(&model);
let processor = ProcessorAsync::new(&model, &license_key)?
.with_config(&config)
.await?;
// The async API takes ownership of the audio block and returns it back.
let audio = vec![0.0f32; config.block_size];
let audio = processor.process(audio).await?;
Ok(())
}