autoagents-speech 0.3.7

Speech (TTS/STT) provider abstractions for AutoAgents
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77

//! # AutoAgents Speech
//!
//! Speech (TTS/STT) provider abstractions for the AutoAgents framework.
//!
//! This crate provides trait-based abstraction layers for speech providers, allowing
//! different backends to be used interchangeably within the AutoAgents ecosystem.
//!
//! ## Features
//!
//! ### TTS (Text-to-Speech)
//! - **Speech Generation**: Generate audio from text
//! - **Voice Management**: Use predefined voices
//! - **Streaming Support**: Optional streaming for real-time audio generation
//! - **Model Management**: Support for multiple models and languages
//!
//! ### STT (Speech-to-Text)
//! - **Transcription**: Convert audio to text
//! - **Streaming Support**: Real-time audio transcription
//! - **Timestamp Support**: Token-level timestamps for transcriptions
//! - **Multilingual**: Support for multiple languages with auto-detection
//!
//! ## Architecture
//!
//! The crate follows a trait-based design with provider implementations in the `providers` module:
//!
//! ### TTS Traits
//! - `TTSProvider`: Marker trait combining all TTS capabilities
//! - `TTSSpeechProvider`: Speech generation capabilities
//! - `TTSModelsProvider`: Model and language support
//!
//! ### STT Traits
//! - `STTProvider`: Marker trait combining all STT capabilities
//! - `STTSpeechProvider`: Transcription capabilities
//! - `STTModelsProvider`: Model and language support
//!
//! ## Providers
//!
//! Enable providers using feature flags:
//! - `pocket-tts`: Pocket-TTS model support (TTS)
//! - `parakeet`: Parakeet (NVIDIA) model support (STT)
//! - `vad`: Silero VAD support (speech segmentation)
//!

pub mod error;
pub mod model_source;
mod provider;
pub mod types;

// Provider implementations
pub mod providers;

// TTS utilities (sentence chunking, streaming pipeline)
pub mod tts;

// Re-export main TTS types
pub use error::{TTSError, TTSResult};
pub use provider::{TTSModelsProvider, TTSProvider, TTSSpeechProvider};
pub use tts::{ChunkerConfig, SentenceChunker, StreamingTtsPipeline};
pub use types::{
    AudioChunk, AudioData, AudioFormat, ModelInfo, SharedAudioData, SpeechRequest, SpeechResponse,
    VoiceIdentifier,
};

// Re-export main STT types
pub use error::{STTError, STTResult};
pub use model_source::ModelSource;
pub use provider::{STTModelsProvider, STTProvider, STTSpeechProvider};
pub use types::{TextChunk, TokenTimestamp, TranscriptionRequest, TranscriptionResponse};

#[cfg(feature = "playback")]
pub mod playback;

#[cfg(feature = "audio-capture")]
pub mod audio_capture;

#[cfg(feature = "vad")]
pub mod vad;