Expand description
Service-processor trait signatures the cascaded path builds against (PROCESSOR-DESIGN §6.1) + no-op mock impls + the audio-intelligence traits.
These traits are frozen here so providers and the audio-intelligence layer
build against a stable surface. The core ships only the trait + a mock impl of
each, and the mock cascaded pipeline fixture test (mock-STT → mock-LLM →
mock-TTS through a real Pipeline) that provider
crates extend.
Modules§
- adapters
- Service-processor adapters — the public
FrameProcessorwrappers that lift a frozenSttService/LlmService/TtsService(incrate::service) into a pipeline node.
Structs§
- MockLlm
- A mock LLM: echoes the last user transcription back as a single LLM text + response framing. Provider implementations replace this with real backends.
- MockStt
- A mock STT: turns any audio chunk into a fixed final transcription. Provider implementations replace this with real backends.
- MockTts
- A mock TTS: turns text into a
TtsStarted+ oneTtsAudiochunk (silence sized to the text length) +TtsStopped. Provider implementations replace this with real backends. - Turn
Prediction - An end-of-turn prediction. Mirrors pipecat’s turn-analyzer output.
Enums§
- VadState
- VAD classification of a frame of audio. Mirrors pipecat
VADState.
Traits§
- LlmService
- Context-driven LLM. Consumes
LlmContext/LlmRun, emitsLlmResponseStart,LlmText*, optionalFunctionCallsStarted,LlmResponseEnd. - Realtime
LlmService - The realtime S2S contract (today’s
crate::realtime::RealtimeLlm— UNCHANGED shape, restated as the canonical service trait the processor wraps). - SttService
- Streaming speech→text. Consumes
InputAudio, emitsInterimTranscriptionthen finalTranscription. Mirrors pipecatSTTService. - TtsService
- Streaming text→speech. Consumes
TtsSpeak/Text, emitsTtsStarted,TtsAudio*,TtsStopped. Mirrors pipecatTTSService. - Turn
Analyzer - End-of-turn / semantic-completion analyzer. Mirrors pipecat
BaseTurnAnalyzer(Smart-Turn v2/v3 is the reference impl). - VadAnalyzer
- Voice-activity detector. Mirrors pipecat
VADAnalyzer. Silero (ONNX/ort) is the reference impl (behind thevad-ortfeature — the trait is always here).
Type Aliases§
- Realtime
Service Setup - Connection-time setup for a
RealtimeLlmService— the realtime S2S contract (today’scrate::realtime::RealtimeLlm, restated as the canonical service trait the processor wraps). Aliased to the existingRealtimeSetup. - Tool
- A tool declaration for the cascaded LLM service (alias to the existing
ToolDecldata shape so the realtime + cascaded paths agree).