Expand description
§plato-audio-jepa
Audio / vibration JEPA for the PLATO nervous system. Processes microphone input into structured room state vectors suitable for downstream tiles.
Structs§
- Audio
Deadband - Spectral deadband filter — only process chunks when frequency content changes.
- Audio
Tile - Structured room state produced by the audio JEPA from a chunk of audio.
- Room
Audio State - 16-dimensional audio state vector for a room.
Functions§
- audio_
state_ to_ tile - Convert a RoomAudioState into an AudioTile (the output artifact).
- compute_
band_ energy - Compute the energy (sum of squares) in a frequency range.
- compute_
onset_ rate - Estimate the onset rate (sudden volume increases per unit time) from a volume history. Returns the rate of onsets.
- compute_
spectral_ centroid - Compute the spectral centroid (weighted mean of frequency bins). Returns a value in the range of the spectrum magnitudes.
- compute_
spectrum - Compute a simple DFT returning the magnitude of the first 16 frequency bins. Input is a window of time-domain samples (ideally power-of-2 length).
- detect_
rhythm - Estimate BPM from a volume envelope by counting peaks.
sample_rateis the rate of the volume-history samples (not audio samples).