Struct SplitResidualVectorQuantizer 

pub struct SplitResidualVectorQuantizer<T: Tensor> {
    pub rvq_first: ResidualVectorQuantizer<T>,
    pub rvq_rest: ResidualVectorQuantizer<T>,
    /* private fields */
}

Split residual vector quantizer used by Mimi.

Fields

rvq_first: ResidualVectorQuantizer<T>

First semantic codebook branch.

rvq_rest: ResidualVectorQuantizer<T>

Remaining acoustic codebook branch.

Implementations

impl<T: Tensor> SplitResidualVectorQuantizer<T>

pub fn encode(&mut self, latent: &T, context: &T::Context) -> Result<T, Error>

Encodes latent frames shaped [batch, 512, frames].

pub fn decode(&mut self, codes: &T, context: &T::Context) -> Result<T, Error>

Decodes tokens shaped [batch, codebooks, frames].

Trait Implementations

impl<T: Clone + Tensor> Clone for SplitResidualVectorQuantizer<T>

fn clone(&self) -> SplitResidualVectorQuantizer<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug + Tensor> Debug for SplitResidualVectorQuantizer<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.