Struct GemmaMultimodalConfig 

pub struct GemmaMultimodalConfig {
    pub vision: Option<GemmaVisionConfig>,
    pub audio: Option<GemmaAudioConfig>,
    pub image_token_id: Option<u32>,
    pub audio_token_id: Option<u32>,
    pub video_token_id: Option<u32>,
    pub boi_token_id: Option<u32>,
    pub eoi_token_id: Option<u32>,
    pub boa_token_id: Option<u32>,
    pub eoa_token_index: Option<u32>,
}

Bundle of multimodal sub-configs + the placeholder token ids the LM uses to mark where media projections go in the token stream.

Fields

vision: Option<GemmaVisionConfig>

audio: Option<GemmaAudioConfig>

image_token_id: Option<u32>

audio_token_id: Option<u32>

video_token_id: Option<u32>

boi_token_id: Option<u32>

eoi_token_id: Option<u32>

boa_token_id: Option<u32>

eoa_token_index: Option<u32>

Implementations

impl GemmaMultimodalConfig

pub fn from_file(path: &Path) -> Result<GemmaMultimodalConfig, Error>

Read the unified config and extract the multimodal blocks (vision_config, audio_config, image/audio/video token ids). Returns an empty config when none of them are present, so pre-Gemma-4 callers get a no-op value.

pub fn parse_json(raw: &str) -> Result<GemmaMultimodalConfig, Error>

Parse multimodal fields from a unified HF config.json string.

pub fn has_vision(&self) -> bool

pub fn has_audio(&self) -> bool

Trait Implementations

impl Clone for GemmaMultimodalConfig

fn clone(&self) -> GemmaMultimodalConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GemmaMultimodalConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for GemmaMultimodalConfig

fn default() -> GemmaMultimodalConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for GemmaMultimodalConfig

fn deserialize<__D>( __deserializer: __D, ) -> Result<GemmaMultimodalConfig, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl FromStr for GemmaMultimodalConfig

type Err = Error

The associated error which can be returned from parsing.

fn from_str( raw: &str, ) -> Result<GemmaMultimodalConfig, <GemmaMultimodalConfig as FromStr>::Err>

Parses a string s to return a value of this type.