pub struct Layout {
pub seq_len: usize,
pub segments: Vec<Segment>,
pub pos: Vec<[f64; 3]>,
pub text_len: usize,
pub audio_t: usize,
pub latent_t: usize,
pub lat_h: usize,
pub lat_w: usize,
pub frame_rows: usize,
pub text_tags: Vec<u8>,
}Expand description
The static structure of one shape signature: where each stream sits in the sequence and what 3-D position every row carries.
Fields§
§seq_len: usize§segments: Vec<Segment>§pos: Vec<[f64; 3]>[seq_len, 3] — (t, h, w), f64 because the axes are fractional.
text_len: usize§audio_t: usize§latent_t: usize§lat_h: usize§lat_w: usize§frame_rows: usizeRows per latent frame after the 2×2 patch.
Per-token modality tag for the text span. A vision block inside the prompt carries the VIDEO tag, not the text one.
Implementations§
Source§impl Layout
impl Layout
Sourcepub fn t2va(
text_len: usize,
latent_t: usize,
lat_h: usize,
lat_w: usize,
audio_t: usize,
) -> Self
pub fn t2va( text_len: usize, latent_t: usize, lat_h: usize, lat_w: usize, audio_t: usize, ) -> Self
t2va: [text | audio | video], the target streams last and in
that order. Keyframe and reference blocks would slot between the
text and the audio; this port does text-to-video only.
Sourcepub fn fl2va(
text_len: usize,
latent_t: usize,
lat_h: usize,
lat_w: usize,
audio_t: usize,
frames: &[(usize, usize)],
text_tags: &[u8],
) -> Self
pub fn fl2va( text_len: usize, latent_t: usize, lat_h: usize, lat_w: usize, audio_t: usize, frames: &[(usize, usize)], text_tags: &[u8], ) -> Self
fl2va: keyframe condition rows sit between the text and the
audio, sharing the TARGET spatial grid, each pinned to the time
coordinate of the frame it stands for — the first frame at the
text’s end, the last one a whole clip further on, minus one
span. They never advance the cursor, so audio and video still
start where they would have.
frames gives each keyframe’s pixel index and the clip’s total,
and text_tags the per-token modality of the prompt span.
Sourcepub fn ref2va(
text_len: usize,
latent_t: usize,
lat_h: usize,
lat_w: usize,
audio_t: usize,
refs: &[Ref],
text_tags: &[u8],
) -> Self
pub fn ref2va( text_len: usize, latent_t: usize, lat_h: usize, lat_w: usize, audio_t: usize, refs: &[Ref], text_tags: &[u8], ) -> Self
ref2va: reference images, audio and clips ahead of the target
streams. Unlike a keyframe, a reference ADVANCES the cursor —
each block occupies its own stretch of the time axis, and the
target audio and video begin after the last of them.