Skip to main content

LayaGraph

Struct LayaGraph 

Source
pub struct LayaGraph {
    pub tok_embeddings: W,
    pub embed_norm: W,
    pub layers: Vec<EncoderLayer>,
    pub final_norm: W,
    pub type_emb: W,
    pub head: Vec<HeadLayer>,
    pub scorer_norm: Affine,
    pub scorer_in: Affine,
    pub scorer_out: Affine,
    pub act_in: Affine,
    pub act_out: Affine,
    pub temperature: W,
}
Expand description

The whole compat graph with every weight bound.

Fields§

§tok_embeddings: W

[vocab, d].

§embed_norm: W

[d].

§layers: Vec<EncoderLayer>

Encoder layers in order.

§final_norm: W

[d].

§type_emb: W

[3, d], one row per question type.

§head: Vec<HeadLayer>

Decision head layers in order.

§scorer_norm: Affine

LayerNorm, scorer.0.

§scorer_in: Affine

scorer.1, [d, d].

§scorer_out: Affine

scorer.3, [1, d].

§act_in: Affine

act_head.0, [256, d + 4].

§act_out: Affine

act_head.2, [2, 256].

§temperature: W

[3], the calibrated temperatures stored in the checkpoint.

Implementations§

Source§

impl LayaGraph

Source

pub fn bind(spec: &LayaSpec, tensors: &Tensors) -> Result<Self, Error>

Binds every weight of the graph to tensors, checking names, shapes and dtypes.

§Errors

Error::Mismatch listing every missing tensor, extra tensor, wrong shape and non float dtype, in that order.

§Panics

Never. Binding looks up only names the check above has found.

Source

pub fn plan(&self, spec: &LayaSpec) -> Graph

The forward pass as ops for a backend to lower, the graph in the module comment. Values are token rows until the markers are gathered, and a backend runs each op on the rows the batch has.

Trait Implementations§

Source§

impl Clone for LayaGraph

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for LayaGraph

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl PartialEq for LayaGraph

Source§

fn eq(&self, other: &Self) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl StructuralPartialEq for LayaGraph

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.