pub struct HydraConfig {
pub vocab_size: usize,
pub hidden_size: usize,
pub num_layers: usize,
pub num_experts: usize,
pub top_k_experts: usize,
}Expand description
Model configuration derived from actual weights
Fields§
§vocab_size: usizeVocabulary size (32000 for Hydra - uses sentencepiece-like tokenizer)
Hidden dimension (192 for Hydra)
num_layers: usizeNumber of MoE layers (4 for Hydra)
num_experts: usizeNumber of experts per layer (4 for Hydra)
top_k_experts: usizeTop-k experts to activate (2 for Hydra)
Trait Implementations§
Source§impl Clone for HydraConfig
impl Clone for HydraConfig
Source§fn clone(&self) -> HydraConfig
fn clone(&self) -> HydraConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for HydraConfig
impl Debug for HydraConfig
Auto Trait Implementations§
impl Freeze for HydraConfig
impl RefUnwindSafe for HydraConfig
impl Send for HydraConfig
impl Sync for HydraConfig
impl Unpin for HydraConfig
impl UnwindSafe for HydraConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more