Struct rust_bert::gpt_neo::LayerState [−][src]
Expand description
Cache for GPT-Neo attention layers
Stores the cached value of key and value
Fields
prev_key: TensorCached keys
prev_value: Option<Tensor>Cached values
Trait Implementations
Auto Trait Implementations
impl RefUnwindSafe for LayerState
impl Send for LayerState
impl !Sync for LayerState
impl Unpin for LayerState
impl UnwindSafe for LayerState
Blanket Implementations
Mutably borrows from an owned value. Read more
Instruments this type with the provided Span, returning an
Instrumented wrapper. Read more
type Output = T
type Output = T
Should always be Self
