Skip to main content

replace_kv_cache

tract_transformers::ops::dyn_kv_cache

Function replace_kv_cache 

Source 
pub fn replace_kv_cache(
    target: &mut TypedModel,
    source_node_id: usize,
) -> TractResult<Option<()>>
Expand description

Search pattern => Input -> Concat -> Output Return type is for using rule-ensure macro