Skip to main content

Module tensor_role

Module tensor_role 

Source
Expand description

Semantic tensor roles mirroring llama.cpp llm_tensor / LLM_TN.

Architecture loaders resolve roles to concrete GGUF names once at load time. Hot-path kernels never see string names.

Enumsยง

TensorRole
Logical weight / activation tensor identity inside a decoder block.