Modules§
Structs§
- Stage
Logit Bias - Stage
Native MtpDraft - A native MTP proposal associated with a stage reply.
- Stage
Reply - Stage
Reply Stats - Stage
Reply Window - Stage
Request Epoch - Stage
Sampling Config - Stage
State Header - Stage
Wire Message
Enums§
Constants§
- ACTIVATION_
FLAG_ GEMM A3N_ ALTUP - ACTIVATION_
FLAG_ INKLING_ MTP_ EMBD - ACTIVATION_
FLAG_ RWKV7_ V_ FIRST - LLAMA_
TOKEN_ NULL - MAX_
STAGE_ ACTIVATION_ BYTES - MAX_
STAGE_ CHAT_ SAMPLING_ METADATA_ BYTES - MAX_
STAGE_ DECODED_ ACTIVATION_ BYTES - MAX_
STAGE_ LOGIT_ BIAS - MAX_
STAGE_ PREDICTED_ TOKENS - MAX_
STAGE_ SIDEBAND_ VALUES - MAX_
STAGE_ STATE_ IMPORT_ BYTES - READY_
MAGIC - STAGE_
LOGIT_ BIAS_ WIRE_ BYTES - STAGE_
SAMPLING_ CONFIG_ BASE_ BYTES - STAGE_
STATE_ HEADER_ BYTES - STAGE_
STATE_ VERSION - STAGE_
WIRE_ FIXED_ HEADER_ BYTES
Functions§
- activation_
frame_ flags_ from_ state_ flags - activation_
payload_ multiplier_ from_ state_ flags - activation_
state_ flags_ from_ frame_ flags - activation_
wire_ bytes - activation_
wire_ bytes_ with_ state_ flags - encode_
f32_ activation_ payload - encode_
f32_ activation_ payload_ with_ state_ flags - read_
stage_ message - recv_
ready - recv_
reply - send_
ready - send_
reply_ ack - send_
reply_ ack_ with_ stats - send_
reply_ message - send_
reply_ predicted - send_
reply_ predicted_ tokens_ with_ stats - send_
reply_ predicted_ tokens_ with_ window_ and_ stats - send_
reply_ predicted_ with_ stats - send_
reply_ predicted_ with_ tokens_ and_ stats - send_
reply_ predicted_ with_ tokens_ window_ and_ stats - write_
stage_ message