List of all items

Structs

• AckMessage
• ActivationDescriptor
• DecodeTokenMessage
• ErrorMessage
• FinalPrefillChunkMessage
• MessageBase
• PeerConfig
• PrefillChunkMessage
• ReadyMessage
• StageConfig
• StageDevice
• StageIdentity
• StageKvCacheConfig
• StageTopology
• StageTopologyEntry
• StateExportMessage
• StateImportMessage
• StopMessage
• TokenReplyMessage
• binary::StageLogitBias
• binary::StageNativeMtpDraft
• binary::StageReply
• binary::StageReplyStats
• binary::StageReplyWindow
• binary::StageRequestEpoch
• binary::StageSamplingConfig
• binary::StageStateHeader
• binary::StageWireMessage
• proto::stage::CancelPrepareStage
• proto::stage::ClaimCoordinator
• proto::stage::CoordinatorClaimAccepted
• proto::stage::GetLayerInventory
• proto::stage::GetStageStatus
• proto::stage::LayerInventory
• proto::stage::LayerRange
• proto::stage::LoadStage
• proto::stage::PrepareStage
• proto::stage::PrepareStageAccepted
• proto::stage::StageArtifactTransferRequest
• proto::stage::StageArtifactTransferResponse
• proto::stage::StageControlRequest
• proto::stage::StageControlResponse
• proto::stage::StageDevice
• proto::stage::StagePeer
• proto::stage::StagePreparationStatus
• proto::stage::StageReady
• proto::stage::StageStatus
• proto::stage::StageStatusAck
• proto::stage::StageStatusList
• proto::stage::StageStatusUpdate
• proto::stage::StageTransportOpen
• proto::stage::StopStage
• tokenizer::TokenizeRequest
• tokenizer::TokenizeResponse
• tokenizer::TokenizerIdentity

Enums

• ActivationDType
• ActivationLayout
• FlashAttentionType
• LoadMode
• MessageKind
• StageFrameError
• StageKvCacheMode
• StageKvCachePayload
• StageMessage
• binary::WireActivationDType
• binary::WireMessageKind
• binary::WireReplyKind
• binary::WireStagePhase
• proto::stage::SourceModelKind
• proto::stage::StageFlashAttnType
• proto::stage::StageLoadMode
• proto::stage::StagePreparationState
• proto::stage::StageRuntimeState
• proto::stage::StageWireDType
• proto::stage::stage_control_request::Command
• proto::stage::stage_control_response::Response

Functions

• binary::activation_frame_flags_from_state_flags
• binary::activation_payload_multiplier_from_state_flags
• binary::activation_state_flags_from_frame_flags
• binary::activation_wire_bytes
• binary::activation_wire_bytes_with_state_flags
• binary::encode_f32_activation_payload
• binary::encode_f32_activation_payload_with_state_flags
• binary::read_stage_message
• binary::recv_ready
• binary::recv_reply
• binary::send_ready
• binary::send_reply_ack
• binary::send_reply_ack_with_stats
• binary::send_reply_message
• binary::send_reply_predicted
• binary::send_reply_predicted_tokens_with_stats
• binary::send_reply_predicted_tokens_with_window_and_stats
• binary::send_reply_predicted_with_stats
• binary::send_reply_predicted_with_tokens_and_stats
• binary::send_reply_predicted_with_tokens_window_and_stats
• binary::write_stage_message
• validate_stage_artifact_transfer_request
• validate_stage_artifact_transfer_response
• validate_stage_control_request
• validate_stage_control_response
• validate_stage_transport_open

Constants

• MAX_STAGE_FRAME_BYTES
• MAX_VERIFY_WINDOW_PIPELINE_DEPTH
• SCHEMA_VERSION
• STAGE_ALPN_V2
• STAGE_PROTOCOL_GENERATION
• STAGE_STREAM_ARTIFACT_TRANSFER
• STAGE_STREAM_CONTROL
• STAGE_STREAM_TRANSPORT
• STAGE_SUBPROTOCOL_FEATURE_ARTIFACT_TRANSFER
• STAGE_SUBPROTOCOL_FEATURE_STAGE_CONTROL
• STAGE_SUBPROTOCOL_FEATURE_STAGE_GENERATION
• STAGE_SUBPROTOCOL_FEATURE_STAGE_PROTOCOL_GENERATION_V4
• STAGE_SUBPROTOCOL_FEATURE_STATUS_LIST
• STAGE_SUBPROTOCOL_MAJOR
• STAGE_SUBPROTOCOL_NAME
• binary::ACTIVATION_FLAG_GEMMA3N_ALTUP
• binary::ACTIVATION_FLAG_INKLING_MTP_EMBD
• binary::ACTIVATION_FLAG_RWKV7_V_FIRST
• binary::LLAMA_TOKEN_NULL
• binary::MAX_STAGE_ACTIVATION_BYTES
• binary::MAX_STAGE_CHAT_SAMPLING_METADATA_BYTES
• binary::MAX_STAGE_DECODED_ACTIVATION_BYTES
• binary::MAX_STAGE_LOGIT_BIAS
• binary::MAX_STAGE_PREDICTED_TOKENS
• binary::MAX_STAGE_SIDEBAND_VALUES
• binary::MAX_STAGE_STATE_IMPORT_BYTES
• binary::READY_MAGIC
• binary::STAGE_LOGIT_BIAS_WIRE_BYTES
• binary::STAGE_SAMPLING_CONFIG_BASE_BYTES
• binary::STAGE_STATE_HEADER_BYTES
• binary::STAGE_STATE_VERSION
• binary::STAGE_WIRE_FIXED_HEADER_BYTES
• binary::state_flags::CHAT_SAMPLING_METADATA
• binary::state_flags::FINAL_CHUNK
• binary::state_flags::FULL_STATE
• binary::state_flags::GEMMA3N_ALTUP_SIDEBAND
• binary::state_flags::INKLING_MTP_EMBD_SIDEBAND
• binary::state_flags::LIGHT_CONTEXT
• binary::state_flags::RWKV7_V_FIRST_SIDEBAND
• binary::state_flags::SAMPLING
• tokenizer::MAX_TOKENIZE_INPUT_BYTES