Re-exports§
pub use super::RKLLMExtendParam;pub use super::RKLLMLoraParam;pub use super::RKLLMParam;pub use super::RKLLMResultLastHiddenLayer;
Structs§
- Instance
Data - Internal structure to hold the callback handler.
- LLMHandle
- Handle to an LLM instance.
- RKLLM
Infer Param - Structure for defining parameters during inference.
- RKLLM
Input - Represents different types of input that can be provided to the LLM.
- RKLLM
Lora Adapter - RKLLM
Prompt Cache Param - Structure to define parameters for caching prompts.
- RKLLM
Result - Represents the result of an LLM inference.
Enums§
- Keep
History - LLMCall
State - Represents the state of an LLM call.
- RKLLM
Infer Mode - Defines the inference mode for the LLM.
- RKLLM
Input Role - The role of the user providing the input.
- RKLLM
Input Type - The type of input being provided to the LLM.
Traits§
- Rkllm
Callback Handler - Trait for handling callbacks from LLM operations.
Functions§
- rkllm_
init - Initializes the LLM with the given parameters.