Enum RKLLMInferMode 

pub enum RKLLMInferMode {
    InferGenerate = 0,
    InferGetLastHiddenLayer = 1,
}

Defines the inference mode for the LLM.

Variants

InferGenerate = 0

The LLM generates text based on the input. This is the default mode.

InferGetLastHiddenLayer = 1

The LLM retrieves the last hidden layer for further processing.

Trait Implementations

impl Clone for RKLLMInferMode

fn clone(&self) -> RKLLMInferMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RKLLMInferMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RKLLMInferMode

fn default() -> RKLLMInferMode

Returns the “default value” for a type.

impl Into<u32> for RKLLMInferMode

fn into(self) -> u32

Converts the enum variant to its underlying u32 value.

impl Copy for RKLLMInferMode