Struct PrefixTuningLayer 

pub struct PrefixTuningLayer { /* private fields */ }

Prefix tuning layer.

Stores trainable prefix embeddings for keys and values.

Implementations

impl PrefixTuningLayer

pub fn new( config: PrefixTuningConfig, head_dim: usize, device: &Device, ) -> Result<PrefixTuningLayer, PeftError>

Create a new prefix tuning layer.

Arguments

• config - Prefix tuning configuration
• head_dim - Dimension per attention head
• device - Device to create tensors on

Errors

Returns an error if configuration validation fails or layer construction fails.

pub fn get_prefix_keys(&self, layer_idx: usize) -> Result<Tensor, PeftError>

Get prefix keys for a specific layer.

Errors

Returns an error if the layer index is out of bounds.

pub fn get_prefix_values(&self, layer_idx: usize) -> Result<Tensor, PeftError>

Get prefix values for a specific layer.

Errors

Returns an error if the layer index is out of bounds.

Trait Implementations

impl Adapter for PrefixTuningLayer

type Config = PrefixTuningConfig

The configuration type for this adapter.

fn forward( &self, input: &Tensor, _base_output: Option<&Tensor>, ) -> Result<Tensor, PeftError>

Forward pass applying the adapter transformation.

fn num_parameters(&self) -> usize

Get the number of trainable parameters.

fn config(&self) -> &<PrefixTuningLayer as Adapter>::Config

Get the adapter’s configuration.