Struct PromptTuningLayer 

pub struct PromptTuningLayer { /* private fields */ }

Prompt tuning layer.

Maintains soft prompt embeddings that are prepended to input embeddings.

Implementations

impl PromptTuningLayer

pub fn new( config: PromptTuningConfig, device: &Device, ) -> Result<PromptTuningLayer, PeftError>

Create a new prompt tuning layer with random initialization.

Arguments

• config - Prompt tuning configuration
• device - Device to create tensors on

Errors

Returns an error if configuration validation fails or layer construction fails.

pub fn soft_prompt(&self) -> &Tensor

Get the soft prompt embeddings.

pub fn prepend_to_input( &self, input_embeds: &Tensor, ) -> Result<Tensor, PeftError>

Prepend soft prompts to input embeddings.

Arguments

• input_embeds - Input embeddings [batch, seq_len, hidden]

Returns

Concatenated embeddings [batch, num_virtual_tokens + seq_len, hidden]

Errors

Returns an error if tensor operations fail.

Trait Implementations

impl Adapter for PromptTuningLayer

type Config = PromptTuningConfig

The configuration type for this adapter.

fn forward( &self, input: &Tensor, _base_output: Option<&Tensor>, ) -> Result<Tensor, PeftError>

Forward pass applying the adapter transformation.

fn num_parameters(&self) -> usize

Get the number of trainable parameters.

fn config(&self) -> &<PromptTuningLayer as Adapter>::Config

Get the adapter’s configuration.