Struct SamplingManager

pub struct SamplingManager { /* private fields */ }

Sampling manager that handles requests for LLM sampling

Implementations

impl SamplingManager

pub fn new() -> Self

Create a new sampling manager

pub fn register_create_message_callback(&self, callback: CreateMessageCallback)

Register a create message callback

pub async fn create_message( &self, params: &CreateMessageParams, ) -> Result<CreateMessageResult>

Create a message using the registered callback

Trait Implementations

impl Default for SamplingManager

fn default() -> Self

Returns the “default value” for a type.