pub struct RuntimeBedrockModel { /* private fields */ }Expand description
A model selected at runtime, including an exact inference-profile ID or ARN.
Token ceilings are supplied by the caller; this type does not discover account access, service limits, or model capabilities. Constructing it performs no I/O. Unlike some historical typed models, it never opts into global routing.
Implementations§
Trait Implementations§
Source§impl BedrockModel for RuntimeBedrockModel
impl BedrockModel for RuntimeBedrockModel
Source§fn bedrock_id(&self) -> &str
fn bedrock_id(&self) -> &str
The Bedrock model ID Read more
Source§fn default_inference_profile(&self) -> InferenceProfile
fn default_inference_profile(&self) -> InferenceProfile
The default inference profile for this model Read more
Source§impl Clone for RuntimeBedrockModel
impl Clone for RuntimeBedrockModel
Source§impl Debug for RuntimeBedrockModel
impl Debug for RuntimeBedrockModel
Source§impl Model for RuntimeBedrockModel
impl Model for RuntimeBedrockModel
Source§fn max_context_tokens(&self) -> usize
fn max_context_tokens(&self) -> usize
Maximum input context tokens
Source§fn max_output_tokens(&self) -> usize
fn max_output_tokens(&self) -> usize
Maximum output tokens the model can generate
Source§fn estimate_message_tokens(&self, messages: &[Message]) -> usize
fn estimate_message_tokens(&self, messages: &[Message]) -> usize
Estimate tokens for a conversation Read more
Source§fn estimate_content_block_tokens(&self, block: &ContentBlock) -> usize
fn estimate_content_block_tokens(&self, block: &ContentBlock) -> usize
Estimate tokens for a single content block
Auto Trait Implementations§
impl Freeze for RuntimeBedrockModel
impl RefUnwindSafe for RuntimeBedrockModel
impl Send for RuntimeBedrockModel
impl Sync for RuntimeBedrockModel
impl Unpin for RuntimeBedrockModel
impl UnsafeUnpin for RuntimeBedrockModel
impl UnwindSafe for RuntimeBedrockModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more