Skip to main content

BedrockEmbedder

Struct BedrockEmbedder 

Source
pub struct BedrockEmbedder { /* private fields */ }
Expand description

Embeddings through Amazon Bedrock’s InvokeModel.

§Why this exists beside the OpenAI-compatible one

Bedrock is the deployment that cannot reach the other driver: a plane chosen for Bedrock was usually chosen because its data may not leave a particular account, and telling it to call api.openai.com for the query text is the one thing it cannot do. Without this, semantic retrieval was unavailable to exactly the regulated deployments this crate is built for — the AWS SDK already being paid for by the bedrock feature.

Implementations§

Source§

impl BedrockEmbedder

Source

pub async fn from_env( region: impl Into<String>, model: impl Into<String>, dialect: EmbeddingDialect, ) -> Result<Self, StoreError>

Load the standard AWS credential chain for this region.

The same chain Bedrock::from_env documents, Bedrock API keys included — they cover InvokeModel.

§Errors

If the region is blank.

Source

pub fn from_client( client: Client, model: impl Into<String>, dialect: EmbeddingDialect, ) -> Result<Self, StoreError>

Build from an already configured AWS client.

The region is read from the client, not accepted beside it. It is half of Embedder::revision, which decides whether a stored vector belongs to the index being queried — so a region taken as a separate argument is a second copy of a fact the client already holds, free to disagree with the service the vectors actually came from. Two indexes built in different regions would then share one revision and be treated as comparable.

§Errors

If the client carries no region, or a blank one.

Source

pub const fn dimensions(self, dimensions: u32) -> Self

Ask Titan for a shortened vector.

Titan v2 accepts 256, 512 or 1024. Cohere does not take the parameter at all, so setting it there is refused rather than ignored — a ceiling that silently does nothing is the shape this crate refuses everywhere else.

Source

pub const fn pricing(self, pricing: Pricing) -> Self

What this model’s input tokens cost, so its calls count against a money ceiling.

Only Titan reports its input tokens on Bedrock, so a priced Cohere embedder refuses every call rather than reporting it free.

Trait Implementations§

Source§

impl Clone for BedrockEmbedder

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for BedrockEmbedder

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Embedder for BedrockEmbedder

Source§

fn revision(&self) -> String

Region, model and width.

The region is in it because a Bedrock model id names a model, not a deployment: the same id in two regions is two services, and a vector from one has no standing in an index built from the other. It is also the fact a compliance reader most wants on the record.

Source§

fn pricing(&self) -> Option<Pricing>

What this service’s tokens cost, when the deployment stated it. Read more
Source§

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Embedded, StoreError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Embed one text. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FromRef<T> for T
where T: Clone,

Source§

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.
Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

Source§

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.
Source§

impl<T> MaybeSend for T
where T: Send,

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more