pub struct EmbeddingExecutorConfig {
pub max_batch_inputs: usize,
pub max_batch_text_bytes: usize,
pub max_input_text_bytes: usize,
pub max_request_inputs: usize,
pub max_request_text_bytes: usize,
pub max_batch_vector_bytes: usize,
pub max_request_vector_bytes: usize,
pub max_retries: u32,
pub base_retry_delay: Duration,
pub max_retry_delay: Duration,
pub request_timeout: Duration,
}Expand description
Hard limits and retry policy for one embedding executor generation.
Fields§
§max_batch_inputs: usize§max_batch_text_bytes: usize§max_input_text_bytes: usize§max_request_inputs: usize§max_request_text_bytes: usize§max_batch_vector_bytes: usize§max_request_vector_bytes: usize§max_retries: u32§base_retry_delay: Duration§max_retry_delay: Duration§request_timeout: DurationTrait Implementations§
Source§impl Clone for EmbeddingExecutorConfig
impl Clone for EmbeddingExecutorConfig
Source§fn clone(&self) -> EmbeddingExecutorConfig
fn clone(&self) -> EmbeddingExecutorConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for EmbeddingExecutorConfig
Source§impl Debug for EmbeddingExecutorConfig
impl Debug for EmbeddingExecutorConfig
Source§impl Default for EmbeddingExecutorConfig
impl Default for EmbeddingExecutorConfig
impl Eq for EmbeddingExecutorConfig
Source§impl PartialEq for EmbeddingExecutorConfig
impl PartialEq for EmbeddingExecutorConfig
impl StructuralPartialEq for EmbeddingExecutorConfig
Auto Trait Implementations§
impl Freeze for EmbeddingExecutorConfig
impl RefUnwindSafe for EmbeddingExecutorConfig
impl Send for EmbeddingExecutorConfig
impl Sync for EmbeddingExecutorConfig
impl Unpin for EmbeddingExecutorConfig
impl UnsafeUnpin for EmbeddingExecutorConfig
impl UnwindSafe for EmbeddingExecutorConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
Source§fn with_current_context(self) -> WithContext<Self> ⓘ
fn with_current_context(self) -> WithContext<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more