pub struct VectorCompletionFlatTaskProfile {
pub path: Vec<u64>,
pub ensemble: EnsembleBase,
pub profile: Vec<Decimal>,
pub messages: Vec<Message>,
pub tools: Option<Vec<Tool>>,
pub responses: Vec<RichContent>,
}Expand description
A flattened vector completion task ready for execution.
The leaf task type. Contains everything needed to run a vector completion: the Ensemble of LLMs, their weights from the Profile, and the compiled messages/responses.
Fields§
§path: Vec<u64>Path to this task in the Function tree (indices into tasks arrays).
ensemble: EnsembleBaseThe Ensemble configuration with LLMs and their settings.
profile: Vec<Decimal>The weights for each LLM in the Ensemble (from the Profile).
messages: Vec<Message>The compiled messages for the vector completion.
tools: Option<Vec<Tool>>Optional tools for the vector completion (read-only context).
responses: Vec<RichContent>The compiled response options the LLMs will vote on.
Implementations§
Trait Implementations§
Source§impl Clone for VectorCompletionFlatTaskProfile
impl Clone for VectorCompletionFlatTaskProfile
Source§fn clone(&self) -> VectorCompletionFlatTaskProfile
fn clone(&self) -> VectorCompletionFlatTaskProfile
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for VectorCompletionFlatTaskProfile
impl RefUnwindSafe for VectorCompletionFlatTaskProfile
impl Send for VectorCompletionFlatTaskProfile
impl Sync for VectorCompletionFlatTaskProfile
impl Unpin for VectorCompletionFlatTaskProfile
impl UnwindSafe for VectorCompletionFlatTaskProfile
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more