pub enum ChatTemplateContentFormat {
Auto,
String(MediaPlaceholders),
OpenAi,
}Expand description
How message content is shaped before the HF chat template sees it, with
the semantics of vLLM’s --chat-template-content-format.
Variants§
Auto
Probe the template at load and pick a shape for it (Dynamo’s default).
String(MediaPlaceholders)
Flatten every message’s content to one string, as vLLM’s string
format does with its default interleave_mm_strings=False: one
placeholder per media item first, then the text parts, all joined
with \n.
OpenAi
Pass every message’s content as a list of parts, as vLLM’s openai
format does.
Trait Implementations§
Source§impl Clone for ChatTemplateContentFormat
impl Clone for ChatTemplateContentFormat
Source§impl Debug for ChatTemplateContentFormat
impl Debug for ChatTemplateContentFormat
Source§impl Default for ChatTemplateContentFormat
impl Default for ChatTemplateContentFormat
impl Eq for ChatTemplateContentFormat
impl StructuralPartialEq for ChatTemplateContentFormat
Auto Trait Implementations§
impl Forget for ChatTemplateContentFormat
impl Freeze for ChatTemplateContentFormat
impl RefUnwindSafe for ChatTemplateContentFormat
impl Send for ChatTemplateContentFormat
impl Sync for ChatTemplateContentFormat
impl Unpin for ChatTemplateContentFormat
impl UnsafeUnpin for ChatTemplateContentFormat
impl UnwindSafe for ChatTemplateContentFormat
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more