pub struct BenchPrefixSharingInput {
pub shared_prefix_ratio: f64,
pub shared_prefix_tokens: u32,
pub unique_suffix_tokens: u32,
}Expand description
The effective split between one shared system-message prefix and each request’s independently generated user suffix.
Fields§
§unique_suffix_tokens: u32Trait Implementations§
Source§impl Clone for BenchPrefixSharingInput
impl Clone for BenchPrefixSharingInput
Source§fn clone(&self) -> BenchPrefixSharingInput
fn clone(&self) -> BenchPrefixSharingInput
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BenchPrefixSharingInput
impl Debug for BenchPrefixSharingInput
Source§impl<'de> Deserialize<'de> for BenchPrefixSharingInput
impl<'de> Deserialize<'de> for BenchPrefixSharingInput
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl JsonSchema for BenchPrefixSharingInput
impl JsonSchema for BenchPrefixSharingInput
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for BenchPrefixSharingInput
impl PartialEq for BenchPrefixSharingInput
Source§impl Serialize for BenchPrefixSharingInput
impl Serialize for BenchPrefixSharingInput
impl StructuralPartialEq for BenchPrefixSharingInput
Auto Trait Implementations§
impl Freeze for BenchPrefixSharingInput
impl RefUnwindSafe for BenchPrefixSharingInput
impl Send for BenchPrefixSharingInput
impl Sync for BenchPrefixSharingInput
impl Unpin for BenchPrefixSharingInput
impl UnsafeUnpin for BenchPrefixSharingInput
impl UnwindSafe for BenchPrefixSharingInput
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more