pub enum BenchRequestSourceInput {
Random {
input_tokens: BenchTokenSelectorInput,
output_tokens: BenchTokenSelectorInput,
prefix_sharing: Option<BenchPrefixSharingInput>,
shared_system_content: Option<BenchSharedSystemContentInput>,
corpus: Option<BenchCorpusInput>,
images: Option<BenchImagesInput>,
},
RandomMixture {
shapes: Vec<BenchRandomShapeInput>,
total_weight: u64,
prefix_sharing: Option<BenchPrefixSharingInput>,
},
Dataset {
dataset: String,
profile: Option<String>,
max_input_tokens: u32,
output_tokens: Option<u32>,
catalog: Box<BenchDatasetCatalogInput>,
},
Replay {
path: String,
expected_sha256: Option<String>,
prefix_sharing: Option<BenchPrefixSharingInput>,
},
}Expand description
One closed request origin lowered by Inferlab for the Bench runtime.
Variants§
Random
AIPerf generates exact token-shape prompts from the release-pinned synthetic generator.
Fields
§
input_tokens: BenchTokenSelectorInput§
output_tokens: BenchTokenSelectorInput§
prefix_sharing: Option<BenchPrefixSharingInput>§
corpus: Option<BenchCorpusInput>§
images: Option<BenchImagesInput>The effective per-request image decoration ([[RFC-0004:C-BENCH-REQUEST-SOURCES]]); absent when the source declares no images.
RandomMixture
AIPerf samples exact token-shape pairs from one seeded categorical distribution.
Dataset
Inferlab materializes a release-catalog conversation snapshot before AIPerf starts.
Fields
§
catalog: Box<BenchDatasetCatalogInput>Replay
Inferlab replays one workspace-local frozen population file unchanged; the file bytes are the sole population authority ([[RFC-0004:C-BENCH-REQUEST-SOURCES]]).
Trait Implementations§
Source§impl Clone for BenchRequestSourceInput
impl Clone for BenchRequestSourceInput
Source§impl Debug for BenchRequestSourceInput
impl Debug for BenchRequestSourceInput
Source§impl<'de> Deserialize<'de> for BenchRequestSourceInput
impl<'de> Deserialize<'de> for BenchRequestSourceInput
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl JsonSchema for BenchRequestSourceInput
impl JsonSchema for BenchRequestSourceInput
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for BenchRequestSourceInput
impl PartialEq for BenchRequestSourceInput
Source§impl Serialize for BenchRequestSourceInput
impl Serialize for BenchRequestSourceInput
impl StructuralPartialEq for BenchRequestSourceInput
Auto Trait Implementations§
impl Freeze for BenchRequestSourceInput
impl RefUnwindSafe for BenchRequestSourceInput
impl Send for BenchRequestSourceInput
impl Sync for BenchRequestSourceInput
impl Unpin for BenchRequestSourceInput
impl UnsafeUnpin for BenchRequestSourceInput
impl UnwindSafe for BenchRequestSourceInput
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more