pub enum LlmSubcommand {
Test(LlmTestArgs),
Load(LlmLoadArgs),
Bench(LlmBenchArgs),
Report(LlmReportArgs),
Experiment(ExperimentArgs),
DataAudit(DataAuditArgs),
Sweep(LlmSweepArgs),
GenDataset(LlmGenDatasetArgs),
Score(LlmScoreArgs),
}Expand description
LLM subcommands
Variants§
Test(LlmTestArgs)
Run correctness tests against an LLM endpoint
Load(LlmLoadArgs)
Run concurrent load test against an LLM endpoint
Bench(LlmBenchArgs)
Run full benchmark lifecycle (start, warmup, measure, compare, teardown)
Report(LlmReportArgs)
Generate reports from test results
Experiment(ExperimentArgs)
ML experiment tracking with data audits, budget gates, and early stopping
DataAudit(DataAuditArgs)
Pre-flight data quality audit for training data
Sweep(LlmSweepArgs)
Sweep concurrency levels to find optimal operating point
GenDataset(LlmGenDatasetArgs)
Generate synthetic JSONL dataset for workload-driven benchmarking
Score(LlmScoreArgs)
Compute weighted performance scores for runtime comparison
Trait Implementations§
Source§impl Debug for LlmSubcommand
impl Debug for LlmSubcommand
Source§impl FromArgMatches for LlmSubcommand
impl FromArgMatches for LlmSubcommand
Source§fn from_arg_matches(__clap_arg_matches: &ArgMatches) -> Result<Self, Error>
fn from_arg_matches(__clap_arg_matches: &ArgMatches) -> Result<Self, Error>
Source§fn from_arg_matches_mut(
__clap_arg_matches: &mut ArgMatches,
) -> Result<Self, Error>
fn from_arg_matches_mut( __clap_arg_matches: &mut ArgMatches, ) -> Result<Self, Error>
Source§fn update_from_arg_matches(
&mut self,
__clap_arg_matches: &ArgMatches,
) -> Result<(), Error>
fn update_from_arg_matches( &mut self, __clap_arg_matches: &ArgMatches, ) -> Result<(), Error>
Assign values from
ArgMatches to self.Source§fn update_from_arg_matches_mut<'b>(
&mut self,
__clap_arg_matches: &mut ArgMatches,
) -> Result<(), Error>
fn update_from_arg_matches_mut<'b>( &mut self, __clap_arg_matches: &mut ArgMatches, ) -> Result<(), Error>
Assign values from
ArgMatches to self.Source§impl Subcommand for LlmSubcommand
impl Subcommand for LlmSubcommand
Source§fn augment_subcommands<'b>(__clap_app: Command) -> Command
fn augment_subcommands<'b>(__clap_app: Command) -> Command
Source§fn augment_subcommands_for_update<'b>(__clap_app: Command) -> Command
fn augment_subcommands_for_update<'b>(__clap_app: Command) -> Command
Append to
Command so it can instantiate self via
FromArgMatches::update_from_arg_matches_mut Read moreSource§fn has_subcommand(__clap_name: &str) -> bool
fn has_subcommand(__clap_name: &str) -> bool
Test whether
Self can parse a specific subcommandAuto Trait Implementations§
impl Freeze for LlmSubcommand
impl RefUnwindSafe for LlmSubcommand
impl Send for LlmSubcommand
impl Sync for LlmSubcommand
impl Unpin for LlmSubcommand
impl UnsafeUnpin for LlmSubcommand
impl UnwindSafe for LlmSubcommand
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more