pub enum GenerationError {
Show 30 variants
AlreadyFinished,
EmptyProposalBlock,
InvalidSpeculativeTransition,
IncompleteSpeculativeRound,
OptimisticPrefixDiverged,
EmptyOptimisticBranch,
OptimisticBranchAlreadyPresent,
UnknownSpeculativeRequest {
index: usize,
},
ProposalCapacityExceeded {
proposed: usize,
capacity: usize,
},
ActiveSpeculativeRequests,
MissingSpeculativeFinishReason {
index: usize,
},
ZeroDraftTokens,
NoBackendDraftCapacity,
InvalidTemperature(f32),
StochasticZeroTemperature,
InvalidMirostatTau(f32),
InvalidMirostatEta(f32),
InvalidTopK(i32),
InvalidTopP(f32),
InvalidMinP(f32),
InvalidRepetitionPenalty(f32),
InvalidFrequencyPenalty(f32),
InvalidPresencePenalty(f32),
ZeroTokenBudget,
ZeroInFlightVerifications,
TooManyLookaheadBlocks,
LookaheadWithoutBranchCapacity,
ZeroAdaptiveLookaheadWindow,
StalledSpeculativeSchedule,
InvalidSpeculativeStatusTransition {
from: SpeculativeRequestStatus,
to: SpeculativeRequestStatus,
},
}Expand description
Invalid backend-neutral generation configuration or state transition.
Variants§
AlreadyFinished
A token was committed after termination.
EmptyProposalBlock
A proposal transaction cannot be empty.
InvalidSpeculativeTransition
Proposal acceptance/rejection order was invalid.
IncompleteSpeculativeRound
No terminal outcome or replacement/bonus tail resolved the round.
OptimisticPrefixDiverged
Optimistic state was forked from a different prefix.
EmptyOptimisticBranch
An optimistic branch contained no proposals.
OptimisticBranchAlreadyPresent
A second optimistic branch was installed for one target transaction.
UnknownSpeculativeRequest
A speculative request identifier does not belong to this table.
ProposalCapacityExceeded
A promoted proposal block no longer fits the canonical request budget.
Fields
ActiveSpeculativeRequests
A speculative request table was consumed before reaching terminal state.
MissingSpeculativeFinishReason
A terminal speculative request did not retain its canonical finish reason.
ZeroDraftTokens
No assistant proposal may be generated per round.
NoBackendDraftCapacity
The selected backend cannot submit an assistant proposal.
InvalidTemperature(f32)
Temperature is NaN, infinite, or negative.
StochasticZeroTemperature
Stochastic sampling cannot use zero temperature.
InvalidMirostatTau(f32)
Mirostat V2 target surprise is non-finite or non-positive.
InvalidMirostatEta(f32)
Mirostat V2 adaptation rate is non-finite or non-positive.
InvalidTopK(i32)
Top-k is negative.
InvalidTopP(f32)
Top-p lies outside zero through one.
InvalidMinP(f32)
Min-p lies outside zero through one.
InvalidRepetitionPenalty(f32)
Repetition penalty is non-finite or non-positive.
InvalidFrequencyPenalty(f32)
Frequency penalty is non-finite.
InvalidPresencePenalty(f32)
Presence penalty is non-finite.
ZeroTokenBudget
An explicit token budget was zero.
ZeroInFlightVerifications
Scheduler cannot retain any target transaction.
TooManyLookaheadBlocks
Current scheduler supports no more than one lookahead block.
LookaheadWithoutBranchCapacity
Lookahead was enabled with no branch capacity.
ZeroAdaptiveLookaheadWindow
Adaptive lookahead needs a non-zero observation window.
StalledSpeculativeSchedule
Active requests expose no legal scheduler action.
InvalidSpeculativeStatusTransition
The requested speculative lifecycle edge is invalid.
Trait Implementations§
Source§impl Clone for GenerationError
impl Clone for GenerationError
Source§fn clone(&self) -> GenerationError
fn clone(&self) -> GenerationError
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for GenerationError
impl Debug for GenerationError
Source§impl Display for GenerationError
impl Display for GenerationError
Source§impl Error for GenerationError
impl Error for GenerationError
1.30.0 · Source§fn source(&self) -> Option<&(dyn Error + 'static)>
fn source(&self) -> Option<&(dyn Error + 'static)>
1.0.0 · Source§fn description(&self) -> &str
fn description(&self) -> &str
use the Display impl or to_string()