Skip to main content

Module runtime

rnn

Module runtime 

Source

Structs§

BudgetFit
RuntimeEstimate
RuntimeFlopsEstimate
RuntimeProfile
ThroughputEstimate

Enums§

RuntimeError

Functions§

check_runtime_budget
estimate_runtime_flops
estimate_runtime_memory
estimate_tokens_per_second
fit_from_estimate