pub struct LobeBudget {
pub max_tokens: u32,
pub max_duration: Option<Duration>,
pub streaming: bool,
}Expand description
Resource limits for a single lobe.
Fields§
§max_tokens: u32Max tokens this lobe can consume.
max_duration: Option<Duration>Max wall-clock time for this lobe.
streaming: boolWhether this lobe streams LLM tokens incrementally.
Default is false because lobes run in parallel — streaming multiple
lobes concurrently causes SSE I/O thrash with no user-visible benefit
(the synthesizer waits for all lobes anyway). Enable selectively for
lobes that need token-level progress reporting.
Trait Implementations§
Source§impl Clone for LobeBudget
impl Clone for LobeBudget
Source§fn clone(&self) -> LobeBudget
fn clone(&self) -> LobeBudget
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LobeBudget
impl Debug for LobeBudget
Source§impl Default for LobeBudget
impl Default for LobeBudget
Source§impl<'de> Deserialize<'de> for LobeBudget
impl<'de> Deserialize<'de> for LobeBudget
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LobeBudget
impl RefUnwindSafe for LobeBudget
impl Send for LobeBudget
impl Sync for LobeBudget
impl Unpin for LobeBudget
impl UnsafeUnpin for LobeBudget
impl UnwindSafe for LobeBudget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more