pub struct RemoteConfig {
pub logger: LoggerConfig<RemoteLogLevel>,
pub flush_threshold: usize,
pub flush_bytes_threshold: usize,
}Expand description
Configuration for the remote backend.
Fields§
§logger: LoggerConfig<RemoteLogLevel>Logger configuration for remote-backend logs (e.g. the bytes-saved metric of the fusion / op-graph caching feature).
flush_threshold: usizeFlush the outgoing task buffer once this many tasks have accumulated.
Wire-level batching only — every task keeps its own stream/request id, so the server sees the same per-task semantics. Larger values batch more aggressively (fewer, bigger frames); smaller values cut latency for chains of fire-and-forget submits.
flush_bytes_threshold: usizeFlush once this many bytes of buffered tensor data accumulate, independent of
flush_threshold.
Bounds how much tensor data sits unsent so large uploads go out promptly while small ops keep batching. Larger batches fewer/bigger frames; smaller cuts latency for data-heavy streams.
Trait Implementations§
Source§impl Clone for RemoteConfig
impl Clone for RemoteConfig
Source§fn clone(&self) -> RemoteConfig
fn clone(&self) -> RemoteConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RemoteConfig
impl Debug for RemoteConfig
Source§impl Default for RemoteConfig
impl Default for RemoteConfig
Source§impl<'de> Deserialize<'de> for RemoteConfig
impl<'de> Deserialize<'de> for RemoteConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for RemoteConfig
impl RefUnwindSafe for RemoteConfig
impl Send for RemoteConfig
impl Sync for RemoteConfig
impl Unpin for RemoteConfig
impl UnsafeUnpin for RemoteConfig
impl UnwindSafe for RemoteConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more