pub struct RemoteConfig {
pub logger: LoggerConfig<RemoteLogLevel>,
pub flush_threshold: usize,
pub flush_bytes_threshold: usize,
pub iroh_segmentation_offload: bool,
}Expand description
Configuration for the remote backend.
Fields§
§logger: LoggerConfig<RemoteLogLevel>Logger configuration for remote-backend logs (e.g. the bytes-saved metric of the fusion / op-graph caching feature).
flush_threshold: usizeFlush the outgoing task buffer once this many tasks have accumulated.
Wire-level batching only — every task keeps its own stream/request id, so the server sees the same per-task semantics. Larger values batch more aggressively (fewer, bigger frames); smaller values cut latency for chains of fire-and-forget submits.
flush_bytes_threshold: usizeFlush once this many bytes of buffered tensor data accumulate, independent of
flush_threshold.
Bounds how much tensor data sits unsent so large uploads go out promptly while small ops keep batching. Larger batches fewer/bigger frames; smaller cuts latency for data-heavy streams.
iroh_segmentation_offload: boolLet the Iroh endpoints Burn binds send segmentation-offloaded (GSO) batches.
Off by default: Iroh keeps sending them after the kernel refuses one, which stalls every open connection (iroh#4555).