Struct ExternalLocationConfig 

pub struct ExternalLocationConfig {
    pub threshold_bytes: usize,
    pub compression: Compression,
    pub storage: Arc<dyn ExternalStorage>,
    pub fetcher: Arc<dyn Fetcher>,
    pub url_validator: UrlValidator,
    pub max_decompressed_bytes: usize,
}

Externalization configuration.

Fields

threshold_bytes: usize

Payload size in bytes at which a batch is eligible for externalization. Smaller batches stay inline. Default 1 MiB.

compression: Compression

Compression applied to the IPC bytes before upload. Default Compression::None.

storage: Arc<dyn ExternalStorage>

Upload backend. Required when externalization is enabled.

fetcher: Arc<dyn Fetcher>

Resolver used on the read side. Required when resolving inbound pointer batches.

url_validator: UrlValidator

URL validator run on both the upload (post-signing) and fetch (pre-download) paths. Defaults to safe_https_validator, which rejects non-https URLs and internal/non-routable hosts. Reject a URL by returning Err.

max_decompressed_bytes: usize

Hard ceiling on the post-decompression size of a fetched payload. Zstd frames carry their decompressed size in the header and zstd::decode_all would otherwise trust it eagerly — a small malicious payload claiming gigabytes of output would OOM the client. Default 1 GiB. Set to usize::MAX to disable.

Implementations

impl ExternalLocationConfig

pub fn new(storage: Arc<dyn ExternalStorage>, fetcher: Arc<dyn Fetcher>) -> Self

pub fn with_threshold_bytes(self, n: usize) -> Self

pub fn with_compression(self, c: Compression) -> Self

pub fn with_url_validator(self, v: UrlValidator) -> Self

pub fn with_max_decompressed_bytes(self, n: usize) -> Self

Override the hard ceiling on post-decompression payload size. Pass usize::MAX to disable. Default is 1 GiB.

Trait Implementations

impl Clone for ExternalLocationConfig

fn clone(&self) -> ExternalLocationConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ExternalLocationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.