Struct AzureBlobSourceConfig 

pub struct AzureBlobSourceConfig {
    pub connection: AzureConnection,
    pub prefix: Option<String>,
    pub object_keys: Option<Vec<String>>,
    pub file_format: AzureFileFormat,
    pub max_objects: Option<usize>,
    pub concurrency: usize,
    pub batch_size: usize,
    pub compression: CompressionConfig,
}

Available on crate features source-azure-blob and source-rest only.

Configuration for the Azure Blob source connector.

Fields

connection: AzureConnection

Azure connection (container, account, credentials, endpoint, …).

prefix: Option<String>

Object name prefix filter. Ignored when object_keys is set.

object_keys: Option<Vec<String>>

Explicit object names. When set, listing is skipped and prefix is ignored.

file_format: AzureFileFormat

File format.

max_objects: Option<usize>

Hard cap on the number of objects read (after listing).

concurrency: usize

Maximum concurrent object reads (default: 10).

batch_size: usize

Records per emitted StreamPage. batch_size = 0 is the “no batching” sentinel and emits one page per object.

compression: CompressionConfig

Available on crate feature compression only.

Compression codec applied to each downloaded object. Defaults to CompressionConfig::Auto — the codec is resolved per-object-key, so a single source can read a mix of compressed and uncompressed objects. Requires the crate-local compression feature.

Implementations

impl AzureBlobSourceConfig

pub fn new(container: impl Into<String>) -> AzureBlobSourceConfig

Create a new config for container with sensible defaults.

pub fn account(self, account: impl Into<String>) -> AzureBlobSourceConfig

Set the storage-account name.

pub fn auth(self, creds: AzureCredentials) -> AzureBlobSourceConfig

Set the credential source.

pub fn endpoint(self, endpoint: impl Into<String>) -> AzureBlobSourceConfig

Set a custom blob endpoint (emulator / sovereign cloud).

pub fn allow_http(self, allow: bool) -> AzureBlobSourceConfig

Permit plaintext HTTP (required for the Azurite emulator).

pub fn use_emulator(self, use_emulator: bool) -> AzureBlobSourceConfig

Target the Azurite emulator.

pub fn prefix(self, prefix: impl Into<String>) -> AzureBlobSourceConfig

Filter objects by name prefix.

pub fn object_keys(self, keys: Vec<String>) -> AzureBlobSourceConfig

Read an explicit set of object names (skips listing).

pub fn file_format(self, format: AzureFileFormat) -> AzureBlobSourceConfig

Set the object file format.

pub fn max_objects(self, max: usize) -> AzureBlobSourceConfig

Cap the number of objects read.

pub fn concurrency(self, concurrency: usize) -> AzureBlobSourceConfig

Set the maximum concurrent object reads.

pub fn with_batch_size(self, batch_size: usize) -> AzureBlobSourceConfig

Set the records-per-StreamPage hint.

pub fn compression(self, c: CompressionConfig) -> AzureBlobSourceConfig

Available on crate feature compression only.

Set the compression codec. Available only with the compression feature.

pub fn container(&self) -> &str

The container name.

Trait Implementations

impl Clone for AzureBlobSourceConfig

fn clone(&self) -> AzureBlobSourceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AzureBlobSourceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for AzureBlobSourceConfig

fn deserialize<__D>( __deserializer: __D, ) -> Result<AzureBlobSourceConfig, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl JsonSchema for AzureBlobSourceConfig

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema.

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type.

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type.

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword.

impl Serialize for AzureBlobSourceConfig

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.