Struct SqliteSinkConfig 

pub struct SqliteSinkConfig {
    pub database_url: String,
    pub table_name: String,
    pub column_mapping: SqliteColumnMapping,
    pub batch_size: usize,
    pub max_connections: u32,
}

Configuration for the SQLite sink.

Fields

database_url: String

SQLite database URL (file path or :memory:).

table_name: String

Target table name.

column_mapping: SqliteColumnMapping

How to map JSON records to columns.

batch_size: usize

Maximum number of rows per multi-row INSERT. Defaults to DEFAULT_BATCH_SIZE (1000); the recommended value for SQLite.

When the upstream StreamPage carries more records than batch_size, the sink slices the page into batch_size-row chunks and issues one multi-row INSERT per chunk, each wrapped in its own BEGIN/COMMIT transaction. When batch_size = 0, the entire slice is written as a single multi-row INSERT inside one transaction — useful when the source already emits pages sized for SQLite (e.g. a Postgres source configured with batch_size: 1000).

batch_size = 0 is the “no batching” sentinel: upstream framing is preserved exactly, no internal re-chunking is performed.

max_connections: u32

Maximum number of connections in the pool. Defaults to 1.

SQLite serializes writers at the file level, so a single SQLite file can only ever have one writer at a time. A multi-connection pool against one file therefore races for the write lock and risks SQLITE_BUSY errors under concurrency; one writer is the safe default. Raise this only if your workload is read-heavy against a WAL database (the sink opens the pool in WAL mode with a busy_timeout, so extra connections can still read concurrently with the single writer).

Implementations

impl SqliteSinkConfig

pub fn new( database_url: impl Into<String>, table_name: impl Into<String>, ) -> Self

Create a new config with required fields and sensible defaults.

pub fn column_mapping(self, mapping: SqliteColumnMapping) -> Self

Set the column mapping strategy.

pub fn with_batch_size(self, batch_size: usize) -> Self

Set the maximum number of rows per multi-row INSERT.

Pass 0 to opt out of re-chunking — the entire records slice handed to write_batch is written in a single multi-row INSERT inside one transaction, preserving upstream StreamPage framing.

pub fn max_connections(self, n: u32) -> Self

Set the maximum number of connections in the pool.

Trait Implementations

impl Clone for SqliteSinkConfig

fn clone(&self) -> SqliteSinkConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SqliteSinkConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for SqliteSinkConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl JsonSchema for SqliteSinkConfig

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema.

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type.

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type.

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword.

impl Serialize for SqliteSinkConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.