Skip to main content

Module tuning

Module tuning 

Source
Expand description

Tuning module — resolution of SourceTuning from YAML + adaptive helpers.

Split into three concerns:

  • [profile] — config types, three baked-in profiles, SourceTuning, ResourceSummary. The bulk of the module’s surface lives here.
  • [memory] — pure schema-based memory estimation (estimate_row_bytes, [compute_batch_size_from_memory]).
  • [adaptive] — live-feedback batch sizing (next_adaptive_batch_size + the ADAPTIVE_* constants).

All public symbols are re-exported at the module root so existing crate::tuning::SourceTuning / crate::tuning::estimate_row_bytes paths keep working.

Structs§

SourceTuning
TuningConfig

Enums§

BatchMemoryPolicy
Action taken when a single Arrow batch exceeds max_batch_memory_mb.
TuningProfile

Constants§

ADAPTIVE_SAMPLE_INTERVAL
Number of batches between adaptive pressure samples.

Functions§

estimate_row_bytes
Estimate average row size in bytes from an Arrow schema.
merge_tuning_config
Layer export on top of source: each field uses export when set, otherwise source. None only when both inputs are None.
next_adaptive_batch_size
Decide the next adaptive fetch size from current pressure state.