Expand description
Batch embedding client — issue #275.
Accepts a Vec<String>, splits into sub-batches up to max_batch_size,
sends each via AiTransport with retry, and reassembles results in the
original order. Empty texts are skipped; their positions get an empty
Vec<f32> in the output.
Issue #277 adds optional dedup cache and text chunking.
Structs§
- AiBatch
Client - Batch embedding client.
- AiTransport
Sender - Production backend: routes sub-batches through
AiTransport. - SubBatch
Request - One sub-batch worth of work.
- SubBatch
Response
Constants§
Traits§
- SubBatch
Sender - Backend abstraction. Production uses
AiTransportSender; tests use mocks.