Skip to main content

embed_buffer_chunks_incremental

Function embed_buffer_chunks_incremental 

Source
pub fn embed_buffer_chunks_incremental(
    storage: &mut SqliteStorage,
    embedder: &dyn Embedder,
    buffer_id: i64,
    force_reembed: bool,
) -> Result<IncrementalEmbedResult>
Expand description

Incrementally embeds chunks in a buffer.

Only embeds chunks that:

  • Have no embedding, OR
  • Have an embedding from a different model (if force_reembed is true)

This is more efficient than embed_buffer_chunks for large buffers where only a few chunks have changed.

§Arguments

  • storage - The storage backend.
  • embedder - The embedder to use.
  • buffer_id - The buffer to embed.
  • force_reembed - If true, re-embeds chunks with different models.

§Returns

An IncrementalEmbedResult with statistics about what was done.

§Errors

Returns an error if embedding generation or storage fails.