spawn_evaluation_tasks_with_embeddings

scouter_evaluate::util

Function spawn_evaluation_tasks_with_embeddings 

Source 
pub async fn spawn_evaluation_tasks_with_embeddings(
    workflow: Workflow,
    records: Vec<LLMEvalRecord>,
    embedder: Arc<Embedder>,
    config: &Arc<EvaluationConfig>,
) -> JoinSet<(String, Option<LLMEvalTaskResult>)>
Expand description

Spawn tasks to run evaluation workflows with embedding calculations

§Arguments

  • workflow - The workflow to execute for each record.
  • records - The list of LLMEvalRecords to process.
  • embedder - The Embedder instance to use for generating embeddings.
  • embedding_targets - The list of keys in the record’s context to generate embeddings.

§Returns

A JoinSet containing LLMEvalTaskResults for each record.