Module llm 

Structs

HttpDistiller

LlmEmbeddingProvider

LlmReranker

Functions

build_distiller

test_embedding

Test the embedding config. Returns Ok(dim) or Err.

test_llm

Test the LLM config by sending a minimal request. Returns Ok(model_response) or Err.