Expand description
Sampling provider trait for tool-internal LLM access.
Allows tools and middleware to request LLM completions without taking a hard dependency on a specific model or MCP transport. Zero LLM calls happen during indexing — sampling is only invoked when explicitly needed (e.g. community summary generation, hierarchical narrowing ranking).
Structs§
- Noop
Sampling Provider - A sampling provider that is always unavailable.
- Sampling
Request - A request to the LLM for a text completion.
- Sampling
Response - A response from the LLM.
Enums§
- Sampling
Error - Error from a sampling call.
Traits§
- Sampling
Provider - Provides LLM sampling for tool-internal use.