Struct Provider 

pub struct Provider { /* private fields */ }

Cloudflare Workers AI provider implementing anyllm::ChatProvider.

Wraps a worker::Ai binding to call AI models directly from within a Cloudflare Worker. No HTTP overhead: calls go through the Workers runtime’s internal AI binding.

Construction

Obtain the worker::Ai binding from the Worker’s Env:

let ai = env.ai("AI")?;
let provider = Provider::new(ai);

The "AI" string must match the binding name in wrangler.toml:

[ai]
binding = "AI"

Implementations

impl Provider

pub fn new(ai: Ai) -> Self

Create a new provider from a worker::Ai binding.

pub fn with_chat_capabilities( self, resolver: impl ChatCapabilityResolver, ) -> Self

Install a resolver consulted before the provider’s built-in capability logic.

Trait Implementations

impl ChatProvider for Provider

type Stream = Pin<Box<dyn Stream<Item = Result<StreamEvent, Error>> + Send>>

Concrete stream type returned by chat_stream

async fn chat(&self, request: &ChatRequest) -> Result<ChatResponse>

Send a chat completion request and return the full response.

async fn chat_stream(&self, request: &ChatRequest) -> Result<ChatStream>

Send a chat completion request and return a stream of chunks.

fn chat_capability( &self, model: &str, capability: ChatCapability, ) -> CapabilitySupport

Returns support information for a provider/model capability query.

impl EmbeddingProvider for Provider

async fn embed(&self, request: &EmbeddingRequest) -> Result<EmbeddingResponse>

Send an embedding request and return ordered vectors.

fn embedding_capability( &self, _model: &str, capability: EmbeddingCapability, ) -> CapabilitySupport

Returns support information for a provider/model embedding capability.

impl ExtractExt for Provider

Available on crate feature extract only.

fn extract<'a, T>( &'a self, request: &'a ChatRequest, ) -> impl Future<Output = Result<Extracted<T>, Error>> + Send + 'a

where T: JsonSchema + DeserializeOwned + Send + 'a,

Extract structured data from a chat request.

impl ProviderIdentity for Provider

fn provider_name(&self) -> &'static str

Returns the provider identity name.