Struct AiProxyPlugin 

pub struct AiProxyPlugin { /* private fields */ }

Proxies requests to LLM providers with streaming support.

Supports Anthropic, OpenAI, and any OpenAI-compatible custom endpoint (Ollama, Together, Groq, etc.). HTTPS endpoints require a TLS-terminating reverse proxy; plain HTTP endpoints (e.g. local Ollama) work directly.

Implementations

impl AiProxyPlugin

pub fn anthropic(api_key: &str, model: &str) -> Self

pub fn openai(api_key: &str, model: &str) -> Self

pub fn custom(base_url: &str, api_key: &str) -> Self

pub fn custom_with_model(base_url: &str, api_key: &str, model: &str) -> Self

Create a custom provider with an explicit model name included in the request body sent to the upstream endpoint.

pub fn provider(&self) -> &AiProvider

Returns a reference to the configured provider.

pub fn stream_completion( &self, messages: &[AiMessage], on_chunk: &mut dyn FnMut(&str), ) -> Result<String, String>

Stream a completion request to the configured provider.

Calls on_chunk for each text token received from the provider. Returns the full accumulated response text on success.

pub fn completion(&self, messages: &[AiMessage]) -> Result<String, String>

Non-streaming convenience wrapper. Waits for the full response.

Trait Implementations

impl Plugin for AiProxyPlugin

fn name(&self) -> &str

Unique name for this plugin.

fn on_init(&self, _ctx: &PluginContext)

Called once when the plugin is registered.

fn routes(&self) -> Vec<PluginRoute>

Custom API routes this plugin handles.

fn before_insert( &self, _entity: &str, _data: &mut Value, _auth: &AuthContext, ) -> Result<(), PluginError>

Called before an entity insert. Return Err to reject.

fn after_insert( &self, _entity: &str, _id: &str, _data: &Value, _auth: &AuthContext, )

Called after a successful insert.

fn before_update( &self, _entity: &str, _id: &str, _data: &mut Value, _auth: &AuthContext, ) -> Result<(), PluginError>

Called before an entity update. Return Err to reject.

fn after_update( &self, _entity: &str, _id: &str, _data: &Value, _auth: &AuthContext, )

Called after a successful update.

fn before_delete( &self, _entity: &str, _id: &str, _auth: &AuthContext, ) -> Result<(), PluginError>

Called before an entity delete. Return Err to reject.

fn after_delete(&self, _entity: &str, _id: &str, _auth: &AuthContext)

Called after a successful delete.

fn on_request( &self, _method: &str, _path: &str, _auth: &AuthContext, ) -> Result<(), PluginError>

Called on every incoming request (middleware).

fn on_request_with_meta( &self, method: &str, path: &str, auth: &AuthContext, _meta: &RequestMeta<'_>, ) -> Result<(), PluginError>

Richer variant of [on_request] that also receives per-request metadata (peer IP today; more fields may be added later). The default implementation delegates to on_request so existing plugins keep working without changes. Plugins that care about IP — notably rate limiting — override this hook.

fn on_session_create(&self, _user_id: &str, _token: &str)

Called when a new session is created.

fn entities(&self) -> Vec<ManifestEntity>

Additional manifest entities this plugin contributes.