opensourcellmrouter 0.7.0

A fast, local-first LLM router — proxy any OpenAI/Anthropic/Ollama client to your own provider pipeline with classifiers, cost/latency/random routing rules, plugins, a live dashboard, and a TUI.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36

//! `web`: augments a request with real-time web search results.
//!
//! Not yet implemented — enabling this plugin (via `[plugins.web]
//! enabled = true` or a request's `plugins` array) fails the request with a
//! clear error rather than silently doing nothing.
//!
//! To implement: configure a search backend (`base_url`, `api_key_env`,
//! `max_results`, similar to [`crate::config::ProviderConfig`]), call it
//! from `pre_request` with the last user message as the query, and prepend
//! the results to `req.system` as context.

use async_trait::async_trait;

use super::{Flow, Plugin, PluginContext};
use crate::canonical::{ChatRequest, ChatResponse};

pub struct WebSearchPlugin;

#[async_trait]
impl Plugin for WebSearchPlugin {
    fn id(&self) -> &'static str {
        "web"
    }

    async fn pre_request(
        &self,
        _ctx: &PluginContext,
        _req: &mut ChatRequest,
        _resp: &mut Option<ChatResponse>,
    ) -> anyhow::Result<Flow> {
        anyhow::bail!(
            "plugin 'web' (Web Search) is enabled but not yet implemented: configure a search \
             backend and implement WebSearchPlugin::pre_request"
        )
    }
}