Crate onwards 

Onwards - A flexible LLM proxy library

This library provides the core functionality for proxying requests to various LLM endpoints with support for authentication, model routing, and dynamic configuration.

Modules

auth

client

errors

handlers

models

target

Structs

AppState

The main application state containing the HTTP client and targets configuration

Functions

build_metrics_layer_and_handle

Builds a layer and handle for prometheus metrics collection.

build_metrics_router

Builds a router for the metrics endpoint.

build_router

Build the main router for the proxy This creates routes for:

extract_model_from_request

Extract the model name from a request