Skip to main content

Module http

Module http 

Source
Expand description

HTTP utilities and abstraction for LLM API calls

Structs§

HttpMetricsRecord
Information about an HTTP request for metrics collection.
HttpResponse
HTTP response from a non-streaming POST request
ReqwestHttpClient
Default HTTP client backed by reqwest
StreamingHttpResponse
HTTP response from a streaming POST request

Traits§

HttpClient
Abstraction over HTTP POST requests for LLM API calls.

Functions§

clear_http_metrics_callback
Clear the global HTTP metrics callback.
default_http_client
Create a default HTTP client
set_http_metrics_callback
Register a global HTTP metrics callback. The callback will be invoked after each HTTP request completes.

Type Aliases§

HttpMetricsCallback
Callback function type for HTTP metrics collection. The callback is called after each HTTP request completes.