Skip to main content

timed_send

llm_git::api

Function timed_send 

Source 
pub async fn timed_send(
    request_builder: RequestBuilder,
    label: &str,
    model: &str,
) -> Result<(StatusCode, String), CommitGenError>
Expand description

Send an HTTP request with timing instrumentation.

Measures TTFT (time to first byte / headers received) separately from total response time. Logs to stderr when LLM_GIT_TRACE=1.