Skip to main content

vllm_chat

vllm_cpp_sys

Function vllm_chat 

Source 
pub unsafe extern "C" fn vllm_chat(
    engine: *mut vllm_engine,
    request_json: *const c_char,
    out_response_json: *mut *mut c_char,
) -> vllm_status