List of all items

Structs

• vllm_completion
• vllm_engine
• vllm_model_params
• vllm_request
• vllm_sampling_params

Functions

• vllm_abi_version
• vllm_chat
• vllm_chat_stream
• vllm_complete
• vllm_complete_stream
• vllm_completion_free
• vllm_engine_free
• vllm_engine_load
• vllm_last_error
• vllm_model_params_default
• vllm_request_cancel
• vllm_request_done
• vllm_request_error
• vllm_request_free
• vllm_request_submit
• vllm_request_wait
• vllm_sampling_params_default
• vllm_string_free
• vllm_version

Type Aliases

• vllm_logits_processor
• vllm_status
• vllm_token_callback

Constants

• VLLM_ABI_VERSION
• vllm_status_VLLM_ERR_INVALID_ARGUMENT
• vllm_status_VLLM_ERR_MODEL_LOAD
• vllm_status_VLLM_ERR_RUNTIME
• vllm_status_VLLM_ERR_UNKNOWN
• vllm_status_VLLM_OK