hanzo-server-core 0.6.1

Hanzo Engine - fast, flexible LLM inference engine written in Rust.
Documentation

hanzo-server-core

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 15 feature flags, 1 of them enabled by default.

default

swagger-ui (default)

accelerate

accelerate-src

code-execution

cuda

cudnn

flash-attn

flash-attn-v3

intel-mkl-src

metal

mkl

nccl

ring

rocm

vulkan