docs.rs failed to build onnx-genai-engine-0.1.0
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Generation engine.
The core orchestrator that ties together:
- ORT sessions (model execution)
- KV cache manager (memory)
- Scheduler (batching)
- Logit processors (sampling)
- Speculative decoding (acceleration)