pagoda 0.1.0

Zero-dependency LLM inference runtime in pure-std Rust: radix/block prefix cache, continuous batching, KV checkpoint, single-binary offline deploy
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
Pagoda
Copyright (C) 2026 quantz8a and contributors.

Pagoda is licensed under the Apache License, Version 2.0
(Apache-2.0). See LICENSE.

This product is an independent, from-scratch Rust implementation whose
architecture is derived from and inspired by SGLang
(https://github.com/sgl-project/sglang), which is also licensed under
the Apache License, Version 2.0.

No SGLang source code is copied into this repository. The design lineage
and the mapping to upstream SGLang components are documented in
docs/DESIGN.md. This notice is kept as attribution and provenance
documentation: pagoda and SGLang share the Apache-2.0 ecosystem, and we
aim to keep that relationship transparent and cooperative.