inference-lab 0.6.1

High-performance LLM inference simulator for analyzing serving systems
Documentation