inference-lab 0.6.2

High-performance LLM inference simulator for analyzing serving systems
Documentation