inference-lab 0.3.1

High-performance LLM inference simulator for analyzing serving systems
Documentation