inference-lab 0.6.0

High-performance LLM inference simulator for analyzing serving systems
Documentation