Module request 

Requests from a frontend to the engine (engine/io_struct.py).

Structs

SessionParams

Continual-prompting session of a request. Array layout, untagged.

TokenizedGenerateReqInput

A tokenized generate request, the payload of an ADD message.