pub struct SglangArgs {
pub schedule_policy: Option<String>,
pub page_size: Option<usize>,
pub max_prefill_tokens: Option<usize>,
pub chunked_prefill_size: Option<usize>,
pub clip_max_new_tokens: Option<usize>,
pub schedule_conservativeness: Option<f64>,
}Expand description
SGLang-specific configuration parameters.
Grouped into a nested struct to keep the MockEngineArgs namespace clean,
following the same pattern as ReasoningConfig.
Fields§
§schedule_policy: Option<String>Scheduling policy: “fifo”/“fcfs” or “lpm”. Default: “fifo”.
page_size: Option<usize>Radix cache page size in tokens. Default: 1.
max_prefill_tokens: Option<usize>Maximum prefill tokens budget per batch. Default: 16384.
chunked_prefill_size: Option<usize>Chunked prefill size (max tokens per chunk). Default: 8192.
clip_max_new_tokens: Option<usize>Clip max new tokens for admission budget. Default: 4096.
schedule_conservativeness: Option<f64>Schedule conservativeness factor (0.0–1.0). Default: 1.0.
Trait Implementations§
Source§impl Clone for SglangArgs
impl Clone for SglangArgs
Source§fn clone(&self) -> SglangArgs
fn clone(&self) -> SglangArgs
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SglangArgs
impl Debug for SglangArgs
Source§impl Default for SglangArgs
impl Default for SglangArgs
Source§fn default() -> SglangArgs
fn default() -> SglangArgs
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for SglangArgs
impl<'de> Deserialize<'de> for SglangArgs
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Serialize for SglangArgs
impl Serialize for SglangArgs
Source§impl Validate for SglangArgs
impl Validate for SglangArgs
Source§impl<'v_a> ValidateArgs<'v_a> for SglangArgs
impl<'v_a> ValidateArgs<'v_a> for SglangArgs
Auto Trait Implementations§
impl Freeze for SglangArgs
impl RefUnwindSafe for SglangArgs
impl Send for SglangArgs
impl Sync for SglangArgs
impl Unpin for SglangArgs
impl UnsafeUnpin for SglangArgs
impl UnwindSafe for SglangArgs
Blanket Implementations§
impl<T> BlockMetadata for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more