Struct ProfileReq 

pub struct ProfileReq {
    pub rid: Option<StrOrList>,
    pub http_worker_ipc: Option<String>,
    pub kind: i64,
    pub output_dir: Option<String>,
    pub start_step: Option<i64>,
    pub num_steps: Option<i64>,
    pub activities: Option<Vec<String>>,
    pub profile_by_stage: bool,
    pub with_stack: Option<bool>,
    pub record_shapes: Option<bool>,
    pub profile_id: Option<String>,
}

Start (kind 1) or stop (kind 2) the profiler.

Fields

rid: Option<StrOrList>

Request id; control operations rarely set it.

http_worker_ipc: Option<String>

In-process HTTP worker address; unused across processes.

kind: i64

ProfileReqType: 1 starts, 2 stops.

output_dir: Option<String>

Where traces go.

start_step: Option<i64>

The forward step to start at.

num_steps: Option<i64>

Steps to profile before stopping.

activities: Option<Vec<String>>

What to record (CPU, GPU, MEM, …).

profile_by_stage: bool

One trace per stage (prefill, decode).

with_stack: Option<bool>

Record Python stacks.

record_shapes: Option<bool>

Record tensor shapes.

profile_id: Option<String>

Names the trace files.

Trait Implementations

impl Clone for ProfileReq

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProfileReq

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ProfileReq

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ProfileReq

impl Wire for ProfileReq

fn encode(&self, encoder: &mut Encoder)

Append this value to a message.

fn decode(decoder: &mut Decoder<'_>) -> Result<Self>

Read one value of this type.