Struct InferParams 

pub struct InferParams {
    pub prompt: String,
    pub provider: Option<String>,
    pub model: Option<String>,
    pub temperature: Option<f64>,
    pub max_tokens: Option<u32>,
    pub system: Option<String>,
    pub response_format: Option<ResponseFormat>,
    pub extended_thinking: Option<bool>,
    pub thinking_budget: Option<u64>,
    pub content: Option<Vec<ContentPart>>,
    pub guardrails: Vec<GuardrailConfig>,
}

Infer action - one-shot LLM call

Supports shorthand: infer: "prompt" or full form infer: { prompt: "..." }

LLM Control Options

• temperature: Control randomness (0.0-2.0, default varies by model)
• max_tokens: Limit output length
• system: System prompt to prepend

Extended Thinking

• extended_thinking: Enable Claude’s extended thinking for deeper reasoning
• thinking_budget: Token budget for extended thinking (1024-65536, default 4096)

Fields

prompt: String

provider: Option<String>

Override provider for this task

model: Option<String>

Override model for this task

temperature: Option<f64>

Temperature for sampling (0.0 = deterministic, 2.0 = maximum randomness)

max_tokens: Option<u32>

Maximum tokens to generate

system: Option<String>

System prompt to set context for the LLM

response_format: Option<ResponseFormat>

Expected response format: json, text, markdown

extended_thinking: Option<bool>

Enable extended thinking for deeper reasoning (Claude only)

thinking_budget: Option<u64>

Token budget for extended thinking (1024-65536, default 4096, Claude only)

content: Option<Vec<ContentPart>>

Multimodal content parts for vision models (text + images)

guardrails: Vec<GuardrailConfig>

Guardrails for validating infer output

Implementations

impl InferParams

pub fn validate(&self) -> Result<(), NikaError>

Validate infer parameters.

Errors

Returns an error string if:

• prompt is empty or whitespace-only
• temperature is outside valid range (0.0..=2.0)
• extended_thinking is true with non-Claude provider
• thinking_budget is outside valid range (1024..=65536)

pub fn effective_thinking_budget(&self) -> u64

Get effective thinking budget.

Returns the configured thinking_budget if set, otherwise returns the default value (4096).

Trait Implementations

impl Clone for InferParams

fn clone(&self) -> InferParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferParams

fn default() -> InferParams

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for InferParams

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.