agentkit-provider-groq

Groq model adapter for the agentkit agent loop.

This crate provides GroqAdapter and GroqConfig for connecting the agent loop to the Groq chat completions API, which serves open-source models on custom LPU hardware. It handles request translation, response normalization, and usage reporting for Groq-backed sessions. Streaming is enabled by default; use .with_streaming(false) to force the buffered response path.

Configuration

Create a config with GroqConfig::new(api_key, model) and chain .with_*() builders for optional parameters. Alternatively, GroqConfig::from_env() reads from environment variables:

Examples

Minimal chat agent

use agentkit_loop::{Agent, SessionConfig};
use agentkit_provider_groq::{GroqAdapter, GroqConfig};

# #[tokio::main]
# async fn main() -> Result<(), Box<dyn std::error::Error>> {
let config = GroqConfig::new("gsk_...", "llama-3.3-70b-versatile");
let adapter = GroqAdapter::new(config)?;

let agent = Agent::builder()
    .model(adapter)
    .build()?;

let mut driver = agent
    .start(SessionConfig::new("demo"))
    .await?;

let step = driver.next().await?;
println!("{step:?}");
# Ok(())
# }

With model parameters

use agentkit_provider_groq::{GroqAdapter, GroqConfig};

# fn main() -> Result<(), Box<dyn std::error::Error>> {
let config = GroqConfig::new("gsk_...", "llama-3.3-70b-versatile")
    .with_temperature(0.0)
    .with_max_completion_tokens(4096);

let adapter = GroqAdapter::new(config)?;
# Ok(())
# }

Environment-based configuration with overrides

use agentkit_provider_groq::{GroqAdapter, GroqConfig};

# fn main() -> Result<(), Box<dyn std::error::Error>> {
let config = GroqConfig::from_env()?
    .with_temperature(0.0)
    .with_max_completion_tokens(512);

let adapter = GroqAdapter::new(config)?;
# Ok(())
# }