Type Alias Groq

Source

pub type Groq = GenericOpenAI<GroqConfig>;

Available on crate feature groq only.

Expand description

The Groq struct encapsulates a Groq client that implements swiftide_core::SimplePrompt

There is also a builder available.

By default it will look for a GROQ_API_KEY environment variable. Note that a model always needs to be set, either with Groq::with_default_prompt_model or via the builder. You can find available models in the Groq documentation.

Under the hood it uses async_openai, with the Groq openai mapping. This means some features might not work as expected. See the Groq documentation for details.

Aliased Type§

pub struct Groq {
    pub stream_full: bool,
    /* private fields */
}

Fields§

§stream_full: bool

Convenience option to stream the full response. Defaults to true, because nobody has time to reconstruct the delta. Disabling this will make the streamed content only return the delta, for when performance matters. This only has effect when streaming is enabled.