cai - The fastest CLI tool for prompting LLMs

• Prompt the best AIs directly from the terminal and faster than ever before! ⚡️
• Finishing often in less than 1 second. 🚀
• Build with Rust 🦀 and [Groq] for supreme performance and speed! 🏎️

Installation

cargo install cai

Set API key

Supports the following APIs:

• Groq (mixtral-8x7b-32768) - Set environment variable GROQ_API_KEY
  (Create new API key here).
• OpenAI (gpt-4-turbo-preview) - Set environment variable OPENAI_API_KEY
  (Create new API key here).

Usage

Before using it, an API key must be set up. Simply execute cai in your terminal and follow the instructions.

Afterwards, you can use cai to run prompts directly from the terminal:

cai list fast CLI tools

Follow @AdrianSieber for more! 🚀