cai - The fastest CLI tool for prompting LLMs

• Prompt the best AIs directly from the terminal and faster than ever before! ⚡️
• Finishing often in less than 1 second. 🚀
• Build with Rust 🦀 and [Groq] for supreme performance and speed! 🏎️

Installation

cargo install cai

Usage

Before using Cai, an API key must be set up. Simply execute cai in your terminal and follow the instructions.

Cai supports the following APIs:

• Groq (mixtral-8x7b-32768) - Create new API key here.
• OpenAI (gpt-4-turbo-preview) - Create new API key here.
• localhost:8080 - No API key required.

Afterwards, you can use cai to run prompts directly from the terminal:

cai list fast CLI tools

For more information, run:

cai help

Follow @AdrianSieber for more! 🚀