cai - The fastest CLI tool for prompting LLMs

Features

• Build with Rust 🦀 for supreme performance and speed! 🏎️
• Support for models by Groq, OpenAI, Anthropic, and local LLMs. 📚
• Prompt several models at once. 🤼
• Syntax highlighting for better readability of code snippets. 🌈

Demo

Installation

cargo install cai

Usage

Before using Cai, an API key must be set up. Simply execute cai in your terminal and follow the instructions.

Cai supports the following APIs:

• Groq - Create new API key.
• OpenAI - Create new API key.
• Anthropic - Create new API key.
• localhost:8080 - Any OpenAI API compatible local server (E.g. llamafile)

Afterwards, you can use cai to run prompts directly from the terminal:

cai List 10 fast CLI tools

Or a specific model, like Anthropic's Claude Opus:

cai op List 10 fast CLI tools

Full help output:

$ cai help
Cai 0.4.0

The fastest CLI tool for prompting LLMs

Usage: cai [PROMPT]...
       cai <COMMAND>

Commands:
  mixtral        Groq's Mixtral [aliases: mi]
  gpt-turbo      OpenAI's GPT 4 Turbo [aliases: tu]
  gpt            OpenAI's GPT 4 [aliases: gp]
  claude-opus    Anthropic's Claude Opus [aliases: op]
  claude-sonnet  Anthropic's Claude Sonnet [aliases: so]
  claude-haiku   🏆 Default | Anthropic's Claude Haiku [aliases: ha]
  llamafile      Llamafile server hosted at http://localhost:8080 [aliases: lf]
  ollama         Ollama server hosted at http://localhost:11434 [aliases: ol]
  all            Send prompt to each provider's default model simultaneously (Claude Haiku, Groq Mixtral, GPT 4 Turbo,
                     Llamafile, Ollama Llama2)
  help           Print this message or the help of the given subcommand(s)

Arguments:
  [PROMPT]...  The prompt to send to the AI model

Options:
  -h, --help  Print help


Examples:
  # Send a prompt to the default model
  cai How heigh is the Eiffel Tower in meters

  # Send a prompt to each provider's default model
  cai all How heigh is the Eiffel Tower in meters

  # Send a prompt to Anthropic's Claude Opus (+ alias)
  cai claude-opus How heigh is the Eiffel Tower in meters
  cai op How heigh is the Eiffel Tower in meters

  # Send a prompt to locally running Ollama server
  cai ollama mistral How heigh is the Eiffel Tower in meters
  cai ol mistral How heigh is the Eiffel Tower in meters

  # Add data via stdin
  cat main.rs | cai Explain this code

Related

• AI CLI - Get answers for CLI commands from ChatGPT. (TypeScript)
• AIChat - All-in-one chat and copilot CLI for 10+ AI platforms. (Rust)
• ja - CLI / TUI app to work with AI tools. (Rust)
• llm - Access large language models from the command-line. (Python)
• smartcat - Integrate LLMs in the Unix command ecosystem. (Rust)
• tgpt - AI chatbots for the terminal without needing API keys. (Go)