cai 0.3.0

The fastest CLI tool for prompting LLMs (powered by Groq AI)
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44

# `cai` - The fastest CLI tool for prompting LLMs

- Prompt the best AIs directly from the terminal and faster than ever before! ⚡️
- Finishing often in **less than 1 second**. 🚀
- Build with Rust 🦀 and [Groq] for supreme performance and speed! 🏎️

![`cai` demo](./demos/main.gif)


## Installation

```sh
cargo install cai
```


## Usage

Before using Cai, an API key must be set up.
Simply execute `cai` in your terminal and follow the instructions.

Cai supports the following APIs:

- **Groq** (mixtral-8x7b-32768) -
    [Create new API key here](https://console.groq.com/keys).
- **OpenAI** (gpt-4-turbo-preview) -
    [Create new API key here](https://platform.openai.com/api-keys).
- **localhost:8080** - No API key required.

Afterwards, you can use `cai` to run prompts directly from the terminal:

```bash
cai list fast CLI tools
```

For more information, run:

```sh
cai help
```

---

### Follow [@AdrianSieber](https://x.com/AdrianSieber) for more! 🚀