squid-rs 0.4.0

An AI-powered command-line tool for code reviews and suggestions.
squid-rs-0.4.0 is not a library.

squid 🦑

An AI-powered command-line tool for code reviews and suggestions.

Features

  • 🤖 Chat with LLMs via OpenAI-compatible APIs
  • 📄 Provide file context for AI analysis
  • 🔍 AI-powered code reviews with language-specific prompts
  • 🔧 Tool calling support (file read/write/search operations) with security approval
  • 🔒 User approval required for all tool executions (read/write files)
  • 🌊 Streaming support for real-time responses
  • 🎨 Enhanced UI with styled prompts, emoji icons, and color-coded information
  • 🦑 Friendly squid assistant personality with professional responses
  • ⚙️ Configurable via environment variables
  • 🔌 Works with LM Studio, OpenAI, and other compatible services

Prerequisites

Before you begin, you'll need:

  1. Rust toolchain (for building squid)

    curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

  2. An OpenAI-compatible LLM service (choose one):

Option A: LM Studio (Recommended for Local Development)

LM Studio provides a user-friendly interface for running local LLMs.

  1. Download and install LM Studio from https://lmstudio.ai/
  2. Download a model - We recommend Qwen2.5-Coder for code-related tasks:
  3. Load the model - Select the downloaded model in LM Studio
  4. Start the local server:
    • Click the "Local Server" tab (↔️ icon on the left)
    • Click "Start Server"
    • Default endpoint: http://127.0.0.1:1234/v1
    • Note: No API key required for local server

Alternative models in LM Studio:

  • Meta-Llama-3.1-8B-Instruct - General purpose
  • deepseek-coder - Code-focused
  • Any other model compatible with your hardware

Option B: Ollama (Lightweight CLI Option)

Ollama is a lightweight, command-line tool for running LLMs.

  1. Install Ollama:

    # macOS
brew install ollama

# Linux
curl -fsSL https://ollama.com/install.sh | sh

# Or download from https://ollama.com/

  2. Start Ollama service:

    ollama serve

  3. Pull the recommended model - Qwen2.5-Coder:

    ollama pull qwen2.5-coder

  4. Verify it's running:

    ollama list  # Should show qwen2.5-coder
curl http://localhost:11434/api/tags  # API check

Alternative models in Ollama:

  • codellama - Code generation
  • deepseek-coder - Code understanding
  • llama3.1 - General purpose
  • See all at https://ollama.com/library

Option C: OpenAI API

Use OpenAI's cloud API for access to GPT models:

  1. Get an API key from https://platform.openai.com/api-keys
  2. Add credits to your OpenAI account
  3. Choose a model: gpt-4, gpt-4-turbo, gpt-3.5-turbo, etc.

Option D: Other OpenAI-Compatible Services

Squid works with any OpenAI-compatible REST API:

Installation

Install to Your System

cargo install --path .

This installs the squid command globally. You can then use squid from anywhere.

Or Build for Development

cargo build --release

For development, use cargo run -- instead of squid in the examples below.

Configuration

You can configure squid in two ways:

Option 1: Interactive Setup (Recommended)

Use the init command to create a squid.config.json file:

Interactive Mode (Default)

# Initialize in current directory
squid init

# Initialize in a specific directory
squid init ./my-project
squid init /path/to/project

This will prompt you for:

  • API URL: The base URL for your LLM service (e.g., http://127.0.0.1:1234/v1)
  • API Model: The model identifier (e.g., local-model, qwen2.5-coder, gpt-4)
  • API Key: Optional API key (leave empty for local models like LM Studio or Ollama)
  • Log Level: Logging verbosity (error, warn, info, debug, trace)

Example session:

$ squid init
INFO: Initializing squid configuration in "."...
? API URL: http://127.0.0.1:1234/v1
? API Model: local-model
? API Key (optional, press Enter to skip): 
? Log Level: info

Configuration saved to: "squid.config.json"
  API URL: http://127.0.0.1:1234/v1
  API Model: local-model
  API Key: [not set]
  Log Level: info

Non-Interactive Mode

You can also provide configuration values via command-line arguments to skip the interactive prompts:

# Initialize with all parameters
squid init --url http://127.0.0.1:1234/v1 --model local-model --log-level info

# Initialize in a specific directory with parameters
squid init ./my-project --url http://localhost:11434/v1 --model qwen2.5-coder --log-level debug

# Partial parameters (will prompt for missing values)
squid init --url http://127.0.0.1:1234/v1 --model gpt-4
# Will still prompt for API Key and Log Level

# Include API key for cloud services
squid init --url https://api.openai.com/v1 --model gpt-4 --api-key sk-your-key-here --log-level info

Available options:

  • --url <URL> - API URL (e.g., http://127.0.0.1:1234/v1)
  • --model <MODEL> - API Model (e.g., local-model, qwen2.5-coder, gpt-4)
  • --api-key <KEY> - API Key (optional for local models)
  • --log-level <LEVEL> - Log Level (error, warn, info, debug, trace)

The configuration is saved to squid.config.json in the specified directory (or current directory if not specified). This file can be committed to your repository to share project settings with your team.

Option 2: Manual Configuration

Create a .env file in the project root:

# OpenAI API Configuration (for LM Studio or OpenAI)
API_URL=http://127.0.0.1:1234/v1
API_MODEL=local-model
API_KEY=not-needed

Important Notes:

  • squid.config.json takes precedence over .env variables. If both exist, the config file will be used.
  • Commit squid.config.json to your repository to share project settings with your team
  • Keep .env private - it should contain sensitive information like API keys and is excluded from git
  • For cloud API services (OpenAI, etc.), store the actual API key in .env and omit api_key from squid.config.json

Configuration Options

  • API_URL: The base URL for the API endpoint

    • LM Studio: http://127.0.0.1:1234/v1 (default)
    • Ollama: http://localhost:11434/v1
    • OpenAI: https://api.openai.com/v1
    • Other: Your provider's base URL

  • API_MODEL: The model to use

    • LM Studio: local-model (uses whatever model is loaded)
    • Ollama: qwen2.5-coder (recommended) or any pulled model
    • OpenAI: gpt-4, gpt-3.5-turbo, etc.
    • Other: Check your provider's model names

  • API_KEY: Your API key

    • LM Studio: not-needed (no authentication required)
    • Ollama: not-needed (no authentication required)
    • OpenAI: Your actual API key (e.g., sk-...)
    • Other: Your provider's API key

  • LOG_LEVEL: Logging verbosity (optional, default: error)

    • error: Only errors (default)
    • warn: Warnings and errors
    • info: Informational messages
    • debug: Detailed debugging information
    • trace: Very verbose output

Usage

Note: The examples below use the squid command (after installation with cargo install --path .).
For development, replace squid with cargo run -- (e.g., cargo run -- ask "question").

Ask a Question

# Basic question (streaming by default)
squid ask "What is Rust?"

# With additional context using -m
squid ask "Explain Rust" -m "Focus on memory safety"

# Use a custom system prompt
squid ask "Explain Rust" -p custom-prompt.md

# Disable streaming for complete response at once (useful for scripting)
squid ask "Explain async/await in Rust" --no-stream

By default, responses are streamed in real-time, displaying tokens as they are generated. Use --no-stream to get the complete response at once (useful for piping or scripting).

Ask About a File

# Basic file question (streams by default)
squid ask -f sample-files/sample.txt "What are the key features mentioned?"

# With additional context using -m
squid ask -f src/main.rs "What does this do?" -m "Focus on error handling"

# Use a custom system prompt for specialized analysis
squid ask -f src/main.rs "Review this" -p expert-reviewer-prompt.md

# Disable streaming for complete response
squid ask -f code.rs --no-stream "Explain what this code does"

This will read the file content and include it in the prompt, allowing the AI to answer questions based on the file's content.

Review Code

# Review a file with language-specific prompts (streams by default)
squid review src/main.rs

# Focus on specific aspects
squid review styles.css -m "Focus on performance issues"

# Get complete review at once (no streaming)
squid review app.ts --no-stream

The review command automatically selects the appropriate review prompt based on file type:

  • Rust (.rs) - Ownership, safety, idioms, error handling
  • TypeScript/JavaScript (.ts, .js, .tsx, .jsx) - Type safety, modern features, security
  • HTML (.html, .htm) - Semantics, accessibility, SEO
  • CSS (.css, .scss, .sass) - Performance, responsive design, maintainability
  • Other files - Generic code quality and best practices

Tool Calling (with Security Approval)

The LLM has been trained to intelligently use tools when needed. It understands when to read, write, or search files based on your questions. For security, you'll be prompted to approve each tool execution:

# LLM intelligently reads files when you ask about them
squid ask "Read the README.md file and summarize it"
squid ask "What dependencies are in Cargo.toml?"
squid ask "Analyze the main.rs file for me"
# You'll be prompted: "Allow reading file: [filename]? (Y/n)"

# LLM can write files
squid ask "Create a hello.txt file with 'Hello, World!'"
# You'll be prompted with a preview: "Allow writing to file: hello.txt?"

# Use custom prompts with tool calling
squid ask -p expert-coder.md "Read Cargo.toml and suggest optimizations"

# LLM can search for patterns in files using grep
squid ask "Search for all TODO comments in the src directory"
squid ask "Find all function definitions in src/main.rs"
squid ask "Search for 'API_URL' in the project"
squid ask "Find all uses of 'unwrap' in the codebase"
squid ask "Show me all error handling patterns in src/tools.rs"
# You'll be prompted: "Allow searching for pattern '...' in: [path]? (Y/n)"
# Results show file path, line number, and matched content

# Use --no-stream for non-streaming mode
squid ask --no-stream "Read Cargo.toml and list all dependencies"

Available Tools:

  • 📖 read_file - Read file contents from the filesystem
  • 📝 write_file - Write content to files
  • 🔍 grep - Search for patterns in files using regex (supports directories and individual files)

Key Features:

  • 🤖 Intelligent tool usage - LLM understands when to read/write/search files from natural language
  • 🔒 Security approval - All tool executions require user confirmation
  • 📋 Content preview - File write operations show what will be written
  • ⌨️ Simple controls - Press Y to allow or N to skip
  • 📝 Full logging - All tool calls are logged for transparency
  • 🔍 Regex support - Grep tool supports regex patterns with configurable case sensitivity

Documentation

Testing

Try the code review and security features with the provided test scripts:

# Test code reviews (automated)
./tests/test-reviews.sh

# Test security approval (interactive)
./tests/test-security.sh

# Or test individual examples
squid review sample-files/example.rs
squid review sample-files/example.ts --stream
squid review sample-files/example.html -m "Focus on accessibility"

See tests/README.md for complete testing documentation and sample-files/README.md for details on each example file.

Examples

Using with LM Studio

  1. Download and install LM Studio from https://lmstudio.ai/
  2. Download the recommended model: lmstudio-community/Qwen2.5-Coder-7B-Instruct-MLX-4bit
  3. Load the model in LM Studio
  4. Start the local server (↔️ icon → "Start Server")
  5. Set up your .env: 
    API_URL=http://127.0.0.1:1234/v1
API_MODEL=local-model
API_KEY=not-needed
  6. Run: 
    squid ask "Write a hello world program in Rust"
# Or with a file
squid ask -f sample-files/sample.txt "What is this document about?"
# Use --no-stream for complete response at once
squid ask --no-stream "Quick question"

Using with Ollama

  1. Install Ollama from https://ollama.com/
  2. Start Ollama service: 
    ollama serve
  3. Pull the recommended model: 
    ollama pull qwen2.5-coder
  4. Set up your .env: 
    API_URL=http://localhost:11434/v1
API_MODEL=qwen2.5-coder
API_KEY=not-needed
  5. Run: 
    squid ask "Write a hello world program in Rust"
# Or with a file
squid ask -f mycode.rs "Explain this code"
# Use --no-stream if needed
squid ask --no-stream "Quick question"

Using with OpenAI

  1. Get your API key from https://platform.openai.com/api-keys
  2. Set up your .env: 
    API_URL=https://api.openai.com/v1
API_MODEL=gpt-4
API_KEY=sk-your-api-key-here
  3. Run: 
    squid ask "Explain the benefits of Rust"
# Or analyze a file
squid ask -f mycode.rs "Review this code for potential improvements"
# Use --no-stream for scripting
result=$(squid ask --no-stream "Generate a function name")

License

Apache-2.0 License. See LICENSE file for details.