fyai

A command-line tool to combine files from a directory into a single file for AI processing, with flexible filtering options.

Features

• Combines multiple text files into one output file
• Can process a remote git repository in a temporary directory
• Supports configuration via CLI options and config files (YAML)
• Filters files by:
  • Size
  • File extensions (e.g., .txt, .md)
  • Directory inclusion/exclusion
  • File inclusion/exclusion
  • Optionally respects .gitignore rules (can be disabled)
• Preserves file boundaries with headers showing filename and size
• Customizable input directory and output file

Installation

Prerequisites

• Rust (latest stable version recommended)

Install via Cargo

cargo install feedyourai

Or,

cargo install --git https://github.com/alexandretrotel/feedyourai.git

This installs the fyai binary to ~/.cargo/bin/. Ensure this directory is in your PATH.

Usage

Run fyai in your terminal to combine files:

Config File Support

You can specify options in a config file (YAML format):

• Local config: ./fyai.yaml (used if present in current directory)
• Global config: ~/.config/fyai.yaml (used if no local config found)
• Precedence: Local config overrides global config. CLI options override both config files.

Example fyai.yaml

directory: ./src
output: combined.txt
include_ext:
  - md
  - txt
exclude_dirs:
  - node_modules
  - dist
min_size: 10240
max_size: 512000
respect_gitignore: true
tree_only: false

All CLI options can be set in the config file. CLI flags always take precedence.

Basic Usage

fyai

• Combines all files from the current directory into fyai.txt

Options

USAGE:
    fyai [OPTIONS] [SUBCOMMAND]

OPTIONS:
    -d, --dir <DIR>                Sets the input directory [default: .]
    -o, --output <FILE>            Sets the output file [default: fyai.txt]
        --repo <URL>               Clone a git repository (e.g., GitHub/GitLab) into a temporary directory before processing
        --repo-branch <BRANCH>     Branch or tag to checkout when using --repo
        --repo-commit <COMMIT>     Commit SHA to checkout when using --repo
        --include-dirs <DIRS>      Comma-separated list of directories to include (e.g., src,docs)
    -x, --exclude-dirs <DIRS>      Comma-separated list of directories to exclude (e.g., node_modules,dist)
        --include-files <FILES>    Comma-separated list of files to include (e.g., README.md,main.rs)
        --exclude-files <FILES>    Comma-separated list of files to exclude (e.g., LICENSE,config.json)
        --include-ext <EXT>        Comma-separated list of file extensions to include (e.g., txt,md)
    -e, --exclude-ext <EXT>        Comma-separated list of file extensions to exclude (e.g., log,tmp)
    -n, --min-size <BYTES>         Exclude files smaller than this size in bytes
    -m, --max-size <BYTES>         Exclude files larger than this size in bytes
        --respect-gitignore <BOOL> Whether to respect .gitignore rules (true/false) [default: true]
        --tree-only                Only output the project directory tree, no file contents
    -t, --test                     Run in test mode
    -h, --help                     Print help information
    -V, --version                  Print version information

CONFIG FILE SUPPORT:
    You can specify options in a config file (YAML format).
    Local config: ./fyai.yaml (used if present in current directory)
    Global config: ~/.config/fyai.yaml (used if no local config found)
    CLI options override config file values.
    See README for details and examples.

SUBCOMMANDS:
    init    Generate a template fyai.yaml config file

Examples

• Combine only .txt and .md files from a specific directory:

  fyai -d ./docs --include-ext txt,md
  

• Exclude all .log and .tmp files from the output:

  fyai --exclude-ext log,tmp
  

• Include only files named README.md and main.rs from the src and docs directories:

  fyai --include-dirs src,docs --include-files README.md,main.rs
  

• Exclude all files named LICENSE and config.json from any directory:

  fyai --exclude-files LICENSE,config.json
  

• Include all files (no size minimum) up to 1MB:

  fyai -n 0 -m 1048576
  

• Custom output file with files between 10KB and 500KB, excluding dist and node_modules directories:

  fyai -n 10240 -m 512000 -o ai_input.txt -x dist,node_modules
  

• Output only the project directory structure (no file contents):

  fyai --tree-only -o tree.txt
  

• Ignore .gitignore rules and include all files (even those normally excluded):

  fyai --respect-gitignore false
  

• Run against a remote GitHub/GitLab repository without leaving the clone on disk:

  fyai --repo https://github.com/owner/repo.git --repo-branch main
  

• Run against a specific commit:

  fyai --repo https://github.com/owner/repo.git --repo-commit 1234abcd
  

• Generate a config template:

  fyai init
  

Output Format

The combined file includes headers for each source file:

=== File: example.txt (12345 bytes) ===
[contents of example.txt]

=== File: notes.md (67890 bytes) ===
[contents of notes.md]

Contributing

Contributions are welcome! Please:

1. Fork the repository
2. Create a feature branch
3. Submit a pull request

License

This project is licensed under the MIT License.

Changelog

See CHANGELOG.md for release notes.

Acknowledgments

• Built with Rust
• Uses clap for command-line parsing