FeedYourAI

A command-line tool to combine text files from a directory into a single file for AI processing, with flexible filtering options.

Features

Combines multiple text files into one output file
Filters files by:
- Size
- File extensions (e.g., .txt, .md)
- Custom minimum and maximum size limits
Preserves file boundaries with headers showing filename and size
Customizable input directory and output file

Installation

Prerequisites

Rust (latest stable version recommended)

Install via Cargo

cargo install --git https://github.com/alexandretrotel/feedyourai.git

Or, clone and install locally:

git clone https://github.com/alexandretrotel/feedyourai.git
cd feedyourai
cargo install --path .

This installs the feedyourai binary to ~/.cargo/bin/. Ensure this directory is in your PATH.

Usage

Run fyai in your terminal to combine files:

Basic Usage

fyai

Combines all files ≥ 50KB from the current directory into feedyourai.txt

Options

USAGE:
    fyai [OPTIONS]

OPTIONS:
    -d, --dir <DIR>          Sets the input directory [default: .]
    -o, --output <FILE>      Sets the output file [default: feedyourai.txt]
    -e, --ext <EXT>          Comma-separated list of file extensions to include (e.g., txt,md)
    -n, --min-size <BYTES>   Exclude files smaller than this size in bytes (default: 51200)
    -m, --max-size <BYTES>   Exclude files larger than this size in bytes
    -h, --help               Print help information
    -V, --version            Print version information

Examples

Combine .txt and .md files from a specific directory:
```
fyai -d ./docs -e txt,md
```
Include all files (no size minimum) up to 1MB:
```
fyai -n 0 -m 1048576
```
Custom output file with files between 10KB and 500KB:
```
fyai -n 10240 -m 512000 -o ai_input.txt
```

Output Format

The combined file includes headers for each source file:

=== File: example.txt (12345 bytes) ===
[contents of example.txt]

=== File: notes.md (67890 bytes) ===
[contents of notes.md]

Building from Source

Clone the repository:

git clone https://github.com/alexandretrotel/feedyourai.git
cd feedyourai

Build the project:
```
cargo build --release
```
Run it directly:
```
./target/release/fyai
```

Contributing

Contributions are welcome! Please:

Fork the repository
Create a feature branch
Submit a pull request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgments

Built with Rust
Uses clap for command-line parsing

feedyourai 1.2.2