📦 chatpack

Compress chat exports from Telegram, WhatsApp, and Instagram into token-efficient CSV for LLMs.

Less tokens. Same conversation.

✨ Features

• Token optimization — Merges consecutive messages from the same sender, reducing token count by 30-50%
• Multi-platform — Supports Telegram, WhatsApp, and Instagram exports
• Clean output — Strips metadata (timestamps, IDs, reactions) leaving only sender and content
• LLM-ready — CSV format with semicolon delimiter, perfect for feeding into AI models
• Fast — Written in Rust for maximum performance

📊 Example

Before (62 messages):

[14:25] Alice: Hey
[14:25] Alice: How are you?
[14:26] Alice: Did you see the news?
[14:27] Bob: Hi! Yes I did

After (2 rows, 43.5% reduction):

Sender;Content
Alice;Hey
How are you?
Did you see the news?
Bob;Hi! Yes I did

🚀 Installation

From source

git clone https://github.com/berektassuly/chatpack.git

cd chatpack

cargo build --release

Binary will be at ./target/release/chatpack

Using Cargo

cargo install --path .

📖 Usage

chatpack <source> <input_file> [output_file]

Examples

# Telegram JSON export

chatpack telegram result.json

chatpack tg chat.json output.csv


# WhatsApp TXT export

chatpack whatsapp _chat.txt

chatpack wa chat.txt messages.csv


# Instagram JSON export

chatpack instagram messages.json

chatpack ig inbox.json chat.csv

Options

Output format

• File: optimized_chat.csv (default)
• Delimiter: Semicolon (;)
• Columns: Sender, Content
• Encoding: UTF-8

📱 Supported Sources

🏗️ Project Structure

chatpack/
├── Cargo.toml
└── src/
    ├── main.rs              # CLI entry point
    ├── core/
    │   ├── mod.rs
    │   ├── models.rs        # InternalMessage struct
    │   └── processor.rs     # Merge logic + CSV writer
    └── parsers/
        ├── mod.rs           # ChatParser trait + factory
        ├── telegram.rs      # ✅ Implemented
        ├── whatsapp.rs      # 🔲 Stub
        └── instagram.rs     # 🔲 Stub

🔧 Adding a New Parser

1. Create src/parsers/newsource.rs:

use crate::core::InternalMessage;
use super::ChatParser;

pub struct NewSourceParser;

impl NewSourceParser {
    pub fn new() -> Self { Self }
}

impl ChatParser for NewSourceParser {
    fn name(&self) -> &'static str {
        "NewSource"
    }

    fn parse(&self, file_path: &str) -> Result<Vec<InternalMessage>, Box<dyn Error>> {
        // Your parsing logic here
        // Return Vec<InternalMessage { sender, content }>
    }
}

2. Register in src/parsers/mod.rs:

mod newsource;
pub use newsource::NewSourceParser;

// In ChatSource enum:
NewSource,

// In from_arg():
"newsource" | "ns" => Some(Self::NewSource),

// In create_parser():
ChatSource::NewSource => Box::new(NewSourceParser::new()),

3. Done! No changes needed in main.rs or processor.rs.

🧪 Running Tests

cargo test

📈 Benchmarks

🤝 Contributing

1. Fork the repository
2. Create your feature branch (git checkout -b feature/discord-parser)
3. Implement the ChatParser trait for your source
4. Add tests
5. Submit a pull request

📄 License

MIT License — see LICENSE for details.

🙏 Acknowledgments

• Built for the AI era, where every token counts
• Inspired by the need to analyze chat histories with LLMs without burning through context windows