Rust

<!-- Project Info -->
<a href="https://github.com/xberg-io/tree-sitter-language-pack/blob/main/LICENSE">
	<img src="https://img.shields.io/badge/License-MIT-007ec6" alt="License" />
</a>
<a href="https://docs.tree-sitter-language-pack.xberg.io">
	<img src="https://img.shields.io/badge/Docs-tree--sitter--language--pack-007ec6" alt="Documentation" />
</a>

Pre-compiled tree-sitter grammars for 371 programming languages, with on-demand download and caching. Polyglot core that powers every binding in the xberg.io ecosystem.

What This Package Provides

• Parser access — load a tree-sitter language parser by name without wiring individual grammar crates or packages.
• Code intelligence primitives — parse trees, functions, classes, imports, exports, symbols, docstrings, diagnostics, and syntax-aware chunks.
• Shared cache model — parsers are fetched and cached once, then reused by every call in the process.
• Same catalog as every binding — Rust, Python, Node.js, Go, Java, PHP, Ruby, .NET, Elixir, WASM, Dart, Kotlin Android, Swift, Zig, and C FFI use the same grammar set.
• Rust crate — canonical API used by the other bindings and by Xberg code intelligence.

Installation

cargo add tree-sitter-language-pack

Quick Start

use tree_sitter_language_pack::{ProcessConfig, get_parser, process};

fn main() -> Result<(), tree_sitter_language_pack::Error> {
    // Parsers are downloaded on first use and cached for every later call.
    let config = ProcessConfig::new("python").all();
    let result = process("def hello():\n    print('world')\n", &config)?;
    println!("Language: {}", result.language);
    println!("Functions: {}", result.structure.len());
    println!("Lines: {}", result.metrics.total_lines);

    // Or drop down to the tree-sitter parser directly.
    let mut parser = get_parser("python")?;
    if let Some(tree) = parser.parse("def hello(): pass") {
        println!("{}", tree.root_node().to_sexp());
    }
    Ok(())
}

Features

• 371 languages — pre-compiled tree-sitter grammars covering every major programming language and many minor ones.
• On-demand download + cache — parsers fetched at first use; subsequent runs hit the local cache.
• Code intelligence — extract functions, classes, imports, exports, symbols, docstrings, and diagnostics with one API.
• Syntax-aware chunking — semantic chunks for RAG/LLM pipelines.
• Polyglot bindings — native APIs across 15 languages: Rust, Python, TypeScript/Node.js, Go, Java, C#, Ruby, PHP, Elixir, WebAssembly, Dart, Kotlin, Swift, Zig, and C/C++ via alef.

Documentation

• Documentation -- Full docs and API reference
• GitHub Repository -- Source, issues, and discussions

Part of Xberg

• Xberg — document intelligence: text, tables, metadata from 101 formats with optional OCR.
• Xberg Enterprise — managed extraction API with SDKs, dashboards, and observability.
• crawlberg — web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
• html-to-markdown — fast, lossless HTML→Markdown engine.
• liter-llm — universal LLM API client with native bindings for 14 languages and 165 providers.
• alef — the polyglot binding generator that produces this README and all per-language bindings.
• Discord — community, roadmap, announcements.

Contributing

Contributions are welcome! See CONTRIBUTING.md for guidelines.

Join our Discord community for questions and discussion.

License

MIT -- see LICENSE for details.