⚠️ Current Limitation: Currently only search engines without anti-bot protection are workable, such as DuckDuckGo and Brave. We require advanced features to bypass anti-bot measures for other engines like Google and Bing.
🐒 Tarzi is a unified search interface designed for Retrieval-Augmented Generation (RAG) and agentic systems built on large language models. Search is a core functionality in these systems, yet most search engine providers (SEPs) impose API paywalls or strict rate limits. Tarzi, empowered by browser automation and web crawling technologies, removes these barriers by supporting token-free queries across multiple search engines. With a single dependency, you can integrate and switch between different SEPs as needed—seamlessly and efficiently.
⚙️ Core Capabilities
- 🦀 Dual Implementation: Native Rust library and Python wrapper with CLI tools
- 🔄 Content Conversion: Convert raw HTML into Markdown, JSON, or YAML, which is ready for LLMs
- 🔍 Search Integration: API → plain HTTP → headless browser cascade with a unified result format
- 🧠 Multi-Engine Support: Bing, Google, Google Serper, DuckDuckGo, Brave, Baidu, Sogou Weixin
- 🛡️ Proxy Support: Bypass network bans using proxy support to access global SEPs
- 🚀 End-to-End Workflow: Full pipeline from search to content extraction for AI and automation use cases
🧪 Advanced Features (Under dev.)
- 🕵️♂️ Anti-Bot Evasion: Use fingerprint spoofing, proxy rotation, and human-like actions to avoid detection
- 🧠 Smarter Queries: Improve search results with prompt rewriting and intent-aware queries
- 🔗 Workflow Automation: Chain steps like search, click, form fill, and scraping into automated flows
Install
pip install tarzi
CLI Commands
Tarzi provides two command-line interfaces:
tarzi: Native Rust CLI (faster, more efficient)pytarzi: Python CLI (easier to extend, same functionality)
Both CLIs support the same commands and configuration precedence.
Usage Examples
- Examples in Python and Rust: examples
Alternatives
- LangChain PlayWrightBrowserToolkit
Contributors
Thank you ❤ all human and non-human contributors.