omnivore-cli 0.1.0

Command-line interface for Omnivore web crawler
omnivore-cli-0.1.0 is not a library.
Visit the last successful build: omnivore-cli-0.2.0

omnivore-cli

Command-line interface for the Omnivore web crawler.

Install

cargo install omnivore-cli

Usage

# Basic crawl
omnivore crawl https://example.com --workers 5 --depth 3

# Build knowledge graph
omnivore graph results.json --output knowledge-graph.db

License

MIT OR Apache-2.0