od-get

A Rust tool for recursively crawling & downloading data from open directories

• Filtering (regex) support
  • Exclude file patterns
  • Include file patterns
  • Exclude folder patterns
  • Include folder patterns
• Customizable output
  • Target directory
  • Verbosity
  • JSON file generation
  • Log file/dynamic terminal output
• Customizable limits
  • recursion depth limit
  • file count limit
  • file count offset (skip n files)
• Multi threaded (using rayon)

(work in progress, one layer of recursion works)