Link scraper

This small university-project aims to scrape links from the contents of any file. It also provides some extra information about the location of those links in the file, and what role they have.

Currently, it supports most commonly used document formats, all text-based formats, and can provide extra information for xml-based ones. A complete list of all supported formats can be found here. It also contains a convenience function, that just takes any file and tries to guess the correct filetype for you.

This crate is heavily seperated into features, to avoid blowing up its size if you only need it for a small amount of known file-types. By default, only the any_format feature is active, that can not be used on its own. So to actually use this crate you need to activate at least one format-feature.

Supported formats

• TXT
• PDF
• DOCX
• PPTX
• XLSX
• ODP
• ODS
• ODT
• OTT
• RTF
• XML ( And all xml-based formats. Also has some extra features for the following xml-based formats )
  • SVG
  • XLink (There is the beginnings of an XLink-parser/validator in here. It is not this crates' purpose, but since I couldn't really find any other crate that does this, I thought I'd mention it)
• Image formats (From exif-data)
  • JPG / JPEG
  • PNG
  • WebP
  • TIFF
  • HEIF

Any format scraper

This modules' scrape-function will behave nicely with most files, however its ability to recognize filetypes is somewhat limited, and if you know what format you're using, you should probably use the format-specific module's scrape-function instead.

License

This work is released under the GPLv3 license. A copy of the license is provided in the LICENSE file.