cleanse-0.6.0 is not a library.
🔥 cleanse
A small utility to clean up delimited data to make it consumable by standard unix tools.
Search words
Clean tsv data. Clean csv data.
Overview
Under the hood this uses the csv
crate to parse data as a CSV, respecting quoting and escaping rules. For each field
cleanse
will then try to do the following three things:
- Inside a field, replace any instances of the
delimiter
character with - Inside a field, replace any instances of the terminator
\n
character with - Inside a field, replace any malformed UTF8 with the utf8 replacment character.
If any changes were made to a field a log entry is made with the record number, field number and changes.
Example
|