Expand description
Erase the content of the crate::connector.
§Actions
1 - Get a crate::Context from the input queue.
2 - Extract the crate::DataResult from the crate::Context.
3 - Erase the content of the resource.
4 - Reuse the current crate::Context and attach the crate::DataResult to it.
5 - Push the new crate::Context into the output queue.
6 - Go to step 1 until the input queue is not empty.
§Configuration
| key | alias | Description | Default Value | Possible Values |
|---|---|---|---|---|
| type | - | Required in order to use eraser step | eraser | eraser / eraser / truncate / e |
| connector_type | conn / connector | Connector type to use in order to read a resource | io | See crate::connector |
| name | alias | Name step | null | Auto generate alphanumeric value |
| exclude_paths | exclude | resource to exclude for the erase step | null | List of string |
| data_type | data | Type of data used for the transformation. skip other data type | ok | ok / err |
§Examples
[
{
"type": "erase",
"name": "erase_a",
"data_type": "ok",
"connector": {
"type": "local",
"path": "./*.{{ metadata.mime_subtype }}"
},
"exclude_paths": [
"file1.json"
]
}
]