cc2p 0.6.1

Convert a CSV to parquet file format
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56

name: cc2p
base: core22
version: '0.6.1'
title: cc2p
summary: Convert CSV To Parquet
description: |
  **CC2P** (Convert CSV To Parquet) is a high-performance command-line tool written in Rust that efficiently converts CSV files to the Apache Parquet format. Parquet is a columnar storage file format that offers efficient data compression and encoding schemes, making it ideal for big data processing.

  ## Why Use CC2P?

  - **Performance**: Leverages Rust's speed and multi-threading for fast conversions
  - **Memory Efficiency**: Processes files with minimal memory footprint
  - **Flexibility**: Supports various CSV formats with different delimiters and header options
  - **Schema Inference**: Automatically detects column types from your data
  - **Batch Processing**: Convert multiple CSV files in a single command
  - **Interactive Mode**: Browse and selectively export columns using the TUI

  ## Features

  - **Columnar Storage**: Parquet's columnar format provides better compression and faster query performance compared to row-based formats like CSV
  - **Efficient Compression**: Uses Snappy compression for a good balance between compression ratio and speed
  - **Schema Handling**: Automatically infers data types and handles duplicate column names
  - **Parallel Processing**: Multi-threaded conversion using Tokio runtime
  - **Progress Tracking**: Real-time progress indication with indicatif progress bars
  - **Interactive TUI**: Browse files, inspect schemas, and select columns for export using a terminal-based UI

website: https://rayyildiz.com/projects/cc2p/
source-code: https://github.com/rayyildiz/cc2p
issues: https://github.com/rayyildiz/cc2p/issues/new
license: MIT
contact: https://github.com/rayyildiz/cc2p

architectures:
  - build-on: amd64
  - build-on: arm64
grade: stable

confinement: strict
parts:
  cc2p:
    plugin: rust
    source: .
    build-packages:
      - pkg-config
      - libssl-dev

apps:
  cc2p:
    command: bin/cc2p
    plugs:
      - home
      - removable-media
      - network
    environment:
      RUST_BACKTRACE: "1"
    common-id: com.github.rayyildiz.cc2p