datu 0.3.4

datu - a data file utility
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72

Feature: Schema
  Display the schema of a Parquet, Avro, CSV, or ORC file.

  Scenario: Schema Parquet default (csv output)
    When I run `datu schema fixtures/table.parquet`
    Then the command should succeed
    And the output should contain "one"
    And the output should contain "two"

  Scenario: Schema Avro default (csv output)
    When I run `datu schema fixtures/userdata5.avro`
    Then the command should succeed
    And the output should contain "id"
    And the output should contain "first_name"
    And the output should contain "email"

  Scenario: Schema Parquet with --output json
    When I run `datu schema fixtures/table.parquet --output json`
    Then the command should succeed
    And the output should be valid JSON
    And the output should contain "name"
    And the output should contain "data_type"
    And the output should contain "one"

  Scenario: Schema Avro with --output json
    When I run `datu schema fixtures/userdata5.avro -o json`
    Then the command should succeed
    And the output should be valid JSON
    And the output should contain "nullable"
    And the output should contain "id"

  Scenario: Schema Parquet with --output json-pretty
    When I run `datu schema fixtures/table.parquet --output json-pretty`
    Then the command should succeed
    And the output should be valid JSON
    And the output should contain "name"
    And the output should contain "data_type"
    And the output should contain "one"

  Scenario: Schema Avro with --output json-pretty
    When I run `datu schema fixtures/userdata5.avro -o json-pretty`
    Then the command should succeed
    And the output should be valid JSON
    And the output should contain "nullable"
    And the output should contain "id"

  Scenario: Schema Parquet with --output yaml
    When I run `datu schema fixtures/table.parquet --output yaml`
    Then the command should succeed
    And the output should be valid YAML
    And the output should contain "name"
    And the output should contain "one"

  Scenario: Schema Avro with --output yaml
    When I run `datu schema fixtures/userdata5.avro -o yaml`
    Then the command should succeed
    And the output should be valid YAML
    And the output should contain "email"

  Scenario: Schema ORC default (csv output)
    When I run `datu convert fixtures/userdata5.avro $TEMPDIR/userdata5.orc --select id,first_name --limit 10`
    Then the command should succeed
    When I run `datu schema $TEMPDIR/userdata5.orc`
    Then the command should succeed
    And the output should contain "id"
    And the output should contain "first_name"

  Scenario: Schema CSV default (csv output)
    When I run `datu schema fixtures/table.csv`
    Then the command should succeed
    And the output should contain "one"
    And the output should contain "two"