datapan 0.1.1

datapan filters (big) files. 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68


# _`datapan`_ <a href='https://github.com/knapply/datapan'><img src='https://upload.wikimedia.org/wikipedia/commons/thumb/8/84/Gold_panning_at_Bonanza_Creek.JPG/318px-Gold_panning_at_Bonanza_Creek.JPG' align="right" /></a>

<!-- badges: start -->
<!-- [![crates.io](https://img.shields.io/crates/v/datapan.svg)](https://crates.io/crates/datapan) -->
[![Build](https://github.com/knapply/datapan/workflows/Rust+Python/badge.svg)](https://github.com/knapply/datapan/actions)
[![Lifecycle](https://img.shields.io/badge/lifecycle-experimental-orange.svg)]()
[![PyPI](https://badge.fury.io/py/datapan.svg)](https://badge.fury.io/py/datapan)
[![Crates.io](https://img.shields.io/crates/v/datapan.svg?maxAge=3600)](https://crates.io/crates/datapan)

<!-- [![crates.io](https://img.shields.io/badge/crates.io-sift-green.svg)](https://crates.io/crates/datapan) -->
<!-- [![License: GPL v3](https://img.shields.io/badge/License-GPLv3-blue.svg)](https://www.gnu.org/licenses/gpl-3.0) -->
<!-- badges: end -->

<br>

__This is still a test bed. It is not useful__

_`datapan`_ sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.

<br>

# Installation

```sh
## create/activate venv
# sudo apt-get install python3-venv
# python3 -m venv datapan_env
# source datapan_env/bin/activate
# python -m pip install --upgrade pip

## install datapan
pip install datapan
```

# Usage

```python
import datapan

some_dir = ""

test = datapan.hello_rust(some_dir)

print(test)
```


# Developer Version

* Rust (nightly)

```sh
curl https://sh.rustup.rs -sSf | sh
# rustup default nightly
rustup update nightly
```

* Poetry

```sh
pip install poetry
```

```sh
make install
make test
```