kumo 0.1.1

An async web crawling framework for Rust — Scrapy for Rust
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63

# Contributing to kumo


Thank you for your interest in contributing!

## Getting Started


```bash
git clone https://github.com/wihlarkop/kumo
cd kumo
cargo build
cargo test
```

## Running Tests


```bash
# Unit + integration tests

cargo test

# With a specific feature

cargo test --features sqlite

# Derive macro tests

cargo test --features derive --test derive_macro
```

Before release-sensitive changes, also run:

```bash
cargo fmt --check
cargo clippy --workspace -- -D warnings
cargo check --workspace --all-targets --features "postgres sqlite mysql llm claude openai gemini ollama jsonpath xpath browser persistence redis-frontier derive otel cloud cloud-s3 cloud-gcs cloud-azure"
```

## Running Examples


```bash
cargo run --example quotes
cargo run --example books
```

See [`examples/README.md`](examples/README.md) for the full list.

## Pull Requests


1. Fork the repo and create a branch from `main`
2. Make your changes with tests where applicable
3. Run `cargo clippy --all-targets -- -D warnings` and `cargo fmt`
4. Open a pull request — describe what changed and why

## Reporting Bugs


Use the [bug report template](https://github.com/wihlarkop/kumo/issues/new?template=bug_report.md).

Please report security vulnerabilities privately. See [SECURITY.md](SECURITY.md).

## Requesting Features


Use the [feature request template](https://github.com/wihlarkop/kumo/issues/new?template=feature_request.md).

## License


By contributing, you agree that your contributions will be licensed under the [MIT License](LICENSE).