rune-chain-parallel 0.1.0

ParallelChain for rune-chain: fan-out to multiple chains concurrently and merge outputs
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40

# rune-chain-parallel

> ParallelChain for rune-chain: fan-out to multiple chains concurrently and merge outputs.

[![crates.io](https://img.shields.io/crates/v/rune-chain-parallel)](https://crates.io/crates/rune-chain-parallel)
[![docs.rs](https://img.shields.io/docsrs/rune-chain-parallel)](https://docs.rs/rune-chain-parallel)
[![license](https://img.shields.io/crates/l/rune-chain-parallel)](LICENSE)

All registered steps execute simultaneously using `tokio::spawn`. Their
text outputs are merged into the shared variable map keyed by each
step's `output_key`, making them available to downstream chains. Token
usage across all branches is summed.

## Usage

```rust,no_run
use rune_chain_parallel::ParallelChain;
use rune_chain_core::{Chain, ChainError, GenerateResult, PromptArgs, prompt_args};
use async_trait::async_trait;

struct UpperCase;
#[async_trait]
impl Chain for UpperCase {
    async fn call(&self, input: PromptArgs) -> Result<GenerateResult, ChainError> {
        let text = input.get("input").and_then(|v| v.as_str()).unwrap_or("").to_uppercase();
        Ok(GenerateResult::from_text(text))
    }
}

# #[tokio::main]
# async fn main() {
let chain = ParallelChain::new().branch(UpperCase, "upper");
let result = chain.call(prompt_args! { "input" => "hi" }).await.unwrap();
# let _ = result;
# }
```

## License

MIT