sema-docs 1.20.3

Canonical structured documentation for Sema builtins/special forms; powers LSP hover/completion and REPL apropos
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
---
name: "llm/batch"
module: "llm"
params: [{ name: prompts }, { name: opts, type: map }]
returns: "list"
---

Send a list of prompt strings to the default provider in parallel (via the provider's batch completion) and return a list of completion strings in the same order. The opts map accepts `:model`, `:max-tokens`, `:temperature`, and `:system`.

```sema
(llm/batch ["Capital of France?" "Capital of Japan?"] {:max-tokens 20})
```