sema-docs 1.23.0

Canonical structured documentation for Sema builtins/special forms; powers LSP hover/completion and REPL apropos
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
---
name: "llm/token-count"
module: "llm"
params: [{ name: input }]
returns: "int"
---

Estimate the number of tokens in a string (or the combined length of a list of strings) using a simple chars-divided-by-4 heuristic. Returns an integer token estimate.

```sema
(llm/token-count "the quick brown fox jumps")   ; => 6
```