spnl 0.13.4

A Span Query is a declarative way to specify which portions of a generative AI (GenAI) program should be run directly on model serving components.
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
# Span Queries

What if we had a way to plan and optimize GenAI like we do for
[SQL](https://en.wikipedia.org/wiki/SQL)?

A **Span Query** is a declarative way to specify which portions of a
generative AI (GenAI) program should be **run directly on model
serving components**. As with
[SQL](https://en.wikipedia.org/wiki/SQL), this declarative structure
is safe to run on the backend and provides a clean starting point for
optimization. Also like SQL, some GenAI programs will be entirely
expressible as queries, though most will be expressed as the
programmatic interludes around the declarative queries.