eredu-runtime
eredu-runtime provides backend-neutral model execution and resource
orchestration for Eredu. It coordinates opaque backend-owned values through
portable contracts for parameter binding, mutable state, cache and weight
residency, transfers, collectives, generation, speculative decoding, and
realtime execution.
The crate does not depend on a model-family implementation or a concrete
backend. Architectures declare their execution and state semantics in
eredu-architectures; backends implement the capabilities required to realize
those declarations.
Most applications should use
eredu. Use this crate directly
when building architecture or backend integrations.
See the backend architecture guide for the ownership and dependency rules.
License
Licensed under either Apache-2.0 or MIT.