eredu-runtime 0.1.0

Backend-neutral model execution runtime for Eredu
Documentation

eredu-runtime

eredu-runtime provides backend-neutral model execution and resource orchestration for Eredu. It coordinates opaque backend-owned values through portable contracts for parameter binding, mutable state, cache and weight residency, transfers, collectives, generation, speculative decoding, and realtime execution.

The crate does not depend on a model-family implementation or a concrete backend. Architectures declare their execution and state semantics in eredu-architectures; backends implement the capabilities required to realize those declarations.

Most applications should use eredu. Use this crate directly when building architecture or backend integrations.

See the backend architecture guide for the ownership and dependency rules.

License

Licensed under either Apache-2.0 or MIT.