eredu-runtime

eredu-runtime provides backend-neutral model execution and resource orchestration for Eredu. It coordinates opaque backend-owned values through portable contracts for parameter binding, mutable state, cache and weight residency, transfers, collectives, generation, speculative decoding, and realtime execution. NormalizedLoadRequest is the singular portable cold-load policy: topology, wire, invocation bounds, completion, residency, session, and drafting intent are validated before any backend resource is selected.

Execution plans normalize through one shared converter with injected diagnostic choices. Capability synthesis enumerates exact parameter and state requirements and queries backend support predicates; providers report mechanisms without repeating that enumeration. Selected-task residency sizing and report telemetry are portable runtime operations.

It owns the canonical declarative parameter-binding and logical placement plans, communication-manifest validation, and reusable replicated-session construction flow. Backends supply statically dispatched native materialization, completion, storage, group, and tensor mechanisms to those plans.

The crate does not depend on a model-family implementation or a concrete backend. Architectures declare their execution and state semantics in eredu-architectures; backends implement the capabilities required to realize those declarations.

Most applications should use eredu. Use this crate directly when building architecture or backend integrations.

See the backend architecture guide for the ownership and dependency rules.

License

Licensed under either Apache-2.0 or MIT.