Crate acyclic_inference 

acyclic-inference

Customer-side Inference SDK for immutable Context revisions, recoverable Runs, streamed events, and explicit warm retention. Context content operations do not imply a deployed inference service.

cargo add acyclic-inference

Connect over authenticated HTTPS with Inference::connect(endpoint, api_key, ca_pem). Supply a trusted PEM CA when the service uses a private CA; transport validation remains enabled. Create or attach a Context, then use the typed operation builders to fork, edit, generate, and retain. Save the Run identity after admission so an interrupted caller can recover it. Warm commitments have their own inspect, renew, and release lifecycle.

See the Rust API, repository example, and customer protocol. Provider availability, model access, and billing are deployment-specific.

Modules

wire

Generated customer contract and service traits, also used by deterministic mocks.

Structs

Context

Immutable revision handle; cloning a handle does not create a fork or retention edge.

ContextMutation

Replayable mutation with a pre-dispatch command identity, not an execution retry.

CreateContext

Replayable creation builder. Reusing it reconciles the same exact command.

CreateEvaluation

Replayable immutable evaluation admission. Reusing this value reconciles the same candidate/suite/grader contract and never creates another evaluation.

Evaluation

Recoverable immutable evaluation handle.

GenerateRun

Replayable Run admission builder. Reusing it reconciles one logical Run.

Inference

Authenticated customer connection; infrastructure remains entirely service-owned.

ReleaseWarm

Replayable cleanup-complete release.

RenewWarm

Replayable warm renewal.

RetainWarm

Replayable warm admission. A failed observation must be reconciled by sending this same value, never by allocating another request identity.

Retention

Explicit customer warm-retention policy. Distribution and capacity remain service-owned; the opaque profile must come from model discovery.

Run

Recoverable logical Run. Cloning this handle never repeats execution.

RunEvents

Validating event-stream observation. Dropping it never cancels the Run.

WarmContext

Recoverable warm commitment. It never exposes physical placement or KV allocation identity and therefore remains valid through service rebalancing.

Enums

Error

Transport or contract failure. Reuse the same builder to reconcile uncertainty.

Constants

DESCRIPTOR

Customer-only reflection; no backend descriptors or implementation are packaged.

MAXIMUM_CA_CERTIFICATE_BYTES

Largest caller-supplied PEM trust bundle accepted by Inference::connect.

MAXIMUM_EVALUATION_CANDIDATES

Maximum immutable candidates admitted by one evaluation.

MAXIMUM_EVALUATION_CASES

Maximum ordered cases admitted by one evaluation suite.

MAXIMUM_EVALUATION_METRICS

Maximum metric identities admitted by one evaluation.

MAXIMUM_EVALUATION_RESULTS

Maximum materialized candidate/case results in one evaluation.

MAXIMUM_MESSAGE_BYTES

Bounded customer transport ceiling, not a published retention entitlement.