Skip to main content

Crate workload_spec

Crate workload_spec 

Source
Expand description

WorkloadSpec — typed wire format for yubaba workloads.

This crate is the schema source of truth. It has zero dependencies on yubaba; yubaba depends on it, not the other way around. Agents and desktop code that construct specs can link this crate without pulling in yubaba’s containerd client.

Three validation layers live in validate: shape (sync, no I/O), semantic (reads yubaba state), and environment (deploy-time). The schema types live at the top level.

@yah:ticket(R222-T3, “Workload schema doesn’t match per-kind on-disk shapes (mesofact-static)”) @yah:assignee(agent:claude) @yah:at(2026-05-18T16:47:03Z) @yah:status(review) @yah:parent(R222) @yah:handoff(“Picked option (a): tagged-enum Workload envelope with per-kind variants. Added Workload { MesofactStatic(MesofactStaticWorkload), Container(WorkloadSpec) } + BuildConfig in workload-spec. WorkloadSpec stays the containerd RPC wire type (now also the kind="container" variant payload). xtask emit-schemas now renders workload.toml.schema.json as a oneOf over kind; schema drift test green. TS export updated. Arch doc ‘workloads — colocated, not registered’ rewritten to describe the envelope + both example kinds; B4 outlook updated to point at Workload.”) @yah:verify(“cargo check -p cloud && cargo test -p cloud && cargo check -p yah && cargo check -p agent-tools && cargo check -p yah –tests && cargo check -p agent-tools –tests”) @yah:verify(“cargo test -p xtask # schema drift test must stay green”) @yah:verify(“cargo run -p workload-spec –bin export-ts # idempotent regen”)

@yah:ticket(R256-F7, “Model mesofact container as two roles: transient build/publish job vs long-lived SSR/SPA runtime”) @yah:assignee(agent:claude) @yah:at(2026-05-25T20:08:29Z) @yah:status(review) @yah:parent(R256) @yah:next(“role A — build/publish job: transient task that runs the build and PUTs to the object store, then exits/GC’d; needed whenever there is a build step (SSR or not)”) @yah:next(“role B — SSR/SPA runtime: long-lived container, only present when the app has realtime/dynamic pages (this is what the ‘only if SSR/SPA’ gate applies to)”) @yah:next(“decide the fidelity knob: does the build run in-container (matches CI, max fidelity, costs image+cold-start) or on host with yubaba orchestrating only the serving edge?”) @yah:assumes(“in cloud these are separate: CI/build job produces artifacts, R2+CDN serve them, and a distinct worker serves any SSR — so one merged ‘mesofact container’ is the trap”) @yah:handoff(“BuildMode enum added to workload-spec with HostSide (default) and InContainer { image } variants. MesofactStaticWorkload gains build_mode: BuildMode (skip_serializing_if default) and ssr_runtime: Option. Encodes the two-role model: build step is always transient; SSR companion is optional long-lived. Fidelity knob decision: HostSide = host watcher (dev+sim), InContainer = CI-fidelity (cloud/ha). All three codegen targets updated: export-ts.rs, packages/yah/workload-spec/index.ts, .yah/schema/workload.toml.schema.json. Schema drift tests pass.”) @yah:verify(“cargo check -p workload-spec –locked”) @yah:verify(“cargo test -p xtask –locked # schema_drift tests pass”) @yah:verify(“cargo test -p cloud –locked –lib # 165 passed”)

@yah:ticket(R256-F9, “Almanac as a dependency manifest: orchestrator verifies I/O targets live before run; output invalidates mesofact sources cleanly”) @yah:assignee(agent:claude) @yah:at(2026-05-25T21:28:15Z) @yah:status(review) @yah:parent(R256) @yah:next(“almanac is a manifest declaring inputs + outputs + cadence + command — NOT a bash cron; the declared I/O is the contract”) @yah:next(“before a run the orchestrator verifies declared inputs exist AND output targets (e.g. the mesofact app + its source/object store) are reachable; if not → the run fails or waits/times out rather than producing orphaned output”) @yah:next(“almanac output invalidates downstream mesofact sources cleanly + deliberately (a declared dependency edge, not a blunt rebuild-everything) — this is the reason it’s a named manifest, not a shell cron”) @yah:next(“decide the not-ready policy knob: fail-fast vs wait-with-timeout vs requeue”) @yah:next(“generalizes the OpenRouter refresher (spawn_almanac_refresher), which is the degenerate no-dependency case (output = JSON cache, no app target)”) @yah:assumes(“precondition enforcement lives in the shared scheduler layer (embedded by camp for dev/sim, yubaba for cloud/ha) — it needs the workload registry + xlb-net discovery to answer ‘is the target up?’, which a bash cron lacks”) @arch:see(.yah/docs/architecture/A024-vocabulary.md) @yah:depends_on(R256-F6) @yah:handoff(“AlmanacTarget (Http/Tcp probe), NotReadyPolicy (WaitWithTimeout default=5s/FailFast/Requeue), Cadence (Once/Every/Cron), and AlmanacManifest types added to workload-spec. Workload enum gains Almanac(AlmanacManifest) variant (kind=‘almanac’). NotReadyPolicy::WaitWithTimeout(5s) is the default — matches sim-tier spinup budget. AlmanacManifest.invalidates: Vec declares downstream cache-bust targets. export-ts.rs updated; index.ts and workload.toml.schema.json regenerated; drift tests pass. The degenerate case (no inputs, no outputs, Cron, no invalidates) is exactly the OpenRouter refresher pattern. The orchestrator precondition enforcement (xlb-net probing) is left for R276/yubaba integration.”) @yah:verify(“cargo check -p workload-spec –locked”) @yah:verify(“cargo test -p xtask –locked # schema drift tests pass”) @yah:verify(“cargo test -p cloud –locked –lib # 165 passed”)

@yah:relay(R335, “Almanac mirror-binding — scope a feed to the mirror it affects”) @yah:at(2026-05-27T02:19:09Z) @yah:status(open) @arch:see(.yah/docs/working/W058-almanac-mirror-binding.md) @yah:depends_on(R256-F9)

@yah:ticket(R335-S1, “Decide cross-env pollution mechanism: extend R256-F9 manifest vs add per-mirror capability”) @yah:assignee(agent:claude) @yah:at(2026-05-27T02:19:33Z) @yah:kind(spike) @yah:status(review) @yah:phase(P1) @yah:parent(R335) @yah:gotcha(“Build ON R256-F9’s AlmanacManifest (workload-spec/src/lib.rs) — do NOT invent a parallel manifest. R256-F9 is in review.”) @yah:depends_on(R256-F9) @yah:handoff(“Decided. Recorded in almanac-mirror-binding.md §11. KEY FINDING: two almanac paths exist; the live R330 feed uses almanac::FeedConfig (on_change=MesofactRebuild{service,route} — a service id, NOT a MeshIdent), so it never touches AlmanacManifest.invalidates. Verdict on the S1 title: NEITHER extend the manifest nor (yet) add capability is the accident fix — dev->cloud is ALREADY blocked by construction (feed path = process locality + per-mirror reconciler + MinIO/R2 backend split; manifest path = no camp-embedded MeshState, mesh resolution is yubaba-raft-only). Residual holes: /revalidate receiver is UNAUTHENTICATED, and same-tier (two clouds on one R2) has no per-mirror key prefix.”) @yah:next(“FILED: R335-F3 (P1, no yubaba dep) mirror-aware /revalidate receiver — reject feeds not bound to this mirror; satisfies R335-T2; lands with R330-F4.”) @yah:next(“FILED: R335-F4 (P2) per-mirror artifact key prefix in derive_minio_key/publish_to_r2 — closes same-tier collision.”) @yah:next(“FILED: R335-F5 (P3, BLOCKED on yubaba control plane) per-mirror capability gate on /revalidate via yubaba/xlb-net node identity.”)

@yah:ticket(R278-F4, “RolloutPolicy schema in workload-spec (TOML types)”) @yah:assignee(agent:claude) @yah:at(2026-06-01T02:31:25Z) @yah:status(review) @yah:parent(R278) @yah:next(“Add src/rollout.rs with RolloutPolicy, RolloutStrategy, RolloutGate, RolloutStep, RolloutOnFailure”) @yah:next(“Export pub mod rollout from lib.rs”) @yah:next(“Add TS export via ts-rs in export-ts.rs”) @arch:see(.yah/docs/working/W140-yah-yubaba-ci-cd.md) @yah:handoff(“RolloutPolicy, RolloutStrategy, RolloutGate, RolloutStep, RolloutOnFailure added to workload-spec/src/rollout.rs. Exported from lib.rs. toml dev-dep added for round-trip test. Tests: rollout::tests::round_trip_toml + on_failure_default both green.”)

@yah:ticket(R429-T1, “Workload::StaticAsset variant + schema in workload-spec (catalog + aliases)”) @yah:assignee(agent:claude) @yah:at(2026-06-03T23:24:20Z) @yah:status(review) @yah:phase(P1) @yah:parent(R429) @yah:next(“Add Workload::StaticAsset(StaticAssetWorkload) variant alongside the existing MesofactStatic + Container envelopes. Mirror the tagged-enum shape R222-T3 established.”) @yah:next(“StaticAssetWorkload fields: kind=‘static-asset’ tag, assets: Vec, aliases: BTreeMap<String, String>. AssetEntry { filename: String, source: PathBuf, blake3: BlakeHash }.”) @yah:next(“BlakeHash newtype validates 64-hex-char shape (reuse from existing places if available, else introduce here).”) @yah:next(“Closed-catalog invariant: aliases values MUST be filenames present in the assets list. Reject at load with a clear error pointing at the offending alias key + bad filename.”) @yah:next(“Mirror schema extension: optional [asset_aliases] BTreeMap<String, String> on MirrorConfig. Semantic validator (when both workload + mirror are loaded together) rejects mirror aliases whose target filename isn’t in the catalog.”) @yah:next(“Regenerate the workload.toml.schema.json via xtask emit-schemas (R222-B4). Confirm the drift test stays green.”) @yah:next(“TS mirror: extend packages/yah/workload-spec/index.ts with the StaticAsset variant + AssetEntry. Confirm bun typecheck stays green.”) @yah:verify(“cargo check -p workload-spec –locked”) @yah:verify(“cargo test -p workload-spec”) @yah:verify(“cargo run -p workload-spec –bin export-ts”) @yah:verify(“cargo test -p xtask”) @arch:see(.yah/docs/working/W160-atomic-release-waves.md)

@yah:ticket(R429-F2, “static-asset reconciler: BLAKE3 verify + S3 PUT against mirror’s object_store + drift”) @yah:assignee(agent:claude) @yah:at(2026-06-03T23:24:38Z) @yah:status(review) @yah:phase(P2) @yah:parent(R429) @yah:next(“New reconciler that handles kind=‘static-asset’ in the same service-sync loop that already runs mesofact-static + container. Same wave-gate semantics, same drift shape.”) @yah:next(“For each [[asset]] row: hash source file (BLAKE3) and compare to manifest entry. Mismatch → surface as drift, halt push for that asset until rebuild.”) @yah:next(“Resolve mirror’s object_store provider → R2 bucket + credentials. HEAD cas/filename; if absent or different content-length → PUT. Idempotent on re-run.”) @yah:next(“Drift detection: list bucket contents under the component’s prefix, compare against catalog filenames. Files in bucket ∖ catalog → report as drift (do NOT delete; that’s the prune verb’s job).”) @yah:next(“ServicesView’s existing matrix consumes the new drift shape automatically. Confirm SyncGlyph/DriftList render correctly for a static-asset row without UI changes.”) @yah:next(“MockR2 in tests: HashMap<key, bytes> implementing the S3 surface the reconciler hits. Cover: push first-time, push idempotent, drift catches catalog-vs-bucket mismatch, BLAKE3 mismatch halts push.”) @yah:next(“Real-R2 integration test gated behind YAH_TEST_R2_BUCKET env var — one round-trip against a scratch bucket; skipped otherwise.”) @yah:verify(“cargo check –workspace –locked”) @yah:verify(“cargo test -p # crate TBD by impl agent”) @yah:verify(“cargo test -p workload-spec”) @yah:gotcha(“Auto-delete is OFF — reconciler reports drift on bucket∖catalog files but never DELETEs. That’s the prune verb (R429-T2). Easy bug to introduce when ‘cleaning up drift’; don’t.”) @yah:gotcha(“S3 multipart upload threshold matters — distil-large-v3 is ~270MB which is over the 5MB single-PUT limit on R2’s strictest mode. Use aws-sdk-s3’s multipart helper for assets >100MB.”) @yah:gotcha(“Long-running progress MUST surface in QED/task-pane per the long-running-yah-surface rule. Don’t silently spin in a tokio task; model as a Task with progress events.”) @arch:see(.yah/docs/working/W160-atomic-release-waves.md) @yah:depends_on(R429-T1)

@yah:ticket(R429-T3, “yah service prune verb: candidate enumeration + operator-confirm delete”) @yah:assignee(agent:claude) @yah:at(2026-06-03T23:24:52Z) @yah:status(review) @yah:phase(P3) @yah:parent(R429) @yah:next(“yah service prune enumerates files present in the bucket but not referenced by any current mirror’s resolved alias graph. Lists candidates + sizes + last-modified, requires explicit operator confirm before DELETE.”) @yah:next(“Resolution graph: for each mirror, walk [asset_aliases] → catalog [aliases] → catalog [[asset]] rows. Union across all mirrors = live set. Bucket ∖ live set = prune candidates.”) @yah:next(“MCP tool mcp__yah__service_prune routes through approval gate (write verb). Read counterpart mcp__yah__service_prune_status auto-passes — returns the candidate list without acting.”) @yah:next(“Camp: Tauri command + a ‘Prune candidates’ panel in the existing DeployPanel for each service, showing the candidate table with per-row checkboxes + confirm.”) @yah:next(“Analytics-driven candidate filter (old AND unaccessed-for-N-days) is OUT OF SCOPE for this ticket — needs access logs we don’t aggregate yet. The candidate set today is purely catalog-derived.”) @yah:next(“User-asset TTL is OUT OF SCOPE — different surface, access-pattern-based, separate relay when it lands.”) @yah:verify(“cargo test -p ”) @yah:verify(“yah service prune yah-desktop –dry-run lists candidates”) @arch:see(.yah/docs/working/W160-atomic-release-waves.md) @yah:depends_on(R429-F2) @yah:handoff(“CLI + library + MCP all landed; UI deferred to R429-F4 (filed). Library lives in crates/yah/cloud/src/reconciler/static_asset_prune.rs and exposes compute_live_set (pure resolution graph), compute_prune_candidates (live + LIST + diff), execute_prune (DELETE), and load_service_and_mirror (path helper). CLI verb is yah cloud service prune <name> --env <env> [--dry-run] [--yes] [--format=table|json] at app/yah/cli/src/cloud.rs (ServiceCommands::Prune + handle_service_prune). MCP tools cloud.service_prune_status (read, auto-pass, –dry-run –format=json) and cloud.service_prune (write, –yes –format=json) dispatch through build_command(). New S3 helper sign_s3_get_with_query in local-driver covers ListObjectsV2 (the existing s3_sign helpers don’t handle canonical query strings); ListObjectsV2 response is parsed with a tiny hand-rolled split_tags helper to avoid a quick-xml workspace dep. Tests: 12 prune-module unit tests (live-set union, kind filtering, list response parse for single/empty/truncated/no-token, candidate filtering including catalog manifest sidecar exclusion) + 1 s3_sign helper test + 2 MCP build_command tests. cargo check –workspace clean. cargo test -p cloud –lib: 279 pass (1 pre-existing failure cloud_init::tests::embedded_template_matches_workspace_canonical unrelated, per R419-F4 docstring). cargo test -p yah –lib: 299 pass.”) @yah:next(“R429-F4 carries the Tauri + DeployPanel UI work — depends_on R429-T3, status=open.”) @yah:verify(“cargo check –workspace –locked”) @yah:verify(“cargo test -p cloud –lib reconciler::static_asset_prune # 12 pass”) @yah:verify(“cargo test -p yah –lib mcp::tools::tests::cloud_service_prune # 2 pass”) @yah:verify(“yah cloud service prune –help # renders usage with –env/–dry-run/–yes/–format”)

@arch:see(.yah/docs/working/W164-derived-static-assets.md)

@yah:ticket(R438-T2, “AssetEntry XOR: source vs derive + shape_static_asset rules”) @yah:assignee(agent:claude) @yah:at(2026-06-04T21:06:51Z) @yah:status(review) @yah:phase(P1) @yah:parent(R438) @yah:next(“AssetEntry.source: PathBuf → Option”) @yah:next(“Add AssetEntry.derive: Option with fetch + optional transform”) @yah:next(“Extend shape_static_asset to enforce exactly-one(source, derive) + license closed-set”) @yah:verify(“Both-set and neither-set fail shape validation with ShapeError::Field”) @yah:verify(“Legacy TOMLs with only source still parse + serialize identically”) @arch:see(.yah/docs/working/W164-derived-static-assets.md) @yah:handoff(“AssetEntry now carries Option source + Option derive (both skip_serializing_if). New types AssetDerive {fetch: FetchSource, transform: Option} and TransformSpec {recipe, params} added to workload-spec/src/lib.rs. validate.rs grew FieldPath::Asset(usize, &’static str) and shape_static_asset enforces XOR: both-set or neither-set fail with ShapeError::Field { path: Asset(i, "source") }. 4 new tests cover derive-mode round-trip, legacy source-only TOML round-trip without leaking a derive field, both-set rejection, neither-set rejection, and both-modes-accepted positive case. Cloud reconciler (static_asset.rs:360) now bails on derive-mode with a pointer to R438-T5 until the materialize step lands. 3 test fixtures updated with source: Some(…) + derive: None. export-ts regenerated (TransformSpec + AssetDerive emitted); xtask emit-schemas regenerated workload.toml.schema.json; schema_drift test green. workload-spec: 24/24, cloud static_asset: 25/25, xtask: 2/2.”)

@yah:ticket(R438-T3, “ImageRef digest-pin enforcement at deserialize”) @yah:assignee(agent:claude) @yah:at(2026-06-04T21:06:55Z) @yah:status(review) @yah:phase(P1) @yah:parent(R438) @arch:see(.yah/docs/working/W164-derived-static-assets.md) @arch:see(.yah/docs/working/W165-mesofact-build-mode-lowering.md) @yah:handoff(“ImageRef now accepts either a string form (digest-pinned, W164/W165 path) or the legacy struct form (backwards-compat for WorkloadSpec configs). String form requires @sha256: suffix: bare-tag, non-sha256, and non-hex digests all reject at serde-deserialize. Single parser compose_import::parse_pinned_image_ref is the rule’s one home; T4 (recipes) and T6 (BuildMode::InContainer) will both deserialize images through this string path. Custom Deserialize uses untagged enum (Pinned(String) | Struct(Fields)); Serialize/TS/JsonSchema derives stay on the struct so wire output and TS exports are unchanged. 6 new tests cover: bare-tag reject, pinned accept (docker.io + ghcr.io), non-sha256 algorithm reject, empty/non-hex digest reject, struct-form still works with digest=None, struct-form TOML round-trip. workload-spec: 30/30 lib + 18/18 semantic + 6/6 shape_fixtures. xtask schema_drift green after emit-schemas regen. cargo check –workspace clean.”) @yah:next(“Tighten ImageRef workspace-wide: digest: Option → digest: String (required). tag stays as the human-readable identifier; digest is the source of truth. Rationale: every image we execute should be reproducible-by-construction; the on-disk shape should make unpinned-image bugs impossible.”) @yah:next(“Every existing ImageRef construction site updates to pass a digest. Call sites known today (~10): yubaba integration tests (fake digests via a test helper), yubaba/runtime/{containerd,fake}, yubaba/deploy/{mesh_resolve,env_validate}, local-runtime, cloud/config, workload-spec round_trip tests, restart_policy tests, compose_import::parse_image_ref. The break is bounded — single PR, no surprise call sites outside the workspace.”) @yah:next(“compose_import::parse_image_ref returns Result<ImageRef, ParseImageRefError> with an UnpinnedImage variant. Docker-compose strings without @sha256: become an explicit parse error — callers must pre-resolve tags to digests (most compose imports already happen at yubaba submission time where a pinning pass can run).”) @yah:next(“Add task::local::test_support::test_digest() (or similar) for test fixtures — a fixed valid-format sha256 string so tests don’t have to mint their own.”) @yah:next(“Recipe TOML loader (T4) and W165 BuildMode::InContainer (T6) inherit the new requirement for free — they consume ImageRef and digest is now structurally required.”) @yah:verify(“cargo check –workspace –locked passes after the tightening + call-site migration (yubaba, runtime, local-runtime, mesh_resolve, env_validate, cloud/config, compose_import)”) @yah:verify(“ImageRef without digest no longer constructs — parse-time + type-level enforcement. cargo test -p workload-spec round_trip + restart_policy pass with updated fixtures.”) @yah:verify(“compose_import::parse_image_ref("node:20") → Err(UnpinnedImage); parse_image_ref("node:20@sha256:…") → Ok.”) @yah:verify(“cargo test -p yubaba –tests + -p local-driver passes with new test_digest() helper in place of bare tags.”) @yah:gotcha(“Earlier framing assumed T3 needed a PinnedImageRef newtype to avoid breaking yubaba. Reversed after design discussion 2026-06-04: breaking yubaba in service of reproducibility-by-construction is the right architectural move. Digest is required workspace-wide; tag stays as a human-readable identifier. ~10 call sites migrate in one PR.”) @yah:gotcha(“MesofactStaticWorkload.build_mode → InContainer { image } today is declared but never executed (build always runs on host — see W165). Once T3 tightens ImageRef, the wired-up build_mode lowering in T6 inherits digest-pinning automatically, closing W165 OQ#1’s escape hatch.”) @yah:assumes(“No production yubaba deployment ships ImageRefs we don’t already digest-pin. Spot-check Hetzner/cloud yah-castle workload specs before merging the tightening; if any prod path uses tag-only, it gets pinned in the same PR.”) @yah:handoff(“Pushed back from review 2026-06-04 — user reaffirmed the workspace-wide tightening direction. What landed (untagged Deserialize accepting string-form OR struct-form-with-digest:Option) ships digest enforcement at the W164/W165 wire surfaces but leaves the struct-form escape hatch (digest: None still constructs). User: ‘breaking yubaba in order to improve it architecturally is fine’. Final shape needs both: (a) keep the string-form parser as a recipe-author convenience (image = "ghcr.io/x@sha256:…"), AND (b) tighten the struct form’s digest: Option → String. Then both paths land at the same digest-required field and unpinned-image bugs become impossible by construction. ~10 call sites still need migration (yubaba/runtime/{containerd,fake}, yubaba/deploy/{mesh_resolve,env_validate}, local-driver/local_runtime, cloud/config, workload-spec tests/round_trip + tests/restart_policy + yubaba integration_* + yubaba/tests/integration_public_ingress + integration_operator_bridge + integration_mesh + integration_single_node). Add task::local::test_support::test_digest() returning a fixed valid-format sha256 string. Pick this up by claiming R438-T3.”) @yah:handoff(“Workspace-wide ImageRef tightening landed. (a) ImageRef.digest: Option → String at workload-spec/src/lib.rs:923; Deserialize struct arm now requires the field; untagged string-form parser at compose_import::parse_pinned_image_ref untouched. (b) ImageRef::docker_ref() now always emits tag@digest pair (informational tag alongside content-addressed digest). (c) validate.rs ImageTag check tightened: tag must be non-empty (digest presence is type-enforced now). (d) compose_import::parse_image_ref returns Result<ImageRef, String> — alias for parse_pinned_image_ref. import_compose gained ImportError::UnpinnedImage { service, image, reason } variant; only external caller (yah workload import in app/yah/cli/src/workload.rs) propagates the error type. (e) New workload_spec::testing module (doc-hidden) exposes TEST_DIGEST const + test_digest() fn — all-zeros 64-hex sentinel. (f) task::default_image::catalog_image falls back to testing::test_digest() when the per-image env var is unset, preserving the infallible API but making unset-digest visible at runtime via docker pull failure. default_buildkit_image follows the same pattern. (g) Migrated ~22 struct-form construction sites: workload-spec tests (round_trip/semantic/restart_policy + all 15 fixture JSONs + 3 compose YAML fixtures + matching expected.json), task crate (default_image/integration/lib/local/remote), yubaba (runtime/{containerd,fake}, deploy/{mesh_resolve,env_validate}, all 4 integration_*.rs files), cloud/config (3 sites), local-driver (local_runtime + pond_ssr_runtime), scryer/beholders, kamaji/{server,native,containerd}. (h) ImageSource::pull trait signature tightened: digest: Option<&’a str> → digest: &’a str (only one impl in yubaba/env_validate). (i) Read-site cleanup: yubaba::runtime::containerd::image_ref, kamaji::containerd::image_ref, local-driver::pond_ssr_runtime::compose_image_ref, task::local::image_ref_arg — all dropped Option ceremony, always emit tag@digest. cargo check –workspace clean. cargo test -p workload-spec: 82 pass. cargo test -p task –lib: 59 pass. Pre-existing test failures in cloud (5: 1 cloud_init drift, 4 mesofact_static adopt) and yubaba tests (pond_reconciler_smoke missing ssr_runtime/worker_mode/ssr_origin fields) are unrelated to ImageRef — separate ticket. R438-T4 (recipe loader) and R438-T6 (BuildMode::InContainer) inherit digest-required structurally with zero per-consumer work.”)

@yah:ticket(R438-T7, “Golden tests: recipe→ForgeSpec lowering + BuildMode→ForgeSpec lowering parity”) @yah:assignee(agent:claude) @yah:at(2026-06-04T21:07:30Z) @yah:status(review) @yah:phase(P3) @yah:parent(R438) @yah:next(“Golden test: sample transform recipe + asset.derive.transform.params lowers to expected ForgeSpec (argv, image digest, TaskPlacement)”) @yah:next(“Golden test: MesofactStaticWorkload with build_mode=in_container lowers to expected ForgeSpec”) @yah:next(“Round-trip parity: same Subprocess + Local + Container quadrant for both consumers; regression-guards argv-substitution and image-pin drop-through”) @yah:verify(“cargo test -p workload-spec lowering_golden_*”) @yah:verify(“Golden files versioned; updates require explicit –update flag”) @arch:see(.yah/docs/working/W164-derived-static-assets.md) @arch:see(.yah/docs/working/W165-mesofact-build-mode-lowering.md) @yah:depends_on(R438-T5) @yah:depends_on(R438-T6) @yah:handoff(“T7 landed. (1) Extracted pure lowering helpers exposed at pub(crate):\n - mesofact_static::lower_build_to_forge_spec(workload_dir, &BuildConfig, &BuildMode) -> ForgeSpec (run_build now wraps this)\n - static_asset::lower_recipe_step_to_forge_spec(&TransformRecipe, &RecipeStep, substituted_argv) -> ForgeSpec (materialize_transform now calls this for each step)\n(2) New cfg(test) module crates/yah/cloud/src/reconciler/lowering_golden.rs registered from reconciler/mod.rs. Five golden tests:\n - golden_recipe_step_lowers_to_pinned_local_container_subprocess (recipe → ForgeSpec shape: argv, image digest, timeout, label, initiator)\n - golden_recipe_step_with_zero_timeout_lowers_to_none (regression-guards the timeout=0 → None mapping)\n - golden_build_in_container_lowers_to_pinned_local_container_subprocess (BuildMode::InContainer → sh -c shell wrap + pinned image + cwd label)\n - golden_build_host_side_lowers_to_native_quadrant_without_image (BuildMode::HostSide → image=None + TaskRuntime::Native)\n - parity_recipe_and_build_in_container_share_quadrant (THE architectural invariant: both consumers land in the same Subprocess + Local + Container quadrant with sha256-pinned images and Gnome initiators — lets one ForgeExecutor dispatch handle both)\n(3) Test artifacts are hand-coded assertions, not insta/snapshot files — workspace has no insta infra and explicit-Pin tests give clearer diff on drift than auto-update snapshots. The W164/W165 lowering shape is now regression-guarded against silent drift in either consumer. cargo test -p cloud –lib reconciler::lowering_golden: 5 pass. Workspace check clean.”) @yah:next(“Sign off → archive R438-T7”) @yah:next(“T8 (worked examples) now has tested lowering primitives to reference”) @yah:verify(“cargo test -p cloud –lib reconciler::lowering_golden — 5 pass”) @yah:verify(“cargo test -p cloud –lib reconciler:: — 124 pass; 4 pre-existing R441-B4 adopt_only failures (port 4321 dev-box collision) unrelated”) @yah:verify(“cargo check –workspace –locked — clean (warnings only)”) @yah:verify(“Parity test asserts both lowerings produce TaskPlacement{Local, Container} + ForgeCommand::Subprocess + sha256-pinned image — the shared executor dispatch invariant”) @yah:gotcha(“Test location pivot: original ticket said cargo test -p workload-spec lowering_golden_* but the lowering primitives don’t live in workload-spec — ForgeSpec/TaskPlacement are in task, and the actual lowering helpers are in cloud (both consumers live there). Tests landed in cloud as reconciler::lowering_golden. If a future consumer outside cloud needs the BuildMode lowering, lift lower_build_to_forge_spec up to task::transforms alongside the existing recipe lowering primitives.”) @yah:gotcha(“No snapshot/insta infra in workspace — ‘Golden files versioned; updates require explicit –update flag’ verify line interpreted as hand-coded explicit assertions instead. Drift surfaces as a single-file test diff on the lowering helper, which is more readable than a .snap diff for the small ForgeSpec shape these tests cover.”)

Modules§

compose_import
One-way, lossy compose YAML → WorkloadSpec import shim.
rollout
Rollout policy schema — the typed form of .yubaba/rollout.toml.
secrets
Pluggable secret resolver for crate::SecretRef values.
validate
Shape validators for WorkloadSpec.

Structs§

AlmanacManifest
kind = "almanac" manifest — a declared data-pipeline job.
AssetDerive
Provenance chain for a derived asset: required fetch step, optional transform step. Materialized bytes replace AssetEntry.source for the rest of the static-asset reconcile loop.
AssetEntry
A single file entry in the static-asset catalog.
BackoffPolicy
Exponential backoff parameters for RestartPolicy::OnFailure.
BlakeHash
BLAKE3 content hash expressed as exactly 64 ASCII hex digits.
BuildConfig
Build step that produces the static artifact published by a mesofact-static workload.
DeriveLock
W212/R518: the committed derivation lock — the in-tree action-cache receipt. input_hash is the input-addressed derivation key computed over the complete declared input set (fetched-input pin ⊕ recipe-file bytes ⊕ invocation params ⊕ schema version); output_blake3 is what those inputs produced (== the entry’s blake3). The reconciler skips the entire build (no fetch, no transform, no PUT) when the lock matches the inputs recomputed from the current pins and the bucket already holds the output — the Nix-substituter / Bazel-remote-cache behaviour. Written by the R510 bind path from the reconciler’s discovered_input_hash:<filename> output; the git diff on this block is the receipt that the derivation rolled.
EnvVar
A single environment variable injected into the container.
ExposeSpec
Network exposure configuration. The three channels are independent; any combination is valid.
FetchSource
Shared fetch primitive — usable by asset.derive today, and by Almanac’s ReleaseSource after a follow-up migration (R438-F10). Defined once in workload-spec so both consumers reject the same set of non-permissive licenses.
Healthcheck
Container health probe configuration.
ImageRef
Container image reference identifying a specific image to pull.
MachineId
Opaque identifier for a yubaba-managed machine within the cluster.
MeshExpose
Mesh-internal port exposure and peer access control.
MeshIdent
DNS-segment identity for a workload on the cluster mesh, e.g. "noisetable-api.pdx". Regex constraint: ^[a-z0-9]([a-z0-9-]*[a-z0-9])?$, length ≤ 63. Enforced in shape validation (R090-F2).
MesofactStaticWorkload
kind = "mesofact-static" payload — static-site build colocated with the frontend it deploys.
Millis
Duration expressed as an integer millisecond count.
OperatorExpose
Operator-facing exposure via a Tailscale ACL tag.
PublicExpose
Public internet exposure via a Cloudflare tunnel route.
ResourceLimits
Hard resource caps enforced by containerd/cgroups at runtime.
SecretMount
A secret value mounted into the container as an env var or file.
StaticAssetWorkload
kind = "static-asset" payload — content-addressed bucket catalog.
StopPolicy
Graceful shutdown configuration for yubaba’s stop sequence.
TierTag
Tier classification that governs admission control and mesh allow_from filtering. Known values: "public", "tenant", "private", "infra". Custom tiers are allowed per cluster; shape validation warns on unknowns rather than rejecting them (R090-F2).
TransformSpec
Optional transform applied after a FetchSource download, lowering to a ForgeCommand::Subprocess via the recipe loader (R438-T4). The transform’s output is content-addressed by the entry’s blake3 (the recipe runs only when the cache misses).
VolumeMount
A volume mount inside the container.
WorkloadSpec
Complete typed description of a containerd workload handed to yubaba over RPC. This is also the payload of the kind = "container" variant of Workload on disk.

Enums§

AlmanacTarget
An observable endpoint the almanac scheduler probes to check readiness.
BuildMode
Where the build command runs for a mesofact-static workload.
Cadence
When the almanac scheduler triggers a run.
EnvValue
Value source for an environment variable.
HealthProbe
Mechanism used to check container health.
License
Closed-set, parse-time-enforced license tag. Mirrors the workspace permissive-license rule (MIT / Apache-2.0 / BSD-2/3-Clause / ISC). Adding a variant is an explicit schema change — non-permissive strings ("GPL-3.0", "AGPL", etc.) fail at serde-deserialize before any shape validator runs.
MeshLookup
Which aspect of a mesh peer’s address to inject.
NotReadyPolicy
What the almanac scheduler does when a precondition check fails.
PublicTls
TLS mode for a public endpoint.
RestartPolicy
What yubaba does when the container exits.
SchemaVersion
Wire-format schema version envelope.
SecretRef
Where yubaba resolves the secret value from.
SecretTarget
How the secret is surfaced inside the container.
VolumeSource
Backing source for a volume mount.
Workload
On-disk workload.toml manifest. Each variant matches one ServiceComponent.kind value; the kind field on the wire is the serde discriminator.

Constants§

HOST_NETWORK_ANNOTATION
Annotation key requesting a workload share the host network namespace. See WorkloadSpec::wants_host_network.
HOST_NETWORK_VALUE
Annotation value (for HOST_NETWORK_ANNOTATION) selecting host networking. Any other value leaves the workload in an isolated netns.

Traits§

WorkloadRuntime
Shared interface for deploying and managing WorkloadSpec containers.