Expand description
Observations, compact masks, and VisionIndex storage for SightLoom.
SightLoom owns the VisionIndex document. Sibling products own
separate documents that must not be mixed in:
CaptureProjectSemanticEditPlanRenderGraphExecutionPlan
Modules§
- sqlite_
query - Query helpers over a saved
SQLiteevent index.
Structs§
- Anomaly
Event - Backend-neutral anomaly event exposed to host products.
- Anomaly
Event Dto - Serializable anomaly event.
- Appearance
- One continuous appearance of a subject on a source timeline.
- Appearance
Dto - Serializable appearance.
- CoOccurrence
- Two subjects observed together within a temporal window.
- CoOccurrence
Dto - Serializable co-occurrence.
- Cropped
Mask - A binary mask cropped to a bounding rectangle in full-frame coordinates.
- Dense
Mask - A dense binary mask with one byte per pixel (
0or non-zero). - Event
Envelope Dto - Serializable event envelope.
- Event
Index - In-memory stand-in for the
SQLiteevent/subject index. - Event
Record - One indexed analytics/event row.
- Evidence
Reel - Evidence reel: ordered segments for one subject (or multi-subject host set).
- Evidence
Reel Builder - Builds reels from index data.
- Evidence
Reel Dto - Serializable evidence reel.
- Keypoint
- One 2D keypoint with optional confidence and class/index tag.
- Keypoint
Set - A set of keypoints for one detection / observation.
- Keypoint
Store - In-memory store of keypoint sets (out-of-line from observations).
- Mask
Store - In-memory compact mask store.
- Media
Time Dto - Serializable media time.
- Memory
Build Config - Options for materializing appearances and visits.
- Memory
Manifest - Top-level sidecar package description.
- Model
Provenance - Provenance for detections that produced a memory record.
- NlParse
Result - Successful parse with optional non-fatal warnings.
- Observation
- A rich, model-neutral observation for video understanding pipelines.
- Observation
Attributes - Small fixed set of numeric/boolean attributes attached to an observation.
- Observation
Dto - Serializable rich observation (revision-aware).
- Oriented
Detection - Oriented detection for NMS (score + OBB + optional class).
- Oriented
Rect - A center-based oriented rectangle (degrees clockwise from +X).
- Page
- Pagination cursor.
- Pattern
Record - Stored pattern record.
- Pattern
Record Dto - Serializable pattern record.
- Polygon
Mask - A polygonal mask stored as validated vertices in full-frame coordinates.
- Query
Cursor - Cursor state for paginated + incremental subject queries.
- Redaction
Interval - First-class provenance row for a redaction-relevant media interval.
- Redaction
Interval Dto - Serializable redaction / provenance interval.
- Redaction
Spec - Host / re-id input for one provenance interval (no auto appearance link).
- ReelId
- Opaque reel identifier within one index / session.
- Reel
Segment - One segment inside an evidence reel (still no pixels).
- Reel
Segment Dto - Serializable reel segment.
- RleMask
- A COCO-style row-major RLE mask.
- Route
- Ordered route summary for a subject (sequence of zone or source hops).
- Route
Dto - Serializable route.
- Source
Entry - One media source recorded in the manifest.
- Source
Hash - Content hash of a media source for integrity and multi-camera joins.
- Source
Transition - Transition of a subject between media sources (multi-camera handoff).
- Source
Transition Dto - Serializable source transition.
- Spatial
Hit - One spatial hit (track sample intersecting the region).
- Spatial
Query - Axis-aligned region query over effective track samples.
- Streaming
Subject Query - Streaming subject query: holds a filter + cursor.
- Subject
Hit - One subject row returned by
execute_subject_query. - Subject
Profile - Compact long-lived subject profile stored in the index.
- Subject
Profile Dto - Serializable subject profile.
- Subject
Query - Composable subject-oriented query.
- Subject
Rank - One ranked subject row.
- Then
Seen In - Require zone A then zone B within a time bound.
- Track
Arrow Batch - Columnar batch of track samples (Arrow-shaped logical schema).
- Track
Sample - One track sample suitable for CBOR and Arrow-shaped columnar export.
- Track
Sample Dto - Serializable track sample.
- Track
Stream - In-memory append-only track stream (host conveniences).
- Validation
Issue - One validation finding with an object path and optional repair hint.
- Validation
Report - Full validation report.
- Video
Memory - In-memory package convenience wrapper.
- Vision
Index - In-memory
VisionIndexdocument. - Vision
Index Header - Header describing a
VisionIndexpackage on disk or in memory. - Vision
Index Package - Saves and loads a directory-based
VisionIndexpackage. - Vision
Index Snapshot - Fully serializable materialization of a
VisionIndex. - Visit
- A visit of a subject to a scene or logical place across one or more sources.
- Visit
Dto - Serializable visit.
- Zone
Stay - Time spent by a subject or track inside a zone.
- Zone
Stay Dto - Serializable zone stay.
Enums§
- Anomaly
Reason - Machine-readable anomaly reason codes (host maps to UI copy).
- Mask
Error - An error produced by a mask operation.
- Memory
Error - An error produced by sidecar memory operations.
- NlParse
Error - NL parse failure.
- Pattern
Kind - Pattern kind tags.
- Query
Node - Boolean query tree.
- Query
Order - Sort order for query results.
- Redaction
Intent - Host / Intelligence intent for a redaction provenance interval.
- Severity
- Anomaly severity for host presentation.
- Subject
Predicate - Atomic subject predicate.
- Validation
Severity - Severity of a validation finding.
Constants§
- CURRENT_
FILE - Pointer file naming the active generation directory.
- GALLERY_
FILE - Optional identity gallery sidecar written by the facade session.
- MANIFEST_
FILE - Filename used for the package header JSON.
- MANIFEST_
VERSION - Current manifest schema version written by this crate.
- TRACK_
ARROW_ MAGIC - Codec magic + version for
encode_track_arrow/decode_track_arrow. - TRACK_
ARROW_ VERSION - Current schema version.
- VISION_
INDEX_ VERSION - Schema version written by this crate for
VisionIndexdocuments.
Functions§
- append_
redaction_ intervals - Appends rows to the redaction table.
- bbox_
to_ polygon - Bounding-box rectangle as a trivial four-corner polygon.
- build_
appearances - Builds appearances from effective track samples.
- build_
redaction_ from_ appearances - Builds redaction provenance rows from appearances matching a filter.
- build_
redaction_ from_ specs - Builds redaction rows from explicit host-provided interval specs.
- build_
subject_ profiles - Builds
SubjectProfilerows from appearances (preferred) or track samples. - build_
subject_ reel - Convenience: build a coalesced reel for a subject on an index.
- build_
visits - Builds visits by merging a subject’s appearances across sources.
- cropped_
mask_ iou - Intersection-over-union for two cropped masks in a shared full-frame space.
- cropped_
to_ polygon_ approx - Extracts an ordered boundary-ish polygon from a cropped mask’s outer bbox corners.
- decode_
track_ arrow - Decodes
SLARROW1bytes into track samples. - decode_
track_ arrow_ batch - Decodes into a columnar batch.
- dense_
mask_ difference - Pixel-wise difference
a \ bintooutput. - dense_
mask_ iou - Intersection-over-union for two dense masks of equal size.
- dense_
mask_ union - Pixel-wise union of two equal-size dense masks into
output. - dense_
to_ bbox - Converts a dense mask to its tight axis-aligned bounding box.
- dense_
to_ contour - Traces the outer contour of the first foreground component found.
- dense_
to_ contours - All external contours (one per 4-connected component, outer only).
- dense_
to_ rle - Encodes dense bytes into RLE (see
RleMask::encode_from_dense). - dilate
- Dilates a dense mask with a square odd kernel of
radiuspixels. - effective_
observations - Effective observation view: rows not superseded by a later observation.
- encode_
track_ arrow - Encodes samples as
SLARROW1bytes. - encode_
track_ arrow_ batch - Encodes a columnar batch.
- erode
- Erodes a dense mask with a square odd kernel of
radiuspixels. - execute_
query_ ast - Executes a boolean query AST, returning subject hits.
- execute_
spatial_ query - Returns effective track samples whose boxes intersect the spatial region.
- execute_
subject_ query - Executes a
SubjectQueryagainst an in-memory index. - feather
- Soft feathering: distance-like alpha falloff inside
radiusof the edge. - fill_
holes - Fills enclosed background holes entirely surrounded by foreground.
- mask_
nms_ by_ iou - Mask-level NMS scores: each entry is
(score, mask_index). - most_
frequent_ subject - Returns the single most frequent subject, if any samples are labeled.
- observation_
idempotency_ seen - True when
key != 0already appears on any observation (host idempotency). - oriented_
aabb_ iou - Approximate oriented box overlap via AABB of each OBB (fast host prefilter).
- oriented_
iou - Exact-ish oriented box
IoUvia convex polygon intersection (Sutherland–Hodgman). - oriented_
nms_ aabb - Hard NMS on oriented detections using AABB-IoU approximation.
- parse_
nl_ query - Parses a restricted English query string into a
QueryNode. - polygon_
to_ dense - Rasterizes a polygon mask into a dense buffer of size
width * height. - rank_
subjects_ by_ frequency - Ranks subjects by sample count (most frequent first).
- rebuild_
memory_ entities - Rebuilds
appearancesandvisitson the index from effective track samples. - rebuild_
subject_ profiles - Rebuilds
index.subjectsfrom appearances (or tracks). Preserves labels / embeddings. Returns profile count. - rle_
to_ dense - Decodes RLE into dense bytes (see
RleMask::decode_into). - set_
redaction_ intervals - Replaces
index.redaction_intervalswithrows(idempotent assign). - source_
entry - Helper to attach an optional content hash to a source entry at construction.