Expand description
The read-API message types, re-exported from headwaters_proto.
These are the owned proto messages the HeadwatersClient
returns. Their open-ended facets / data / fields / events fields are
google.protobuf.Struct; struct_to_json converts one to a
serde_json::Value so callers can read it without depending on buffa.
Structs§
- Dataset
- — datasets —
- Dataset
Version - One historical version of a dataset’s schema. A new version is recorded each time the schema changes.
- Dataset
Version Id - Entity
Id - A
{namespace, name}reference to a job or dataset. - GetAsset
Stats Request - GetColumn
Lineage Request - GetDataset
Request - GetJob
Request - GetJob
Runs Request - GetLineage
Event Stats Request - GetLineage
Request - GetRun
Facets Request - GetTag
Downstream Request - JobDetail
- — jobs —
- Lineage
Edge - — lineage / column-lineage graph —
- Lineage
Graph - A lineage graph: the set of nodes reached from the requested seed, each
carrying its own incident edges. Returned by
GetLineageandGetColumnLineage. - Lineage
Node - One node in a lineage graph, addressed by its nodeId (
id).in_edges/out_edgeslist the edges incident to this node (upstream and downstream respectively); follow them across nodes to walk the graph. - List
Dataset Versions Request - List
Dataset Versions Response - List
Datasets Request - List
Datasets Response - List
Events Request - List
Events Response - — events feed —
- List
Jobs Request - List
Jobs Response - List
Namespaces Request - — request messages —
- List
Namespaces Response - List
Runs Response - List
Tags Request - List
Tags Response - Namespace
- — namespaces —
- RunDetail
- A single execution of a job.
- RunFacets
Response - — run facets —
- Search
Request - Search
Response - Search
Result - — search —
- Stat
Bucket - — stats —
- Stats
Response - A time series of
StatBuckets. Returned by the stats endpoints; on the REST surface it serializes as a bare JSON array. - Tag
- — tags —
- TagPropagation
- Every field a tag reaches downstream through column lineage, including the
originally tagged fields. Returned by
GetTagDownstream. - Tagged
Field - A dataset field carrying a tag, directly or by propagation through column lineage.
Enums§
- Dataset
Type - Storage kind of a dataset. Currently always
DB_TABLE. - Entity
Kind - Kind of a graph node or search hit.
DATASET_FIELDis column-level and only appears in column-lineage graphs. - JobType
- How a job processes data. Currently always
BATCH— the event log does not yet distinguish streaming jobs. - RunState
- Lifecycle state of a run, derived from its OpenLineage events.
COMPLETED/FAILED/ABORTEDare terminal.
Functions§
- struct_
to_ json - Convert an open-ended
Structinto aserde_json::Value(always a JSON object). Use it to readfacets/data/fields/eventswithout touching buffa types directly.
Type Aliases§
- Struct
- The
google.protobuf.Structcarried by open-ended fields (facets,data, schemafields, rawevents).