[][src]Module pachyderm::pps

Modules

api_client

Generated client implementations.

Structs

ActivateAuthRequest
ActivateAuthResponse
Aggregate
AggregateProcessStats
BuildSpec
ChunkSpec

ChunkSpec specifies how a pipeline should chunk its datums.

CreateJobRequest
CreatePipelineRequest
CreateSecretRequest
CronInput
Datum
DatumInfo
DeleteJobRequest
DeletePipelineRequest
DeleteSecretRequest
Egress
EtcdJobInfo

EtcdJobInfo is the portion of the JobInfo that gets stored in etcd during job execution. It contains fields which change over the lifetime of the job but aren't used in the execution of the job.

EtcdPipelineInfo

EtcdPipelineInfo is proto that Pachd stores in etcd for each pipeline. It tracks the state of the pipeline, and points to its metadata in PFS (and, by pointing to a PFS commit, de facto tracks the pipeline's version)

FlushJobRequest
GarbageCollectRequest
GarbageCollectResponse
GetLogsRequest
GitInput
GpuSpec
HashtreeSpec

HashTreeSpec sets the number of shards into which pps splits a pipeline's output commits (sharded commits are implemented in Pachyderm 1.8+ only)

Input
InputFile
InspectDatumRequest
InspectJobRequest
InspectPipelineRequest
InspectSecretRequest
Job
JobInfo
JobInfos
JobInput
ListDatumRequest
ListDatumResponse
ListDatumStreamResponse

ListDatumStreamResponse is identical to ListDatumResponse, except that only one DatumInfo is present (as these responses are streamed)

ListJobRequest
ListPipelineRequest
LogMessage

LogMessage is a log line from a PPS worker, annotated with metadata indicating when and why the line was logged.

Metadata
ParallelismSpec
PfsInput
Pipeline
PipelineInfo
PipelineInfos
ProcessStats
ResourceSpec

ResourceSpec describes the amount of resources that pipeline pods should request from kubernetes, for scheduling.

RestartDatumRequest
RunCronRequest
RunPipelineRequest
SchedulingSpec
Secret
SecretInfo
SecretInfos
SecretMount
Service
Spout
StartPipelineRequest
StopJobRequest
StopPipelineRequest
TfJob
Transform
UpdateJobStateRequest
Worker
WorkerStatus

Enums

DatumState
JobState
PipelineState
WorkerState