Pipelines

Manages pipelines and controls batch or event execution.

📄️ Get Stage Schema

Serve the canonical stage vocabulary as JSON Schema. Read-only and resource-free — it describes the contract, not anybody's data — so it authenticates but has nothing to authorize against. The bytes are the same ones the compiler and the conformance tests pin by digest.

📄️ Validate Transform

Validate a draft transform step against its ports and input schemas. Returns ``valid=true`` or raises 422.

📄️ Preview Transform

Run a draft transform on a limited number of rows and return the result without saving data. The preview applies the same transform semantics as a full run.

📄️ List Pipelines

List all pipelines. Only returns pipelines the user has permission to access.

📄️ Create Pipeline

Create a pipeline from its metadata and workflow definition.

📄️ Get Pipeline Versions

List version history for a specific pipeline.

📄️ Get Pipeline

Retrieve a specific pipeline. If a version is specified, return that version.

📄️ Update Pipeline

Change mutable pipeline metadata and workflow definition after write permission is checked. Fields omitted from the request keep their current values.

📄️ Delete Pipeline

Delete a pipeline. Existing batch runs must be deleted first.

📄️ Get Cleanup Status

Retrieve the cleanup progress status after pipeline deletion.

📄️ Execute Batch

Start a batch run for a pipeline.

📄️ Get Batch

Retrieve the current batch status for a pipeline, including step checkpoints.

📄️ Delete Batch

Delete a batch run and its checkpoints.

📄️ Fire Batch Run

Start one scheduled occurrence of a batch pipeline. 202 means the run was started, not finished: the warm trigger retries in the background for minutes and a cold pod takes tens of seconds to come up, while the scheduler's `DISPATCH_TIMEOUT_S` bounds delivery alone. A run already in flight answers 409, which the scheduler records as a dropped occurrence. Cleanup contention is a distinct 503: the scheduler briefly retries that same occurrence through its pod drain.

📄️ Stop Batch

Request a cooperative stop for an in-flight batch run. Completed step outputs are retained.

📄️ Execute Event

Start event-driven execution for a pipeline.

📄️ Get Event

Get the readiness status of an event pipeline.

📄️ Delete Event

Stop event execution for the specified pipeline and release its runtime resources.

📄️ Send Event

Send an event to an event pipeline. By default the operation enqueues the event and returns `202`; use `topic` when the pipeline subscribes to multiple topics. With `direct=true`, it sends the event directly and returns the synchronous execution result.

📄️ Stream Pipeline Run State

Stream the current batch/event run state as Server-Sent Events.