Build¶
Create pipeline bundles, choose structure and patterns, and author Data Flow Specs.
Browse the guides below. Deploy pipeline bundles in the Deploy section (Deploy).
Bundle scope and structure
Decide how to scope Pipeline Bundles, organize src/dataflows, and decompose large pipelines.
Build a pipeline bundle
Initialize from the template or CLI, add specs, and wire pipeline YAML.
Open guideData Flow Spec reference
Schema and field reference for standard, flows, and materialized-view specs.
Open referencePatterns
Reference recipes for Basic 1:1, multi-source streaming, stream-static, and CDC-from-snapshot flows.
Open patterns