Lakeflow Framework
Migrations
Initializing search
lakeflow_framework
Home
Get Started
Architecture
Samples
Build
Deploy
Features
Contributors
Lakeflow Framework
lakeflow_framework
Home
Get Started
Get Started
What is the Lakeflow Framework?
Quick Start
Architecture
Samples
Build
Build
Bundle Scope and Structure
Building a Pipeline Bundle
Data Flow Spec Reference
Data Flow Spec Reference
Creating a Standard Data Flow Spec Reference
Creating a Flows Data Flow Spec Reference
Creating a Materialized View Data Flow Spec Reference
Data Flows & Pipeline Patterns
Data Flows & Pipeline Patterns
Base Patterns
Base Patterns
Pattern -
Basic 1:
1
Pattern -
Gold Materialized Views
Advanced composition
Advanced composition
Pattern -
Multi-
Source Streaming
Pattern -
Stream-
Static -
Basic
Pattern -
Stream-
Static -
Streaming Data Warehouse
Pattern -
CDC Stream from Snapshots
Scaling and decomposing pipelines
Mix and Match Patterns
Deploy
Deploy
Before you deploy
Deploy the Framework
Deploy the Framework
Deployment options
Deploy from local machine
Installing as a wheel
Deploy Pipeline Bundles
Setting up CI/CD
Features
Features
Metadata-
Driven Development
Metadata-
Driven Development
Data Flow Specification Format
Schema Management
Substitutions
Templates
Validation
Authoring and Tooling
Authoring and Tooling
Auto Complete / Intelli
Sense
UI Integration
Configuration Management
Configuration Management
Framework configuration
Mandatory Table Properties
Spark Configuration
Operational Metadata
Secrets Management
Logging
Builder Parallelization
Supported Sources and Targets
Supported Sources and Targets
Supported Source Types
Supported Target Types
SQL Source
Key Databricks Features
Key Databricks Features
Change Data Capture
(CDC)
Change Data Feed
(CDF)
Multi-
Source Streaming
(Flows)
Liquid Clustering
Materialized Views
Schema-
related Databricks Features
Soft Deletes
Target Catalog and Schema
Python Development and Extensibility
Python Development and Extensibility
Python Code, Libraries & Init Scripts
Python Function Transforms
Python Dependency Management
Python Source
Data Quality
Data Quality
Data Quality -
Expectations
Data Quality -
Quarantine
Environments and Versioning
Environments and Versioning
Logical Environments
Versioning -
Data
Flow Specs
Versioning -
Framework
Migrations
Migrations
Table of contents
Table Migration
Features A–Z
Contributors
Contributors
Set up your environment
Branching, versioning & releases
Contribution workflow
Import conventions
Write & build docs
Contributing to contrib
Migrations
¶
Bring existing tables into Lakeflow Framework-managed pipelines.
Table Migration
Back to top