Schema-related Databricks Features¶
Applies To: |
Pipeline Bundle |
Configuration Scope: |
Data Flow Spec |
Databricks Docs: |
Overview¶
Databricks supports schema-level table capabilities such as constraints, generated columns, column masks, and SQL data types. Lakeflow Framework does not redefine these product features; it provides a way to include them in the schema files that are referenced by the data flow spec.
How LFF exposes it¶
Use a text DDL schema file for staging or target tables when you need Databricks SQL schema features that cannot be represented in JSON StructType format. Reference that schema file from the relevant source, staging, target, or materialized view configuration in the data flow spec.
For file layout, supported schema formats, schemaPath usage, and examples,
see Schema Management.