Expanded column datasets for Databricks Delta Lake
Learn about the Expanded column datasets for Databricks Delta Lake.
Expanded column
This table lists the fields in this Delta Lake storage raw table.
| Field | Data Type | Description |
|---|---|---|
| attributes | STRUCT | All the attributes of the entity |
| analyticsAttributes | STRUCT | All the analytical attributes of the entity |
RDM lookup attribute type normalization
Attributes that have a lookupCode defined (pointing to an RDM lookup type) are always represented as String in schema.json and in Databricks datasets, regardless of the attribute's original type in the L3 model.
For example:
AgeRDM(original type: Integer, withlookupCode) → exported asvalue:stringAgeNonRDM(original type: Integer, nolookupCode) → exported asvalue:long
In addition to the resolved value, materialized views also include:
lookupCode— the standardized code from the RDM lookuplookupRawValue— the raw incoming value before resolution