A data engineer needs to implement a Slowly Changing Dimension Type 2 (SCD Type 2) for a customer dimension table. Which statement correctly describes the SCD Type 2 approach?

Question

Accepted Answer

B. When a customer attribute changes, a new row is inserted with the updated values and effective date columns, while the previous row is marked as expired. SCD Type 2 maintains a complete history of all changes to dimension attributes. When an attribute changes, a new row is inserted with the updated values, a new `start_date`, and a null or far-future `end_date`. The previous row is updated with an `end_date` set to the current date and an `is_current` flag set to `false`. In Databricks, this pattern is commonly implemented using `MERGE INTO` with matched and not-matched conditions.

A data engineer needs to implement a Slowly Changing Dimension Type 2 (SCD Type 2) for a customer dimension table. Which statement correctly describes the SCD Type 2 approach?

Related Questions

Discussion