A data engineer configures Auto Loader with cloudFiles.schemaEvolutionMode set to addNewColumns. A new field discount_pct appears in incoming JSON files that was not present in the original schema. What happens?
discount_pct field is written to a _rescued_data column and not added to the target schemadiscount_pct field is automatically added to the target table schema and populated in new recordsdiscount_pct are dropped and logged as schema violationsMore Data Ingestion & Acquisition Questions
14 questions
Full Databricks Certified Data Engineer Professional Practice Test
All topics covered
All Databricks Certified Data Engineer Professional Questions
Browse by topic
Related Questions
What is the primary purpose of the `cloudFiles` source format in Databricks Auto Loader?...
A data engineer needs to perform a one-time batch load of Parquet files from an S3 bucket into an ex...
A data engineer ingests JSON files using Auto Loader with a fixed target schema. Incoming files occa...
In Auto Loader, what is the difference between directory listing mode and file notification mode for...
A data engineer uses Auto Loader to ingest files from an Azure Data Lake Storage Gen2 path. The sour...
Educational Content — CertQnA practice questions are written against official exam objectives, covering the same domains tested on the real exam. All content is original and independent — not actual exam questions, not affiliated with any certification vendor. Learn more about our content policy
Discussion
Be the first to share your understanding of this concept
Sign in to join the discussion