Databricks Certified Data Engineer Associate Practice Test 28
Question 270
At Satellite imagery startup, the land-cover observations workflow depends on land_cover_observations_south. Engineers report that land_cover_observations_south Delta queries slow after the filter distribution changes; the evidence is that query profile shows increased file scanning despite healthy worker utilization. They require that performance optimization must adapt to predicate patterns. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Compare representative query scan metrics and results before and after
- Monitor scan-to-result ratio and clustering upkeep for land_cover_observations_south
- Add a new physical partition for every possible filter value at Satellite imagery startup
- Choose suitable liquid clustering keys and supported optimization maintenance
Explanation
Correct Answer
B:Monitor scan-to-result ratio and clustering upkeep for land_cover_observations_south creates recurring visibility into the failure mode (land_cover_observations_south Delta queries slow after the filter distribution changes). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while performance optimization must adapt to predicate patterns.
Incorrect Answers
A:Compare representative query scan metrics and results before and after is a one-time acceptance check. It does not supply continuing operational detection for land_cover_observations_south; a passing test cannot substitute for the specific task now required.
C:Extreme partitioning creates metadata overhead. The proposed action (Add a new physical partition for every possible filter value at Satellite imagery startup) does not meet the requirement that performance optimization must adapt to predicate patterns, nor does it constitute continuing operational detection.
D:Choose suitable liquid clustering keys and supported optimization maintenance is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the land_cover_observations_south scenario, the observed evidence is that query profile shows increased file scanning despite healthy worker utilization; the requirement remains: performance optimization must adapt to predicate patterns.
Question 271
At Online bicycle retailer, the product sales transactions workflow depends on product_sales_transactions_east. Engineers report that product_sales_transactions_east downstream transformation needs to run after its governed source table changes; the evidence is that the source updates irregularly while cron polling starts empty jobs. They require that data freshness should follow actual table changes rather than wall-clock guesses. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Enable the data-driven trigger and run a controlled upstream update
- Schedule a blind daily task when source updates require immediate processing at Online bicycle retailer
- Verify that source table and trigger are supported for product_sales_transactions_east
- Configure a table-update trigger tied to the supported source table
Explanation
Correct Answer
C:Verify that source table and trigger are supported for product_sales_transactions_east directly investigates the evidence (the source updates irregularly while cron polling starts empty jobs) and distinguishes possible causes of product_sales_transactions_east downstream transformation needs to run after its governed source table changes. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: data freshness should follow actual table changes rather than wall-clock guesses.
Incorrect Answers
A:Enable the data-driven trigger and run a controlled upstream update may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the source updates irregularly while cron polling starts empty jobs.
B:Coarse polling cannot consistently meet data-driven freshness. The proposed action (Schedule a blind daily task when source updates require immediate processing at Online bicycle retailer) does not meet the requirement that data freshness should follow actual table changes rather than wall-clock guesses, nor does it constitute the required pre-change investigation.
D:Configure a table-update trigger tied to the supported source table is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the product_sales_transactions_east scenario, the observed evidence is that the source updates irregularly while cron polling starts empty jobs; the requirement remains: data freshness should follow actual table changes rather than wall-clock guesses.
Question 272
At Manufacturing quality network, the factory defect records workflow depends on factory_defect_records_urban. Engineers report that factory_defect_records_urban silver records pass ingestion despite negative billed quantities; the evidence is that validation sample identifies impossible values in otherwise well-formed JSON. They require that bad records need a defined reject/quarantine policy without hiding valid data. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Define explicit data-quality expectations with documented action for invalid records
- Monitor expectation violation counts and changed data quality trends in factory_defect_records_urban
- Inject invalid rows and verify correct drop, fail or quarantine behavior
- Delete invalid rows silently and report the entire batch as error-free at Manufacturing quality network
Explanation
Correct Answer
B:Monitor expectation violation counts and changed data quality trends in factory_defect_records_urban creates recurring visibility into the failure mode (factory_defect_records_urban silver records pass ingestion despite negative billed quantities). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while bad records need a defined reject/quarantine policy without hiding valid data.
Incorrect Answers
A:Define explicit data-quality expectations with documented action for invalid records is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the factory_defect_records_urban scenario, the observed evidence is that validation sample identifies impossible values in otherwise well-formed JSON; the requirement remains: bad records need a defined reject/quarantine policy without hiding valid data.
C:Inject invalid rows and verify correct drop, fail or quarantine behavior is a one-time acceptance check. It does not supply continuing operational detection for factory_defect_records_urban; a passing test cannot substitute for the specific task now required.
D:Silent loss hides quality issues and masks upstream defects. The proposed action (Delete invalid rows silently and report the entire batch as error-free at Manufacturing quality network) does not meet the requirement that bad records need a defined reject/quarantine policy without hiding valid data, nor does it constitute continuing operational detection.
Question 273
A data engineer at National farm supplier is responsible for harvest purchase orders. The quality expectations pipeline issue is that harvest_purchase_orders_west silver records pass ingestion despite negative billed quantities. The supporting evidence is that validation sample identifies impossible values in otherwise well-formed JSON. The engineer must ensure that bad records need a defined reject/quarantine policy without hiding valid data. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Quantify invalid predicate occurrences and source impact for harvest_purchase_orders_west
- Roll out expectation checks and a quarantine audit before enforcing production policy
- Define explicit data-quality expectations with documented action for invalid records
- Delete invalid rows silently and report the entire batch as error-free at National farm supplier
Explanation
Correct Answer
A:Quantify invalid predicate occurrences and source impact for harvest_purchase_orders_west directly investigates the evidence (validation sample identifies impossible values in otherwise well-formed JSON) and distinguishes possible causes of harvest_purchase_orders_west silver records pass ingestion despite negative billed quantities. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: bad records need a defined reject/quarantine policy without hiding valid data.
Incorrect Answers
B:Roll out expectation checks and a quarantine audit before enforcing production policy may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that validation sample identifies impossible values in otherwise well-formed JSON.
C:Define explicit data-quality expectations with documented action for invalid records is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the harvest_purchase_orders_west scenario, the observed evidence is that validation sample identifies impossible values in otherwise well-formed JSON; the requirement remains: bad records need a defined reject/quarantine policy without hiding valid data.
D:Silent loss hides quality issues and masks upstream defects. The proposed action (Delete invalid rows silently and report the entire batch as error-free at National farm supplier) does not meet the requirement that bad records need a defined reject/quarantine policy without hiding valid data, nor does it constitute the required pre-change investigation.
Question 274
The admission_scan_events_north pipeline at Regional sporting venue has this failure: admission_scan_events_north table exposes national IDs to analysts who need only transaction amounts. The team observed that query review shows raw identifier values in common reports. Business requirement: users without an approved role must see masked sensitive columns. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Rename identifier column to a harmless label while leaving values visible at Regional sporting venue
- Attach the mask in staging with explicit tested identity rules
- Query the same column as privileged and unprivileged groups
- Apply Unity Catalog column masks or suitable centrally governed masking policy
Explanation
Correct Answer
B:Attach the mask in staging with explicit tested identity rules provides a bounded way to introduce the approved solution into admission_scan_events_north and detect an early mismatch. The existing signal is query review shows raw identifier values in common reports; a staged change protects the service requirement (users without an approved role must see masked sensitive columns) and makes rollback practical.
Incorrect Answers
A:Renaming a column does not protect its contents. The proposed action (Rename identifier column to a harmless label while leaving values visible at Regional sporting venue) does not meet the requirement that users without an approved role must see masked sensitive columns, nor does it constitute the controlled implementation step.
C:Query the same column as privileged and unprivileged groups is a one-time acceptance check. It does not supply the controlled implementation step for admission_scan_events_north; a passing test cannot substitute for the specific task now required.
D:Apply Unity Catalog column masks or suitable centrally governed masking policy is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the admission_scan_events_north scenario, the observed evidence is that query review shows raw identifier values in common reports; the requirement remains: users without an approved role must see masked sensitive columns.
Question 275
A data engineer at Regional telecom operator is responsible for subscriber provisioning logs. The timestamp type normalization issue is that subscriber_provisioning_logs_central source timestamps arrive as mixed strings and local offsets. The supporting evidence is that a daily fact report groups the same instant into different dates. The engineer must ensure that event time must use a documented timezone and typed timestamp convention. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Compare time strings lexicographically and ignore offsets at Regional telecom operator
- Monitor failed timestamp casts and timezone drift for subscriber_provisioning_logs_central
- Parse timestamps to a common typed convention before time-window aggregation
- Inspect sample offsets and source timestamp formats for subscriber_provisioning_logs_central
Explanation
Correct Answer
C:Parse timestamps to a common typed convention before time-window aggregation is the intended durable approach for subscriber_provisioning_logs_central: it addresses the verified problem (subscriber_provisioning_logs_central source timestamps arrive as mixed strings and local offsets) while preserving the required behavior (event time must use a documented timezone and typed timestamp convention). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:String ordering and timezone ambiguity are not robust event-time modeling. The proposed action (Compare time strings lexicographically and ignore offsets at Regional telecom operator) does not meet the requirement that event time must use a documented timezone and typed timestamp convention, nor does it constitute the target approach.
B:Monitor failed timestamp casts and timezone drift for subscriber_provisioning_logs_central would help detect future recurrence, but metrics alone do not deliver the target approach. The subscriber_provisioning_logs_central requirement is that event time must use a documented timezone and typed timestamp convention.
D:Inspect sample offsets and source timestamp formats for subscriber_provisioning_logs_central could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The subscriber_provisioning_logs_central workflow still requires that event time must use a documented timezone and typed timestamp convention.
Question 276
Consider the device_calibration_readings_urban workload at Optical instrument maker: device_calibration_readings_urban needs a normalized discount amount but the pipeline overwrites the source field. Inspection found that code review shows an arithmetic expression replacing original gross_sales. The governed outcome must ensure that auditors require gross and net amounts independently. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Overwrite the only gross amount and discard source values at Optical instrument maker
- Monitor negative net amounts and source-to-derived reconciliation for device_calibration_readings_urban
- Check discount scenarios and verify both gross and net are correct
- Use withColumn to add a derived net amount while keeping gross_sales unchanged
Explanation
Correct Answer
B:Monitor negative net amounts and source-to-derived reconciliation for device_calibration_readings_urban creates recurring visibility into the failure mode (device_calibration_readings_urban needs a normalized discount amount but the pipeline overwrites the source field). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while auditors require gross and net amounts independently.
Incorrect Answers
A:Overwriting original financial evidence breaks reconciliation. The proposed action (Overwrite the only gross amount and discard source values at Optical instrument maker) does not meet the requirement that auditors require gross and net amounts independently, nor does it constitute continuing operational detection.
C:Check discount scenarios and verify both gross and net are correct is a one-time acceptance check. It does not supply continuing operational detection for device_calibration_readings_urban; a passing test cannot substitute for the specific task now required.
D:Use withColumn to add a derived net amount while keeping gross_sales unchanged is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the device_calibration_readings_urban scenario, the observed evidence is that code review shows an arithmetic expression replacing original gross_sales; the requirement remains: auditors require gross and net amounts independently.
Question 277
The experiment_records_central pipeline at University research consortium has this failure: experiment_records_central has one row per order with an array of purchased items. The team observed that the silver table counts order-level rows as product-level units. Business requirement: downstream inventory reporting needs one row per element with its parent key. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Split the serialized array text on commas without parsing JSON at University research consortium
- Inspect array structure and null or empty-array cases for experiment_records_central
- Monitor empty-array and unexpected element types for experiment_records_central
- Apply explode or explode_outer deliberately while retaining the order ID
Explanation
Correct Answer
D:Apply explode or explode_outer deliberately while retaining the order ID is the intended durable approach for experiment_records_central: it addresses the verified problem (experiment_records_central has one row per order with an array of purchased items) while preserving the required behavior (downstream inventory reporting needs one row per element with its parent key). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:String splitting is not a typed nested-array transformation. The proposed action (Split the serialized array text on commas without parsing JSON at University research consortium) does not meet the requirement that downstream inventory reporting needs one row per element with its parent key, nor does it constitute the target approach.
B:Inspect array structure and null or empty-array cases for experiment_records_central could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The experiment_records_central workflow still requires that downstream inventory reporting needs one row per element with its parent key.
C:Monitor empty-array and unexpected element types for experiment_records_central would help detect future recurrence, but metrics alone do not deliver the target approach. The experiment_records_central requirement is that downstream inventory reporting needs one row per element with its parent key.
Question 278
The lab_sample_events_urban pipeline at Clinical diagnostics network has this failure: the lab_sample_events_urban import creates a single malformed column because input format settings are wrong. The team observed that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. Business requirement: all source columns must map to the intended typed Delta fields. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Choose COPY INTO with the correct CSV fileformat and source column mapping
- Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network
- Inspect sample files and COPY INTO format options for lab_sample_events_urban
- Monitor malformed-file quarantine and schema errors in lab_sample_events_urban
Explanation
Correct Answer
A:Choose COPY INTO with the correct CSV fileformat and source column mapping is the intended durable approach for lab_sample_events_urban: it addresses the verified problem (the lab_sample_events_urban import creates a single malformed column because input format settings are wrong) while preserving the required behavior (all source columns must map to the intended typed Delta fields). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:The parser would misread the source schema rather than fix its mapping. The proposed action (Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network) does not meet the requirement that all source columns must map to the intended typed Delta fields, nor does it constitute the target approach.
C:Inspect sample files and COPY INTO format options for lab_sample_events_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The lab_sample_events_urban workflow still requires that all source columns must map to the intended typed Delta fields.
D:Monitor malformed-file quarantine and schema errors in lab_sample_events_urban would help detect future recurrence, but metrics alone do not deliver the target approach. The lab_sample_events_urban requirement is that all source columns must map to the intended typed Delta fields.
Question 279
The property_reservation_updates_highland pipeline at Multi-region rental platform has this failure: a streaming file reader for property_reservation_updates_highland reprocesses historical data after every job restart. The team observed that the streaming query creates a new checkpoint directory on each run. Business requirement: a restart must resume discovered files instead of replaying all existing input. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Deploy the stream with a durable checkpoint and restart the same logical query
- Configure cloudFiles with a stable checkpoint path for the property_reservation_updates_highland stream
- Restart after a micro-batch and confirm no duplicate file ingestion
- Delete checkpoint state as part of each successful load at Multi-region rental platform
Explanation
Correct Answer
A:Deploy the stream with a durable checkpoint and restart the same logical query provides a bounded way to introduce the approved solution into property_reservation_updates_highland and detect an early mismatch. The existing signal is the streaming query creates a new checkpoint directory on each run; a staged change protects the service requirement (a restart must resume discovered files instead of replaying all existing input) and makes rollback practical.
Incorrect Answers
B:Configure cloudFiles with a stable checkpoint path for the property_reservation_updates_highland stream is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the property_reservation_updates_highland scenario, the observed evidence is that the streaming query creates a new checkpoint directory on each run; the requirement remains: a restart must resume discovered files instead of replaying all existing input.
C:Restart after a micro-batch and confirm no duplicate file ingestion is a one-time acceptance check. It does not supply the controlled implementation step for property_reservation_updates_highland; a passing test cannot substitute for the specific task now required.
D:Deleting checkpoint progress can cause full replay. The proposed action (Delete checkpoint state as part of each successful load at Multi-region rental platform) does not meet the requirement that a restart must resume discovered files instead of replaying all existing input, nor does it constitute the controlled implementation step.
Question 280
At Public weather agency, the station observation files workflow depends on station_observation_files_rural. Engineers report that station_observation_files_rural join hangs on one task while almost every task completes quickly; the evidence is that Spark UI reveals one partition contains most rows for a hot customer key. They require that optimization must preserve all correct joined rows. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Verify exact join output and reduced straggler duration
- Drop the most frequent business key to balance partitions at Public weather agency
- Address skew with AQE skew handling or justified key-salting strategy
- Monitor max-to-median task times and hot-key growth for station_observation_files_rural
Explanation
Correct Answer
D:Monitor max-to-median task times and hot-key growth for station_observation_files_rural creates recurring visibility into the failure mode (station_observation_files_rural join hangs on one task while almost every task completes quickly). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while optimization must preserve all correct joined rows.
Incorrect Answers
A:Verify exact join output and reduced straggler duration is a one-time acceptance check. It does not supply continuing operational detection for station_observation_files_rural; a passing test cannot substitute for the specific task now required.
B:Dropping a hot key loses legitimate data. The proposed action (Drop the most frequent business key to balance partitions at Public weather agency) does not meet the requirement that optimization must preserve all correct joined rows, nor does it constitute continuing operational detection.
C:Address skew with AQE skew handling or justified key-salting strategy is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the station_observation_files_rural scenario, the observed evidence is that Spark UI reveals one partition contains most rows for a hot customer key; the requirement remains: optimization must preserve all correct joined rows.