Databricks Certified Data Engineer Associate Practice Test 16
Question 150
Consider the collection_telemetry_highland workload at Municipal waste service: collection_telemetry_highland executive dashboard refreshes before its gold dataset is updated. Inspection found that job run graph has no edge from aggregation to dashboard refresh. The governed outcome must ensure that dashboards must represent the latest committed daily snapshot. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Refresh the dashboard before materializing the gold data at Municipal waste service
- Configure dashboard refresh after the aggregation task with failure handling
- Use a Lakeflow dashboard task dependent on successful upstream gold refresh
- Trace data dependencies and dashboard refresh timestamps for collection_telemetry_highland
Explanation
Correct Answer
D:Trace data dependencies and dashboard refresh timestamps for collection_telemetry_highland directly investigates the evidence (job run graph has no edge from aggregation to dashboard refresh) and distinguishes possible causes of collection_telemetry_highland executive dashboard refreshes before its gold dataset is updated. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: dashboards must represent the latest committed daily snapshot.
Incorrect Answers
A:The dashboard would show stale results. The proposed action (Refresh the dashboard before materializing the gold data at Municipal waste service) does not meet the requirement that dashboards must represent the latest committed daily snapshot, nor does it constitute the required pre-change investigation.
B:Configure dashboard refresh after the aggregation task with failure handling may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that job run graph has no edge from aggregation to dashboard refresh.
C:Use a Lakeflow dashboard task dependent on successful upstream gold refresh is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the collection_telemetry_highland scenario, the observed evidence is that job run graph has no edge from aggregation to dashboard refresh; the requirement remains: dashboards must represent the latest committed daily snapshot.
Question 151
A data engineer at Research clinical trial group is responsible for consent-related data changes. The CDC primary key and updates issue is that the consent_related_data_changes_west relational source emits inserts and updates but the lakehouse target retains multiple current versions. The supporting evidence is that change records carry primary keys and update sequence numbers. The engineer must ensure that the destination must represent the latest source state without losing required history. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Append every change as a new current row without keys at Research clinical trial group
- Introduce change capture on a small table and reconcile the initial snapshot
- Use supported CDC apply logic with keys, ordering and defined delete handling
- Apply multiple out-of-order changes and verify deterministic final state
Explanation
Correct Answer
B:Introduce change capture on a small table and reconcile the initial snapshot provides a bounded way to introduce the approved solution into consent_related_data_changes_west and detect an early mismatch. The existing signal is change records carry primary keys and update sequence numbers; a staged change protects the service requirement (the destination must represent the latest source state without losing required history) and makes rollback practical.
Incorrect Answers
A:An append-only current-state table does not resolve updates or deletes. The proposed action (Append every change as a new current row without keys at Research clinical trial group) does not meet the requirement that the destination must represent the latest source state without losing required history, nor does it constitute the controlled implementation step.
C:Use supported CDC apply logic with keys, ordering and defined delete handling is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the consent_related_data_changes_west scenario, the observed evidence is that change records carry primary keys and update sequence numbers; the requirement remains: the destination must represent the latest source state without losing required history.
D:Apply multiple out-of-order changes and verify deterministic final state is a one-time acceptance check. It does not supply the controlled implementation step for consent_related_data_changes_west; a passing test cannot substitute for the specific task now required.
Question 152
The station_observation_files_island pipeline at Public weather agency has this failure: station_observation_files_island Spark Declarative Pipeline is managed separately and not part of the daily job. The team observed that analytics runs before the pipeline produces its updated streaming table. Business requirement: job orchestration must wait for pipeline update completion. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Assume the pipeline auto-refreshes before every dashboard query at Public weather agency
- Use a Lakeflow pipeline task with success dependency before analytics tasks
- Trigger a full job and verify pipeline completion precedes analytics
- Attach the governed pipeline to the job and pilot the execution graph
Explanation
Correct Answer
D:Attach the governed pipeline to the job and pilot the execution graph provides a bounded way to introduce the approved solution into station_observation_files_island and detect an early mismatch. The existing signal is analytics runs before the pipeline produces its updated streaming table; a staged change protects the service requirement (job orchestration must wait for pipeline update completion) and makes rollback practical.
Incorrect Answers
A:Uncontrolled refresh timing does not guarantee dependency order. The proposed action (Assume the pipeline auto-refreshes before every dashboard query at Public weather agency) does not meet the requirement that job orchestration must wait for pipeline update completion, nor does it constitute the controlled implementation step.
B:Use a Lakeflow pipeline task with success dependency before analytics tasks is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the station_observation_files_island scenario, the observed evidence is that analytics runs before the pipeline produces its updated streaming table; the requirement remains: job orchestration must wait for pipeline update completion.
C:Trigger a full job and verify pipeline completion precedes analytics is a one-time acceptance check. It does not supply the controlled implementation step for station_observation_files_island; a passing test cannot substitute for the specific task now required.
Question 153
Consider the smart_meter_readings_delta workload at Community energy cooperative: smart_meter_readings_delta table exposes national IDs to analysts who need only transaction amounts. Inspection found that query review shows raw identifier values in common reports. The governed outcome must ensure that users without an approved role must see masked sensitive columns. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Attach the mask in staging with explicit tested identity rules
- Rename identifier column to a harmless label while leaving values visible at Community energy cooperative
- Apply Unity Catalog column masks or suitable centrally governed masking policy
- Query the same column as privileged and unprivileged groups
Explanation
Correct Answer
A:Attach the mask in staging with explicit tested identity rules provides a bounded way to introduce the approved solution into smart_meter_readings_delta and detect an early mismatch. The existing signal is query review shows raw identifier values in common reports; a staged change protects the service requirement (users without an approved role must see masked sensitive columns) and makes rollback practical.
Incorrect Answers
B:Renaming a column does not protect its contents. The proposed action (Rename identifier column to a harmless label while leaving values visible at Community energy cooperative) does not meet the requirement that users without an approved role must see masked sensitive columns, nor does it constitute the controlled implementation step.
C:Apply Unity Catalog column masks or suitable centrally governed masking policy is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the smart_meter_readings_delta scenario, the observed evidence is that query review shows raw identifier values in common reports; the requirement remains: users without an approved role must see masked sensitive columns.
D:Query the same column as privileged and unprivileged groups is a one-time acceptance check. It does not supply the controlled implementation step for smart_meter_readings_delta; a passing test cannot substitute for the specific task now required.
Question 154
At Cloud gaming cooperative, the open versus Databricks Delta Sharing workflow handles match-session events. The problem is that match_session_events_delta dataset is shared with a third party that does not run Databricks. Evidence: recipient cannot authenticate to a Databricks workspace but supports the open protocol. Constraint: the partner needs supported read-only interoperability. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Require every external organization to obtain provider workspace administrator access at Cloud gaming cooperative
- Read shared sample data through the external client and validate scope
- Issue recipient configuration using supported sharing workflow and test access
- Verify recipient client protocol and data-access obligations for match_session_events_delta
Explanation
Correct Answer
B:Read shared sample data through the external client and validate scope directly tests the behavior that should change after the correction. With the observed evidence (recipient cannot authenticate to a Databricks workspace but supports the open protocol), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the partner needs supported read-only interoperability.
Incorrect Answers
A:Workspace administration is not needed for open read-only sharing. The proposed action (Require every external organization to obtain provider workspace administrator access at Cloud gaming cooperative) does not meet the requirement that the partner needs supported read-only interoperability, nor does it constitute the post-change acceptance test.
C:Issue recipient configuration using supported sharing workflow and test access may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that recipient cannot authenticate to a Databricks workspace but supports the open protocol.
D:Verify recipient client protocol and data-access obligations for match_session_events_delta could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The match_session_events_delta workflow still requires that the partner needs supported read-only interoperability.
Question 155
Consider the pollution_measurements_central workload at Air quality nonprofit: pollution_measurements_central SQL filter misses transactions where the nullable flag was never populated. Inspection found that the predicate uses flag = NULL and always yields unknown. The governed outcome must ensure that the analysis must distinguish missing from explicitly false flag values. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Use IS NULL for missing flags and IS NOT NULL for populated fields
- Monitor unknown-flag rate and predicate regression for pollution_measurements_central
- Test null, false and true rows against the intended filter
- Use flag = NULL and assume it matches missing values at Air quality nonprofit
Explanation
Correct Answer
B:Monitor unknown-flag rate and predicate regression for pollution_measurements_central creates recurring visibility into the failure mode (pollution_measurements_central SQL filter misses transactions where the nullable flag was never populated). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the analysis must distinguish missing from explicitly false flag values.
Incorrect Answers
A:Use IS NULL for missing flags and IS NOT NULL for populated fields is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the pollution_measurements_central scenario, the observed evidence is that the predicate uses flag = NULL and always yields unknown; the requirement remains: the analysis must distinguish missing from explicitly false flag values.
C:Test null, false and true rows against the intended filter is a one-time acceptance check. It does not supply continuing operational detection for pollution_measurements_central; a passing test cannot substitute for the specific task now required.
D:Sql equality against null is not true. The proposed action (Use flag = NULL and assume it matches missing values at Air quality nonprofit) does not meet the requirement that the analysis must distinguish missing from explicitly false flag values, nor does it constitute continuing operational detection.
Question 156
A data engineer at Wholesale produce exchange is responsible for trade settlement files. The Unity Catalog lineage issue is that trade_settlement_files_urban Gold dashboard shows wrong revenue and owners cannot trace the upstream dataset. The supporting evidence is that lineage view is missing a newly added silver transformation. The engineer must ensure that impact analysis needs upstream and downstream dependency visibility. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Instrument or update the supported job dependency record before release
- Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies
- Compare inferred lineage to an actual source-to-gold test transformation
- Rely on file naming conventions as proof of full lineage at Wholesale produce exchange
Explanation
Correct Answer
A:Instrument or update the supported job dependency record before release provides a bounded way to introduce the approved solution into trade_settlement_files_urban and detect an early mismatch. The existing signal is lineage view is missing a newly added silver transformation; a staged change protects the service requirement (impact analysis needs upstream and downstream dependency visibility) and makes rollback practical.
Incorrect Answers
B:Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the trade_settlement_files_urban scenario, the observed evidence is that lineage view is missing a newly added silver transformation; the requirement remains: impact analysis needs upstream and downstream dependency visibility.
C:Compare inferred lineage to an actual source-to-gold test transformation is a one-time acceptance check. It does not supply the controlled implementation step for trade_settlement_files_urban; a passing test cannot substitute for the specific task now required.
D:Names alone cannot prove transformations and dependencies. The proposed action (Rely on file naming conventions as proof of full lineage at Wholesale produce exchange) does not meet the requirement that impact analysis needs upstream and downstream dependency visibility, nor does it constitute the controlled implementation step.
Question 157
Consider the digitization_inventories_south workload at National heritage library: the digitization_inventories_south producer is a managed enterprise database but engineers plan a custom nightly file scraper. Inspection found that evaluation finds supported managed CDC connector and tight freshness targets. The governed outcome must ensure that data must reach Unity Catalog with near-real-time change capture. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Use monthly manual CSV downloads for a near-real-time feed at National heritage library
- Monitor replication lag, source load and connector recovery for digitization_inventories_south
- Select Lakeflow Connect managed CDC rather than custom file snapshots where supported
- Compare connector support, freshness SLA, cost and source load for digitization_inventories_south
Explanation
Correct Answer
C:Select Lakeflow Connect managed CDC rather than custom file snapshots where supported is the intended durable approach for digitization_inventories_south: it addresses the verified problem (the digitization_inventories_south producer is a managed enterprise database but engineers plan a custom nightly file scraper) while preserving the required behavior (data must reach Unity Catalog with near-real-time change capture). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Manual batch exports cannot meet continuous change freshness. The proposed action (Use monthly manual CSV downloads for a near-real-time feed at National heritage library) does not meet the requirement that data must reach Unity Catalog with near-real-time change capture, nor does it constitute the target approach.
B:Monitor replication lag, source load and connector recovery for digitization_inventories_south would help detect future recurrence, but metrics alone do not deliver the target approach. The digitization_inventories_south requirement is that data must reach Unity Catalog with near-real-time change capture.
D:Compare connector support, freshness SLA, cost and source load for digitization_inventories_south could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The digitization_inventories_south workflow still requires that data must reach Unity Catalog with near-real-time change capture.
Question 158
Consider the turbine_sensor_messages_south workload at Renewable energy operator: turbine_sensor_messages_south downstream transformation needs to run after its governed source table changes. Inspection found that the source updates irregularly while cron polling starts empty jobs. The governed outcome must ensure that data freshness should follow actual table changes rather than wall-clock guesses. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Configure a table-update trigger tied to the supported source table
- Schedule a blind daily task when source updates require immediate processing at Renewable energy operator
- Verify that source table and trigger are supported for turbine_sensor_messages_south
- Monitor trigger delivery, lag and disabled-source conditions for turbine_sensor_messages_south
Explanation
Correct Answer
A:Configure a table-update trigger tied to the supported source table is the intended durable approach for turbine_sensor_messages_south: it addresses the verified problem (turbine_sensor_messages_south downstream transformation needs to run after its governed source table changes) while preserving the required behavior (data freshness should follow actual table changes rather than wall-clock guesses). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Coarse polling cannot consistently meet data-driven freshness. The proposed action (Schedule a blind daily task when source updates require immediate processing at Renewable energy operator) does not meet the requirement that data freshness should follow actual table changes rather than wall-clock guesses, nor does it constitute the target approach.
C:Verify that source table and trigger are supported for turbine_sensor_messages_south could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The turbine_sensor_messages_south workflow still requires that data freshness should follow actual table changes rather than wall-clock guesses.
D:Monitor trigger delivery, lag and disabled-source conditions for turbine_sensor_messages_south would help detect future recurrence, but metrics alone do not deliver the target approach. The turbine_sensor_messages_south requirement is that data freshness should follow actual table changes rather than wall-clock guesses.
Question 159
A data engineer at Municipal waste service is responsible for collection telemetry. The Auto Loader checkpoint issue is that a streaming file reader for collection_telemetry_island reprocesses historical data after every job restart. The supporting evidence is that the streaming query creates a new checkpoint directory on each run. The engineer must ensure that a restart must resume discovered files instead of replaying all existing input. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Configure cloudFiles with a stable checkpoint path for the collection_telemetry_island stream
- Deploy the stream with a durable checkpoint and restart the same logical query
- Delete checkpoint state as part of each successful load at Municipal waste service
- Inspect checkpoint continuity, discovery progress and input file identifiers
Explanation
Correct Answer
D:Inspect checkpoint continuity, discovery progress and input file identifiers directly investigates the evidence (the streaming query creates a new checkpoint directory on each run) and distinguishes possible causes of a streaming file reader for collection_telemetry_island reprocesses historical data after every job restart. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: a restart must resume discovered files instead of replaying all existing input.
Incorrect Answers
A:Configure cloudFiles with a stable checkpoint path for the collection_telemetry_island stream is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the collection_telemetry_island scenario, the observed evidence is that the streaming query creates a new checkpoint directory on each run; the requirement remains: a restart must resume discovered files instead of replaying all existing input.
B:Deploy the stream with a durable checkpoint and restart the same logical query may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the streaming query creates a new checkpoint directory on each run. This matters here because a data engineer at Municipal waste service is responsible for collection telemetry. The Auto Loader checkpoint issue….
C:Deleting checkpoint progress can cause full replay. The proposed action (Delete checkpoint state as part of each successful load at Municipal waste service) does not meet the requirement that a restart must resume discovered files instead of replaying all existing input, nor does it constitute the required pre-change investigation.
Question 160
At Regional museum alliance, the cross join explosion workflow handles artifact metadata updates. The problem is that a artifact_metadata_updates_north DataFrame operation unexpectedly produces billions of rows. Evidence: the plan shows a cartesian product between two unrelated inputs. Constraint: records should match on explicit business keys without multiplying every pair. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Join on the correct equality keys rather than using a cross join
- Verify every output row matches the intended keys with bounded cardinality
- Leave the cross join in place because adding workers makes it semantically correct at Regional museum alliance
- Track unexpected row amplification and crossJoin operators for artifact_metadata_updates_north
Explanation
Correct Answer
D:Track unexpected row amplification and crossJoin operators for artifact_metadata_updates_north creates recurring visibility into the failure mode (a artifact_metadata_updates_north DataFrame operation unexpectedly produces billions of rows). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while records should match on explicit business keys without multiplying every pair.
Incorrect Answers
A:Join on the correct equality keys rather than using a cross join is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the artifact_metadata_updates_north scenario, the observed evidence is that the plan shows a cartesian product between two unrelated inputs; the requirement remains: records should match on explicit business keys without multiplying every pair.
B:Verify every output row matches the intended keys with bounded cardinality is a one-time acceptance check. It does not supply continuing operational detection for artifact_metadata_updates_north; a passing test cannot substitute for the specific task now required.
C:Scaling cannot repair invalid join semantics. The proposed action (Leave the cross join in place because adding workers makes it semantically correct at Regional museum alliance) does not meet the requirement that records should match on explicit business keys without multiplying every pair, nor does it constitute continuing operational detection.