Databricks Certified Data Engineer Associate Practice Test 15
Question 140
Consider the station_observation_files_island workload at Public weather agency: station_observation_files_island Spark Declarative Pipeline is managed separately and not part of the daily job. Inspection found that analytics runs before the pipeline produces its updated streaming table. The governed outcome must ensure that job orchestration must wait for pipeline update completion. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Use a Lakeflow pipeline task with success dependency before analytics tasks
- Monitor pipeline update failures and downstream task skips for station_observation_files_island
- Assume the pipeline auto-refreshes before every dashboard query at Public weather agency
- Trigger a full job and verify pipeline completion precedes analytics
Explanation
Correct Answer
B:Monitor pipeline update failures and downstream task skips for station_observation_files_island creates recurring visibility into the failure mode (station_observation_files_island Spark Declarative Pipeline is managed separately and not part of the daily job). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while job orchestration must wait for pipeline update completion.
Incorrect Answers
A:Use a Lakeflow pipeline task with success dependency before analytics tasks is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the station_observation_files_island scenario, the observed evidence is that analytics runs before the pipeline produces its updated streaming table; the requirement remains: job orchestration must wait for pipeline update completion.
C:Uncontrolled refresh timing does not guarantee dependency order. The proposed action (Assume the pipeline auto-refreshes before every dashboard query at Public weather agency) does not meet the requirement that job orchestration must wait for pipeline update completion, nor does it constitute continuing operational detection.
D:Trigger a full job and verify pipeline completion precedes analytics is a one-time acceptance check. It does not supply continuing operational detection for station_observation_files_island; a passing test cannot substitute for the specific task now required.
Question 141
The lab_sample_events_delta pipeline at Clinical diagnostics network has this failure: lab_sample_events_delta delta target must apply corrected invoice amounts from an incremental feed. The team observed that the source has two updates for the same invoice_id in one batch. Business requirement: target must have one latest value per invoice after applying ordered changes. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What should the engineer inspect to establish the failure mechanism?
- MERGE with multiple unfiltered source matches per target key at Clinical diagnostics network
- Identify stable merge keys and deduplicate multiple updates in the batch for lab_sample_events_delta
- Use Delta MERGE with a deduplicated source on invoice_id and matched update logic
- Test MERGE on a small target and rerun an identical source batch
Explanation
Correct Answer
B:Identify stable merge keys and deduplicate multiple updates in the batch for lab_sample_events_delta directly investigates the evidence (the source has two updates for the same invoice_id in one batch) and distinguishes possible causes of lab_sample_events_delta delta target must apply corrected invoice amounts from an incremental feed. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: target must have one latest value per invoice after applying ordered changes.
Incorrect Answers
A:Ambiguous multiple source matches can make updates nondeterministic or fail. The proposed action (MERGE with multiple unfiltered source matches per target key at Clinical diagnostics network) does not meet the requirement that target must have one latest value per invoice after applying ordered changes, nor does it constitute the required pre-change investigation.
C:Use Delta MERGE with a deduplicated source on invoice_id and matched update logic is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the lab_sample_events_delta scenario, the observed evidence is that the source has two updates for the same invoice_id in one batch; the requirement remains: target must have one latest value per invoice after applying ordered changes.
D:Test MERGE on a small target and rerun an identical source batch may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the source has two updates for the same invoice_id in one batch.
Question 142
The shipment_manifests_central pipeline at Coastal freight alliance has this failure: the shipment_manifests_central SQL aggregation runs slowly on eligible compute despite a stable dataset. The team observed that query profiling identifies CPU-bound SQL operations with little external I/O. Business requirement: performance changes must be measured at equivalent compute and data volume. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Baseline SQL plan, engine configuration and resource use for shipment_manifests_central
- Enable the appropriate engine on a pilot compute configuration and compare plans
- Benchmark the same shipment_manifests_central query and dataset on both configurations
- Assume Photon eliminates every network, skew and access-permission problem at Coastal freight alliance
Explanation
Correct Answer
C:Benchmark the same shipment_manifests_central query and dataset on both configurations directly tests the behavior that should change after the correction. With the observed evidence (query profiling identifies CPU-bound SQL operations with little external I/O), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that performance changes must be measured at equivalent compute and data volume.
Incorrect Answers
A:Baseline SQL plan, engine configuration and resource use for shipment_manifests_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The shipment_manifests_central workflow still requires that performance changes must be measured at equivalent compute and data volume.
B:Enable the appropriate engine on a pilot compute configuration and compare plans may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that query profiling identifies CPU-bound SQL operations with little external I/O.
D:An execution engine cannot cure unrelated input or authorization constraints. The proposed action (Assume Photon eliminates every network, skew and access-permission problem at Coastal freight alliance) does not meet the requirement that performance changes must be measured at equivalent compute and data volume, nor does it constitute the post-change acceptance test.
Question 143
At Food delivery franchise, the predictive optimization behavior workflow handles dispatch and delivery status. The problem is that dispatch_and_delivery_status_south managed table has manual OPTIMIZE jobs colliding with platform-managed maintenance. Evidence: table maintenance history shows overlapping compaction attempts. Constraint: the maintenance policy must avoid redundant cost and scheduling conflict. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Disable the overlapping manual maintenance after verifying managed policy
- Manually VACUUM all data files before retention safeguards are checked at Food delivery franchise
- Compare file counts, query results and maintenance cost across a full cycle
- Use predictive optimization where supported and retire redundant manual jobs
Explanation
Correct Answer
A:Disable the overlapping manual maintenance after verifying managed policy provides a bounded way to introduce the approved solution into dispatch_and_delivery_status_south and detect an early mismatch. The existing signal is table maintenance history shows overlapping compaction attempts; a staged change protects the service requirement (the maintenance policy must avoid redundant cost and scheduling conflict) and makes rollback practical.
Incorrect Answers
B:Unguarded vacuum can remove files needed for recovery. The proposed action (Manually VACUUM all data files before retention safeguards are checked at Food delivery franchise) does not meet the requirement that the maintenance policy must avoid redundant cost and scheduling conflict, nor does it constitute the controlled implementation step.
C:Compare file counts, query results and maintenance cost across a full cycle is a one-time acceptance check. It does not supply the controlled implementation step for dispatch_and_delivery_status_south; a passing test cannot substitute for the specific task now required.
D:Use predictive optimization where supported and retire redundant manual jobs is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the dispatch_and_delivery_status_south scenario, the observed evidence is that table maintenance history shows overlapping compaction attempts; the requirement remains: the maintenance policy must avoid redundant cost and scheduling conflict.
Question 144
The trade_settlement_files_metro pipeline at Wholesale produce exchange has this failure: an interactive notebook cluster runs trade_settlement_files_metro every minute even when analysts are offline. The team observed that billing shows idle all-purpose compute for a deterministic scheduled transformation. Business requirement: the pipeline needs reproducible cost-controlled scheduled runs. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Watch idle compute costs and missed trade_settlement_files_metro job triggers
- Compare time of execution, compute utilization and job latency for trade_settlement_files_metro
- Choose suitable job or serverless compute for the scheduled trade_settlement_files_metro task rather than an always-on interactive cluster
- Resize the interactive cluster to its maximum size and keep it on overnight at Wholesale produce exchange
Explanation
Correct Answer
C:Choose suitable job or serverless compute for the scheduled trade_settlement_files_metro task rather than an always-on interactive cluster is the intended durable approach for trade_settlement_files_metro: it addresses the verified problem (an interactive notebook cluster runs trade_settlement_files_metro every minute even when analysts are offline) while preserving the required behavior (the pipeline needs reproducible cost-controlled scheduled runs). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Watch idle compute costs and missed trade_settlement_files_metro job triggers would help detect future recurrence, but metrics alone do not deliver the target approach. The trade_settlement_files_metro requirement is that the pipeline needs reproducible cost-controlled scheduled runs.
B:Compare time of execution, compute utilization and job latency for trade_settlement_files_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The trade_settlement_files_metro workflow still requires that the pipeline needs reproducible cost-controlled scheduled runs.
D:Larger always-on interactive compute increases waste without fixing scheduling. The proposed action (Resize the interactive cluster to its maximum size and keep it on overnight at Wholesale produce exchange) does not meet the requirement that the pipeline needs reproducible cost-controlled scheduled runs, nor does it constitute the target approach.
Question 145
At Wholesale produce exchange, the timestamp type normalization workflow handles trade settlement files. The problem is that trade_settlement_files_north source timestamps arrive as mixed strings and local offsets. Evidence: a daily fact report groups the same instant into different dates. Constraint: event time must use a documented timezone and typed timestamp convention. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Compare time strings lexicographically and ignore offsets at Wholesale produce exchange
- Compare events around midnight and daylight-saving transitions in the output
- Run a pilot cast with invalid values quarantined and documented time policy
- Parse timestamps to a common typed convention before time-window aggregation
Explanation
Correct Answer
C:Run a pilot cast with invalid values quarantined and documented time policy provides a bounded way to introduce the approved solution into trade_settlement_files_north and detect an early mismatch. The existing signal is a daily fact report groups the same instant into different dates; a staged change protects the service requirement (event time must use a documented timezone and typed timestamp convention) and makes rollback practical.
Incorrect Answers
A:String ordering and timezone ambiguity are not robust event-time modeling. The proposed action (Compare time strings lexicographically and ignore offsets at Wholesale produce exchange) does not meet the requirement that event time must use a documented timezone and typed timestamp convention, nor does it constitute the controlled implementation step.
B:Compare events around midnight and daylight-saving transitions in the output is a one-time acceptance check. It does not supply the controlled implementation step for trade_settlement_files_north; a passing test cannot substitute for the specific task now required.
D:Parse timestamps to a common typed convention before time-window aggregation is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the trade_settlement_files_north scenario, the observed evidence is that a daily fact report groups the same instant into different dates; the requirement remains: event time must use a documented timezone and typed timestamp convention.
Question 146
At Public water district, the pipeline flow metrics workflow depends on pipeline_flow_metrics_north. Engineers report that pipeline_flow_metrics_north pipeline configuration exists only in one engineer's workspace UI; the evidence is that releasing to test requires manual reconstruction of tasks. They require that the same versioned workload definitions must deploy to multiple targets. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Compare deployed resource properties and run results to the approved bundle
- Inventory job, pipeline and permissions resources needed for pipeline_flow_metrics_north
- Deploy the versioned bundle to test then prod with approval and target-specific config
- Recreate every task manually with different values in each environment at Public water district
Explanation
Correct Answer
A:Compare deployed resource properties and run results to the approved bundle directly tests the behavior that should change after the correction. With the observed evidence (releasing to test requires manual reconstruction of tasks), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the same versioned workload definitions must deploy to multiple targets.
Incorrect Answers
B:Inventory job, pipeline and permissions resources needed for pipeline_flow_metrics_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The pipeline_flow_metrics_north workflow still requires that the same versioned workload definitions must deploy to multiple targets.
C:Deploy the versioned bundle to test then prod with approval and target-specific config may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that releasing to test requires manual reconstruction of tasks.
D:Manual recreation invites hidden differences and unreproducible releases. The proposed action (Recreate every task manually with different values in each environment at Public water district) does not meet the requirement that the same versioned workload definitions must deploy to multiple targets, nor does it constitute the post-change acceptance test.
Question 147
Consider the property_reservation_updates_rural workload at Multi-region rental platform: property_reservation_updates_rural executive dashboard refreshes before its gold dataset is updated. Inspection found that job run graph has no edge from aggregation to dashboard refresh. The governed outcome must ensure that dashboards must represent the latest committed daily snapshot. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Trace data dependencies and dashboard refresh timestamps for property_reservation_updates_rural
- Change source data and verify dashboard refresh occurs after processing
- Configure dashboard refresh after the aggregation task with failure handling
- Refresh the dashboard before materializing the gold data at Multi-region rental platform
Explanation
Correct Answer
B:Change source data and verify dashboard refresh occurs after processing directly tests the behavior that should change after the correction. With the observed evidence (job run graph has no edge from aggregation to dashboard refresh), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that dashboards must represent the latest committed daily snapshot.
Incorrect Answers
A:Trace data dependencies and dashboard refresh timestamps for property_reservation_updates_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The property_reservation_updates_rural workflow still requires that dashboards must represent the latest committed daily snapshot.
C:Configure dashboard refresh after the aggregation task with failure handling may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that job run graph has no edge from aggregation to dashboard refresh.
D:The dashboard would show stale results. The proposed action (Refresh the dashboard before materializing the gold data at Multi-region rental platform) does not meet the requirement that dashboards must represent the latest committed daily snapshot, nor does it constitute the post-change acceptance test.
Question 148
A data engineer at Coastal freight alliance is responsible for shipment manifests. The SQL DENY governance scope issue is that shipment_manifests_west access exception uses a DENY policy without verifying feature support and scope. The supporting evidence is that review finds the target resource is outside the supported ABAC deny-policy securable types. The engineer must ensure that authorization must use supported policy semantics without assuming beta behavior. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Use supported UC grants and only supported ABAC deny policies where available
- Verify exact privilege, supported securable type and ABAC DENY feature status for shipment_manifests_west
- Assume any DENY syntax universally applies to all Unity Catalog objects at Coastal freight alliance
- Monitor policy evaluation errors and unauthorized grants for shipment_manifests_west
Explanation
Correct Answer
A:Use supported UC grants and only supported ABAC deny policies where available is the intended durable approach for shipment_manifests_west: it addresses the verified problem (shipment_manifests_west access exception uses a DENY policy without verifying feature support and scope) while preserving the required behavior (authorization must use supported policy semantics without assuming beta behavior). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Verify exact privilege, supported securable type and ABAC DENY feature status for shipment_manifests_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The shipment_manifests_west workflow still requires that authorization must use supported policy semantics without assuming beta behavior.
C:Beta deny policy semantics are not universal to every securable type. The proposed action (Assume any DENY syntax universally applies to all Unity Catalog objects at Coastal freight alliance) does not meet the requirement that authorization must use supported policy semantics without assuming beta behavior, nor does it constitute the target approach.
D:Monitor policy evaluation errors and unauthorized grants for shipment_manifests_west would help detect future recurrence, but metrics alone do not deliver the target approach. The shipment_manifests_west requirement is that authorization must use supported policy semantics without assuming beta behavior.
Question 149
At Multi-region rental platform, the job retry transient failure workflow handles property reservation updates. The problem is that property_reservation_updates_island notebook occasionally fails on transient service throttling. Evidence: task failure records show HTTP 429 followed by a successful manual retry. Constraint: safe retries must not create duplicate output or run indefinitely. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Configure bounded Lakeflow task retries with backoff where appropriate
- Inject a temporary failure and verify eventual success without duplicated rows
- Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform
- Enable retries on a noncritical task and use replay-safe output writes
Explanation
Correct Answer
D:Enable retries on a noncritical task and use replay-safe output writes provides a bounded way to introduce the approved solution into property_reservation_updates_island and detect an early mismatch. The existing signal is task failure records show HTTP 429 followed by a successful manual retry; a staged change protects the service requirement (safe retries must not create duplicate output or run indefinitely) and makes rollback practical.
Incorrect Answers
A:Configure bounded Lakeflow task retries with backoff where appropriate is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the property_reservation_updates_island scenario, the observed evidence is that task failure records show HTTP 429 followed by a successful manual retry; the requirement remains: safe retries must not create duplicate output or run indefinitely.
B:Inject a temporary failure and verify eventual success without duplicated rows is a one-time acceptance check. It does not supply the controlled implementation step for property_reservation_updates_island; a passing test cannot substitute for the specific task now required.
C:Unbounded retries can overload services and conceal deterministic defects. The proposed action (Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform) does not meet the requirement that safe retries must not create duplicate output or run indefinitely, nor does it constitute the controlled implementation step.
Question 150
Consider the collection_telemetry_highland workload at Municipal waste service: collection_telemetry_highland executive dashboard refreshes before its gold dataset is updated. Inspection found that job run graph has no edge from aggregation to dashboard refresh. The governed outcome must ensure that dashboards must represent the latest committed daily snapshot. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Refresh the dashboard before materializing the gold data at Municipal waste service
- Configure dashboard refresh after the aggregation task with failure handling
- Use a Lakeflow dashboard task dependent on successful upstream gold refresh
- Trace data dependencies and dashboard refresh timestamps for collection_telemetry_highland
Explanation
Correct Answer
D:Trace data dependencies and dashboard refresh timestamps for collection_telemetry_highland directly investigates the evidence (job run graph has no edge from aggregation to dashboard refresh) and distinguishes possible causes of collection_telemetry_highland executive dashboard refreshes before its gold dataset is updated. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: dashboards must represent the latest committed daily snapshot.
Incorrect Answers
A:The dashboard would show stale results. The proposed action (Refresh the dashboard before materializing the gold data at Municipal waste service) does not meet the requirement that dashboards must represent the latest committed daily snapshot, nor does it constitute the required pre-change investigation.
B:Configure dashboard refresh after the aggregation task with failure handling may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that job run graph has no edge from aggregation to dashboard refresh.
C:Use a Lakeflow dashboard task dependent on successful upstream gold refresh is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the collection_telemetry_highland scenario, the observed evidence is that job run graph has no edge from aggregation to dashboard refresh; the requirement remains: dashboards must represent the latest committed daily snapshot.