Databricks Certified Data Engineer Associate Practice Test 53
Question 520
At Air quality nonprofit, the pollution measurements workflow depends on pollution_measurements_central. Engineers report that pollution_measurements_central access exception uses a DENY policy without verifying feature support and scope; the evidence is that review finds the target resource is outside the supported ABAC deny-policy securable types. They require that authorization must use supported policy semantics without assuming beta behavior. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Assume any DENY syntax universally applies to all Unity Catalog objects at Air quality nonprofit
- Monitor policy evaluation errors and unauthorized grants for pollution_measurements_central
- Verify exact privilege, supported securable type and ABAC DENY feature status for pollution_measurements_central
- Use supported UC grants and only supported ABAC deny policies where available
Explanation
Correct Answer
D:Use supported UC grants and only supported ABAC deny policies where available is the intended durable approach for pollution_measurements_central: it addresses the verified problem (pollution_measurements_central access exception uses a DENY policy without verifying feature support and scope) while preserving the required behavior (authorization must use supported policy semantics without assuming beta behavior). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Beta deny policy semantics are not universal to every securable type. The proposed action (Assume any DENY syntax universally applies to all Unity Catalog objects at Air quality nonprofit) does not meet the requirement that authorization must use supported policy semantics without assuming beta behavior, nor does it constitute the target approach.
B:Monitor policy evaluation errors and unauthorized grants for pollution_measurements_central would help detect future recurrence, but metrics alone do not deliver the target approach. The pollution_measurements_central requirement is that authorization must use supported policy semantics without assuming beta behavior.
C:Verify exact privilege, supported securable type and ABAC DENY feature status for pollution_measurements_central could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The pollution_measurements_central workflow still requires that authorization must use supported policy semantics without assuming beta behavior.
Question 521
Consider the artifact_metadata_updates_north workload at Regional museum alliance: a artifact_metadata_updates_north DataFrame operation unexpectedly produces billions of rows. Inspection found that the plan shows a cartesian product between two unrelated inputs. The governed outcome must ensure that records should match on explicit business keys without multiplying every pair. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Join on the correct equality keys rather than using a cross join
- Replace the accidental Cartesian step and run count parity tests
- Leave the cross join in place because adding workers makes it semantically correct at Regional museum alliance
- Verify every output row matches the intended keys with bounded cardinality
Explanation
Correct Answer
B:Replace the accidental Cartesian step and run count parity tests provides a bounded way to introduce the approved solution into artifact_metadata_updates_north and detect an early mismatch. The existing signal is the plan shows a cartesian product between two unrelated inputs; a staged change protects the service requirement (records should match on explicit business keys without multiplying every pair) and makes rollback practical.
Incorrect Answers
A:Join on the correct equality keys rather than using a cross join is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the artifact_metadata_updates_north scenario, the observed evidence is that the plan shows a cartesian product between two unrelated inputs; the requirement remains: records should match on explicit business keys without multiplying every pair.
C:Scaling cannot repair invalid join semantics. The proposed action (Leave the cross join in place because adding workers makes it semantically correct at Regional museum alliance) does not meet the requirement that records should match on explicit business keys without multiplying every pair, nor does it constitute the controlled implementation step.
D:Verify every output row matches the intended keys with bounded cardinality is a one-time acceptance check. It does not supply the controlled implementation step for artifact_metadata_updates_north; a passing test cannot substitute for the specific task now required.
Question 522
The customer_order_changes_north pipeline at Online apparel cooperative has this failure: customer_order_changes_north tracks successive device configurations and needs the most recent per device. The team observed that the raw table contains equal device_id rows with varying event timestamps. Business requirement: exactly one latest row per device must be selected using deterministic tie-breaks. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Publish the window transform with stable ordering and preserved raw input
- Inspect per-device timestamps and tie possibilities for customer_order_changes_north
- Insert tied timestamps and verify deterministic version selection
- Call dropDuplicates(device_id) without an explicit ordering rule at Online apparel cooperative
Explanation
Correct Answer
C:Insert tied timestamps and verify deterministic version selection directly tests the behavior that should change after the correction. With the observed evidence (the raw table contains equal device_id rows with varying event timestamps), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that exactly one latest row per device must be selected using deterministic tie-breaks.
Incorrect Answers
A:Publish the window transform with stable ordering and preserved raw input may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the raw table contains equal device_id rows with varying event timestamps.
B:Inspect per-device timestamps and tie possibilities for customer_order_changes_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The customer_order_changes_north workflow still requires that exactly one latest row per device must be selected using deterministic tie-breaks.
D:An unordered dedup does not guarantee selection of the newest record. The proposed action (Call dropDuplicates(device_id) without an explicit ordering rule at Online apparel cooperative) does not meet the requirement that exactly one latest row per device must be selected using deterministic tie-breaks, nor does it constitute the post-change acceptance test.
Question 523
Consider the maintenance_work_orders_north workload at Airport facilities operator: maintenance_work_orders_north bronze records include null business IDs that break downstream joins. Inspection found that profiling identifies a small fraction of missing identifiers plus valid optional fields. The governed outcome must ensure that silver must reject missing required keys but preserve optional null attributes. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Call fillna on every field with zero regardless of semantic type at Airport facilities operator
- Create a tested silver transform and quarantine invalid rows before promoting
- Verify no null required IDs remain and legitimate optional-null records survive
- Profile required versus nullable fields and sample failed maintenance_work_orders_north records
Explanation
Correct Answer
C:Verify no null required IDs remain and legitimate optional-null records survive directly tests the behavior that should change following the correction. With the observed evidence (profiling identifies a small fraction of missing identifiers plus valid optional fields), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that silver must reject missing required keys but preserve optional null attributes.
Incorrect Answers
A:Blanket replacement changes data meaning and can corrupt types. The proposed action (Call fillna on every field with zero regardless of semantic type at Airport facilities operator) does not meet the requirement that silver must reject missing required keys but preserve optional null attributes, nor does it constitute the post-change acceptance test.
B:Create a tested silver transform and quarantine invalid rows before promoting may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that profiling identifies a small fraction of missing identifiers plus valid optional fields. This matters here because consider the maintenance_work_orders_north workload at Airport facilities operator: maintenance_work_orders_north….
D:Profile required versus nullable fields and sample failed maintenance_work_orders_north records could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The maintenance_work_orders_north workflow still requires that silver must reject missing required keys but preserve optional null attributes.
Question 524
A data engineer at Regional sporting venue is responsible for admission scan events. The job DAG observability issue is that admission_scan_events_central final export shows success even though an optional upstream data audit failed. The supporting evidence is that the team treats final task status as whole-pipeline correctness. The engineer must ensure that operational alerts must reflect required DAG path failures. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Configure failure notification and dependency gates before prod promotion
- Inspect task graph run states and required-versus-optional dependencies for admission_scan_events_central
- Set success criteria and notifications on required tasks and aggregate job outcome
- Monitor only the last task while ignoring failed required upstream nodes at Regional sporting venue
Explanation
Correct Answer
B:Inspect task graph run states and required-versus-optional dependencies for admission_scan_events_central directly investigates the evidence (the team treats final task status as whole-pipeline correctness) and distinguishes possible causes of admission_scan_events_central final export shows success even though an optional upstream data audit failed. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: operational alerts must reflect required DAG path failures.
Incorrect Answers
A:Configure failure notification and dependency gates before prod promotion may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the team treats final task status as whole-pipeline correctness.
C:Set success criteria and notifications on required tasks and aggregate job outcome is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the admission_scan_events_central scenario, the observed evidence is that the team treats final task status as whole-pipeline correctness; the requirement remains: operational alerts must reflect required DAG path failures.
D:Last-task success does not prove full dag correctness. The proposed action (Monitor only the last task while ignoring failed required upstream nodes at Regional sporting venue) does not meet the requirement that operational alerts must reflect required DAG path failures, nor does it constitute the required pre-change investigation.
Question 525
A data engineer at Public transport authority is responsible for fare validation events. The DAG task dependency issue is that fare_validation_events_rural gold report launches before silver validation finishes. The supporting evidence is that a task graph shows report and validation as parallel children of ingestion. The engineer must ensure that downstream publishing must not start until all required upstream checks succeed. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Read job DAG edges and task-run timestamps for fare_validation_events_rural
- Pause the validator and verify publish does not start early
- Schedule every task at the same clock time and hope upstream processing completes at Public transport authority
- Reconfigure the job task graph and test one run with a delayed validator
Explanation
Correct Answer
B:Pause the validator and verify publish does not start early directly tests the behavior that should change following the correction. With the observed evidence (a task graph shows report and validation as parallel children of ingestion), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that downstream publishing must not start until all required upstream checks succeed.
Incorrect Answers
A:Read job DAG edges and task-run timestamps for fare_validation_events_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The fare_validation_events_rural workflow still requires that downstream publishing must not start until all required upstream checks succeed.
C:Clock coincidence does not enforce dependency correctness. The proposed action (Schedule every task at the same clock time and hope upstream processing completes at Public transport authority) does not meet the requirement that downstream publishing must not start until all required upstream checks succeed, nor does it constitute the post-change acceptance test.
D:Reconfigure the job task graph and test one run with a delayed validator may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that a task graph shows report and validation as parallel children of ingestion. This matters here because a data engineer at Public transport authority is responsible for fare validation events. The DAG task dependency….
Question 526
At Clinical diagnostics network, the managed versus external lifecycle workflow handles lab sample events. The problem is that lab_sample_events_delta reporting team plans to drop a UC-managed table but needs its data files retained. Evidence: table ownership review shows storage lifecycle controlled by Unity Catalog. Constraint: a cleanup must not accidentally delete retained source data. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Assume managed and external tables always have identical drop semantics at Clinical diagnostics network
- Move to approved external storage only through a supported governed migration
- Inspect table type, location and intended retention before dropping lab_sample_events_delta
- Choose managed or external table lifecycle deliberately for the retention requirement
Explanation
Correct Answer
C:Inspect table type, location and intended retention before dropping lab_sample_events_delta directly investigates the evidence (table ownership review shows storage lifecycle controlled by Unity Catalog) and distinguishes possible causes of lab_sample_events_delta reporting team plans to drop a UC-managed table but needs its data files retained. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: a cleanup must not accidentally delete retained source data.
Incorrect Answers
A:Uc table type affects ownership and managed data lifecycle. The proposed action (Assume managed and external tables always have identical drop semantics at Clinical diagnostics network) does not meet the requirement that a cleanup must not accidentally delete retained source data, nor does it constitute the required pre-change investigation.
B:Move to approved external storage only through a supported governed migration may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that table ownership review shows storage lifecycle controlled by Unity Catalog. Here, the relevant situation is: the managed versus external lifecycle workflow handles lab sample events. The problem is that….
D:Choose managed or external table lifecycle deliberately for the retention requirement is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the lab_sample_events_delta scenario, the observed evidence is that table ownership review shows storage lifecycle controlled by Unity Catalog; the requirement remains: a cleanup must not accidentally delete retained source data.
Question 527
The match_session_events_urban pipeline at Cloud gaming cooperative has this failure: the match_session_events_urban partner API returns 100 rows per page but the batch stores only the first page. The team observed that response metadata includes a next cursor that the client ignores. Business requirement: all authorized records must be imported without exceeding API limits. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Implement cursor pagination with bounded retries and idempotent destination keys
- Compare source advertised total and destination distinct IDs after a full pull
- Stop after one successful HTTP 200 response at Cloud gaming cooperative
- Monitor page completeness, retries and expired cursors for match_session_events_urban
Explanation
Correct Answer
D:Monitor page completeness, retries and expired cursors for match_session_events_urban creates recurring visibility into the failure mode (the match_session_events_urban partner API returns 100 rows per page but the batch stores only the first page). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while all authorized records must be imported without exceeding API limits.
Incorrect Answers
A:Implement cursor pagination with bounded retries and idempotent destination keys is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the match_session_events_urban scenario, the observed evidence is that response metadata includes a next cursor that the client ignores; the requirement remains: all authorized records must be imported without exceeding API limits.
B:Compare source advertised total and destination distinct IDs after a full pull is a one-time acceptance check. It does not supply continuing operational detection for match_session_events_urban; a passing test cannot substitute for the specific task now required.
C:A successful first page does not establish completeness. The proposed action (Stop after one successful HTTP 200 response at Cloud gaming cooperative) does not meet the requirement that all authorized records must be imported without exceeding API limits, nor does it constitute continuing operational detection.
Question 528
At Local government portal, the Lakehouse Federation source workflow handles citizen service applications. The problem is that citizen_service_applications_central analysts need occasional queries of an external warehouse without full bulk ingestion. Evidence: source data is large but analytics needs a small live subset. Constraint: governance should provide on-demand read access without an unnecessary copy. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Copy the entire external database daily regardless of query demand at Local government portal
- Monitor federated query latency and external connection failures for citizen_service_applications_central
- Query the external source through UC and compare returned authorized rows
- Use Lakehouse Federation connection and foreign catalog for suitable source queries
Explanation
Correct Answer
B:Monitor federated query latency and external connection failures for citizen_service_applications_central creates recurring visibility into the failure mode (citizen_service_applications_central analysts need occasional queries of an external warehouse without full bulk ingestion). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while governance should provide on-demand read access without an unnecessary copy.
Incorrect Answers
A:Full-copy ingestion is not required for selective federated querying. The proposed action (Copy the entire external database daily regardless of query demand at Local government portal) does not meet the requirement that governance should provide on-demand read access without an unnecessary copy, nor does it constitute continuing operational detection.
C:Query the external source through UC and compare returned authorized rows is a one-time acceptance check. It does not supply continuing operational detection for citizen_service_applications_central; a passing test cannot substitute for the specific task now required.
D:Use Lakehouse Federation connection and foreign catalog for suitable source queries is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the citizen_service_applications_central scenario, the observed evidence is that source data is large but analytics needs a small live subset; the requirement remains: governance should provide on-demand read access without an unnecessary copy.
Question 529
At Online apparel cooperative, the ABAC governed tag workflow handles customer order changes. The problem is that customer_order_changes_north contains many tables with a sensitive tag but policy enforcement differs by owner. Evidence: audit shows only some similarly tagged tables have manual row filters. Constraint: one central rule must apply automatically to matching governed objects. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Use ungoverned free-text tags and assume they enforce security at Online apparel cooperative
- Test policy on selected tagged tables and gradually apply approved scope
- Inventory governed tag assignments and effective policy scope for customer_order_changes_north
- Add a newly tagged table and verify automatic enforcement
Explanation
Correct Answer
D:Add a newly tagged table and verify automatic enforcement directly tests the behavior that should change following the correction. With the observed evidence (audit shows only some similarly tagged tables have manual row filters), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that one central rule must apply automatically to matching governed objects.
Incorrect Answers
A:Untested labels are not enforced access policies. The proposed action (Use ungoverned free-text tags and assume they enforce security at Online apparel cooperative) does not meet the requirement that one central rule must apply automatically to matching governed objects, nor does it constitute the post-change acceptance test.
B:Test policy on selected tagged tables and gradually apply approved scope may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that audit shows only some similarly tagged tables have manual row filters. Here, the relevant situation is: the ABAC governed tag workflow handles customer order changes. The problem is that customer_order_changes_north….
C:Inventory governed tag assignments and effective policy scope for customer_order_changes_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The customer_order_changes_north workflow still requires that one central rule must apply automatically to matching governed objects.
Question 530
At Public water district, the CDC primary key and updates workflow handles pipeline flow metrics. The problem is that the pipeline_flow_metrics_north relational source emits inserts and updates but the lakehouse target retains multiple current versions. Evidence: change records carry primary keys and update sequence numbers. Constraint: the destination must represent the latest source state without losing required history. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Monitor CDC lag, duplicate keys and discarded out-of-order updates for pipeline_flow_metrics_north
- Inspect key uniqueness, update order and delete semantics in pipeline_flow_metrics_north
- Use supported CDC apply logic with keys, ordering and defined delete handling
- Append every change as a new current row without keys at Public water district
Explanation
Correct Answer
C:Use supported CDC apply logic with keys, ordering and defined delete handling is the intended durable approach for pipeline_flow_metrics_north: it addresses the verified problem (the pipeline_flow_metrics_north relational source emits inserts and updates but the lakehouse target retains multiple current versions) while preserving the required behavior (the destination must represent the latest source state without losing required history). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor CDC lag, duplicate keys and discarded out-of-order updates for pipeline_flow_metrics_north would help detect future recurrence, but metrics alone do not deliver the target approach. The pipeline_flow_metrics_north requirement is that the destination must represent the latest source state without losing required history.
B:Inspect key uniqueness, update order and delete semantics in pipeline_flow_metrics_north could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The pipeline_flow_metrics_north workflow still requires that the destination must represent the latest source state without losing required history.
D:An append-only current-state table does not resolve updates or deletes. The proposed action (Append every change as a new current row without keys at Public water district) does not meet the requirement that the destination must represent the latest source state without losing required history, nor does it constitute the target approach.