Databricks Certified Data Engineer Associate Practice Test 42
Question 410
The consent_related_data_changes_west pipeline at Research clinical trial group has this failure: consent_related_data_changes_west dataset is shared between clouds and network charges surprise the data provider. The team observed that billing shows recipient reads create cross-cloud data transfer. Business requirement: sharing must meet cost and policy expectations. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Design an approved sharing pattern accounting for network egress and access controls
- Assume cross-cloud data transfer is always free because sharing is read-only at Research clinical trial group
- Compare actual transfer bytes and charges against the forecast
- Monitor recipient consumption and cross-cloud egress spikes for consent_related_data_changes_west
Explanation
Correct Answer
D:Monitor recipient consumption and cross-cloud egress spikes for consent_related_data_changes_west creates recurring visibility into the failure mode (consent_related_data_changes_west dataset is shared between clouds and network charges surprise the data provider). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while sharing must meet cost and policy expectations.
Incorrect Answers
A:Design an approved sharing pattern accounting for network egress and access controls is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the consent_related_data_changes_west scenario, the observed evidence is that billing shows recipient reads create cross-cloud data transfer; the requirement remains: sharing must meet cost and policy expectations.
B:Read-only sharing can still incur network charges. The proposed action (Assume cross-cloud data transfer is always free because sharing is read-only at Research clinical trial group) does not meet the requirement that sharing must meet cost and policy expectations, nor does it constitute continuing operational detection.
C:Compare actual transfer bytes and charges against the forecast is a one-time acceptance check. It does not supply continuing operational detection for consent_related_data_changes_west; a passing test cannot substitute for the specific task now required.
Question 411
A data engineer at Veterinary clinic association is responsible for treatment billing events. The Delta Sharing cross-org issue is that treatment_billing_events_delta provider needs to offer a governed read-only subset to an external partner. The supporting evidence is that partner does not have workspace access but needs fresh authorized data. The engineer must ensure that sharing must not distribute uncontrolled file copies or edit privileges. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Query as the recipient and verify only intended datasets are visible
- Inventory recipient type, share permissions and approved datasets for treatment_billing_events_delta
- Add one approved dataset to the share and grant recipient access
- Email raw Delta storage credentials and allow partner writes at Veterinary clinic association
Explanation
Correct Answer
A:Query as the recipient and verify only intended datasets are visible directly tests the behavior that should change after the correction. With the observed evidence (partner does not have workspace access but needs fresh authorized data), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that sharing must not distribute uncontrolled file copies or edit privileges.
Incorrect Answers
B:Inventory recipient type, share permissions and approved datasets for treatment_billing_events_delta could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The treatment_billing_events_delta workflow still requires that sharing must not distribute uncontrolled file copies or edit privileges.
C:Add one approved dataset to the share and grant recipient access may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that partner does not have workspace access but needs fresh authorized data.
D:Sharing object-storage secrets bypasses governed read-only access. The proposed action (Email raw Delta storage credentials and allow partner writes at Veterinary clinic association) does not meet the requirement that sharing must not distribute uncontrolled file copies or edit privileges, nor does it constitute the post-change acceptance test.
Question 412
At Regional insurance broker, the claims payment events workflow depends on claims_payment_events_delta. Engineers report that claims_payment_events_delta dashboard repeatedly scans years of silver transactions for daily rollups; the evidence is that SQL history shows expensive repeated aggregation on an otherwise stable reporting query. They require that analysts need low-latency aggregates refreshed on a defined cadence. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Publish a materialized view for precomputed frequently queried aggregates
- Create a regular view and promise it stores its results between queries at Regional insurance broker
- Measure refresh needs, compute cost and gold-layer query patterns for claims_payment_events_delta
- Configure a representative refresh schedule and reconcile the initial build
Explanation
Correct Answer
C:Measure refresh needs, compute cost and gold-layer query patterns for claims_payment_events_delta directly investigates the evidence (SQL history shows expensive repeated aggregation on an otherwise stable reporting query) and distinguishes possible causes of claims_payment_events_delta dashboard repeatedly scans years of silver transactions for daily rollups. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: analysts need low-latency aggregates refreshed on a defined cadence.
Incorrect Answers
A:Publish a materialized view for precomputed frequently queried aggregates is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the claims_payment_events_delta scenario, the observed evidence is that SQL history shows expensive repeated aggregation on an otherwise stable reporting query; the requirement remains: analysts need low-latency aggregates refreshed on a defined cadence.
B:Ordinary views do not persist precomputed results. The proposed action (Create a regular view and promise it stores its results between queries at Regional insurance broker) does not meet the requirement that analysts need low-latency aggregates refreshed on a defined cadence, nor does it constitute the required pre-change investigation.
D:Configure a representative refresh schedule and reconcile the initial build may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that SQL history shows expensive repeated aggregation on an otherwise stable reporting query.
Question 413
A data engineer at Community energy cooperative is responsible for smart meter readings. The catalog schema use privileges issue is that smart_meter_readings_central analysts have SELECT on a table but get a permission error at query time. The supporting evidence is that access review shows missing USE CATALOG on its parent catalog. The engineer must ensure that users must read only the authorized governed object. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Query the table as an analyst and confirm sibling data remains denied
- Grant global metastore administration to fix one table query at Community energy cooperative
- Apply least-privilege grants to an analyst group and test identity
- Check current UC parent hierarchy and effective grants for smart_meter_readings_central
Explanation
Correct Answer
A:Query the table as an analyst and confirm sibling data remains denied directly tests the behavior that should change following the correction. With the observed evidence (access review shows missing USE CATALOG on its parent catalog), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that users must read only the authorized governed object.
Incorrect Answers
B:Global admin rights exceed simple read access needs. The proposed action (Grant global metastore administration to fix one table query at Community energy cooperative) does not meet the requirement that users must read only the authorized governed object, nor does it constitute the post-change acceptance test.
C:Apply least-privilege grants to an analyst group and test identity may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that access review shows missing USE CATALOG on its parent catalog. This matters here because a data engineer at Community energy cooperative is responsible for smart meter readings. The catalog schema useā¦.
D:Check current UC parent hierarchy and effective grants for smart_meter_readings_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The smart_meter_readings_central workflow still requires that users must read only the authorized governed object.
Question 414
At Manufacturing quality network, the liquid clustering for dynamic filters workflow handles factory defect records. The problem is that factory_defect_records_central Delta table suffers frequent filter-pattern changes and costly partition rewrites. Evidence: workload history alternates date and customer search predicates across teams. Constraint: layout optimization must adapt without a rigid proliferating partition tree. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network
- Compare query scan size and update overhead for representative filter sets
- Profile common filters, table size and clustering support for factory_defect_records_central
- Enable clustering on a pilot target and run supported maintenance operations
Explanation
Correct Answer
B:Compare query scan size and update overhead for representative filter sets directly tests the behavior that should change after the correction. With the observed evidence (workload history alternates date and customer search predicates across teams), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that layout optimization must adapt without a rigid proliferating partition tree.
Incorrect Answers
A:Overpartitioning drives metadata overhead and inflexible layout. The proposed action (Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network) does not meet the requirement that layout optimization must adapt without a rigid proliferating partition tree, nor does it constitute the post-change acceptance test.
C:Profile common filters, table size and clustering support for factory_defect_records_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The factory_defect_records_central workflow still requires that layout optimization must adapt without a rigid proliferating partition tree.
D:Enable clustering on a pilot target and run supported maintenance operations may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that workload history alternates date and customer search predicates across teams.
Question 415
The sampling_field_notes_metro pipeline at Environmental inspection office has this failure: sampling_field_notes_metro table contains records from many regions but local analysts may view only their own rows. The team observed that a sample query under a local user returns another region's customers. Business requirement: regional row restrictions must apply during queries. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Monitor policy exceptions and cross-region access attempts for sampling_field_notes_metro
- Apply a row filter on the governed table or appropriate centrally governed policy
- Hide the region column in the dashboard but return every row at Environmental inspection office
- Map user groups, regional keys and currently enforced filters for sampling_field_notes_metro
Explanation
Correct Answer
B:Apply a row filter on the governed table or appropriate centrally governed policy is the intended durable approach for sampling_field_notes_metro: it addresses the verified problem (sampling_field_notes_metro table contains records from many regions but local analysts may view only their own rows) while preserving the required behavior (regional row restrictions must apply during queries). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor policy exceptions and cross-region access attempts for sampling_field_notes_metro would help detect future recurrence, but metrics alone do not deliver the target approach. The sampling_field_notes_metro requirement is that regional row restrictions must apply during queries.
C:Display changes do not enforce row-level security. The proposed action (Hide the region column in the dashboard but return every row at Environmental inspection office) does not meet the requirement that regional row restrictions must apply during queries, nor does it constitute the target approach.
D:Map user groups, regional keys and currently enforced filters for sampling_field_notes_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The sampling_field_notes_metro workflow still requires that regional row restrictions must apply during queries.
Question 416
The device_calibration_readings_urban pipeline at Optical instrument maker has this failure: device_calibration_readings_urban needs a normalized discount amount but the pipeline overwrites the source field. The team observed that code review shows an arithmetic expression replacing original gross_sales. Business requirement: auditors require gross and net amounts independently. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Overwrite the only gross amount and discard source values at Optical instrument maker
- Use withColumn to add a derived net amount while keeping gross_sales unchanged
- Check discount scenarios and verify both gross and net are correct
- Deploy the expression to silver with explicit numeric-type handling
Explanation
Correct Answer
D:Deploy the expression to silver with explicit numeric-type handling provides a bounded way to introduce the approved solution into device_calibration_readings_urban and detect an early mismatch. The existing signal is code review shows an arithmetic expression replacing original gross_sales; a staged change protects the service requirement (auditors require gross and net amounts independently) and makes rollback practical.
Incorrect Answers
A:Overwriting original financial evidence breaks reconciliation. The proposed action (Overwrite the only gross amount and discard source values at Optical instrument maker) does not meet the requirement that auditors require gross and net amounts independently, nor does it constitute the controlled implementation step.
B:Use withColumn to add a derived net amount while keeping gross_sales unchanged is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the device_calibration_readings_urban scenario, the observed evidence is that code review shows an arithmetic expression replacing original gross_sales; the requirement remains: auditors require gross and net amounts independently.
C:Check discount scenarios and verify both gross and net are correct is a one-time acceptance check. It does not supply the controlled implementation step for device_calibration_readings_urban; a passing test cannot substitute for the specific task now required.
Question 417
At Cloud gaming cooperative, the ABAC governed tag workflow handles match-session events. The problem is that match_session_events_central contains many tables with a sensitive tag but policy enforcement differs by owner. Evidence: audit shows only some similarly tagged tables have manual row filters. Constraint: one central rule must apply automatically to matching governed objects. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Use ungoverned free-text tags and assume they enforce security at Cloud gaming cooperative
- Inventory governed tag assignments and effective policy scope for match_session_events_central
- Test policy on selected tagged tables and gradually apply approved scope
- Define a Unity Catalog ABAC policy using governed tags at an appropriate parent scope
Explanation
Correct Answer
B:Inventory governed tag assignments and effective policy scope for match_session_events_central directly investigates the evidence (audit shows only some similarly tagged tables have manual row filters) and distinguishes possible causes of match_session_events_central contains many tables with a sensitive tag but policy enforcement differs by owner. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: one central rule must apply automatically to matching governed objects.
Incorrect Answers
A:Untested labels are not enforced access policies. The proposed action (Use ungoverned free-text tags and assume they enforce security at Cloud gaming cooperative) does not meet the requirement that one central rule must apply automatically to matching governed objects, nor does it constitute the required pre-change investigation.
C:Test policy on selected tagged tables and gradually apply approved scope may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that audit shows only some similarly tagged tables have manual row filters.
D:Define a Unity Catalog ABAC policy using governed tags at an appropriate parent scope is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the match_session_events_central scenario, the observed evidence is that audit shows only some similarly tagged tables have manual row filters; the requirement remains: one central rule must apply automatically to matching governed objects.
Question 418
At Renewable energy operator, the JDBC watermark extraction workflow handles turbine sensor messages. The problem is that the turbine_sensor_messages_east SQL source is polled hourly but every run extracts its entire ten-year table. Evidence: source query logs show full scans despite an indexed updated_at column. Constraint: new and changed rows must load with a replay-safe high-water mark. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Use bounded incremental JDBC reads with a persisted watermark and merge keys
- Advance the stored watermark before persisting the extracted batch at Renewable energy operator
- Run an initial backfill, then advance a tested watermark only after successful commit
- Modify an old row and verify incremental fetch plus merge applies its update
Explanation
Correct Answer
C:Run an initial backfill, then advance a tested watermark only after successful commit provides a bounded way to introduce the approved solution into turbine_sensor_messages_east and detect an early mismatch. The existing signal is source query logs show full scans despite an indexed updated_at column; a staged change protects the service requirement (new and changed rows must load with a replay-safe high-water mark) and makes rollback practical.
Incorrect Answers
A:Use bounded incremental JDBC reads with a persisted watermark and merge keys is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the turbine_sensor_messages_east scenario, the observed evidence is that source query logs show full scans despite an indexed updated_at column; the requirement remains: new and changed rows must load with a replay-safe high-water mark.
B:Premature watermark advancement can lose rows on failure. The proposed action (Advance the stored watermark before persisting the extracted batch at Renewable energy operator) does not meet the requirement that new and changed rows must load with a replay-safe high-water mark, nor does it constitute the controlled implementation step.
D:Modify an old row and verify incremental fetch plus merge applies its update is a one-time acceptance check. It does not supply the controlled implementation step for turbine_sensor_messages_east; a passing test cannot substitute for the specific task now required.
Question 419
Consider the station_observation_files_rural workload at Public weather agency: station_observation_files_rural validation notebook computes the partition date but downstream tasks use yesterday by default. Inspection found that logs show successful validation for one date and export for another. The governed outcome must ensure that the exported partition must match the validated partition. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Add explicit task-value references and test with nondefault date
- Hardcode yesterday in every downstream task at Public weather agency
- Run an out-of-order input and verify exported partition matches validated date
- Pass a validated task value to the dependent export task
Explanation
Correct Answer
A:Add explicit task-value references and test with nondefault date provides a bounded way to introduce the approved solution into station_observation_files_rural and detect an early mismatch. The existing signal is logs show successful validation for one date and export for another; a staged change protects the service requirement (the exported partition must match the validated partition) and makes rollback practical.
Incorrect Answers
B:Hardcoded dates can diverge from validated data. The proposed action (Hardcode yesterday in every downstream task at Public weather agency) does not meet the requirement that the exported partition must match the validated partition, nor does it constitute the controlled implementation step.
C:Run an out-of-order input and verify exported partition matches validated date is a one-time acceptance check. It does not supply the controlled implementation step for station_observation_files_rural; a passing test cannot substitute for the specific task now required.
D:Pass a validated task value to the dependent export task is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the station_observation_files_rural scenario, the observed evidence is that logs show successful validation for one date and export for another; the requirement remains: the exported partition must match the validated partition.
Question 420
At Regional hospital network, the shuffle partition oversplitting workflow handles clinical appointment reports. The problem is that clinical_appointment_reports_rural job has hundreds of thousands of very small tasks on a modest daily dataset. Evidence: Spark UI shows scheduling overhead dominates work time. Constraint: the adjustment must keep exact output and avoid poor parallelism. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Measure input sizes, task overhead and shuffle partition count for clinical_appointment_reports_rural
- Reduce excessive partitions or enable adaptive coalescing as appropriate
- Monitor tiny-task fraction, scheduling latency and executor utilization for clinical_appointment_reports_rural
- Set shuffle partitions to an arbitrary enormous value for all workloads at Regional hospital network
Explanation
Correct Answer
B:Reduce excessive partitions or enable adaptive coalescing as appropriate is the intended durable approach for clinical_appointment_reports_rural: it addresses the verified problem (clinical_appointment_reports_rural job has hundreds of thousands of very small tasks on a modest daily dataset) while preserving the required behavior (the adjustment must keep exact output and avoid poor parallelism). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Measure input sizes, task overhead and shuffle partition count for clinical_appointment_reports_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The clinical_appointment_reports_rural workflow still requires that the adjustment must keep exact output and avoid poor parallelism.
C:Monitor tiny-task fraction, scheduling latency and executor utilization for clinical_appointment_reports_rural would help detect future recurrence, but metrics alone do not deliver the target approach. The clinical_appointment_reports_rural requirement is that the adjustment must keep exact output and avoid poor parallelism.
D:More tasks can increase scheduling overhead rather than speed work. The proposed action (Set shuffle partitions to an arbitrary enormous value for all workloads at Regional hospital network) does not meet the requirement that the adjustment must keep exact output and avoid poor parallelism, nor does it constitute the target approach.