Databricks Certified Data Engineer Associate Practice Test 26
Question 250
A data engineer at Manufacturing quality network is responsible for factory defect records. The liquid clustering for dynamic filters issue is that factory_defect_records_central Delta table suffers frequent filter-pattern changes and costly partition rewrites. The supporting evidence is that workload history alternates date and customer search predicates across teams. The engineer must ensure that layout optimization must adapt without a rigid proliferating partition tree. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network
- Consider Liquid Clustering on appropriate columns with supported table features
- Profile common filters, table size and clustering support for factory_defect_records_central
- Enable clustering on a pilot target and run supported maintenance operations
Explanation
Correct Answer
C:Profile common filters, table size and clustering support for factory_defect_records_central directly investigates the evidence (workload history alternates date and customer search predicates across teams) and distinguishes possible causes of factory_defect_records_central Delta table suffers frequent filter-pattern changes and costly partition rewrites. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: layout optimization must adapt without a rigid proliferating partition tree.
Incorrect Answers
A:Overpartitioning drives metadata overhead and inflexible layout. The proposed action (Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network) does not meet the requirement that layout optimization must adapt without a rigid proliferating partition tree, nor does it constitute the required pre-change investigation.
B:Consider Liquid Clustering on appropriate columns with supported table features is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the factory_defect_records_central scenario, the observed evidence is that workload history alternates date and customer search predicates across teams; the requirement remains: layout optimization must adapt without a rigid proliferating partition tree.
D:Enable clustering on a pilot target and run supported maintenance operations may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that workload history alternates date and customer search predicates across teams.
Question 251
A data engineer at Air quality nonprofit is responsible for pollution measurements. The SQL DENY governance scope issue is that pollution_measurements_central access exception uses a DENY policy without verifying feature support and scope. The supporting evidence is that review finds the target resource is outside the supported ABAC deny-policy securable types. The engineer must ensure that authorization must use supported policy semantics without assuming beta behavior. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Test denied and permitted identities on the exact target object
- Assume any DENY syntax universally applies to all Unity Catalog objects at Air quality nonprofit
- Monitor policy evaluation errors and unauthorized grants for pollution_measurements_central
- Use supported UC grants and only supported ABAC deny policies where available
Explanation
Correct Answer
C:Monitor policy evaluation errors and unauthorized grants for pollution_measurements_central creates recurring visibility into the failure mode (pollution_measurements_central access exception uses a DENY policy without verifying feature support and scope). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while authorization must use supported policy semantics without assuming beta behavior.
Incorrect Answers
A:Test denied and permitted identities on the exact target object is a one-time acceptance check. It does not supply continuing operational detection for pollution_measurements_central; a passing test cannot substitute for the specific task now required.
B:Beta deny policy semantics are not universal to every securable type. The proposed action (Assume any DENY syntax universally applies to all Unity Catalog objects at Air quality nonprofit) does not meet the requirement that authorization must use supported policy semantics without assuming beta behavior, nor does it constitute continuing operational detection.
D:Use supported UC grants and only supported ABAC deny policies where available is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the pollution_measurements_central scenario, the observed evidence is that review finds the target resource is outside the supported ABAC deny-policy securable types; the requirement remains: authorization must use supported policy semantics without assuming beta behavior.
Question 252
At Research clinical trial group, the consent-related data changes workflow depends on consent_related_data_changes_delta. Engineers report that joining consent_related_data_changes_delta fact records to a tiny reference table produces a large shuffle; the evidence is that Spark UI shows both inputs shuffled despite one lookup occupying a few megabytes. They require that join output must retain key equality and correct multiplicity. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Compare join counts and stage shuffle bytes with and without the hint
- Monitor dimension growth and join-plan regressions for consent_related_data_changes_delta
- CrossJoin the entire fact and reference datasets then filter after collection at Research clinical trial group
- Broadcast the eligible small reference DataFrame when appropriate to avoid a large shuffle
Explanation
Correct Answer
B:Monitor dimension growth and join-plan regressions for consent_related_data_changes_delta creates recurring visibility into the failure mode (joining consent_related_data_changes_delta fact records to a tiny reference table produces a large shuffle). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while join output must retain key equality and correct multiplicity.
Incorrect Answers
A:Compare join counts and stage shuffle bytes with and without the hint is a one-time acceptance check. It does not supply continuing operational detection for consent_related_data_changes_delta; a passing test cannot substitute for the specific task now required.
C:A cartesian expansion wastes resources and risks mis-joins. The proposed action (CrossJoin the entire fact and reference datasets then filter after collection at Research clinical trial group) does not meet the requirement that join output must retain key equality and correct multiplicity, nor does it constitute continuing operational detection.
D:Broadcast the eligible small reference DataFrame when appropriate to avoid a large shuffle is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the consent_related_data_changes_delta scenario, the observed evidence is that Spark UI shows both inputs shuffled despite one lookup occupying a few megabytes; the requirement remains: join output must retain key equality and correct multiplicity.
Question 253
A data engineer at Public pension trustee is responsible for monthly pension movements. The job conditional branching issue is that monthly_pension_movements_island quality validation flags an empty input but the pipeline always publishes gold. The supporting evidence is that the job DAG lacks an if/else decision based on validation outcome. The engineer must ensure that empty invalid batches must skip publication while still reporting status. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Identify the condition output and branch decisions required for monthly_pension_movements_island
- Always run publish regardless of validator outcome at Public pension trustee
- Monitor branch outcomes and unexpected publish-after-failure events for monthly_pension_movements_island
- Use a Lakeflow condition task to route pass and fail paths explicitly
Explanation
Correct Answer
D:Use a Lakeflow condition task to route pass and fail paths explicitly is the intended durable approach for monthly_pension_movements_island: it addresses the verified problem (monthly_pension_movements_island quality validation flags an empty input but the pipeline always publishes gold) while preserving the required behavior (empty invalid batches must skip publication while still reporting status). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Identify the condition output and branch decisions required for monthly_pension_movements_island could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The monthly_pension_movements_island workflow still requires that empty invalid batches must skip publication while still reporting status.
B:Unconditional publication violates the quality gate. The proposed action (Always run publish regardless of validator outcome at Public pension trustee) does not meet the requirement that empty invalid batches must skip publication while still reporting status, nor does it constitute the target approach.
C:Monitor branch outcomes and unexpected publish-after-failure events for monthly_pension_movements_island would help detect future recurrence, but metrics alone do not deliver the target approach. The monthly_pension_movements_island requirement is that empty invalid batches must skip publication while still reporting status.
Question 254
A data engineer at Multi-region rental platform is responsible for property reservation updates. The job retry transient failure issue is that property_reservation_updates_island notebook occasionally fails on transient service throttling. The supporting evidence is that task failure records show HTTP 429 followed by a successful manual retry. The engineer must ensure that safe retries must not create duplicate output or run indefinitely. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Configure bounded Lakeflow task retries with backoff where appropriate
- Monitor retry attempts, terminal failures and repeated throttling for property_reservation_updates_island
- Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform
- Inject a temporary failure and verify eventual success without duplicated rows
Explanation
Correct Answer
B:Monitor retry attempts, terminal failures and repeated throttling for property_reservation_updates_island creates recurring visibility into the failure mode (property_reservation_updates_island notebook occasionally fails on transient service throttling). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while safe retries must not create duplicate output or run indefinitely.
Incorrect Answers
A:Configure bounded Lakeflow task retries with backoff where appropriate is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the property_reservation_updates_island scenario, the observed evidence is that task failure records show HTTP 429 followed by a successful manual retry; the requirement remains: safe retries must not create duplicate output or run indefinitely.
C:Unbounded retries can overload services and conceal deterministic defects. The proposed action (Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform) does not meet the requirement that safe retries must not create duplicate output or run indefinitely, nor does it constitute continuing operational detection.
D:Inject a temporary failure and verify eventual success without duplicated rows is a one-time acceptance check. It does not supply continuing operational detection for property_reservation_updates_island; a passing test cannot substitute for the specific task now required.
Question 255
A data engineer at Veterinary clinic association is responsible for treatment billing events. The Lakeflow Connect managed connector issue is that a treatment_billing_events_delta enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler. The supporting evidence is that API tokens expire and source field names change without ingestion alerts. The engineer must ensure that the source must arrive in governed Delta tables with manageable credential rotation. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Prefer a supported Lakeflow Connect managed connector with managed ingestion state
- Assess managed connector source support, permissions and refresh semantics for treatment_billing_events_delta
- Copy API secrets into a widely shared notebook and paste full responses manually at Veterinary clinic association
- Configure source credentials and destination catalog for a pilot sync
Explanation
Correct Answer
B:Assess managed connector source support, permissions and refresh semantics for treatment_billing_events_delta directly investigates the evidence (API tokens expire and source field names change without ingestion alerts) and distinguishes possible causes of a treatment_billing_events_delta enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the source must arrive in governed Delta tables with manageable credential rotation.
Incorrect Answers
A:Prefer a supported Lakeflow Connect managed connector with managed ingestion state is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the treatment_billing_events_delta scenario, the observed evidence is that API tokens expire and source field names change without ingestion alerts; the requirement remains: the source must arrive in governed Delta tables with manageable credential rotation.
C:Shared secrets and manual copies do not provide reliable governed ingestion. The proposed action (Copy API secrets into a widely shared notebook and paste full responses manually at Veterinary clinic association) does not meet the requirement that the source must arrive in governed Delta tables with manageable credential rotation, nor does it constitute the required pre-change investigation.
D:Configure source credentials and destination catalog for a pilot sync may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that API tokens expire and source field names change without ingestion alerts. This matters here because a data engineer at Veterinary clinic association is responsible for treatment billing events. The Lakeflow Connect….
Question 256
At Multinational parts distributor, the warehouse movement logs workflow depends on warehouse_movement_logs_north. Engineers report that a new optional field appears in warehouse_movement_logs_north JSON files and the ingestion job starts rejecting rows; the evidence is that failure details identify a field absent from the previously inferred schema. They require that new attributes must be captured without silently corrupting existing columns. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Silently drop every unexpected field and label ingestion complete at Multinational parts distributor
- Monitor schema changes, rescued columns and parsing failures for warehouse_movement_logs_north
- Configure supported Auto Loader schema evolution with an explicit schema location and review process
- Inspect schema inference, evolution mode and rescued data behavior on warehouse_movement_logs_north
Explanation
Correct Answer
C:Configure supported Auto Loader schema evolution with an explicit schema location and review process is the intended durable approach for warehouse_movement_logs_north: it addresses the verified problem (a new optional field appears in warehouse_movement_logs_north JSON files and the ingestion job starts rejecting rows) while preserving the required behavior (new attributes must be captured without silently corrupting existing columns). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Dropping added fields hides source changes and loses information. The proposed action (Silently drop every unexpected field and label ingestion complete at Multinational parts distributor) does not meet the requirement that new attributes must be captured without silently corrupting existing columns, nor does it constitute the target approach.
B:Monitor schema changes, rescued columns and parsing failures for warehouse_movement_logs_north would help detect future recurrence, but metrics alone do not deliver the target approach. The warehouse_movement_logs_north requirement is that new attributes must be captured without silently corrupting existing columns.
D:Inspect schema inference, evolution mode and rescued data behavior on warehouse_movement_logs_north could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The warehouse_movement_logs_north workflow still requires that new attributes must be captured without silently corrupting existing columns.
Question 257
A data engineer at Environmental inspection office is responsible for sampling field notes. The compute workload selection issue is that an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline. The supporting evidence is that billing shows idle all-purpose compute for a deterministic scheduled transformation. The engineer must ensure that the pipeline needs reproducible cost-controlled scheduled runs. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Compare time of execution, compute utilization and job latency for sampling_field_notes_urban
- Migrate a limited workload to an automated job on the chosen compute
- Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office
- Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster
Explanation
Correct Answer
A:Compare time of execution, compute utilization and job latency for sampling_field_notes_urban directly investigates the evidence (billing shows idle all-purpose compute for a deterministic scheduled transformation) and distinguishes possible causes of an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the pipeline needs reproducible cost-controlled scheduled runs.
Incorrect Answers
B:Migrate a limited workload to an automated job on the chosen compute may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that billing shows idle all-purpose compute for a deterministic scheduled transformation. This matters here because a data engineer at Environmental inspection office is responsible for sampling field notes. The compute workload….
C:Larger always-on interactive compute increases waste without fixing scheduling. The proposed action (Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office) does not meet the requirement that the pipeline needs reproducible cost-controlled scheduled runs, nor does it constitute the required pre-change investigation.
D:Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the sampling_field_notes_urban scenario, the observed evidence is that billing shows idle all-purpose compute for a deterministic scheduled transformation; the requirement remains: the pipeline needs reproducible cost-controlled scheduled runs.
Question 258
Consider the loan_repayment_events_east workload at Consumer finance platform: loan_repayment_events_east pipeline runs one fixed notebook for every region using copied task definitions. Inspection found that job configuration repeats the same notebook 40 times with only region parameters changed. The governed outcome must ensure that the regional workload must run repeatably with bounded parallelism. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Compare successful output of every region and isolate one failed iteration
- Inspect parameter list, per-region failures and concurrency limits for loan_repayment_events_east
- Create one unbounded loop that ignores iteration failures at Consumer finance platform
- Pilot the loop on two regions with per-iteration parameters and retry policy
Explanation
Correct Answer
A:Compare successful output of every region and isolate one failed iteration directly tests the behavior that should change after the correction. With the observed evidence (job configuration repeats the same notebook 40 times with only region parameters changed), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the regional workload must run repeatably with bounded parallelism.
Incorrect Answers
B:Inspect parameter list, per-region failures and concurrency limits for loan_repayment_events_east could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The loan_repayment_events_east workflow still requires that the regional workload must run repeatably with bounded parallelism.
C:Unbounded uncontrolled iteration can overwhelm compute and hide errors. The proposed action (Create one unbounded loop that ignores iteration failures at Consumer finance platform) does not meet the requirement that the regional workload must run repeatably with bounded parallelism, nor does it constitute the post-change acceptance test.
D:Pilot the loop on two regions with per-iteration parameters and retry policy may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that job configuration repeats the same notebook 40 times with only region parameters changed.
Question 259
Consider the point_of_sale_receipts_east workload at International coffee retailer: the point_of_sale_receipts_east producer is a managed enterprise database but engineers plan a custom nightly file scraper. Inspection found that evaluation finds supported managed CDC connector and tight freshness targets. The governed outcome must ensure that data must reach Unity Catalog with near-real-time change capture. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Monitor replication lag, source load and connector recovery for point_of_sale_receipts_east
- Select Lakeflow Connect managed CDC rather than custom file snapshots where supported
- Use monthly manual CSV downloads for a near-real-time feed at International coffee retailer
- Update and delete source rows and validate resulting Delta state
Explanation
Correct Answer
A:Monitor replication lag, source load and connector recovery for point_of_sale_receipts_east creates recurring visibility into the failure mode (the point_of_sale_receipts_east producer is a managed enterprise database but engineers plan a custom nightly file scraper). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while data must reach Unity Catalog with near-real-time change capture.
Incorrect Answers
B:Select Lakeflow Connect managed CDC rather than custom file snapshots where supported is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the point_of_sale_receipts_east scenario, the observed evidence is that evaluation finds supported managed CDC connector and tight freshness targets; the requirement remains: data must reach Unity Catalog with near-real-time change capture.
C:Manual batch exports cannot meet continuous change freshness. The proposed action (Use monthly manual CSV downloads for a near-real-time feed at International coffee retailer) does not meet the requirement that data must reach Unity Catalog with near-real-time change capture, nor does it constitute continuing operational detection.
D:Update and delete source rows and validate resulting Delta state is a one-time acceptance check. It does not supply continuing operational detection for point_of_sale_receipts_east; a passing test cannot substitute for the specific task now required.
Question 260
At Public water district, the pipeline flow metrics workflow depends on pipeline_flow_metrics_metro. Engineers report that pipeline_flow_metrics_metro DataFrame join change increases record count after merging; the evidence is that PR diff contains a new join clause but CI checks only linting. They require that joining behavior and key uniqueness must be tested before promotion. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Approve PRs solely on code formatting without data assertions at Public water district
- Monitor CI test regressions and production row-amplification signals for pipeline_flow_metrics_metro
- Identify expected row cardinality and source fixture for pipeline_flow_metrics_metro
- Add functional transformation tests with known join and dedup assertions
Explanation
Correct Answer
D:Add functional transformation tests with known join and dedup assertions is the intended durable approach for pipeline_flow_metrics_metro: it addresses the verified problem (pipeline_flow_metrics_metro DataFrame join change increases record count after merging) while preserving the required behavior (joining behavior and key uniqueness must be tested before promotion). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Well-formatted code can still produce incorrect data. The proposed action (Approve PRs solely on code formatting without data assertions at Public water district) does not meet the requirement that joining behavior and key uniqueness must be tested before promotion, nor does it constitute the target approach.
B:Monitor CI test regressions and production row-amplification signals for pipeline_flow_metrics_metro would help detect future recurrence, but metrics alone do not deliver the target approach. The pipeline_flow_metrics_metro requirement is that joining behavior and key uniqueness must be tested before promotion.
C:Identify expected row cardinality and source fixture for pipeline_flow_metrics_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The pipeline_flow_metrics_metro workflow still requires that joining behavior and key uniqueness must be tested before promotion.