Databricks Certified Data Engineer Associate Practice Test 29
Question 280
At Public weather agency, the station observation files workflow depends on station_observation_files_rural. Engineers report that station_observation_files_rural join hangs on one task while almost every task completes quickly; the evidence is that Spark UI reveals one partition contains most rows for a hot customer key. They require that optimization must preserve all correct joined rows. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Verify exact join output and reduced straggler duration
- Drop the most frequent business key to balance partitions at Public weather agency
- Address skew with AQE skew handling or justified key-salting strategy
- Monitor max-to-median task times and hot-key growth for station_observation_files_rural
Explanation
Correct Answer
D:Monitor max-to-median task times and hot-key growth for station_observation_files_rural creates recurring visibility into the failure mode (station_observation_files_rural join hangs on one task while almost every task completes quickly). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while optimization must preserve all correct joined rows.
Incorrect Answers
A:Verify exact join output and reduced straggler duration is a one-time acceptance check. It does not supply continuing operational detection for station_observation_files_rural; a passing test cannot substitute for the specific task now required.
B:Dropping a hot key loses legitimate data. The proposed action (Drop the most frequent business key to balance partitions at Public weather agency) does not meet the requirement that optimization must preserve all correct joined rows, nor does it constitute continuing operational detection.
C:Address skew with AQE skew handling or justified key-salting strategy is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the station_observation_files_rural scenario, the observed evidence is that Spark UI reveals one partition contains most rows for a hot customer key; the requirement remains: optimization must preserve all correct joined rows.
Question 281
The farm_loan_transaction_history_east pipeline at Agricultural credit union has this failure: the farm_loan_transaction_history_east landing zone has millions of objects and directory discovery is becoming expensive. The team observed that ingestion latency rises as source listing grows while only a few files arrive. Business requirement: incremental detection must scale without repeatedly listing the whole prefix. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Monitor notification lag, missed discoveries and fallbacks for farm_loan_transaction_history_east
- Recursively list the entire object-store prefix every second at Agricultural credit union
- Measure file discovery delay and completeness as the prefix grows
- Select supported managed file events or notification mode when appropriate
Explanation
Correct Answer
A:Monitor notification lag, missed discoveries and fallbacks for farm_loan_transaction_history_east creates recurring visibility into the failure mode (the farm_loan_transaction_history_east landing zone has millions of objects and directory discovery is becoming expensive). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while incremental detection must scale without repeatedly listing the whole prefix.
Incorrect Answers
B:Repeated full listings increase costs and discovery latency. The proposed action (Recursively list the entire object-store prefix every second at Agricultural credit union) does not meet the requirement that incremental detection must scale without repeatedly listing the whole prefix, nor does it constitute continuing operational detection.
C:Measure file discovery delay and completeness as the prefix grows is a one-time acceptance check. It does not supply continuing operational detection for farm_loan_transaction_history_east; a passing test cannot substitute for the specific task now required.
D:Select supported managed file events or notification mode when appropriate is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the farm_loan_transaction_history_east scenario, the observed evidence is that ingestion latency rises as source listing grows while only a few files arrive; the requirement remains: incremental detection must scale without repeatedly listing the whole prefix.
Question 282
A data engineer at National heritage library is responsible for digitization inventories. The job retry transient failure issue is that digitization_inventories_highland notebook occasionally fails on transient service throttling. The supporting evidence is that task failure records show HTTP 429 followed by a successful manual retry. The engineer must ensure that safe retries must not create duplicate output or run indefinitely. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Configure bounded Lakeflow task retries with backoff where appropriate
- Set infinite immediate retries for every failure including invalid SQL at National heritage library
- Enable retries on a noncritical task and use replay-safe output writes
- Inject a temporary failure and verify eventual success without duplicated rows
Explanation
Correct Answer
C:Enable retries on a noncritical task and use replay-safe output writes provides a bounded way to introduce the approved solution into digitization_inventories_highland and detect an early mismatch. The existing signal is task failure records show HTTP 429 followed by a successful manual retry; a staged change protects the service requirement (safe retries must not create duplicate output or run indefinitely) and makes rollback practical.
Incorrect Answers
A:Configure bounded Lakeflow task retries with backoff where appropriate is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the digitization_inventories_highland scenario, the observed evidence is that task failure records show HTTP 429 followed by a successful manual retry; the requirement remains: safe retries must not create duplicate output or run indefinitely.
B:Unbounded retries can overload services and conceal deterministic defects. The proposed action (Set infinite immediate retries for every failure including invalid SQL at National heritage library) does not meet the requirement that safe retries must not create duplicate output or run indefinitely, nor does it constitute the controlled implementation step.
D:Inject a temporary failure and verify eventual success without duplicated rows is a one-time acceptance check. It does not supply the controlled implementation step for digitization_inventories_highland; a passing test cannot substitute for the specific task now required.
Question 283
At Agricultural credit union, the Auto Loader notification discovery workflow handles farm-loan transaction history. The problem is that the farm_loan_transaction_history_east landing zone has millions of objects and directory discovery is becoming expensive. Evidence: ingestion latency rises as source listing grows while only a few files arrive. Constraint: incremental detection must scale without repeatedly listing the whole prefix. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Enable managed file-event discovery on a pilot source and retain checkpoint state
- Compare arrival rates, discovery costs and event-notification prerequisites for farm_loan_transaction_history_east
- Recursively list the entire object-store prefix every second at Agricultural credit union
- Measure file discovery delay and completeness as the prefix grows
Explanation
Correct Answer
D:Measure file discovery delay and completeness as the prefix grows directly tests the behavior that should change following the correction. With the observed evidence (ingestion latency rises as source listing grows while only a few files arrive), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that incremental detection must scale without repeatedly listing the whole prefix.
Incorrect Answers
A:Enable managed file-event discovery on a pilot source and retain checkpoint state may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that ingestion latency rises as source listing grows while only a few files arrive. Here, the relevant situation is: the Auto Loader notification discovery workflow handles farm-loan transaction history. The problem is that the….
B:Compare arrival rates, discovery costs and event-notification prerequisites for farm_loan_transaction_history_east could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The farm_loan_transaction_history_east workflow still requires that incremental detection must scale without repeatedly listing the whole prefix.
C:Repeated full listings increase costs and discovery latency. The proposed action (Recursively list the entire object-store prefix every second at Agricultural credit union) does not meet the requirement that incremental detection must scale without repeatedly listing the whole prefix, nor does it constitute the post-change acceptance test.
Question 284
Consider the admission_scan_events_metro workload at Regional sporting venue: admission_scan_events_metro provider needs to offer a governed read-only subset to an external partner. Inspection found that partner does not have workspace access but needs fresh authorized data. The governed outcome must ensure that sharing must not distribute uncontrolled file copies or edit privileges. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Query as the recipient and verify only intended datasets are visible
- Use Delta Sharing with a configured provider share and appropriate recipient credentials
- Add one approved dataset to the share and grant recipient access
- Email raw Delta storage credentials and allow partner writes at Regional sporting venue
Explanation
Correct Answer
C:Add one approved dataset to the share and grant recipient access provides a bounded way to introduce the approved solution into admission_scan_events_metro and detect an early mismatch. The existing signal is partner does not have workspace access but needs fresh authorized data; a staged change protects the service requirement (sharing must not distribute uncontrolled file copies or edit privileges) and makes rollback practical.
Incorrect Answers
A:Query as the recipient and verify only intended datasets are visible is a one-time acceptance check. It does not supply the controlled implementation step for admission_scan_events_metro; a passing test cannot substitute for the specific task now required.
B:Use Delta Sharing with a configured provider share and appropriate recipient credentials is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the admission_scan_events_metro scenario, the observed evidence is that partner does not have workspace access but needs fresh authorized data; the requirement remains: sharing must not distribute uncontrolled file copies or edit privileges.
D:Sharing object-storage secrets bypasses governed read-only access. The proposed action (Email raw Delta storage credentials and allow partner writes at Regional sporting venue) does not meet the requirement that sharing must not distribute uncontrolled file copies or edit privileges, nor does it constitute the controlled implementation step.
Question 285
Consider the land_cover_observations_south workload at Satellite imagery startup: land_cover_observations_south Delta queries slow after the filter distribution changes. Inspection found that query profile shows increased file scanning despite healthy worker utilization. The governed outcome must ensure that performance optimization must adapt to predicate patterns. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Compare representative query scan metrics and results before and after
- Add a new physical partition for every possible filter value at Satellite imagery startup
- Inspect clustering columns and actual filter patterns for land_cover_observations_south
- Recluster a pilot table and measure read/write behavior
Explanation
Correct Answer
A:Compare representative query scan metrics and results before and after directly tests the behavior that should change following the correction. With the observed evidence (query profile shows increased file scanning despite healthy worker utilization), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that performance optimization must adapt to predicate patterns.
Incorrect Answers
B:Extreme partitioning creates metadata overhead. The proposed action (Add a new physical partition for every possible filter value at Satellite imagery startup) does not meet the requirement that performance optimization must adapt to predicate patterns, nor does it constitute the post-change acceptance test.
C:Inspect clustering columns and actual filter patterns for land_cover_observations_south could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The land_cover_observations_south workflow still requires that performance optimization must adapt to predicate patterns.
D:Recluster a pilot table and measure read/write behavior may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that query profile shows increased file scanning despite healthy worker utilization. This matters here because consider the land_cover_observations_south workload at Satellite imagery startup: land_cover_observations_south….
Question 286
At Public weather agency, the station observation files workflow depends on station_observation_files_rural. Engineers report that station_observation_files_rural validation notebook computes the partition date but downstream tasks use yesterday by default; the evidence is that logs show successful validation for one date and export for another. They require that the exported partition must match the validated partition. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Inspect taskValues producer, dependency and dynamic reference in station_observation_files_rural
- Run an out-of-order input and verify exported partition matches validated date
- Hardcode yesterday in every downstream task at Public weather agency
- Add explicit task-value references and test with nondefault date
Explanation
Correct Answer
B:Run an out-of-order input and verify exported partition matches validated date directly tests the behavior that should change following the correction. With the observed evidence (logs show successful validation for one date and export for another), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the exported partition must match the validated partition.
Incorrect Answers
A:Inspect taskValues producer, dependency and dynamic reference in station_observation_files_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The station_observation_files_rural workflow still requires that the exported partition must match the validated partition.
C:Hardcoded dates can diverge from validated data. The proposed action (Hardcode yesterday in every downstream task at Public weather agency) does not meet the requirement that the exported partition must match the validated partition, nor does it constitute the post-change acceptance test.
D:Add explicit task-value references and test with nondefault date may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that logs show successful validation for one date and export for another. Here, the relevant situation is: the station observation files workflow depends on station_observation_files_rural. Engineers report that….
Question 287
A data engineer at Media postproduction team is responsible for render-job telemetry. The shuffle partition tuning issue is that render_job_telemetry_metro aggregation spends most time scheduling thousands of tiny shuffle tasks. The supporting evidence is that Spark UI shows very low per-task data size and excessive scheduling overhead. The engineer must ensure that performance changes must be benchmarked against the same output. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Increase shuffle partitions without measuring task size or skew at Media postproduction team
- Inspect shuffle output size, task duration and partition setting for render_job_telemetry_metro
- Apply a bounded change in staging and compare resource cost
- Rerun identical aggregation and verify result parity and faster completion
Explanation
Correct Answer
D:Rerun identical aggregation and verify result parity and faster completion directly tests the behavior that should change after the correction. With the observed evidence (Spark UI shows very low per-task data size and excessive scheduling overhead), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that performance changes must be benchmarked against the same output.
Incorrect Answers
A:Arbitrary partition expansion can increase overhead. The proposed action (Increase shuffle partitions without measuring task size or skew at Media postproduction team) does not meet the requirement that performance changes must be benchmarked against the same output, nor does it constitute the post-change acceptance test.
B:Inspect shuffle output size, task duration and partition setting for render_job_telemetry_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The render_job_telemetry_metro workflow still requires that performance changes must be benchmarked against the same output.
C:Apply a bounded change in staging and compare resource cost may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that Spark UI shows very low per-task data size and excessive scheduling overhead.
Question 288
Consider the factory_defect_records_west workload at Manufacturing quality network: engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment. Inspection found that the same schema and table names exist under development and production catalogs. The governed outcome must ensure that code must resolve a single governed production object. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Change the pipeline to explicit three-level names and test in a staging job
- Use catalog.schema.table identifiers with explicit Unity Catalog ownership
- Depend on each user's default catalog to identify the production table at Manufacturing quality network
- Resolve the intended table from the job identity and confirm prod/development isolation
Explanation
Correct Answer
A:Change the pipeline to explicit three-level names and test in a staging job provides a bounded way to introduce the approved solution into factory_defect_records_west and detect an early mismatch. The existing signal is the same schema and table names exist under development and production catalogs; a staged change protects the service requirement (code must resolve a single governed production object) and makes rollback practical.
Incorrect Answers
B:Use catalog.schema.table identifiers with explicit Unity Catalog ownership is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the factory_defect_records_west scenario, the observed evidence is that the same schema and table names exist under development and production catalogs; the requirement remains: code must resolve a single governed production object.
C:Implicit current-catalog resolution makes production writes ambiguous. The proposed action (Depend on each user's default catalog to identify the production table at Manufacturing quality network) does not meet the requirement that code must resolve a single governed production object, nor does it constitute the controlled implementation step.
D:Resolve the intended table from the job identity and confirm prod/development isolation is a one-time acceptance check. It does not supply the controlled implementation step for factory_defect_records_west; a passing test cannot substitute for the specific task now required.
Question 289
At Research clinical trial group, the conditional flag when otherwise workflow handles consent-related data changes. The problem is that consent_related_data_changes_urban rows have statuses requiring a three-way risk category. Evidence: a simple boolean expression sends null status to a high-risk category. Constraint: business rules distinguish active, cancelled and unknown statuses. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Treat null as an active subscription without evidence at Research clinical trial group
- Test all named states plus null and an unrecognized state
- Enumerate source states and null handling for the consent_related_data_changes_urban flag
- Deploy a deterministic mapping table and validate the input states
Explanation
Correct Answer
B:Test all named states plus null and an unrecognized state directly tests the behavior that should change after the correction. With the observed evidence (a simple boolean expression sends null status to a high-risk category), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that business rules distinguish active, cancelled and unknown statuses.
Incorrect Answers
A:Missing status cannot be assumed to mean active. The proposed action (Treat null as an active subscription without evidence at Research clinical trial group) does not meet the requirement that business rules distinguish active, cancelled and unknown statuses, nor does it constitute the post-change acceptance test.
C:Enumerate source states and null handling for the consent_related_data_changes_urban flag could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The consent_related_data_changes_urban workflow still requires that business rules distinguish active, cancelled and unknown statuses.
D:Deploy a deterministic mapping table and validate the input states may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that a simple boolean expression sends null status to a high-risk category.
Question 290
A data engineer at Manufacturing quality network is responsible for factory defect records. The Unity Catalog namespace issue is that engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment. The supporting evidence is that the same schema and table names exist under development and production catalogs. The engineer must ensure that code must resolve a single governed production object. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Depend on each user's default catalog to identify the production table at Manufacturing quality network
- Check current catalog, schema and resolved fully qualified table for factory_defect_records_west
- Audit cross-catalog references and unexpected access to factory_defect_records_west
- Use catalog.schema.table identifiers with explicit Unity Catalog ownership
Explanation
Correct Answer
D:Use catalog.schema.table identifiers with explicit Unity Catalog ownership is the intended durable approach for factory_defect_records_west: it addresses the verified problem (engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment) while preserving the required behavior (code must resolve a single governed production object). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Implicit current-catalog resolution makes production writes ambiguous. The proposed action (Depend on each user's default catalog to identify the production table at Manufacturing quality network) does not meet the requirement that code must resolve a single governed production object, nor does it constitute the target approach.
B:Check current catalog, schema and resolved fully qualified table for factory_defect_records_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The factory_defect_records_west workflow still requires that code must resolve a single governed production object.
C:Audit cross-catalog references and unexpected access to factory_defect_records_west would help detect future recurrence, but metrics alone do not deliver the target approach. The factory_defect_records_west requirement is that code must resolve a single governed production object.