Databricks Certified Data Engineer Associate Practice Test 21
Question 200
At Media postproduction team, the render-job telemetry workflow depends on render_job_telemetry_west. Engineers report that developers edit render_job_telemetry_west production notebooks directly and bypass code review; the evidence is that workspace Git history shows changes without a pull request. They require that releases need traceable approval and a recoverable commit. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Develop in a feature branch with a reviewed pull request before merging
- Copy arbitrary notebook cells into production without a commit at Media postproduction team
- Monitor direct main-branch pushes and unreviewed notebook changes for render_job_telemetry_west
- Verify deployed code hash matches the approved merged commit
Explanation
Correct Answer
C:Monitor direct main-branch pushes and unreviewed notebook changes for render_job_telemetry_west creates recurring visibility into the failure mode (developers edit render_job_telemetry_west production notebooks directly and bypass code review). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while releases need traceable approval and a recoverable commit.
Incorrect Answers
A:Develop in a feature branch with a reviewed pull request before merging is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the render_job_telemetry_west scenario, the observed evidence is that workspace Git history shows changes without a pull request; the requirement remains: releases need traceable approval and a recoverable commit.
B:Untracked copies cannot reliably reproduce the approved source. The proposed action (Copy arbitrary notebook cells into production without a commit at Media postproduction team) does not meet the requirement that releases need traceable approval and a recoverable commit, nor does it constitute continuing operational detection.
D:Verify deployed code hash matches the approved merged commit is a one-time acceptance check. It does not supply continuing operational detection for render_job_telemetry_west; a passing test cannot substitute for the specific task now required.
Question 201
Consider the rental_subsidy_payments_coastal workload at Urban housing fund: rental_subsidy_payments_coastal pipeline runs one fixed notebook for every region using copied task definitions. Inspection found that job configuration repeats the same notebook 40 times with only region parameters changed. The governed outcome must ensure that the regional workload must run repeatably with bounded parallelism. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Monitor incomplete region iterations and excessive concurrency for rental_subsidy_payments_coastal
- Use a Lakeflow For each task over region inputs with controlled concurrency
- Inspect parameter list, per-region failures and concurrency limits for rental_subsidy_payments_coastal
- Create one unbounded loop that ignores iteration failures at Urban housing fund
Explanation
Correct Answer
B:Use a Lakeflow For each task over region inputs with controlled concurrency is the intended durable approach for rental_subsidy_payments_coastal: it addresses the verified problem (rental_subsidy_payments_coastal pipeline runs one fixed notebook for every region using copied task definitions) while preserving the required behavior (the regional workload must run repeatably with bounded parallelism). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor incomplete region iterations and excessive concurrency for rental_subsidy_payments_coastal would help detect future recurrence, but metrics alone do not deliver the target approach. The rental_subsidy_payments_coastal requirement is that the regional workload must run repeatably with bounded parallelism.
C:Inspect parameter list, per-region failures and concurrency limits for rental_subsidy_payments_coastal could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The rental_subsidy_payments_coastal workflow still requires that the regional workload must run repeatably with bounded parallelism.
D:Unbounded uncontrolled iteration can overwhelm compute and hide errors. The proposed action (Create one unbounded loop that ignores iteration failures at Urban housing fund) does not meet the requirement that the regional workload must run repeatably with bounded parallelism, nor does it constitute the target approach.
Question 202
At Satellite imagery startup, the Lakeflow Connect standard connector workflow handles land-cover observations. The problem is that a land_cover_observations_island source has a compatible connector but existing custom scripts have divergent retries. Evidence: logs show different authentication and pagination paths across team-owned scripts. Constraint: ingestion must be standardized under governed destinations. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Let every notebook invent a new unscheduled direct source sync at Satellite imagery startup
- Configure the connector and validate target schema and schedule in staging
- Compare loaded rows and source bookmarks before switching production
- Use the supported Lakeflow Connect standard connector with scoped source access
Explanation
Correct Answer
B:Configure the connector and validate target schema and schedule in staging provides a bounded way to introduce the approved solution into land_cover_observations_island and detect an early mismatch. The existing signal is logs show different authentication and pagination paths across team-owned scripts; a staged change protects the service requirement (ingestion must be standardized under governed destinations) and makes rollback practical.
Incorrect Answers
A:Uncoordinated custom pulls are less governed and harder to recover. The proposed action (Let every notebook invent a new unscheduled direct source sync at Satellite imagery startup) does not meet the requirement that ingestion must be standardized under governed destinations, nor does it constitute the controlled implementation step.
C:Compare loaded rows and source bookmarks before switching production is a one-time acceptance check. It does not supply the controlled implementation step for land_cover_observations_island; a passing test cannot substitute for the specific task now required.
D:Use the supported Lakeflow Connect standard connector with scoped source access is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the land_cover_observations_island scenario, the observed evidence is that logs show different authentication and pagination paths across team-owned scripts; the requirement remains: ingestion must be standardized under governed destinations.
Question 203
At Community energy cooperative, the Git branch review workflow handles smart meter readings. The problem is that developers edit smart_meter_readings_urban production notebooks directly and bypass code review. Evidence: workspace Git history shows changes without a pull request. Constraint: releases need traceable approval and a recoverable commit. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Develop in a feature branch with a reviewed pull request before merging
- Commit and push the change, review it, then deploy the merged revision
- Copy arbitrary notebook cells into production without a commit at Community energy cooperative
- Verify deployed code hash matches the approved merged commit
Explanation
Correct Answer
B:Commit and push the change, review it, then deploy the merged revision provides a bounded way to introduce the approved solution into smart_meter_readings_urban and detect an early mismatch. The existing signal is workspace Git history shows changes without a pull request; a staged change protects the service requirement (releases need traceable approval and a recoverable commit) and makes rollback practical.
Incorrect Answers
A:Develop in a feature branch with a reviewed pull request before merging is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the smart_meter_readings_urban scenario, the observed evidence is that workspace Git history shows changes without a pull request; the requirement remains: releases need traceable approval and a recoverable commit.
C:Untracked copies cannot reliably reproduce the approved source. The proposed action (Copy arbitrary notebook cells into production without a commit at Community energy cooperative) does not meet the requirement that releases need traceable approval and a recoverable commit, nor does it constitute the controlled implementation step.
D:Verify deployed code hash matches the approved merged commit is a one-time acceptance check. It does not supply the controlled implementation step for smart_meter_readings_urban; a passing test cannot substitute for the specific task now required.
Question 204
Consider the collection_telemetry_coastal workload at Municipal waste service: collection_telemetry_coastal job fails before any Spark task begins. Inspection found that cluster event log shows an unavailable instance type in the selected region. The governed outcome must ensure that the diagnostic must distinguish compute provisioning failure from ETL code defects. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Test alternate eligible compute provisioning and controlled job retry
- Select a supported compute configuration or serverless option that meets the job constraints
- Start a fresh cluster then execute one representative task successfully
- Rewrite successful SQL transformations without investigating provisioning at Municipal waste service
Explanation
Correct Answer
A:Test alternate eligible compute provisioning and controlled job retry provides a bounded way to introduce the approved solution into collection_telemetry_coastal and detect an early mismatch. The existing signal is cluster event log shows an unavailable instance type in the selected region; a staged change protects the service requirement (the diagnostic must distinguish compute provisioning failure from ETL code defects) and makes rollback practical.
Incorrect Answers
B:Select a supported compute configuration or serverless option that meets the job constraints is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the collection_telemetry_coastal scenario, the observed evidence is that cluster event log shows an unavailable instance type in the selected region; the requirement remains: the diagnostic must distinguish compute provisioning failure from ETL code defects.
C:Start a fresh cluster then execute one representative task successfully is a one-time acceptance check. It does not supply the controlled implementation step for collection_telemetry_coastal; a passing test cannot substitute for the specific task now required.
D:Query changes cannot fix unavailable compute capacity. The proposed action (Rewrite successful SQL transformations without investigating provisioning at Municipal waste service) does not meet the requirement that the diagnostic must distinguish compute provisioning failure from ETL code defects, nor does it constitute the controlled implementation step.
Question 205
A data engineer at Regional sporting venue is responsible for admission scan events. The secret handling in bundle config issue is that admission_scan_events_west automation configuration contains an API password committed to Git. The supporting evidence is that repository scan detects a plaintext production secret in bundle variables. The engineer must ensure that configuration must remain reproducible without exposing secrets. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Hide the password by renaming its variable key at Regional sporting venue
- Monitor exposed credentials and unexpected secret-version access for admission_scan_events_west
- Reference approved secret storage or injected CI variables rather than plaintext passwords
- Scan the repo and deploy in staging to verify secrets are not printed
Explanation
Correct Answer
B:Monitor exposed credentials and unexpected secret-version access for admission_scan_events_west creates recurring visibility into the failure mode (admission_scan_events_west automation configuration contains an API password committed to Git). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while configuration must remain reproducible without exposing secrets.
Incorrect Answers
A:Renaming a plaintext secret does not protect it. The proposed action (Hide the password by renaming its variable key at Regional sporting venue) does not meet the requirement that configuration must remain reproducible without exposing secrets, nor does it constitute continuing operational detection.
C:Reference approved secret storage or injected CI variables rather than plaintext passwords is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the admission_scan_events_west scenario, the observed evidence is that repository scan detects a plaintext production secret in bundle variables; the requirement remains: configuration must remain reproducible without exposing secrets.
D:Scan the repo and deploy in staging to verify secrets are not printed is a one-time acceptance check. It does not supply continuing operational detection for admission_scan_events_west; a passing test cannot substitute for the specific task now required.
Question 206
A data engineer at Wholesale produce exchange is responsible for trade settlement files. The timestamp type normalization issue is that trade_settlement_files_north source timestamps arrive as mixed strings and local offsets. The supporting evidence is that a daily fact report groups the same instant into different dates. The engineer must ensure that event time must use a documented timezone and typed timestamp convention. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Monitor failed timestamp casts and timezone drift for trade_settlement_files_north
- Compare events around midnight and daylight-saving transitions in the output
- Compare time strings lexicographically and ignore offsets at Wholesale produce exchange
- Parse timestamps to a common typed convention before time-window aggregation
Explanation
Correct Answer
A:Monitor failed timestamp casts and timezone drift for trade_settlement_files_north creates recurring visibility into the failure mode (trade_settlement_files_north source timestamps arrive as mixed strings and local offsets). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while event time must use a documented timezone and typed timestamp convention.
Incorrect Answers
B:Compare events around midnight and daylight-saving transitions in the output is a one-time acceptance check. It does not supply continuing operational detection for trade_settlement_files_north; a passing test cannot substitute for the specific task now required.
C:String ordering and timezone ambiguity are not robust event-time modeling. The proposed action (Compare time strings lexicographically and ignore offsets at Wholesale produce exchange) does not meet the requirement that event time must use a documented timezone and typed timestamp convention, nor does it constitute continuing operational detection.
D:Parse timestamps to a common typed convention before time-window aggregation is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the trade_settlement_files_north scenario, the observed evidence is that a daily fact report groups the same instant into different dates; the requirement remains: event time must use a documented timezone and typed timestamp convention.
Question 207
At Airport facilities operator, the broadcast small dimension workflow handles maintenance work orders. The problem is that joining maintenance_work_orders_metro fact records to a tiny reference table produces a large shuffle. Evidence: Spark UI shows both inputs shuffled despite one lookup occupying a few megabytes. Constraint: join output must retain key equality and correct multiplicity. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Trial a broadcast hint with representative fact cardinality and verify output
- Review table sizes, statistics and shuffle metrics for maintenance_work_orders_metro
- CrossJoin the entire fact and reference datasets then filter after collection at Airport facilities operator
- Compare join counts and stage shuffle bytes with and without the hint
Explanation
Correct Answer
D:Compare join counts and stage shuffle bytes with and without the hint directly tests the behavior that should change following the correction. With the observed evidence (Spark UI shows both inputs shuffled despite one lookup occupying a few megabytes), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that join output must retain key equality and correct multiplicity.
Incorrect Answers
A:Trial a broadcast hint with representative fact cardinality and verify output may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that Spark UI shows both inputs shuffled despite one lookup occupying a few megabytes. Here, the relevant situation is: the broadcast small dimension workflow handles maintenance work orders. The problem is that joining….
B:Review table sizes, statistics and shuffle metrics for maintenance_work_orders_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The maintenance_work_orders_metro workflow still requires that join output must retain key equality and correct multiplicity.
C:A cartesian expansion wastes resources and risks mis-joins. The proposed action (CrossJoin the entire fact and reference datasets then filter after collection at Airport facilities operator) does not meet the requirement that join output must retain key equality and correct multiplicity, nor does it constitute the post-change acceptance test.
Question 208
At Cloud gaming cooperative, the match-session events workflow depends on match_session_events_delta. Engineers report that match_session_events_delta dataset is shared with a third party that does not run Databricks; the evidence is that recipient cannot authenticate to a Databricks workspace but supports the open protocol. They require that the partner needs supported read-only interoperability. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which controlled implementation step is appropriate now?
- Issue recipient configuration using supported sharing workflow and test access
- Read shared sample data through the external client and validate scope
- Choose open Delta Sharing recipient method for eligible non-Databricks consumers
- Require every external organization to obtain provider workspace administrator access at Cloud gaming cooperative
Explanation
Correct Answer
A:Issue recipient configuration using supported sharing workflow and test access provides a bounded way to introduce the approved solution into match_session_events_delta and detect an early mismatch. The existing signal is recipient cannot authenticate to a Databricks workspace but supports the open protocol; a staged change protects the service requirement (the partner needs supported read-only interoperability) and makes rollback practical.
Incorrect Answers
B:Read shared sample data through the external client and validate scope is a one-time acceptance check. It does not supply the controlled implementation step for match_session_events_delta; a passing test cannot substitute for the specific task now required.
C:Choose open Delta Sharing recipient method for eligible non-Databricks consumers is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the match_session_events_delta scenario, the observed evidence is that recipient cannot authenticate to a Databricks workspace but supports the open protocol; the requirement remains: the partner needs supported read-only interoperability.
D:Workspace administration is not needed for open read-only sharing. The proposed action (Require every external organization to obtain provider workspace administrator access at Cloud gaming cooperative) does not meet the requirement that the partner needs supported read-only interoperability, nor does it constitute the controlled implementation step.
Question 209
The experiment_records_urban pipeline at University research consortium has this failure: experiment_records_urban revenue reporting counts each customer event as if it were a unique customer. The team observed that a sample shows three transactions from the same account on one date. Business requirement: dashboard needs daily total revenue and distinct paying accounts. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Test a day with repeated account IDs and verify sum and distinct count
- Publish the aggregate behind a reconciled silver-to-gold transform
- Use sum(account_id) or count of rows as unique-customer count at University research consortium
- Reconcile invoice IDs, account IDs and grouping dates in experiment_records_urban
Explanation
Correct Answer
A:Test a day with repeated account IDs and verify sum and distinct count directly tests the behavior that should change after the correction. With the observed evidence (a sample shows three transactions from the same account on one date), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that dashboard needs daily total revenue and distinct paying accounts.
Incorrect Answers
B:Publish the aggregate behind a reconciled silver-to-gold transform may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that a sample shows three transactions from the same account on one date.
C:Row counts or numeric sums cannot measure distinct account identifiers. The proposed action (Use sum(account_id) or count of rows as unique-customer count at University research consortium) does not meet the requirement that dashboard needs daily total revenue and distinct paying accounts, nor does it constitute the post-change acceptance test.
D:Reconcile invoice IDs, account IDs and grouping dates in experiment_records_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The experiment_records_urban workflow still requires that dashboard needs daily total revenue and distinct paying accounts.
Question 210
At Public weather agency, the skewed join key workflow handles station observation files. The problem is that station_observation_files_rural join hangs on one task while almost every task completes quickly. Evidence: Spark UI reveals one partition contains most rows for a hot customer key. Constraint: optimization must preserve all correct joined rows. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Address skew with AQE skew handling or justified key-salting strategy
- Test skew-aware join on representative hot and cold key samples
- Drop the most frequent business key to balance partitions at Public weather agency
- Profile key frequencies and straggler task metrics for station_observation_files_rural
Explanation
Correct Answer
D:Profile key frequencies and straggler task metrics for station_observation_files_rural directly investigates the evidence (Spark UI reveals one partition contains most rows for a hot customer key) and distinguishes possible causes of station_observation_files_rural join hangs on one task while almost every task completes quickly. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: optimization must preserve all correct joined rows.
Incorrect Answers
A:Address skew with AQE skew handling or justified key-salting strategy is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the station_observation_files_rural scenario, the observed evidence is that Spark UI reveals one partition contains most rows for a hot customer key; the requirement remains: optimization must preserve all correct joined rows.
B:Test skew-aware join on representative hot and cold key samples may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that Spark UI reveals one partition contains most rows for a hot customer key.
C:Dropping a hot key loses legitimate data. The proposed action (Drop the most frequent business key to balance partitions at Public weather agency) does not meet the requirement that optimization must preserve all correct joined rows, nor does it constitute the required pre-change investigation.