Databricks Certified Data Engineer Associate Practice Test 35
Question 340
A data engineer at Environmental inspection office is responsible for sampling field notes. The CI service principal issue is that sampling_field_notes_north deployment works only when the developer logs in interactively. The supporting evidence is that CI pipeline fails with an expired human authentication token. The engineer must ensure that unattended deployments require restricted non-personal credentials. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Inspect authentication identity, workspace permissions and token expiry for sampling_field_notes_north
- Run unattended CI from a clean agent and verify only intended resources change
- Rotate the pipeline to noninteractive credentials and test target validation
- Store the developer's personal token unencrypted in source control at Environmental inspection office
Explanation
Correct Answer
B:Run unattended CI from a clean agent and verify only intended resources change directly tests the behavior that should change after the correction. With the observed evidence (CI pipeline fails with an expired human authentication token), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that unattended deployments require restricted non-personal credentials.
Incorrect Answers
A:Inspect authentication identity, workspace permissions and token expiry for sampling_field_notes_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The sampling_field_notes_north workflow still requires that unattended deployments require restricted non-personal credentials.
C:Rotate the pipeline to noninteractive credentials and test target validation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that CI pipeline fails with an expired human authentication token.
D:Source-controlled long-lived personal secrets create exposure and ownership risk. The proposed action (Store the developer's personal token unencrypted in source control at Environmental inspection office) does not meet the requirement that unattended deployments require restricted non-personal credentials, nor does it constitute the post-change acceptance test.
Question 341
At Regional hospital network, the file arrival trigger workflow handles clinical appointment reports. The problem is that clinical_appointment_reports_east job runs hourly although only one file arrives most days. Evidence: execution history shows repeated empty runs with compute startup cost. Constraint: process each new delivered file promptly without idle polling. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Upload a test file and confirm exactly the expected run fires
- Monitor missed arrival events and repeated empty executions for clinical_appointment_reports_east
- Use a supported file-arrival trigger for the eligible storage location
- Run a full pipeline every minute even if no files arrive at Regional hospital network
Explanation
Correct Answer
B:Monitor missed arrival events and repeated empty executions for clinical_appointment_reports_east creates recurring visibility into the failure mode (clinical_appointment_reports_east job runs hourly although only one file arrives most days). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while process each new delivered file promptly without idle polling.
Incorrect Answers
A:Upload a test file and confirm exactly the expected run fires is a one-time acceptance check. It does not supply continuing operational detection for clinical_appointment_reports_east; a passing test cannot substitute for the specific task now required.
C:Use a supported file-arrival trigger for the eligible storage location is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the clinical_appointment_reports_east scenario, the observed evidence is that execution history shows repeated empty runs with compute startup cost; the requirement remains: process each new delivered file promptly without idle polling.
D:Repetitive empty executions waste compute and cost. The proposed action (Run a full pipeline every minute even if no files arrive at Regional hospital network) does not meet the requirement that process each new delivered file promptly without idle polling, nor does it constitute continuing operational detection.
Question 342
Consider the property_reservation_updates_east workload at Multi-region rental platform: property_reservation_updates_east aggregation spends more time in shuffle than in input scanning. Inspection found that Spark UI shows large shuffle read/write and long exchange stages. The governed outcome must ensure that the transformation must preserve results while reducing unnecessary data movement. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Increase driver memory alone and assume shuffle disappears at Multi-region rental platform
- Reduce avoidable shuffles through appropriate join strategy and pre-aggregation
- Pilot a plan change with fixed input and capture Spark UI metrics
- Compare result equivalence and shuffle bytes before and after tuning
Explanation
Correct Answer
C:Pilot a plan change with fixed input and capture Spark UI metrics provides a bounded way to introduce the approved solution into property_reservation_updates_east and detect an early mismatch. The existing signal is Spark UI shows large shuffle read/write and long exchange stages; a staged change protects the service requirement (the transformation must preserve results while reducing unnecessary data movement) and makes rollback practical.
Incorrect Answers
A:Driver sizing does not remove distributed shuffle operations. The proposed action (Increase driver memory alone and assume shuffle disappears at Multi-region rental platform) does not meet the requirement that the transformation must preserve results while reducing unnecessary data movement, nor does it constitute the controlled implementation step.
B:Reduce avoidable shuffles through appropriate join strategy and pre-aggregation is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the property_reservation_updates_east scenario, the observed evidence is that Spark UI shows large shuffle read/write and long exchange stages; the requirement remains: the transformation must preserve results while reducing unnecessary data movement.
D:Compare result equivalence and shuffle bytes before and after tuning is a one-time acceptance check. It does not supply the controlled implementation step for property_reservation_updates_east; a passing test cannot substitute for the specific task now required.
Question 343
Consider the render_job_telemetry_north workload at Media postproduction team: render_job_telemetry_north dashboard repeatedly scans years of silver transactions for daily rollups. Inspection found that SQL history shows expensive repeated aggregation on an otherwise stable reporting query. The governed outcome must ensure that analysts need low-latency aggregates refreshed on a defined cadence. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Publish a materialized view for precomputed frequently queried aggregates
- Measure refresh needs, compute cost and gold-layer query patterns for render_job_telemetry_north
- Create a regular view and promise it stores its results between queries at Media postproduction team
- Monitor gold refresh age and incremental-refresh failures for render_job_telemetry_north
Explanation
Correct Answer
A:Publish a materialized view for precomputed frequently queried aggregates is the intended durable approach for render_job_telemetry_north: it addresses the verified problem (render_job_telemetry_north dashboard repeatedly scans years of silver transactions for daily rollups) while preserving the required behavior (analysts need low-latency aggregates refreshed on a defined cadence). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Measure refresh needs, compute cost and gold-layer query patterns for render_job_telemetry_north could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The render_job_telemetry_north workflow still requires that analysts need low-latency aggregates refreshed on a defined cadence.
C:Ordinary views do not persist precomputed results. The proposed action (Create a regular view and promise it stores its results between queries at Media postproduction team) does not meet the requirement that analysts need low-latency aggregates refreshed on a defined cadence, nor does it constitute the target approach.
D:Monitor gold refresh age and incremental-refresh failures for render_job_telemetry_north would help detect future recurrence, but metrics alone do not deliver the target approach. The render_job_telemetry_north requirement is that analysts need low-latency aggregates refreshed on a defined cadence.
Question 344
The turbine_sensor_messages_south pipeline at Renewable energy operator has this failure: turbine_sensor_messages_south downstream transformation needs to run after its governed source table changes. The team observed that the source updates irregularly while cron polling starts empty jobs. Business requirement: data freshness should follow actual table changes rather than wall-clock guesses. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Configure a table-update trigger tied to the supported source table
- Schedule a blind daily task when source updates require immediate processing at Renewable energy operator
- Modify source and confirm downstream task runs only after detectable update
- Monitor trigger delivery, lag and disabled-source conditions for turbine_sensor_messages_south
Explanation
Correct Answer
D:Monitor trigger delivery, lag and disabled-source conditions for turbine_sensor_messages_south creates recurring visibility into the failure mode (turbine_sensor_messages_south downstream transformation needs to run after its governed source table changes). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while data freshness should follow actual table changes rather than wall-clock guesses.
Incorrect Answers
A:Configure a table-update trigger tied to the supported source table is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the turbine_sensor_messages_south scenario, the observed evidence is that the source updates irregularly while cron polling starts empty jobs; the requirement remains: data freshness should follow actual table changes rather than wall-clock guesses.
B:Coarse polling cannot consistently meet data-driven freshness. The proposed action (Schedule a blind daily task when source updates require immediate processing at Renewable energy operator) does not meet the requirement that data freshness should follow actual table changes rather than wall-clock guesses, nor does it constitute continuing operational detection.
C:Modify source and confirm downstream task runs only after detectable update is a one-time acceptance check. It does not supply continuing operational detection for turbine_sensor_messages_south; a passing test cannot substitute for the specific task now required.
Question 345
At Retail pharmacy network, the predictive optimization behavior workflow handles inventory adjustments. The problem is that inventory_adjustments_rural managed table has manual OPTIMIZE jobs colliding with platform-managed maintenance. Evidence: table maintenance history shows overlapping compaction attempts. Constraint: the maintenance policy must avoid redundant cost and scheduling conflict. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Use predictive optimization where supported and retire redundant manual jobs
- Compare file counts, query results and maintenance cost across a full cycle
- Manually VACUUM all data files before retention safeguards are checked at Retail pharmacy network
- Monitor predictive optimization events, costs and deferred maintenance for inventory_adjustments_rural
Explanation
Correct Answer
D:Monitor predictive optimization events, costs and deferred maintenance for inventory_adjustments_rural creates recurring visibility into the failure mode (inventory_adjustments_rural managed table has manual OPTIMIZE jobs colliding with platform-managed maintenance). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the maintenance policy must avoid redundant cost and scheduling conflict.
Incorrect Answers
A:Use predictive optimization where supported and retire redundant manual jobs is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the inventory_adjustments_rural scenario, the observed evidence is that table maintenance history shows overlapping compaction attempts; the requirement remains: the maintenance policy must avoid redundant cost and scheduling conflict.
B:Compare file counts, query results and maintenance cost across a full cycle is a one-time acceptance check. It does not supply continuing operational detection for inventory_adjustments_rural; a passing test cannot substitute for the specific task now required.
C:Unguarded vacuum can remove files needed for recovery. The proposed action (Manually VACUUM all data files before retention safeguards are checked at Retail pharmacy network) does not meet the requirement that the maintenance policy must avoid redundant cost and scheduling conflict, nor does it constitute continuing operational detection.
Question 346
Consider the warehouse_movement_logs_west workload at Multinational parts distributor: warehouse_movement_logs_west analysts require a simple always-current projection without a stored refresh process. Inspection found that a team proposes a materialized view even though the logic is just a lightweight filter. The governed outcome must ensure that data access should reflect up-to-date table rows without unnecessary materialization cost. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Physically copy the entire source table every time a user opens a dashboard at Multinational parts distributor
- Use a standard governed view for low-cost logical projection rather than scheduled materialization
- Insert a source row and confirm view results reflect it on subsequent query
- Monitor view permissions, dependency changes and query performance for warehouse_movement_logs_west
Explanation
Correct Answer
D:Monitor view permissions, dependency changes and query performance for warehouse_movement_logs_west creates recurring visibility into the failure mode (warehouse_movement_logs_west analysts require a simple always-current projection without a stored refresh process). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while data access should reflect up-to-date table rows without unnecessary materialization cost.
Incorrect Answers
A:Unnecessary full copies increase cost and stale-data risk. The proposed action (Physically copy the entire source table every time a user opens a dashboard at Multinational parts distributor) does not meet the requirement that data access should reflect up-to-date table rows without unnecessary materialization cost, nor does it constitute continuing operational detection.
B:Use a standard governed view for low-cost logical projection rather than scheduled materialization is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the warehouse_movement_logs_west scenario, the observed evidence is that a team proposes a materialized view even though the logic is just a lightweight filter; the requirement remains: data access should reflect up-to-date table rows without unnecessary materialization cost.
C:Insert a source row and confirm view results reflect it on subsequent query is a one-time acceptance check. It does not supply continuing operational detection for warehouse_movement_logs_west; a passing test cannot substitute for the specific task now required.
Question 347
A data engineer at Independent cinema group is responsible for ticket transactions. The pipeline task invocation issue is that ticket_transactions_highland Spark Declarative Pipeline is managed separately and not part of the daily job. The supporting evidence is that analytics runs before the pipeline produces its updated streaming table. The engineer must ensure that job orchestration must wait for pipeline update completion. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Assume the pipeline auto-refreshes before every dashboard query at Independent cinema group
- Use a Lakeflow pipeline task with success dependency before analytics tasks
- Monitor pipeline update failures and downstream task skips for ticket_transactions_highland
- Inspect pipeline identity, job task settings and downstream dependencies for ticket_transactions_highland
Explanation
Correct Answer
B:Use a Lakeflow pipeline task with success dependency before analytics tasks is the intended durable approach for ticket_transactions_highland: it addresses the verified problem (ticket_transactions_highland Spark Declarative Pipeline is managed separately and not part of the daily job) while preserving the required behavior (job orchestration must wait for pipeline update completion). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Uncontrolled refresh timing does not guarantee dependency order. The proposed action (Assume the pipeline auto-refreshes before every dashboard query at Independent cinema group) does not meet the requirement that job orchestration must wait for pipeline update completion, nor does it constitute the target approach.
C:Monitor pipeline update failures and downstream task skips for ticket_transactions_highland would help detect future recurrence, but metrics alone do not deliver the target approach. The ticket_transactions_highland requirement is that job orchestration must wait for pipeline update completion.
D:Inspect pipeline identity, job task settings and downstream dependencies for ticket_transactions_highland could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The ticket_transactions_highland workflow still requires that job orchestration must wait for pipeline update completion.
Question 348
At Port customs authority, the nested JSON extraction workflow handles border inspection results. The problem is that nested arrays in border_inspection_results_island events are written as uninterpreted strings. Evidence: sample JSON contains an array of line items under each order. Constraint: analytics requires one record per line item while retaining the parent ID. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Parse nested JSON to typed structures and explode line arrays while preserving parent keys
- Split raw JSON text on commas to infer nested objects at Port customs authority
- Inspect schema, array cardinality and nested field types for border_inspection_results_island
- Monitor newly nested fields, null child keys and malformed JSON for border_inspection_results_island
Explanation
Correct Answer
A:Parse nested JSON to typed structures and explode line arrays while preserving parent keys is the intended durable approach for border_inspection_results_island: it addresses the verified problem (nested arrays in border_inspection_results_island events are written as uninterpreted strings) while preserving the required behavior (analytics requires one record per line item while retaining the parent ID). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:String splitting is not valid nested json parsing. The proposed action (Split raw JSON text on commas to infer nested objects at Port customs authority) does not meet the requirement that analytics requires one record per line item while retaining the parent ID, nor does it constitute the target approach.
C:Inspect schema, array cardinality and nested field types for border_inspection_results_island could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The border_inspection_results_island workflow still requires that analytics requires one record per line item while retaining the parent ID.
D:Monitor newly nested fields, null child keys and malformed JSON for border_inspection_results_island would help detect future recurrence, but metrics alone do not deliver the target approach. The border_inspection_results_island requirement is that analytics requires one record per line item while retaining the parent ID.
Question 349
A data engineer at Food delivery franchise is responsible for dispatch and delivery status. The job max concurrent runs issue is that dispatch_and_delivery_status_highland high-frequency triggers create overlapping job runs that overwrite the same gold partition. The supporting evidence is that run history shows two active instances of an identical pipeline. The engineer must ensure that concurrent processing must respect destination write semantics. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Inspect overlap, idempotency and safe concurrency limit for dispatch_and_delivery_status_highland
- Pilot concurrency limits and deterministic write keys
- Raise maximum concurrent runs without coordinating shared output writes at Food delivery franchise
- Set maximum concurrent runs or isolation controls appropriate to the shared target
Explanation
Correct Answer
A:Inspect overlap, idempotency and safe concurrency limit for dispatch_and_delivery_status_highland directly investigates the evidence (run history shows two active instances of an identical pipeline) and distinguishes possible causes of dispatch_and_delivery_status_highland high-frequency triggers create overlapping job runs that overwrite the same gold partition. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: concurrent processing must respect destination write semantics.
Incorrect Answers
B:Pilot concurrency limits and deterministic write keys may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that run history shows two active instances of an identical pipeline. This matters here because a data engineer at Food delivery franchise is responsible for dispatch and delivery status. The job max concurrent….
C:Overlapping unsafe writers can corrupt business results or cause failures. The proposed action (Raise maximum concurrent runs without coordinating shared output writes at Food delivery franchise) does not meet the requirement that concurrent processing must respect destination write semantics, nor does it constitute the required pre-change investigation.
D:Set maximum concurrent runs or isolation controls appropriate to the shared target is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the dispatch_and_delivery_status_highland scenario, the observed evidence is that run history shows two active instances of an identical pipeline; the requirement remains: concurrent processing must respect destination write semantics.
Question 350
At Cloud gaming cooperative, the match-session events workflow depends on match_session_events_urban. Engineers report that the match_session_events_urban partner API returns 100 rows per page but the batch stores only the first page; the evidence is that response metadata includes a next cursor that the client ignores. They require that all authorized records must be imported without exceeding API limits. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which controlled implementation step is appropriate now?
- Compare source advertised total and destination distinct IDs after a full pull
- Test pagination on a multi-page source with backoff for HTTP 429
- Implement cursor pagination with bounded retries and idempotent destination keys
- Stop after one successful HTTP 200 response at Cloud gaming cooperative
Explanation
Correct Answer
B:Test pagination on a multi-page source with backoff for HTTP 429 provides a bounded way to introduce the approved solution into match_session_events_urban and detect an early mismatch. The existing signal is response metadata includes a next cursor that the client ignores; a staged change protects the service requirement (all authorized records must be imported without exceeding API limits) and makes rollback practical.
Incorrect Answers
A:Compare source advertised total and destination distinct IDs after a full pull is a one-time acceptance check. It does not supply the controlled implementation step for match_session_events_urban; a passing test cannot substitute for the specific task now required.
C:Implement cursor pagination with bounded retries and idempotent destination keys is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the match_session_events_urban scenario, the observed evidence is that response metadata includes a next cursor that the client ignores; the requirement remains: all authorized records must be imported without exceeding API limits.
D:A successful first page does not establish completeness. The proposed action (Stop after one successful HTTP 200 response at Cloud gaming cooperative) does not meet the requirement that all authorized records must be imported without exceeding API limits, nor does it constitute the controlled implementation step.