Databricks Certified Data Engineer Associate Practice Test 14
Question 130
At Retail pharmacy network, the job max concurrent runs workflow handles inventory adjustments. The problem is that inventory_adjustments_island high-frequency triggers create overlapping job runs that overwrite the same gold partition. Evidence: run history shows two active instances of an identical pipeline. Constraint: concurrent processing must respect destination write semantics. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Raise maximum concurrent runs without coordinating shared output writes at Retail pharmacy network
- Inspect overlap, idempotency and safe concurrency limit for inventory_adjustments_island
- Set maximum concurrent runs or isolation controls appropriate to the shared target
- Pilot concurrency limits and deterministic write keys
Explanation
Correct Answer
B:Inspect overlap, idempotency and safe concurrency limit for inventory_adjustments_island directly investigates the evidence (run history shows two active instances of an identical pipeline) and distinguishes possible causes of inventory_adjustments_island high-frequency triggers create overlapping job runs that overwrite the same gold partition. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: concurrent processing must respect destination write semantics.
Incorrect Answers
A:Overlapping unsafe writers can corrupt business results or cause failures. The proposed action (Raise maximum concurrent runs without coordinating shared output writes at Retail pharmacy network) does not meet the requirement that concurrent processing must respect destination write semantics, nor does it constitute the required pre-change investigation.
C:Set maximum concurrent runs or isolation controls appropriate to the shared target is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the inventory_adjustments_island scenario, the observed evidence is that run history shows two active instances of an identical pipeline; the requirement remains: concurrent processing must respect destination write semantics.
D:Pilot concurrency limits and deterministic write keys may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that run history shows two active instances of an identical pipeline.
Question 131
Consider the sampling_field_notes_metro workload at Environmental inspection office: sampling_field_notes_metro table contains records from many regions but local analysts may view only their own rows. Inspection found that a sample query under a local user returns another region's customers. The governed outcome must ensure that regional row restrictions must apply during queries. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Map user groups, regional keys and currently enforced filters for sampling_field_notes_metro
- Hide the region column in the dashboard but return every row at Environmental inspection office
- Pilot the filter for two user groups and test no privilege escalation
- Query as each regional group and verify permitted rows only
Explanation
Correct Answer
D:Query as each regional group and verify permitted rows only directly tests the behavior that should change after the correction. With the observed evidence (a sample query under a local user returns another region's customers), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that regional row restrictions must apply during queries.
Incorrect Answers
A:Map user groups, regional keys and currently enforced filters for sampling_field_notes_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The sampling_field_notes_metro workflow still requires that regional row restrictions must apply during queries.
B:Display changes do not enforce row-level security. The proposed action (Hide the region column in the dashboard but return every row at Environmental inspection office) does not meet the requirement that regional row restrictions must apply during queries, nor does it constitute the post-change acceptance test.
C:Pilot the filter for two user groups and test no privilege escalation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that a sample query under a local user returns another region's customers.
Question 132
The factory_defect_records_central pipeline at Manufacturing quality network has this failure: factory_defect_records_central Delta table suffers frequent filter-pattern changes and costly partition rewrites. The team observed that workload history alternates date and customer search predicates across teams. Business requirement: layout optimization must adapt without a rigid proliferating partition tree. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Consider Liquid Clustering on appropriate columns with supported table features
- Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network
- Monitor clustering maintenance costs and changing query predicates for factory_defect_records_central
- Compare query scan size and update overhead for representative filter sets
Explanation
Correct Answer
C:Monitor clustering maintenance costs and changing query predicates for factory_defect_records_central creates recurring visibility into the failure mode (factory_defect_records_central Delta table suffers frequent filter-pattern changes and costly partition rewrites). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while layout optimization must adapt without a rigid proliferating partition tree.
Incorrect Answers
A:Consider Liquid Clustering on appropriate columns with supported table features is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the factory_defect_records_central scenario, the observed evidence is that workload history alternates date and customer search predicates across teams; the requirement remains: layout optimization must adapt without a rigid proliferating partition tree.
B:Overpartitioning drives metadata overhead and inflexible layout. The proposed action (Create thousands of tiny static partitions for every possible predicate at Manufacturing quality network) does not meet the requirement that layout optimization must adapt without a rigid proliferating partition tree, nor does it constitute continuing operational detection.
D:Compare query scan size and update overhead for representative filter sets is a one-time acceptance check. It does not supply continuing operational detection for factory_defect_records_central; a passing test cannot substitute for the specific task now required.
Question 133
Consider the device_calibration_readings_central workload at Optical instrument maker: device_calibration_readings_central analysts require a simple always-current projection without a stored refresh process. Inspection found that a team proposes a materialized view even though the logic is just a lightweight filter. The governed outcome must ensure that data access should reflect up-to-date table rows without unnecessary materialization cost. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Migrate the projection and validate granted access with representative users
- Insert a source row and confirm view results reflect it on subsequent query
- Use a standard governed view for low-cost logical projection rather than scheduled materialization
- Physically copy the entire source table every time a user opens a dashboard at Optical instrument maker
Explanation
Correct Answer
A:Migrate the projection and validate granted access with representative users provides a bounded way to introduce the approved solution into device_calibration_readings_central and detect an early mismatch. The existing signal is a team proposes a materialized view even though the logic is just a lightweight filter; a staged change protects the service requirement (data access should reflect up-to-date table rows without unnecessary materialization cost) and makes rollback practical.
Incorrect Answers
B:Insert a source row and confirm view results reflect it on subsequent query is a one-time acceptance check. It does not supply the controlled implementation step for device_calibration_readings_central; a passing test cannot substitute for the specific task now required.
C:Use a standard governed view for low-cost logical projection rather than scheduled materialization is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the device_calibration_readings_central scenario, the observed evidence is that a team proposes a materialized view even though the logic is just a lightweight filter; the requirement remains: data access should reflect up-to-date table rows without unnecessary materialization cost.
D:Unnecessary full copies increase cost and stale-data risk. The proposed action (Physically copy the entire source table every time a user opens a dashboard at Optical instrument maker) does not meet the requirement that data access should reflect up-to-date table rows without unnecessary materialization cost, nor does it constitute the controlled implementation step.
Question 134
At Media postproduction team, the shuffle partition tuning workflow handles render-job telemetry. The problem is that render_job_telemetry_metro aggregation spends most time scheduling thousands of tiny shuffle tasks. Evidence: Spark UI shows very low per-task data size and excessive scheduling overhead. Constraint: performance changes must be benchmarked against the same output. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Watch task count, spill and stage duration after tuning render_job_telemetry_metro
- Tune spark.sql.shuffle.partitions or AQE behavior based on measured shuffle workload
- Inspect shuffle output size, task duration and partition setting for render_job_telemetry_metro
- Increase shuffle partitions without measuring task size or skew at Media postproduction team
Explanation
Correct Answer
B:Tune spark.sql.shuffle.partitions or AQE behavior based on measured shuffle workload is the intended durable approach for render_job_telemetry_metro: it addresses the verified problem (render_job_telemetry_metro aggregation spends most time scheduling thousands of tiny shuffle tasks) while preserving the required behavior (performance changes must be benchmarked against the same output). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Watch task count, spill and stage duration after tuning render_job_telemetry_metro would help detect future recurrence, but metrics alone do not deliver the target approach. The render_job_telemetry_metro requirement is that performance changes must be benchmarked against the same output.
C:Inspect shuffle output size, task duration and partition setting for render_job_telemetry_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The render_job_telemetry_metro workflow still requires that performance changes must be benchmarked against the same output.
D:Arbitrary partition expansion can increase overhead. The proposed action (Increase shuffle partitions without measuring task size or skew at Media postproduction team) does not meet the requirement that performance changes must be benchmarked against the same output, nor does it constitute the target approach.
Question 135
Consider the experiment_records_metro workload at University research consortium: the experiment_records_metro partner API returns 100 rows per page but the batch stores only the first page. Inspection found that response metadata includes a next cursor that the client ignores. The governed outcome must ensure that all authorized records must be imported without exceeding API limits. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Stop after one successful HTTP 200 response at University research consortium
- Inspect response cursor, throttle status and stable identity for experiment_records_metro
- Test pagination on a multi-page source with backoff for HTTP 429
- Compare source advertised total and destination distinct IDs after a full pull
Explanation
Correct Answer
D:Compare source advertised total and destination distinct IDs after a full pull directly tests the behavior that should change after the correction. With the observed evidence (response metadata includes a next cursor that the client ignores), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that all authorized records must be imported without exceeding API limits.
Incorrect Answers
A:A successful first page does not establish completeness. The proposed action (Stop after one successful HTTP 200 response at University research consortium) does not meet the requirement that all authorized records must be imported without exceeding API limits, nor does it constitute the post-change acceptance test.
B:Inspect response cursor, throttle status and stable identity for experiment_records_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The experiment_records_metro workflow still requires that all authorized records must be imported without exceeding API limits.
C:Test pagination on a multi-page source with backoff for HTTP 429 may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that response metadata includes a next cursor that the client ignores.
Question 136
A data engineer at Airport facilities operator is responsible for maintenance work orders. The Unity Catalog audit event issue is that maintenance_work_orders_urban ownership team cannot explain who changed a sensitive table grant. The supporting evidence is that investigation lacks a query of account audit events around the change. The engineer must ensure that privilege changes require attributable evidence and retention. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Disable audit logs because granting privileges already requires admin at Airport facilities operator
- Identify relevant audit event source, principal, timestamp and target object for maintenance_work_orders_urban
- Use available UC audit logging and governed retention for administrative events
- Configure audit log access and build an approved privilege-change report
Explanation
Correct Answer
B:Identify relevant audit event source, principal, timestamp and target object for maintenance_work_orders_urban directly investigates the evidence (investigation lacks a query of account audit events around the change) and distinguishes possible causes of maintenance_work_orders_urban ownership team cannot explain who changed a sensitive table grant. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: privilege changes require attributable evidence and retention.
Incorrect Answers
A:Administrative permissions do not replace audit evidence. The proposed action (Disable audit logs because granting privileges already requires admin at Airport facilities operator) does not meet the requirement that privilege changes require attributable evidence and retention, nor does it constitute the required pre-change investigation.
C:Use available UC audit logging and governed retention for administrative events is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the maintenance_work_orders_urban scenario, the observed evidence is that investigation lacks a query of account audit events around the change; the requirement remains: privilege changes require attributable evidence and retention.
D:Configure audit log access and build an approved privilege-change report may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that investigation lacks a query of account audit events around the change.
Question 137
Consider the match_session_events_central workload at Cloud gaming cooperative: match_session_events_central contains many tables with a sensitive tag but policy enforcement differs by owner. Inspection found that audit shows only some similarly tagged tables have manual row filters. The governed outcome must ensure that one central rule must apply automatically to matching governed objects. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Add a newly tagged table and verify automatic enforcement
- Inventory governed tag assignments and effective policy scope for match_session_events_central
- Use ungoverned free-text tags and assume they enforce security at Cloud gaming cooperative
- Test policy on selected tagged tables and gradually apply approved scope
Explanation
Correct Answer
A:Add a newly tagged table and verify automatic enforcement directly tests the behavior that should change after the correction. With the observed evidence (audit shows only some similarly tagged tables have manual row filters), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that one central rule must apply automatically to matching governed objects.
Incorrect Answers
B:Inventory governed tag assignments and effective policy scope for match_session_events_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The match_session_events_central workflow still requires that one central rule must apply automatically to matching governed objects.
C:Untested labels are not enforced access policies. The proposed action (Use ungoverned free-text tags and assume they enforce security at Cloud gaming cooperative) does not meet the requirement that one central rule must apply automatically to matching governed objects, nor does it constitute the post-change acceptance test.
D:Test policy on selected tagged tables and gradually apply approved scope may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that audit shows only some similarly tagged tables have manual row filters.
Question 138
At Clinical diagnostics network, the COPY INTO file format workflow handles lab sample events. The problem is that the lab_sample_events_urban import creates a single malformed column because input format settings are wrong. Evidence: source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. Constraint: all source columns must map to the intended typed Delta fields. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network
- Test the file format on a small sample, then run the governed target load
- Choose COPY INTO with the correct CSV fileformat and source column mapping
- Inspect sample files and COPY INTO format options for lab_sample_events_urban
Explanation
Correct Answer
D:Inspect sample files and COPY INTO format options for lab_sample_events_urban directly investigates the evidence (source inspection shows UTF-8 CSV with an explicit header and quoted delimiters) and distinguishes possible causes of the lab_sample_events_urban import creates a single malformed column because input format settings are wrong. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: all source columns must map to the intended typed Delta fields.
Incorrect Answers
A:The parser would misread the source schema rather than fix its mapping. The proposed action (Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network) does not meet the requirement that all source columns must map to the intended typed Delta fields, nor does it constitute the required pre-change investigation.
B:Test the file format on a small sample, then run the governed target load may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. Here, the relevant situation is: the COPY INTO file format workflow handles lab sample events. The problem is that the lab_sample_events_urban import….
C:Choose COPY INTO with the correct CSV fileformat and source column mapping is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the lab_sample_events_urban scenario, the observed evidence is that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters; the requirement remains: all source columns must map to the intended typed Delta fields.
Question 139
Consider the factory_defect_records_delta workload at Manufacturing quality network: factory_defect_records_delta pipeline configuration exists only in one engineer's workspace UI. Inspection found that releasing to test requires manual reconstruction of tasks. The governed outcome must ensure that the same versioned workload definitions must deploy to multiple targets. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Inventory job, pipeline and permissions resources needed for factory_defect_records_delta
- Recreate every task manually with different values in each environment at Manufacturing quality network
- Deploy the versioned bundle to test then prod with approval and target-specific config
- Package supported jobs and pipelines as Declarative Automation Bundle resources
Explanation
Correct Answer
A:Inventory job, pipeline and permissions resources needed for factory_defect_records_delta directly investigates the evidence (releasing to test requires manual reconstruction of tasks) and distinguishes possible causes of factory_defect_records_delta pipeline configuration exists only in one engineer's workspace UI. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the same versioned workload definitions must deploy to multiple targets.
Incorrect Answers
B:Manual recreation invites hidden differences and unreproducible releases. The proposed action (Recreate every task manually with different values in each environment at Manufacturing quality network) does not meet the requirement that the same versioned workload definitions must deploy to multiple targets, nor does it constitute the required pre-change investigation.
C:Deploy the versioned bundle to test then prod with approval and target-specific config may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that releasing to test requires manual reconstruction of tasks.
D:Package supported jobs and pipelines as Declarative Automation Bundle resources is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the factory_defect_records_delta scenario, the observed evidence is that releasing to test requires manual reconstruction of tasks; the requirement remains: the same versioned workload definitions must deploy to multiple targets.
Question 140
Consider the station_observation_files_island workload at Public weather agency: station_observation_files_island Spark Declarative Pipeline is managed separately and not part of the daily job. Inspection found that analytics runs before the pipeline produces its updated streaming table. The governed outcome must ensure that job orchestration must wait for pipeline update completion. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Use a Lakeflow pipeline task with success dependency before analytics tasks
- Monitor pipeline update failures and downstream task skips for station_observation_files_island
- Assume the pipeline auto-refreshes before every dashboard query at Public weather agency
- Trigger a full job and verify pipeline completion precedes analytics
Explanation
Correct Answer
B:Monitor pipeline update failures and downstream task skips for station_observation_files_island creates recurring visibility into the failure mode (station_observation_files_island Spark Declarative Pipeline is managed separately and not part of the daily job). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while job orchestration must wait for pipeline update completion.
Incorrect Answers
A:Use a Lakeflow pipeline task with success dependency before analytics tasks is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the station_observation_files_island scenario, the observed evidence is that analytics runs before the pipeline produces its updated streaming table; the requirement remains: job orchestration must wait for pipeline update completion.
C:Uncontrolled refresh timing does not guarantee dependency order. The proposed action (Assume the pipeline auto-refreshes before every dashboard query at Public weather agency) does not meet the requirement that job orchestration must wait for pipeline update completion, nor does it constitute continuing operational detection.
D:Trigger a full job and verify pipeline completion precedes analytics is a one-time acceptance check. It does not supply continuing operational detection for station_observation_files_island; a passing test cannot substitute for the specific task now required.