Databricks Certified Data Engineer Associate Practice Test 71
Question 700
A data engineer at Aquaculture farming group is responsible for water-quality readings. The shuffle partition oversplitting issue is that water_quality_readings_highland job has hundreds of thousands of very small tasks on a modest daily dataset. The supporting evidence is that Spark UI shows scheduling overhead dominates work time. The engineer must ensure that the adjustment must keep exact output and avoid poor parallelism. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Test bounded shuffle partition adjustment in staging and capture the plan
- Measure input sizes, task overhead and shuffle partition count for water_quality_readings_highland
- Reduce excessive partitions or enable adaptive coalescing as appropriate
- Set shuffle partitions to an arbitrary enormous value for all workloads at Aquaculture farming group
Explanation
Correct Answer
B:Measure input sizes, task overhead and shuffle partition count for water_quality_readings_highland directly investigates the evidence (Spark UI shows scheduling overhead dominates work time) and distinguishes possible causes of water_quality_readings_highland job has hundreds of thousands of very small tasks on a modest daily dataset. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the adjustment must keep exact output and avoid poor parallelism.
Incorrect Answers
A:Test bounded shuffle partition adjustment in staging and capture the plan may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that Spark UI shows scheduling overhead dominates work time. This matters here because a data engineer at Aquaculture farming group is responsible for water-quality readings. The shuffle partition….
C:Reduce excessive partitions or enable adaptive coalescing as appropriate is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the water_quality_readings_highland scenario, the observed evidence is that Spark UI shows scheduling overhead dominates work time; the requirement remains: the adjustment must keep exact output and avoid poor parallelism.
D:More tasks can increase scheduling overhead rather than speed work. The proposed action (Set shuffle partitions to an arbitrary enormous value for all workloads at Aquaculture farming group) does not meet the requirement that the adjustment must keep exact output and avoid poor parallelism, nor does it constitute the required pre-change investigation.
Question 701
At Airport facilities operator, the maintenance work orders workflow depends on maintenance_work_orders_delta. Engineers report that maintenance_work_orders_delta DataFrame join change increases record count after merging; the evidence is that PR diff contains a new join clause but CI checks only linting. They require that joining behavior and key uniqueness must be tested before promotion. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Identify expected row cardinality and source fixture for maintenance_work_orders_delta
- Approve PRs solely on code formatting without data assertions at Airport facilities operator
- Run a duplicate-key fixture and verify output matches expected cardinality
- Introduce fixture-based tests into the PR workflow and gate merge
Explanation
Correct Answer
C:Run a duplicate-key fixture and verify output matches expected cardinality directly tests the behavior that should change following the correction. With the observed evidence (PR diff contains a new join clause but CI checks only linting), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that joining behavior and key uniqueness must be tested before promotion.
Incorrect Answers
A:Identify expected row cardinality and source fixture for maintenance_work_orders_delta could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The maintenance_work_orders_delta workflow still requires that joining behavior and key uniqueness must be tested before promotion.
B:Well-formatted code can still produce incorrect data. The proposed action (Approve PRs solely on code formatting without data assertions at Airport facilities operator) does not meet the requirement that joining behavior and key uniqueness must be tested before promotion, nor does it constitute the post-change acceptance test.
D:Introduce fixture-based tests into the PR workflow and gate merge may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that PR diff contains a new join clause but CI checks only linting. Here, the relevant situation is: the maintenance work orders workflow depends on maintenance_work_orders_delta. Engineers report that….
Question 702
Consider the trade_settlement_files_delta workload at Wholesale produce exchange: trade_settlement_files_delta production job UI was manually edited after bundle deployment. Inspection found that resolved job settings differ from the versioned bundle manifest. The governed outcome must ensure that releases must remain traceable to approved Git changes. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Monitor unexpected UI changes and bundle deployment mismatches for trade_settlement_files_delta
- Treat the versioned bundle as the source of truth and prohibit unreviewed manual drift
- Update the source by copying random current production settings without review at Wholesale produce exchange
- Check resource properties and a smoke run against the approved manifest
Explanation
Correct Answer
A:Monitor unexpected UI changes and bundle deployment mismatches for trade_settlement_files_delta creates recurring visibility into the failure mode (trade_settlement_files_delta production job UI was manually edited after bundle deployment). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while releases must remain traceable to approved Git changes.
Incorrect Answers
B:Treat the versioned bundle as the source of truth and prohibit unreviewed manual drift is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the trade_settlement_files_delta scenario, the observed evidence is that resolved job settings differ from the versioned bundle manifest; the requirement remains: releases must remain traceable to approved Git changes.
C:Unreviewed drift can be promoted into every environment. The proposed action (Update the source by copying random current production settings without review at Wholesale produce exchange) does not meet the requirement that releases must remain traceable to approved Git changes, nor does it constitute continuing operational detection.
D:Check resource properties and a smoke run against the approved manifest is a one-time acceptance check. It does not supply continuing operational detection for trade_settlement_files_delta; a passing test cannot substitute for the specific task now required.
Question 703
At Coastal freight alliance, the Lakehouse Federation source workflow handles shipment manifests. The problem is that shipment_manifests_north analysts need occasional queries of an external warehouse without full bulk ingestion. Evidence: source data is large but analytics needs a small live subset. Constraint: governance should provide on-demand read access without an unnecessary copy. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Copy the entire external database daily regardless of query demand at Coastal freight alliance
- Use Lakehouse Federation connection and foreign catalog for suitable source queries
- Configure a scoped connection and grant access to a test foreign table
- Query the external source through UC and compare returned authorized rows
Explanation
Correct Answer
C:Configure a scoped connection and grant access to a test foreign table provides a bounded way to introduce the approved solution into shipment_manifests_north and detect an early mismatch. The existing signal is source data is large but analytics needs a small live subset; a staged change protects the service requirement (governance should provide on-demand read access without an unnecessary copy) and makes rollback practical.
Incorrect Answers
A:Full-copy ingestion is not required for selective federated querying. The proposed action (Copy the entire external database daily regardless of query demand at Coastal freight alliance) does not meet the requirement that governance should provide on-demand read access without an unnecessary copy, nor does it constitute the controlled implementation step.
B:Use Lakehouse Federation connection and foreign catalog for suitable source queries is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the shipment_manifests_north scenario, the observed evidence is that source data is large but analytics needs a small live subset; the requirement remains: governance should provide on-demand read access without an unnecessary copy.
D:Query the external source through UC and compare returned authorized rows is a one-time acceptance check. It does not supply the controlled implementation step for shipment_manifests_north; a passing test cannot substitute for the specific task now required.
Question 704
At Public transport authority, the fare validation events workflow depends on fare_validation_events_rural. Engineers report that fare_validation_events_rural gold report launches before silver validation finishes; the evidence is that a task graph shows report and validation as parallel children of ingestion. They require that downstream publishing must not start until all required upstream checks succeed. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Reconfigure the job task graph and test one run with a delayed validator
- Schedule every task at the same clock time and hope upstream processing completes at Public transport authority
- Read job DAG edges and task-run timestamps for fare_validation_events_rural
- Declare an explicit dependency from gold publishing to successful validation tasks
Explanation
Correct Answer
C:Read job DAG edges and task-run timestamps for fare_validation_events_rural directly investigates the evidence (a task graph shows report and validation as parallel children of ingestion) and distinguishes possible causes of fare_validation_events_rural gold report launches before silver validation finishes. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: downstream publishing must not start until all required upstream checks succeed.
Incorrect Answers
A:Reconfigure the job task graph and test one run with a delayed validator may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that a task graph shows report and validation as parallel children of ingestion. Here, the relevant situation is: the fare validation events workflow depends on fare_validation_events_rural. Engineers report that….
B:Clock coincidence does not enforce dependency correctness. The proposed action (Schedule every task at the same clock time and hope upstream processing completes at Public transport authority) does not meet the requirement that downstream publishing must not start until all required upstream checks succeed, nor does it constitute the required pre-change investigation.
D:Declare an explicit dependency from gold publishing to successful validation tasks is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the fare_validation_events_rural scenario, the observed evidence is that a task graph shows report and validation as parallel children of ingestion; the requirement remains: downstream publishing must not start until all required upstream checks succeed.
Question 705
Consider the render_job_telemetry_north workload at Media postproduction team: render_job_telemetry_north analysts have SELECT on a table but get a permission error at query time. Inspection found that access review shows missing USE CATALOG on its parent catalog. The governed outcome must ensure that users must read only the authorized governed object. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Grant required parent USE CATALOG and USE SCHEMA along with table SELECT
- Query the table as an analyst and confirm sibling data remains denied
- Apply least-privilege grants to an analyst group and test identity
- Grant global metastore administration to fix one table query at Media postproduction team
Explanation
Correct Answer
C:Apply least-privilege grants to an analyst group and test identity provides a bounded way to introduce the approved solution into render_job_telemetry_north and detect an early mismatch. The existing signal is access review shows missing USE CATALOG on its parent catalog; a staged change protects the service requirement (users must read only the authorized governed object) and makes rollback practical.
Incorrect Answers
A:Grant required parent USE CATALOG and USE SCHEMA along with table SELECT is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the render_job_telemetry_north scenario, the observed evidence is that access review shows missing USE CATALOG on its parent catalog; the requirement remains: users must read only the authorized governed object.
B:Query the table as an analyst and confirm sibling data remains denied is a one-time acceptance check. It does not supply the controlled implementation step for render_job_telemetry_north; a passing test cannot substitute for the specific task now required.
D:Global admin rights exceed simple read access needs. The proposed action (Grant global metastore administration to fix one table query at Media postproduction team) does not meet the requirement that users must read only the authorized governed object, nor does it constitute the controlled implementation step.
Question 706
At Municipal waste service, the collection telemetry workflow depends on collection_telemetry_coastal. Engineers report that collection_telemetry_coastal job fails before any Spark task begins; the evidence is that cluster event log shows an unavailable instance type in the selected region. They require that the diagnostic must distinguish compute provisioning failure from ETL code defects. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Inspect cluster event log, quotas, network and cloud capacity for collection_telemetry_coastal
- Start a fresh cluster then execute one representative task successfully
- Rewrite successful SQL transformations without investigating provisioning at Municipal waste service
- Test alternate eligible compute provisioning and controlled job retry
Explanation
Correct Answer
B:Start a fresh cluster then execute one representative task successfully directly tests the behavior that should change following the correction. With the observed evidence (cluster event log shows an unavailable instance type in the selected region), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the diagnostic must distinguish compute provisioning failure from ETL code defects.
Incorrect Answers
A:Inspect cluster event log, quotas, network and cloud capacity for collection_telemetry_coastal could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The collection_telemetry_coastal workflow still requires that the diagnostic must distinguish compute provisioning failure from ETL code defects.
C:Query changes cannot fix unavailable compute capacity. The proposed action (Rewrite successful SQL transformations without investigating provisioning at Municipal waste service) does not meet the requirement that the diagnostic must distinguish compute provisioning failure from ETL code defects, nor does it constitute the post-change acceptance test.
D:Test alternate eligible compute provisioning and controlled job retry may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that cluster event log shows an unavailable instance type in the selected region. Here, the relevant situation is: the collection telemetry workflow depends on collection_telemetry_coastal. Engineers report that….
Question 707
At Public transport authority, the fare validation events workflow depends on fare_validation_events_rural. Engineers report that the fare_validation_events_rural SQL source is polled hourly but every run extracts its entire ten-year table; the evidence is that source query logs show full scans despite an indexed updated_at column. They require that new and changed rows must load with a replay-safe high-water mark. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Advance the stored watermark before persisting the extracted batch at Public transport authority
- Run an initial backfill, then advance a tested watermark only after successful commit
- Verify update timestamp semantics, primary keys and late-arrival window for fare_validation_events_rural
- Use bounded incremental JDBC reads with a persisted watermark and merge keys
Explanation
Correct Answer
C:Verify update timestamp semantics, primary keys and late-arrival window for fare_validation_events_rural directly investigates the evidence (source query logs show full scans despite an indexed updated_at column) and distinguishes possible causes of the fare_validation_events_rural SQL source is polled hourly but every run extracts its entire ten-year table. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: new and changed rows must load with a replay-safe high-water mark.
Incorrect Answers
A:Premature watermark advancement can lose rows on failure. The proposed action (Advance the stored watermark before persisting the extracted batch at Public transport authority) does not meet the requirement that new and changed rows must load with a replay-safe high-water mark, nor does it constitute the required pre-change investigation.
B:Run an initial backfill, then advance a tested watermark only after successful commit may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that source query logs show full scans despite an indexed updated_at column. Here, the relevant situation is: the fare validation events workflow depends on fare_validation_events_rural. Engineers report that the….
D:Use bounded incremental JDBC reads with a persisted watermark and merge keys is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the fare_validation_events_rural scenario, the observed evidence is that source query logs show full scans despite an indexed updated_at column; the requirement remains: new and changed rows must load with a replay-safe high-water mark.
Question 708
The factory_defect_records_west pipeline at Manufacturing quality network has this failure: engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment. The team observed that the same schema and table names exist under development and production catalogs. Business requirement: code must resolve a single governed production object. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What should the engineer inspect to establish the failure mechanism?
- Depend on each user's default catalog to identify the production table at Manufacturing quality network
- Use catalog.schema.table identifiers with explicit Unity Catalog ownership
- Check current catalog, schema and resolved fully qualified table for factory_defect_records_west
- Change the pipeline to explicit three-level names and test in a staging job
Explanation
Correct Answer
C:Check current catalog, schema and resolved fully qualified table for factory_defect_records_west directly investigates the evidence (the same schema and table names exist under development and production catalogs) and distinguishes possible causes of engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: code must resolve a single governed production object.
Incorrect Answers
A:Implicit current-catalog resolution makes production writes ambiguous. The proposed action (Depend on each user's default catalog to identify the production table at Manufacturing quality network) does not meet the requirement that code must resolve a single governed production object, nor does it constitute the required pre-change investigation.
B:Use catalog.schema.table identifiers with explicit Unity Catalog ownership is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the factory_defect_records_west scenario, the observed evidence is that the same schema and table names exist under development and production catalogs; the requirement remains: code must resolve a single governed production object.
D:Change the pipeline to explicit three-level names and test in a staging job may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the same schema and table names exist under development and production catalogs. This matters here because the factory_defect_records_west pipeline at Manufacturing quality network has this failure: engineers refer to….
Question 709
Consider the student_registration_records_east workload at Education access provider: student_registration_records_east notebook hardcodes a development catalog and writes there during production runs. Inspection found that job run settings differ from values embedded in the notebook code. The governed outcome must ensure that the same notebook must respect runtime environment configuration. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Pass task parameters through supported notebook widgets or job parameters
- Edit the source notebook by hand every time the job changes environment at Education access provider
- Identify job parameter keys and where student_registration_records_east notebook resolves the catalog
- Remove hardcoded target paths and test parameterized notebook invocation
Explanation
Correct Answer
C:Identify job parameter keys and where student_registration_records_east notebook resolves the catalog directly investigates the evidence (job run settings differ from values embedded in the notebook code) and distinguishes possible causes of student_registration_records_east notebook hardcodes a development catalog and writes there during production runs. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the same notebook must respect runtime environment configuration.
Incorrect Answers
A:Pass task parameters through supported notebook widgets or job parameters is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the student_registration_records_east scenario, the observed evidence is that job run settings differ from values embedded in the notebook code; the requirement remains: the same notebook must respect runtime environment configuration.
B:Manual code edits are not reproducible parameterization. The proposed action (Edit the source notebook by hand every time the job changes environment at Education access provider) does not meet the requirement that the same notebook must respect runtime environment configuration, nor does it constitute the required pre-change investigation.
D:Remove hardcoded target paths and test parameterized notebook invocation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that job run settings differ from values embedded in the notebook code.
Question 710
At Regional sporting venue, the admission scan events workflow depends on admission_scan_events_delta. Engineers report that BI users query admission_scan_events_delta through engineering notebook compute with unpredictable startup and permissions; the evidence is that query history shows short read-only dashboards competing with development Spark sessions. They require that analysts need governed SQL concurrency and stable refresh latency. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Migrate one dashboard and verify warehouse permissions and query plans
- Classify admission_scan_events_delta query mix, concurrency and compute isolation requirements
- Run representative concurrent queries and compare latency and spend
- Grant BI users unrestricted notebook cluster administration at Regional sporting venue
Explanation
Correct Answer
C:Run representative concurrent queries and compare latency and spend directly tests the behavior that should change after the correction. With the observed evidence (query history shows short read-only dashboards competing with development Spark sessions), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that analysts need governed SQL concurrency and stable refresh latency.
Incorrect Answers
A:Migrate one dashboard and verify warehouse permissions and query plans may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that query history shows short read-only dashboards competing with development Spark sessions.
B:Classify admission_scan_events_delta query mix, concurrency and compute isolation requirements could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The admission_scan_events_delta workflow still requires that analysts need governed SQL concurrency and stable refresh latency.
D:Broad compute administration is not necessary to query governed bi data. The proposed action (Grant BI users unrestricted notebook cluster administration at Regional sporting venue) does not meet the requirement that analysts need governed SQL concurrency and stable refresh latency, nor does it constitute the post-change acceptance test.