Databricks Certified Data Engineer Associate Practice Test 70
Question 690
The consent_related_data_changes_urban pipeline at Research clinical trial group has this failure: consent_related_data_changes_urban rows have statuses requiring a three-way risk category. The team observed that a simple boolean expression sends null status to a high-risk category. Business requirement: business rules distinguish active, cancelled and unknown statuses. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Treat null as an active subscription without evidence at Research clinical trial group
- Use when/otherwise with explicit conditions and an unknown default
- Monitor unmapped statuses and rule-version changes for consent_related_data_changes_urban
- Test all named states plus null and an unrecognized state
Explanation
Correct Answer
C:Monitor unmapped statuses and rule-version changes for consent_related_data_changes_urban creates recurring visibility into the failure mode (consent_related_data_changes_urban rows have statuses requiring a three-way risk category). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while business rules distinguish active, cancelled and unknown statuses.
Incorrect Answers
A:Missing status cannot be assumed to mean active. The proposed action (Treat null as an active subscription without evidence at Research clinical trial group) does not meet the requirement that business rules distinguish active, cancelled and unknown statuses, nor does it constitute continuing operational detection.
B:Use when/otherwise with explicit conditions and an unknown default is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the consent_related_data_changes_urban scenario, the observed evidence is that a simple boolean expression sends null status to a high-risk category; the requirement remains: business rules distinguish active, cancelled and unknown statuses.
D:Test all named states plus null and an unrecognized state is a one-time acceptance check. It does not supply continuing operational detection for consent_related_data_changes_urban; a passing test cannot substitute for the specific task now required.
Question 691
Consider the pollution_measurements_north workload at Air quality nonprofit: the pollution_measurements_north SQL aggregation runs slowly on eligible compute despite a stable dataset. Inspection found that query profiling identifies CPU-bound SQL operations with little external I/O. The governed outcome must ensure that performance changes must be measured at equivalent compute and data volume. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Assume Photon eliminates every network, skew and access-permission problem at Air quality nonprofit
- Benchmark the same pollution_measurements_north query and dataset on both configurations
- Baseline SQL plan, engine configuration and resource use for pollution_measurements_north
- Enable the appropriate engine on a pilot compute configuration and compare plans
Explanation
Correct Answer
B:Benchmark the same pollution_measurements_north query and dataset on both configurations directly tests the behavior that should change after the correction. With the observed evidence (query profiling identifies CPU-bound SQL operations with little external I/O), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that performance changes must be measured at equivalent compute and data volume.
Incorrect Answers
A:An execution engine cannot cure unrelated input or authorization constraints. The proposed action (Assume Photon eliminates every network, skew and access-permission problem at Air quality nonprofit) does not meet the requirement that performance changes must be measured at equivalent compute and data volume, nor does it constitute the post-change acceptance test.
C:Baseline SQL plan, engine configuration and resource use for pollution_measurements_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The pollution_measurements_north workflow still requires that performance changes must be measured at equivalent compute and data volume.
D:Enable the appropriate engine on a pilot compute configuration and compare plans may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that query profiling identifies CPU-bound SQL operations with little external I/O. This matters here because consider the pollution_measurements_north workload at Air quality nonprofit: the pollution_measurements_north SQL….
Question 692
Consider the border_inspection_results_island workload at Port customs authority: nested arrays in border_inspection_results_island events are written as uninterpreted strings. Inspection found that sample JSON contains an array of line items under each order. The governed outcome must ensure that analytics requires one record per line item while retaining the parent ID. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Split raw JSON text on commas to infer nested objects at Port customs authority
- Parse nested JSON to typed structures and explode line arrays while preserving parent keys
- Verify expected row multiplication and preserved parent/child relationships
- Monitor newly nested fields, null child keys and malformed JSON for border_inspection_results_island
Explanation
Correct Answer
D:Monitor newly nested fields, null child keys and malformed JSON for border_inspection_results_island creates recurring visibility into the failure mode (nested arrays in border_inspection_results_island events are written as uninterpreted strings). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while analytics requires one record per line item while retaining the parent ID.
Incorrect Answers
A:String splitting is not valid nested json parsing. The proposed action (Split raw JSON text on commas to infer nested objects at Port customs authority) does not meet the requirement that analytics requires one record per line item while retaining the parent ID, nor does it constitute continuing operational detection.
B:Parse nested JSON to typed structures and explode line arrays while preserving parent keys is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the border_inspection_results_island scenario, the observed evidence is that sample JSON contains an array of line items under each order; the requirement remains: analytics requires one record per line item while retaining the parent ID.
C:Verify expected row multiplication and preserved parent/child relationships is a one-time acceptance check. It does not supply continuing operational detection for border_inspection_results_island; a passing test cannot substitute for the specific task now required.
Question 693
Consider the pipeline_flow_metrics_delta workload at Public water district: pipeline_flow_metrics_delta bronze records include null business IDs that break downstream joins. Inspection found that profiling identifies a small fraction of missing identifiers plus valid optional fields. The governed outcome must ensure that silver must reject missing required keys but preserve optional null attributes. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Track rejected-row percentage and null-key source patterns in pipeline_flow_metrics_delta
- Profile required versus nullable fields and sample failed pipeline_flow_metrics_delta records
- Call fillna on every field with zero regardless of semantic type at Public water district
- Filter or quarantine null required IDs while applying explicit nullable rules to optional columns
Explanation
Correct Answer
D:Filter or quarantine null required IDs while applying explicit nullable rules to optional columns is the intended durable approach for pipeline_flow_metrics_delta: it addresses the verified problem (pipeline_flow_metrics_delta bronze records include null business IDs that break downstream joins) while preserving the required behavior (silver must reject missing required keys but preserve optional null attributes). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Track rejected-row percentage and null-key source patterns in pipeline_flow_metrics_delta would help detect future recurrence, but metrics alone do not deliver the target approach. The pipeline_flow_metrics_delta requirement is that silver must reject missing required keys but preserve optional null attributes.
B:Profile required versus nullable fields and sample failed pipeline_flow_metrics_delta records could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The pipeline_flow_metrics_delta workflow still requires that silver must reject missing required keys but preserve optional null attributes.
C:Blanket replacement changes data meaning and can corrupt types. The proposed action (Call fillna on every field with zero regardless of semantic type at Public water district) does not meet the requirement that silver must reject missing required keys but preserve optional null attributes, nor does it constitute the target approach.
Question 694
The admission_scan_events_west pipeline at Regional sporting venue has this failure: admission_scan_events_west automation configuration contains an API password committed to Git. The team observed that repository scan detects a plaintext production secret in bundle variables. Business requirement: configuration must remain reproducible without exposing secrets. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Scan the repo and deploy in staging to verify secrets are not printed
- Hide the password by renaming its variable key at Regional sporting venue
- Revoke exposed credentials and replace config with secure references
- Identify secret locations, references and exposed Git history for admission_scan_events_west
Explanation
Correct Answer
A:Scan the repo and deploy in staging to verify secrets are not printed directly tests the behavior that should change following the correction. With the observed evidence (repository scan detects a plaintext production secret in bundle variables), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that configuration must remain reproducible without exposing secrets.
Incorrect Answers
B:Renaming a plaintext secret does not protect it. The proposed action (Hide the password by renaming its variable key at Regional sporting venue) does not meet the requirement that configuration must remain reproducible without exposing secrets, nor does it constitute the post-change acceptance test.
C:Revoke exposed credentials and replace config with secure references may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that repository scan detects a plaintext production secret in bundle variables. This matters here because the admission_scan_events_west pipeline at Regional sporting venue has this failure: admission_scan_events_west….
D:Identify secret locations, references and exposed Git history for admission_scan_events_west could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The admission_scan_events_west workflow still requires that configuration must remain reproducible without exposing secrets.
Question 695
A data engineer at Regional sporting venue is responsible for admission scan events. The SQL warehouse suitability issue is that BI users query admission_scan_events_delta through engineering notebook compute with unpredictable startup and permissions. The supporting evidence is that query history shows short read-only dashboards competing with development Spark sessions. The engineer must ensure that analysts need governed SQL concurrency and stable refresh latency. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Serve the BI workload on an appropriately sized SQL warehouse with Unity Catalog access
- Classify admission_scan_events_delta query mix, concurrency and compute isolation requirements
- Grant BI users unrestricted notebook cluster administration at Regional sporting venue
- Monitor warehouse queuing, idle use and dashboard refresh failures for admission_scan_events_delta
Explanation
Correct Answer
A:Serve the BI workload on an appropriately sized SQL warehouse with Unity Catalog access is the intended durable approach for admission_scan_events_delta: it addresses the verified problem (BI users query admission_scan_events_delta through engineering notebook compute with unpredictable startup and permissions) while preserving the required behavior (analysts need governed SQL concurrency and stable refresh latency). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Classify admission_scan_events_delta query mix, concurrency and compute isolation requirements could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The admission_scan_events_delta workflow still requires that analysts need governed SQL concurrency and stable refresh latency.
C:Broad compute administration is not necessary to query governed bi data. The proposed action (Grant BI users unrestricted notebook cluster administration at Regional sporting venue) does not meet the requirement that analysts need governed SQL concurrency and stable refresh latency, nor does it constitute the target approach.
D:Monitor warehouse queuing, idle use and dashboard refresh failures for admission_scan_events_delta would help detect future recurrence, but metrics alone do not deliver the target approach. The admission_scan_events_delta requirement is that analysts need governed SQL concurrency and stable refresh latency.
Question 696
At Local government portal, the citizen service applications workflow depends on citizen_service_applications_central. Engineers report that citizen_service_applications_central analysts need occasional queries of an external warehouse without full bulk ingestion; the evidence is that source data is large but analytics needs a small live subset. They require that governance should provide on-demand read access without an unnecessary copy. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Query the external source through UC and compare returned authorized rows
- Copy the entire external database daily regardless of query demand at Local government portal
- Assess external connector support, latency and predicate pushdown for citizen_service_applications_central
- Configure a scoped connection and grant access to a test foreign table
Explanation
Correct Answer
A:Query the external source through UC and compare returned authorized rows directly tests the behavior that should change following the correction. With the observed evidence (source data is large but analytics needs a small live subset), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that governance should provide on-demand read access without an unnecessary copy.
Incorrect Answers
B:Full-copy ingestion is not required for selective federated querying. The proposed action (Copy the entire external database daily regardless of query demand at Local government portal) does not meet the requirement that governance should provide on-demand read access without an unnecessary copy, nor does it constitute the post-change acceptance test.
C:Assess external connector support, latency and predicate pushdown for citizen_service_applications_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The citizen_service_applications_central workflow still requires that governance should provide on-demand read access without an unnecessary copy.
D:Configure a scoped connection and grant access to a test foreign table may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that source data is large but analytics needs a small live subset. Here, the relevant situation is: the citizen service applications workflow depends on citizen_service_applications_central. Engineers report that….
Question 697
The render_job_telemetry_west pipeline at Media postproduction team has this failure: developers edit render_job_telemetry_west production notebooks directly and bypass code review. The team observed that workspace Git history shows changes without a pull request. Business requirement: releases need traceable approval and a recoverable commit. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Inspect working branch, remote commit and protected-base rules for render_job_telemetry_west
- Monitor direct main-branch pushes and unreviewed notebook changes for render_job_telemetry_west
- Copy arbitrary notebook cells into production without a commit at Media postproduction team
- Develop in a feature branch with a reviewed pull request before merging
Explanation
Correct Answer
D:Develop in a feature branch with a reviewed pull request before merging is the intended durable approach for render_job_telemetry_west: it addresses the verified problem (developers edit render_job_telemetry_west production notebooks directly and bypass code review) while preserving the required behavior (releases need traceable approval and a recoverable commit). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Inspect working branch, remote commit and protected-base rules for render_job_telemetry_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The render_job_telemetry_west workflow still requires that releases need traceable approval and a recoverable commit.
B:Monitor direct main-branch pushes and unreviewed notebook changes for render_job_telemetry_west would help detect future recurrence, but metrics alone do not deliver the target approach. The render_job_telemetry_west requirement is that releases need traceable approval and a recoverable commit.
C:Untracked copies cannot reliably reproduce the approved source. The proposed action (Copy arbitrary notebook cells into production without a commit at Media postproduction team) does not meet the requirement that releases need traceable approval and a recoverable commit, nor does it constitute the target approach.
Question 698
At Agricultural credit union, the farm-loan transaction history workflow depends on farm_loan_transaction_history_coastal. Engineers report that farm_loan_transaction_history_coastal job runs hourly although only one file arrives most days; the evidence is that execution history shows repeated empty runs with compute startup cost. They require that process each new delivered file promptly without idle polling. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Run a full pipeline every minute even if no files arrive at Agricultural credit union
- Use a supported file-arrival trigger for the eligible storage location
- Inspect file arrival pattern, supported trigger source and job startup overhead for farm_loan_transaction_history_coastal
- Monitor missed arrival events and repeated empty executions for farm_loan_transaction_history_coastal
Explanation
Correct Answer
B:Use a supported file-arrival trigger for the eligible storage location is the intended durable approach for farm_loan_transaction_history_coastal: it addresses the verified problem (farm_loan_transaction_history_coastal job runs hourly although only one file arrives most days) while preserving the required behavior (process each new delivered file promptly without idle polling). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Repetitive empty executions waste compute and cost. The proposed action (Run a full pipeline every minute even if no files arrive at Agricultural credit union) does not meet the requirement that process each new delivered file promptly without idle polling, nor does it constitute the target approach.
C:Inspect file arrival pattern, supported trigger source and job startup overhead for farm_loan_transaction_history_coastal could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The farm_loan_transaction_history_coastal workflow still requires that process each new delivered file promptly without idle polling.
D:Monitor missed arrival events and repeated empty executions for farm_loan_transaction_history_coastal would help detect future recurrence, but metrics alone do not deliver the target approach. The farm_loan_transaction_history_coastal requirement is that process each new delivered file promptly without idle polling.
Question 699
Consider the property_reservation_updates_island workload at Multi-region rental platform: property_reservation_updates_island notebook occasionally fails on transient service throttling. Inspection found that task failure records show HTTP 429 followed by a successful manual retry. The governed outcome must ensure that safe retries must not create duplicate output or run indefinitely. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform
- Inspect transient error types, output idempotency and historical retry behavior for property_reservation_updates_island
- Configure bounded Lakeflow task retries with backoff where appropriate
- Enable retries on a noncritical task and use replay-safe output writes
Explanation
Correct Answer
B:Inspect transient error types, output idempotency and historical retry behavior for property_reservation_updates_island directly investigates the evidence (task failure records show HTTP 429 followed by a successful manual retry) and distinguishes possible causes of property_reservation_updates_island notebook occasionally fails on transient service throttling. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: safe retries must not create duplicate output or run indefinitely.
Incorrect Answers
A:Unbounded retries can overload services and conceal deterministic defects. The proposed action (Set infinite immediate retries for every failure including invalid SQL at Multi-region rental platform) does not meet the requirement that safe retries must not create duplicate output or run indefinitely, nor does it constitute the required pre-change investigation.
C:Configure bounded Lakeflow task retries with backoff where appropriate is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the property_reservation_updates_island scenario, the observed evidence is that task failure records show HTTP 429 followed by a successful manual retry; the requirement remains: safe retries must not create duplicate output or run indefinitely.
D:Enable retries on a noncritical task and use replay-safe output writes may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that task failure records show HTTP 429 followed by a successful manual retry. This matters here because consider the property_reservation_updates_island workload at Multi-region rental platform:….
Question 700
A data engineer at Aquaculture farming group is responsible for water-quality readings. The shuffle partition oversplitting issue is that water_quality_readings_highland job has hundreds of thousands of very small tasks on a modest daily dataset. The supporting evidence is that Spark UI shows scheduling overhead dominates work time. The engineer must ensure that the adjustment must keep exact output and avoid poor parallelism. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Test bounded shuffle partition adjustment in staging and capture the plan
- Measure input sizes, task overhead and shuffle partition count for water_quality_readings_highland
- Reduce excessive partitions or enable adaptive coalescing as appropriate
- Set shuffle partitions to an arbitrary enormous value for all workloads at Aquaculture farming group
Explanation
Correct Answer
B:Measure input sizes, task overhead and shuffle partition count for water_quality_readings_highland directly investigates the evidence (Spark UI shows scheduling overhead dominates work time) and distinguishes possible causes of water_quality_readings_highland job has hundreds of thousands of very small tasks on a modest daily dataset. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the adjustment must keep exact output and avoid poor parallelism.
Incorrect Answers
A:Test bounded shuffle partition adjustment in staging and capture the plan may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that Spark UI shows scheduling overhead dominates work time. This matters here because a data engineer at Aquaculture farming group is responsible for water-quality readings. The shuffle partition….
C:Reduce excessive partitions or enable adaptive coalescing as appropriate is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the water_quality_readings_highland scenario, the observed evidence is that Spark UI shows scheduling overhead dominates work time; the requirement remains: the adjustment must keep exact output and avoid poor parallelism.
D:More tasks can increase scheduling overhead rather than speed work. The proposed action (Set shuffle partitions to an arbitrary enormous value for all workloads at Aquaculture farming group) does not meet the requirement that the adjustment must keep exact output and avoid poor parallelism, nor does it constitute the required pre-change investigation.