Databricks Certified Data Engineer Associate Practice Test 8
Question 70
The rental_subsidy_payments_highland pipeline at Urban housing fund has this failure: the rental_subsidy_payments_highland telemetry producer emits events every few seconds but dashboards only need daily totals. The team observed that profiling shows expensive continuous compute for an overnight business report. Business requirement: ingestion frequency should reflect true freshness requirements and cost. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Force continuous high-cost processing solely because the source emits events frequently at Urban housing fund
- Verify next-morning output and source-to-target reconciliation
- Choose scheduled incremental batch when a daily SLA does not warrant continuous processing
- Switch one report to a scheduled ingest with measured completeness
Explanation
Correct Answer
D:Switch one report to a scheduled ingest with measured completeness provides a bounded way to introduce the approved solution into rental_subsidy_payments_highland and detect an early mismatch. The existing signal is profiling shows expensive continuous compute for an overnight business report; a staged change protects the service requirement (ingestion frequency should reflect true freshness requirements and cost) and makes rollback practical.
Incorrect Answers
A:Source frequency alone does not justify a continuous target pipeline. The proposed action (Force continuous high-cost processing solely because the source emits events frequently at Urban housing fund) does not meet the requirement that ingestion frequency should reflect true freshness requirements and cost, nor does it constitute the controlled implementation step.
B:Verify next-morning output and source-to-target reconciliation is a one-time acceptance check. It does not supply the controlled implementation step for rental_subsidy_payments_highland; a passing test cannot substitute for the specific task now required.
C:Choose scheduled incremental batch when a daily SLA does not warrant continuous processing is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the rental_subsidy_payments_highland scenario, the observed evidence is that profiling shows expensive continuous compute for an overnight business report; the requirement remains: ingestion frequency should reflect true freshness requirements and cost.
Question 71
At Satellite imagery startup, the land-cover observations workflow depends on land_cover_observations_highland. Engineers report that land_cover_observations_highland validation notebook computes the partition date but downstream tasks use yesterday by default; the evidence is that logs show successful validation for one date and export for another. They require that the exported partition must match the validated partition. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Hardcode yesterday in every downstream task at Satellite imagery startup
- Pass a validated task value to the dependent export task
- Add explicit task-value references and test with nondefault date
- Inspect taskValues producer, dependency and dynamic reference in land_cover_observations_highland
Explanation
Correct Answer
D:Inspect taskValues producer, dependency and dynamic reference in land_cover_observations_highland directly investigates the evidence (logs show successful validation for one date and export for another) and distinguishes possible causes of land_cover_observations_highland validation notebook computes the partition date but downstream tasks use yesterday by default. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the exported partition must match the validated partition.
Incorrect Answers
A:Hardcoded dates can diverge from validated data. The proposed action (Hardcode yesterday in every downstream task at Satellite imagery startup) does not meet the requirement that the exported partition must match the validated partition, nor does it constitute the required pre-change investigation.
B:Pass a validated task value to the dependent export task is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the land_cover_observations_highland scenario, the observed evidence is that logs show successful validation for one date and export for another; the requirement remains: the exported partition must match the validated partition.
C:Add explicit task-value references and test with nondefault date may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that logs show successful validation for one date and export for another.
Question 72
At Maritime safety agency, the table SELECT least privilege workflow handles vessel position events. The problem is that vessel_position_events_central contractor group needs read-only curated aggregates but can edit source tables. Evidence: privilege audit shows broad write grants inherited from a project role. Constraint: group must query approved output without data modification. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Grant ALL PRIVILEGES on the entire catalog to a read-only group at Maritime safety agency
- Run SELECT and attempted INSERT as contractor to confirm read-only behavior
- Identify group membership, inherited privileges and accessible tables for vessel_position_events_central
- Replace broad grants through a staged permission change with rollback
Explanation
Correct Answer
B:Run SELECT and attempted INSERT as contractor to confirm read-only behavior directly tests the behavior that should change after the correction. With the observed evidence (privilege audit shows broad write grants inherited from a project role), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that group must query approved output without data modification.
Incorrect Answers
A:All privileges violate read-only requirement. The proposed action (Grant ALL PRIVILEGES on the entire catalog to a read-only group at Maritime safety agency) does not meet the requirement that group must query approved output without data modification, nor does it constitute the post-change acceptance test.
C:Identify group membership, inherited privileges and accessible tables for vessel_position_events_central could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The vessel_position_events_central workflow still requires that group must query approved output without data modification.
D:Replace broad grants through a staged permission change with rollback may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that privilege audit shows broad write grants inherited from a project role.
Question 73
At Media postproduction team, the catalog schema use privileges workflow handles render-job telemetry. The problem is that render_job_telemetry_north analysts have SELECT on a table but get a permission error at query time. Evidence: access review shows missing USE CATALOG on its parent catalog. Constraint: users must read only the authorized governed object. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Monitor failed parent-path access and excessive grants for render_job_telemetry_north
- Grant global metastore administration to fix one table query at Media postproduction team
- Grant required parent USE CATALOG and USE SCHEMA along with table SELECT
- Query the table as an analyst and confirm sibling data remains denied
Explanation
Correct Answer
A:Monitor failed parent-path access and excessive grants for render_job_telemetry_north creates recurring visibility into the failure mode (render_job_telemetry_north analysts have SELECT on a table but get a permission error at query time). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while users must read only the authorized governed object.
Incorrect Answers
B:Global admin rights exceed simple read access needs. The proposed action (Grant global metastore administration to fix one table query at Media postproduction team) does not meet the requirement that users must read only the authorized governed object, nor does it constitute continuing operational detection.
C:Grant required parent USE CATALOG and USE SCHEMA along with table SELECT is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the render_job_telemetry_north scenario, the observed evidence is that access review shows missing USE CATALOG on its parent catalog; the requirement remains: users must read only the authorized governed object.
D:Query the table as an analyst and confirm sibling data remains denied is a one-time acceptance check. It does not supply continuing operational detection for render_job_telemetry_north; a passing test cannot substitute for the specific task now required.
Question 74
At Community energy cooperative, the smart meter readings workflow depends on smart_meter_readings_urban. Engineers report that a smart_meter_readings_urban enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler; the evidence is that API tokens expire and source field names change without ingestion alerts. They require that the source must arrive in governed Delta tables with manageable credential rotation. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Assess managed connector source support, permissions and refresh semantics for smart_meter_readings_urban
- Copy API secrets into a widely shared notebook and paste full responses manually at Community energy cooperative
- Update a source row and verify correct incremental destination behavior
- Configure source credentials and destination catalog for a pilot sync
Explanation
Correct Answer
C:Update a source row and verify correct incremental destination behavior directly tests the behavior that should change after the correction. With the observed evidence (API tokens expire and source field names change without ingestion alerts), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the source must arrive in governed Delta tables with manageable credential rotation.
Incorrect Answers
A:Assess managed connector source support, permissions and refresh semantics for smart_meter_readings_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The smart_meter_readings_urban workflow still requires that the source must arrive in governed Delta tables with manageable credential rotation.
B:Shared secrets and manual copies do not provide reliable governed ingestion. The proposed action (Copy API secrets into a widely shared notebook and paste full responses manually at Community energy cooperative) does not meet the requirement that the source must arrive in governed Delta tables with manageable credential rotation, nor does it constitute the post-change acceptance test.
D:Configure source credentials and destination catalog for a pilot sync may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that API tokens expire and source field names change without ingestion alerts.
Question 75
Consider the match_session_events_urban workload at Cloud gaming cooperative: the match_session_events_urban partner API returns 100 rows per page but the batch stores only the first page. Inspection found that response metadata includes a next cursor that the client ignores. The governed outcome must ensure that all authorized records must be imported without exceeding API limits. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Implement cursor pagination with bounded retries and idempotent destination keys
- Stop after one successful HTTP 200 response at Cloud gaming cooperative
- Inspect response cursor, throttle status and stable identity for match_session_events_urban
- Monitor page completeness, retries and expired cursors for match_session_events_urban
Explanation
Correct Answer
A:Implement cursor pagination with bounded retries and idempotent destination keys is the intended durable approach for match_session_events_urban: it addresses the verified problem (the match_session_events_urban partner API returns 100 rows per page but the batch stores only the first page) while preserving the required behavior (all authorized records must be imported without exceeding API limits). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:A successful first page does not establish completeness. The proposed action (Stop after one successful HTTP 200 response at Cloud gaming cooperative) does not meet the requirement that all authorized records must be imported without exceeding API limits, nor does it constitute the target approach.
C:Inspect response cursor, throttle status and stable identity for match_session_events_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The match_session_events_urban workflow still requires that all authorized records must be imported without exceeding API limits.
D:Monitor page completeness, retries and expired cursors for match_session_events_urban would help detect future recurrence, but metrics alone do not deliver the target approach. The match_session_events_urban requirement is that all authorized records must be imported without exceeding API limits.
Question 76
Consider the ticket_transactions_highland workload at Independent cinema group: ticket_transactions_highland Spark Declarative Pipeline is managed separately and not part of the daily job. Inspection found that analytics runs before the pipeline produces its updated streaming table. The governed outcome must ensure that job orchestration must wait for pipeline update completion. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Use a Lakeflow pipeline task with success dependency before analytics tasks
- Trigger a full job and verify pipeline completion precedes analytics
- Attach the governed pipeline to the job and pilot the execution graph
- Assume the pipeline auto-refreshes before every dashboard query at Independent cinema group
Explanation
Correct Answer
C:Attach the governed pipeline to the job and pilot the execution graph provides a bounded way to introduce the approved solution into ticket_transactions_highland and detect an early mismatch. The existing signal is analytics runs before the pipeline produces its updated streaming table; a staged change protects the service requirement (job orchestration must wait for pipeline update completion) and makes rollback practical.
Incorrect Answers
A:Use a Lakeflow pipeline task with success dependency before analytics tasks is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the ticket_transactions_highland scenario, the observed evidence is that analytics runs before the pipeline produces its updated streaming table; the requirement remains: job orchestration must wait for pipeline update completion.
B:Trigger a full job and verify pipeline completion precedes analytics is a one-time acceptance check. It does not supply the controlled implementation step for ticket_transactions_highland; a passing test cannot substitute for the specific task now required.
D:Uncontrolled refresh timing does not guarantee dependency order. The proposed action (Assume the pipeline auto-refreshes before every dashboard query at Independent cinema group) does not meet the requirement that job orchestration must wait for pipeline update completion, nor does it constitute the controlled implementation step.
Question 77
At Public water district, the pipeline flow metrics workflow depends on pipeline_flow_metrics_north. Engineers report that the pipeline_flow_metrics_north relational source emits inserts and updates but the lakehouse target retains multiple current versions; the evidence is that change records carry primary keys and update sequence numbers. They require that the destination must represent the latest source state without losing required history. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Introduce change capture on a small table and reconcile the initial snapshot
- Inspect key uniqueness, update order and delete semantics in pipeline_flow_metrics_north
- Append every change as a new current row without keys at Public water district
- Use supported CDC apply logic with keys, ordering and defined delete handling
Explanation
Correct Answer
B:Inspect key uniqueness, update order and delete semantics in pipeline_flow_metrics_north directly investigates the evidence (change records carry primary keys and update sequence numbers) and distinguishes possible causes of the pipeline_flow_metrics_north relational source emits inserts and updates but the lakehouse target retains multiple current versions. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: the destination must represent the latest source state without losing required history.
Incorrect Answers
A:Introduce change capture on a small table and reconcile the initial snapshot may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that change records carry primary keys and update sequence numbers.
C:An append-only current-state table does not resolve updates or deletes. The proposed action (Append every change as a new current row without keys at Public water district) does not meet the requirement that the destination must represent the latest source state without losing required history, nor does it constitute the required pre-change investigation.
D:Use supported CDC apply logic with keys, ordering and defined delete handling is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the pipeline_flow_metrics_north scenario, the observed evidence is that change records carry primary keys and update sequence numbers; the requirement remains: the destination must represent the latest source state without losing required history.
Question 78
The border_inspection_results_island pipeline at Port customs authority has this failure: nested arrays in border_inspection_results_island events are written as uninterpreted strings. The team observed that sample JSON contains an array of line items under each order. Business requirement: analytics requires one record per line item while retaining the parent ID. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Split raw JSON text on commas to infer nested objects at Port customs authority
- Land a raw bronze copy then curate line items into a governed silver table
- Parse nested JSON to typed structures and explode line arrays while preserving parent keys
- Verify expected row multiplication and preserved parent/child relationships
Explanation
Correct Answer
B:Land a raw bronze copy then curate line items into a governed silver table provides a bounded way to introduce the approved solution into border_inspection_results_island and detect an early mismatch. The existing signal is sample JSON contains an array of line items under each order; a staged change protects the service requirement (analytics requires one record per line item while retaining the parent ID) and makes rollback practical.
Incorrect Answers
A:String splitting is not valid nested json parsing. The proposed action (Split raw JSON text on commas to infer nested objects at Port customs authority) does not meet the requirement that analytics requires one record per line item while retaining the parent ID, nor does it constitute the controlled implementation step.
C:Parse nested JSON to typed structures and explode line arrays while preserving parent keys is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the border_inspection_results_island scenario, the observed evidence is that sample JSON contains an array of line items under each order; the requirement remains: analytics requires one record per line item while retaining the parent ID.
D:Verify expected row multiplication and preserved parent/child relationships is a one-time acceptance check. It does not supply the controlled implementation step for border_inspection_results_island; a passing test cannot substitute for the specific task now required.
Question 79
The treatment_billing_events_delta pipeline at Veterinary clinic association has this failure: a treatment_billing_events_delta enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler. The team observed that API tokens expire and source field names change without ingestion alerts. Business requirement: the source must arrive in governed Delta tables with manageable credential rotation. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Update a source row and verify correct incremental destination behavior
- Monitor connector lag, source authentication errors and schema drift for treatment_billing_events_delta
- Copy API secrets into a widely shared notebook and paste full responses manually at Veterinary clinic association
- Prefer a supported Lakeflow Connect managed connector with managed ingestion state
Explanation
Correct Answer
B:Monitor connector lag, source authentication errors and schema drift for treatment_billing_events_delta creates recurring visibility into the failure mode (a treatment_billing_events_delta enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the source must arrive in governed Delta tables with manageable credential rotation.
Incorrect Answers
A:Update a source row and verify correct incremental destination behavior is a one-time acceptance check. It does not supply continuing operational detection for treatment_billing_events_delta; a passing test cannot substitute for the specific task now required.
C:Shared secrets and manual copies do not provide reliable governed ingestion. The proposed action (Copy API secrets into a widely shared notebook and paste full responses manually at Veterinary clinic association) does not meet the requirement that the source must arrive in governed Delta tables with manageable credential rotation, nor does it constitute continuing operational detection.
D:Prefer a supported Lakeflow Connect managed connector with managed ingestion state is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the treatment_billing_events_delta scenario, the observed evidence is that API tokens expire and source field names change without ingestion alerts; the requirement remains: the source must arrive in governed Delta tables with manageable credential rotation.
Question 80
The farm_loan_transaction_history_coastal pipeline at Agricultural credit union has this failure: farm_loan_transaction_history_coastal job runs hourly although only one file arrives most days. The team observed that execution history shows repeated empty runs with compute startup cost. Business requirement: process each new delivered file promptly without idle polling. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Inspect file arrival pattern, supported trigger source and job startup overhead for farm_loan_transaction_history_coastal
- Run a full pipeline every minute even if no files arrive at Agricultural credit union
- Enable trigger in staging and test a new object arrival
- Upload a test file and confirm exactly the expected run fires
Explanation
Correct Answer
D:Upload a test file and confirm exactly the expected run fires directly tests the behavior that should change after the correction. With the observed evidence (execution history shows repeated empty runs with compute startup cost), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that process each new delivered file promptly without idle polling.
Incorrect Answers
A:Inspect file arrival pattern, supported trigger source and job startup overhead for farm_loan_transaction_history_coastal could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The farm_loan_transaction_history_coastal workflow still requires that process each new delivered file promptly without idle polling.
B:Repetitive empty executions waste compute and cost. The proposed action (Run a full pipeline every minute even if no files arrive at Agricultural credit union) does not meet the requirement that process each new delivered file promptly without idle polling, nor does it constitute the post-change acceptance test.
C:Enable trigger in staging and test a new object arrival may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that execution history shows repeated empty runs with compute startup cost.