Databricks Certified Data Engineer Associate Practice Test 73
Question 720
Consider the viewer_activity_data_coastal workload at Subscription video network: a viewer_activity_data_coastal source has a compatible connector but existing custom scripts have divergent retries. Inspection found that logs show different authentication and pagination paths across team-owned scripts. The governed outcome must ensure that ingestion must be standardized under governed destinations. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Compare loaded rows and source bookmarks before switching production
- Use the supported Lakeflow Connect standard connector with scoped source access
- Configure the connector and validate target schema and schedule in staging
- Let every notebook invent a new unscheduled direct source sync at Subscription video network
Explanation
Correct Answer
C:Configure the connector and validate target schema and schedule in staging provides a bounded way to introduce the approved solution into viewer_activity_data_coastal and detect an early mismatch. The existing signal is logs show different authentication and pagination paths across team-owned scripts; a staged change protects the service requirement (ingestion must be standardized under governed destinations) and makes rollback practical.
Incorrect Answers
A:Compare loaded rows and source bookmarks before switching production is a one-time acceptance check. It does not supply the controlled implementation step for viewer_activity_data_coastal; a passing test cannot substitute for the specific task now required.
B:Use the supported Lakeflow Connect standard connector with scoped source access is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the viewer_activity_data_coastal scenario, the observed evidence is that logs show different authentication and pagination paths across team-owned scripts; the requirement remains: ingestion must be standardized under governed destinations.
D:Uncoordinated custom pulls are less governed and harder to recover. The proposed action (Let every notebook invent a new unscheduled direct source sync at Subscription video network) does not meet the requirement that ingestion must be standardized under governed destinations, nor does it constitute the controlled implementation step.
Question 721
A data engineer at Regional hospital network is responsible for clinical appointment reports. The backfill recovery issue is that clinical_appointment_reports_island failed halfway through a historical backfill, and a rerun doubles completed partitions. The supporting evidence is that run log records successfully committed early dates before failure. The engineer must ensure that recovery must replay only incomplete work or be provably idempotent. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Append the entire historical dataset on every restart at Regional hospital network
- Use partition-aware idempotent writes and recoverable backfill parameters
- Monitor retry replay volumes and partition reconciliation for clinical_appointment_reports_island
- Restart from the failure boundary and verify no partition is doubled
Explanation
Correct Answer
C:Monitor retry replay volumes and partition reconciliation for clinical_appointment_reports_island creates recurring visibility into the failure mode (clinical_appointment_reports_island failed halfway through a historical backfill, and a rerun doubles completed partitions). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while recovery must replay only incomplete work or be provably idempotent.
Incorrect Answers
A:Unconditional append duplicates earlier successful partitions. The proposed action (Append the entire historical dataset on every restart at Regional hospital network) does not meet the requirement that recovery must replay only incomplete work or be provably idempotent, nor does it constitute continuing operational detection.
B:Use partition-aware idempotent writes and recoverable backfill parameters is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the clinical_appointment_reports_island scenario, the observed evidence is that run log records successfully committed early dates before failure; the requirement remains: recovery must replay only incomplete work or be provably idempotent.
D:Restart from the failure boundary and verify no partition is doubled is a one-time acceptance check. It does not supply continuing operational detection for clinical_appointment_reports_island; a passing test cannot substitute for the specific task now required.
Question 722
Consider the sampling_field_notes_urban workload at Environmental inspection office: an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline. Inspection found that billing shows idle all-purpose compute for a deterministic scheduled transformation. The governed outcome must ensure that the pipeline needs reproducible cost-controlled scheduled runs. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Watch idle compute costs and missed sampling_field_notes_urban job triggers
- Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster
- Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office
- Compare time of execution, compute utilization and job latency for sampling_field_notes_urban
Explanation
Correct Answer
B:Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster is the intended durable approach for sampling_field_notes_urban: it addresses the verified problem (an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline) while preserving the required behavior (the pipeline needs reproducible cost-controlled scheduled runs). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Watch idle compute costs and missed sampling_field_notes_urban job triggers would help detect future recurrence, but metrics alone do not deliver the target approach. The sampling_field_notes_urban requirement is that the pipeline needs reproducible cost-controlled scheduled runs.
C:Larger always-on interactive compute increases waste without fixing scheduling. The proposed action (Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office) does not meet the requirement that the pipeline needs reproducible cost-controlled scheduled runs, nor does it constitute the target approach.
D:Compare time of execution, compute utilization and job latency for sampling_field_notes_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The sampling_field_notes_urban workflow still requires that the pipeline needs reproducible cost-controlled scheduled runs.
Question 723
At Coastal freight alliance, the shipment manifests workflow depends on shipment_manifests_north. Engineers report that shipment_manifests_north analysts need occasional queries of an external warehouse without full bulk ingestion; the evidence is that source data is large but analytics needs a small live subset. They require that governance should provide on-demand read access without an unnecessary copy. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Copy the entire external database daily regardless of query demand at Coastal freight alliance
- Use Lakehouse Federation connection and foreign catalog for suitable source queries
- Monitor federated query latency and external connection failures for shipment_manifests_north
- Assess external connector support, latency and predicate pushdown for shipment_manifests_north
Explanation
Correct Answer
B:Use Lakehouse Federation connection and foreign catalog for suitable source queries is the intended durable approach for shipment_manifests_north: it addresses the verified problem (shipment_manifests_north analysts need occasional queries of an external warehouse without full bulk ingestion) while preserving the required behavior (governance should provide on-demand read access without an unnecessary copy). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Full-copy ingestion is not required for selective federated querying. The proposed action (Copy the entire external database daily regardless of query demand at Coastal freight alliance) does not meet the requirement that governance should provide on-demand read access without an unnecessary copy, nor does it constitute the target approach.
C:Monitor federated query latency and external connection failures for shipment_manifests_north would help detect future recurrence, but metrics alone do not deliver the target approach. The shipment_manifests_north requirement is that governance should provide on-demand read access without an unnecessary copy.
D:Assess external connector support, latency and predicate pushdown for shipment_manifests_north could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The shipment_manifests_north workflow still requires that governance should provide on-demand read access without an unnecessary copy.
Question 724
Consider the trade_settlement_files_delta workload at Wholesale produce exchange: the trade_settlement_files_delta import creates a single malformed column because input format settings are wrong. Inspection found that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. The governed outcome must ensure that all source columns must map to the intended typed Delta fields. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which staged rollout best preserves the existing workload?
- Compare parsed field count, null patterns and source record counts
- Load comma-separated records with JSON parsing and suppress all errors at Wholesale produce exchange
- Choose COPY INTO with the correct CSV fileformat and source column mapping
- Test the file format on a small sample, then run the governed target load
Explanation
Correct Answer
D:Test the file format on a small sample, then run the governed target load provides a bounded way to introduce the approved solution into trade_settlement_files_delta and detect an early mismatch. The existing signal is source inspection shows UTF-8 CSV with an explicit header and quoted delimiters; a staged change protects the service requirement (all source columns must map to the intended typed Delta fields) and makes rollback practical.
Incorrect Answers
A:Compare parsed field count, null patterns and source record counts is a one-time acceptance check. It does not supply the controlled implementation step for trade_settlement_files_delta; a passing test cannot substitute for the specific task now required.
B:The parser would misread the source schema rather than fix its mapping. The proposed action (Load comma-separated records with JSON parsing and suppress all errors at Wholesale produce exchange) does not meet the requirement that all source columns must map to the intended typed Delta fields, nor does it constitute the controlled implementation step.
C:Choose COPY INTO with the correct CSV fileformat and source column mapping is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the trade_settlement_files_delta scenario, the observed evidence is that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters; the requirement remains: all source columns must map to the intended typed Delta fields.
Question 725
A data engineer at Wholesale produce exchange is responsible for trade settlement files. The row filter per region issue is that trade_settlement_files_delta table contains records from many regions but local analysts may view only their own rows. The supporting evidence is that a sample query under a local user returns another region's customers. The engineer must ensure that regional row restrictions must apply during queries. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Apply a row filter on the governed table or appropriate centrally governed policy
- Monitor policy exceptions and cross-region access attempts for trade_settlement_files_delta
- Query as each regional group and verify permitted rows only
- Hide the region column in the dashboard but return every row at Wholesale produce exchange
Explanation
Correct Answer
B:Monitor policy exceptions and cross-region access attempts for trade_settlement_files_delta creates recurring visibility into the failure mode (trade_settlement_files_delta table contains records from many regions but local analysts may view only their own rows). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while regional row restrictions must apply during queries.
Incorrect Answers
A:Apply a row filter on the governed table or appropriate centrally governed policy is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the trade_settlement_files_delta scenario, the observed evidence is that a sample query under a local user returns another region's customers; the requirement remains: regional row restrictions must apply during queries.
C:Query as each regional group and verify permitted rows only is a one-time acceptance check. It does not supply continuing operational detection for trade_settlement_files_delta; a passing test cannot substitute for the specific task now required.
D:Display changes do not enforce row-level security. The proposed action (Hide the region column in the dashboard but return every row at Wholesale produce exchange) does not meet the requirement that regional row restrictions must apply during queries, nor does it constitute continuing operational detection.
Question 726
At Environmental inspection office, the sampling field notes workflow depends on sampling_field_notes_metro. Engineers report that the sampling_field_notes_metro import creates a single malformed column because input format settings are wrong; the evidence is that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. They require that all source columns must map to the intended typed Delta fields. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Inspect sample files and COPY INTO format options for sampling_field_notes_metro
- Choose COPY INTO with the correct CSV fileformat and source column mapping
- Monitor malformed-file quarantine and schema errors in sampling_field_notes_metro
- Load comma-separated records with JSON parsing and suppress all errors at Environmental inspection office
Explanation
Correct Answer
B:Choose COPY INTO with the correct CSV fileformat and source column mapping is the intended durable approach for sampling_field_notes_metro: it addresses the verified problem (the sampling_field_notes_metro import creates a single malformed column because input format settings are wrong) while preserving the required behavior (all source columns must map to the intended typed Delta fields). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Inspect sample files and COPY INTO format options for sampling_field_notes_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The sampling_field_notes_metro workflow still requires that all source columns must map to the intended typed Delta fields.
C:Monitor malformed-file quarantine and schema errors in sampling_field_notes_metro would help detect future recurrence, but metrics alone do not deliver the target approach. The sampling_field_notes_metro requirement is that all source columns must map to the intended typed Delta fields.
D:The parser would misread the source schema rather than fix its mapping. The proposed action (Load comma-separated records with JSON parsing and suppress all errors at Environmental inspection office) does not meet the requirement that all source columns must map to the intended typed Delta fields, nor does it constitute the target approach.
Question 727
At Consumer finance platform, the loan repayment events workflow depends on loan_repayment_events_south. Engineers report that a nightly load of loan_repayment_events_south repeats files from yesterday and developers fear duplicate inserts; the evidence is that the same object-storage folder is scanned on each scheduled run. They require that only new source files should be appended without reprocessing prior paths. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Use incremental idempotent COPY INTO against the governed Delta target
- Inspect file-level load history and path visibility for loan_repayment_events_south
- Schedule COPY INTO for loan_repayment_events_south and test a retry after successful ingestion
- Run unconditional INSERT SELECT over the complete folder on every retry at Consumer finance platform
Explanation
Correct Answer
B:Inspect file-level load history and path visibility for loan_repayment_events_south directly investigates the evidence (the same object-storage folder is scanned on each scheduled run) and distinguishes possible causes of a nightly load of loan_repayment_events_south repeats files from yesterday and developers fear duplicate inserts. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: only new source files should be appended without reprocessing prior paths.
Incorrect Answers
A:Use incremental idempotent COPY INTO against the governed Delta target is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the loan_repayment_events_south scenario, the observed evidence is that the same object-storage folder is scanned on each scheduled run; the requirement remains: only new source files should be appended without reprocessing prior paths.
C:Schedule COPY INTO for loan_repayment_events_south and test a retry after successful ingestion may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the same object-storage folder is scanned on each scheduled run.
D:A blind append can duplicate previously processed records. The proposed action (Run unconditional INSERT SELECT over the complete folder on every retry at Consumer finance platform) does not meet the requirement that only new source files should be appended without reprocessing prior paths, nor does it constitute the required pre-change investigation.
Question 728
At Public water district, the pipeline flow metrics workflow depends on pipeline_flow_metrics_west. Engineers report that pipeline_flow_metrics_west ownership team cannot explain who changed a sensitive table grant; the evidence is that investigation lacks a query of account audit events around the change. They require that privilege changes require attributable evidence and retention. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Identify relevant audit event source, principal, timestamp and target object for pipeline_flow_metrics_west
- Configure audit log access and build an approved privilege-change report
- Use available UC audit logging and governed retention for administrative events
- Disable audit logs because granting privileges already requires admin at Public water district
Explanation
Correct Answer
A:Identify relevant audit event source, principal, timestamp and target object for pipeline_flow_metrics_west directly investigates the evidence (investigation lacks a query of account audit events around the change) and distinguishes possible causes of pipeline_flow_metrics_west ownership team cannot explain who changed a sensitive table grant. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: privilege changes require attributable evidence and retention.
Incorrect Answers
B:Configure audit log access and build an approved privilege-change report may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that investigation lacks a query of account audit events around the change. Here, the relevant situation is: the pipeline flow metrics workflow depends on pipeline_flow_metrics_west. Engineers report that….
C:Use available UC audit logging and governed retention for administrative events is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the pipeline_flow_metrics_west scenario, the observed evidence is that investigation lacks a query of account audit events around the change; the requirement remains: privilege changes require attributable evidence and retention.
D:Administrative permissions do not replace audit evidence. The proposed action (Disable audit logs because granting privileges already requires admin at Public water district) does not meet the requirement that privilege changes require attributable evidence and retention, nor does it constitute the required pre-change investigation.
Question 729
At Food delivery franchise, the dispatch and delivery status workflow depends on dispatch_and_delivery_status_coastal. Engineers report that dispatch_and_delivery_status_coastal overnight export fires one hour early after daylight-saving changes; the evidence is that run history shows schedule configured in a different timezone than business cutoff. They require that the export must complete relative to the local reporting calendar. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Assume all local timezones have the same UTC offset year-round at Food delivery franchise
- Verify triggers across DST transition dates against business calendar
- Configure Lakeflow scheduled trigger using an explicit timezone and cutoff
- Monitor schedule drift, missed triggers and export deadline slips for dispatch_and_delivery_status_coastal
Explanation
Correct Answer
D:Monitor schedule drift, missed triggers and export deadline slips for dispatch_and_delivery_status_coastal creates recurring visibility into the failure mode (dispatch_and_delivery_status_coastal overnight export fires one hour early after daylight-saving changes). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the export must complete relative to the local reporting calendar.
Incorrect Answers
A:Timezones with dst can shift relative to utc. The proposed action (Assume all local timezones have the same UTC offset year-round at Food delivery franchise) does not meet the requirement that the export must complete relative to the local reporting calendar, nor does it constitute continuing operational detection.
B:Verify triggers across DST transition dates against business calendar is a one-time acceptance check. It does not supply continuing operational detection for dispatch_and_delivery_status_coastal; a passing test cannot substitute for the specific task now required.
C:Configure Lakeflow scheduled trigger using an explicit timezone and cutoff is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the dispatch_and_delivery_status_coastal scenario, the observed evidence is that run history shows schedule configured in a different timezone than business cutoff; the requirement remains: the export must complete relative to the local reporting calendar.
Question 730
Consider the station_observation_files_rural workload at Public weather agency: station_observation_files_rural join hangs on one task while almost every task completes quickly. Inspection found that Spark UI reveals one partition contains most rows for a hot customer key. The governed outcome must ensure that optimization must preserve all correct joined rows. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Drop the most frequent business key to balance partitions at Public weather agency
- Profile key frequencies and straggler task metrics for station_observation_files_rural
- Verify exact join output and reduced straggler duration
- Test skew-aware join on representative hot and cold key samples
Explanation
Correct Answer
C:Verify exact join output and reduced straggler duration directly tests the behavior that should change following the correction. With the observed evidence (Spark UI reveals one partition contains most rows for a hot customer key), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that optimization must preserve all correct joined rows.
Incorrect Answers
A:Dropping a hot key loses legitimate data. The proposed action (Drop the most frequent business key to balance partitions at Public weather agency) does not meet the requirement that optimization must preserve all correct joined rows, nor does it constitute the post-change acceptance test.
B:Profile key frequencies and straggler task metrics for station_observation_files_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The station_observation_files_rural workflow still requires that optimization must preserve all correct joined rows.
D:Test skew-aware join on representative hot and cold key samples may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that Spark UI reveals one partition contains most rows for a hot customer key. This matters here because consider the station_observation_files_rural workload at Public weather agency: station_observation_files_rural join….