Databricks Certified Data Engineer Associate Practice Test 89
Question 880
At Research clinical trial group, the share cost and egress workflow handles consent-related data changes. The problem is that consent_related_data_changes_west dataset is shared between clouds and network charges surprise the data provider. Evidence: billing shows recipient reads create cross-cloud data transfer. Constraint: sharing must meet cost and policy expectations. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which test should pass before the new flow is accepted?
- Measure recipient location, data volumes and provider/recipient charge terms for consent_related_data_changes_west
- Assume cross-cloud data transfer is always free because sharing is read-only at Research clinical trial group
- Compare actual transfer bytes and charges against the forecast
- Pilot a small cross-cloud share and review billing before expansion
Explanation
Correct Answer
C:Compare actual transfer bytes and charges against the forecast directly tests the behavior that should change following the correction. With the observed evidence (billing shows recipient reads create cross-cloud data transfer), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that sharing must meet cost and policy expectations.
Incorrect Answers
A:Measure recipient location, data volumes and provider/recipient charge terms for consent_related_data_changes_west could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The consent_related_data_changes_west workflow still requires that sharing must meet cost and policy expectations.
B:Read-only sharing can still incur network charges. The proposed action (Assume cross-cloud data transfer is always free because sharing is read-only at Research clinical trial group) does not meet the requirement that sharing must meet cost and policy expectations, nor does it constitute the post-change acceptance test.
D:Pilot a small cross-cloud share and review billing before expansion may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that billing shows recipient reads create cross-cloud data transfer. Here, the relevant situation is: the share cost and egress workflow handles consent-related data changes. The problem is that….
Question 881
A data engineer at Agricultural credit union is responsible for farm-loan transaction history. The Auto Loader notification discovery issue is that the farm_loan_transaction_history_east landing zone has millions of objects and directory discovery is becoming expensive. The supporting evidence is that ingestion latency rises as source listing grows while only a few files arrive. The engineer must ensure that incremental detection must scale without repeatedly listing the whole prefix. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Compare arrival rates, discovery costs and event-notification prerequisites for farm_loan_transaction_history_east
- Recursively list the entire object-store prefix every second at Agricultural credit union
- Select supported managed file events or notification mode when appropriate
- Enable managed file-event discovery on a pilot source and retain checkpoint state
Explanation
Correct Answer
A:Compare arrival rates, discovery costs and event-notification prerequisites for farm_loan_transaction_history_east directly investigates the evidence (ingestion latency rises as source listing grows while only a few files arrive) and distinguishes possible causes of the farm_loan_transaction_history_east landing zone has millions of objects and directory discovery is becoming expensive. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: incremental detection must scale without repeatedly listing the whole prefix.
Incorrect Answers
B:Repeated full listings increase costs and discovery latency. The proposed action (Recursively list the entire object-store prefix every second at Agricultural credit union) does not meet the requirement that incremental detection must scale without repeatedly listing the whole prefix, nor does it constitute the required pre-change investigation.
C:Select supported managed file events or notification mode when appropriate is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the farm_loan_transaction_history_east scenario, the observed evidence is that ingestion latency rises as source listing grows while only a few files arrive; the requirement remains: incremental detection must scale without repeatedly listing the whole prefix.
D:Enable managed file-event discovery on a pilot source and retain checkpoint state may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that ingestion latency rises as source listing grows while only a few files arrive. This matters here because a data engineer at Agricultural credit union is responsible for farm-loan transaction history. The Auto Loader….
Question 882
A data engineer at Community energy cooperative is responsible for smart meter readings. The SQL warehouse suitability issue is that BI users query smart_meter_readings_metro through engineering notebook compute with unpredictable startup and permissions. The supporting evidence is that query history shows short read-only dashboards competing with development Spark sessions. The engineer must ensure that analysts need governed SQL concurrency and stable refresh latency. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Grant BI users unrestricted notebook cluster administration at Community energy cooperative
- Serve the BI workload on an appropriately sized SQL warehouse with Unity Catalog access
- Monitor warehouse queuing, idle use and dashboard refresh failures for smart_meter_readings_metro
- Run representative concurrent queries and compare latency and spend
Explanation
Correct Answer
C:Monitor warehouse queuing, idle use and dashboard refresh failures for smart_meter_readings_metro creates recurring visibility into the failure mode (BI users query smart_meter_readings_metro through engineering notebook compute with unpredictable startup and permissions). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while analysts need governed SQL concurrency and stable refresh latency.
Incorrect Answers
A:Broad compute administration is not necessary to query governed bi data. The proposed action (Grant BI users unrestricted notebook cluster administration at Community energy cooperative) does not meet the requirement that analysts need governed SQL concurrency and stable refresh latency, nor does it constitute continuing operational detection.
B:Serve the BI workload on an appropriately sized SQL warehouse with Unity Catalog access is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the smart_meter_readings_metro scenario, the observed evidence is that query history shows short read-only dashboards competing with development Spark sessions; the requirement remains: analysts need governed SQL concurrency and stable refresh latency.
D:Run representative concurrent queries and compare latency and spend is a one-time acceptance check. It does not supply continuing operational detection for smart_meter_readings_metro; a passing test cannot substitute for the specific task now required.
Question 883
Consider the appointment_requests_highland workload at Pet-care booking platform: appointment_requests_highland gold report launches before silver validation finishes. Inspection found that a task graph shows report and validation as parallel children of ingestion. The governed outcome must ensure that downstream publishing must not start until all required upstream checks succeed. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Declare an explicit dependency from gold publishing to successful validation tasks
- Schedule every task at the same clock time and hope upstream processing completes at Pet-care booking platform
- Read job DAG edges and task-run timestamps for appointment_requests_highland
- Monitor dependency skips, failures and unexpected concurrent starts for appointment_requests_highland
Explanation
Correct Answer
A:Declare an explicit dependency from gold publishing to successful validation tasks is the intended durable approach for appointment_requests_highland: it addresses the verified problem (appointment_requests_highland gold report launches before silver validation finishes) while preserving the required behavior (downstream publishing must not start until all required upstream checks succeed). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Clock coincidence does not enforce dependency correctness. The proposed action (Schedule every task at the same clock time and hope upstream processing completes at Pet-care booking platform) does not meet the requirement that downstream publishing must not start until all required upstream checks succeed, nor does it constitute the target approach.
C:Read job DAG edges and task-run timestamps for appointment_requests_highland could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The appointment_requests_highland workflow still requires that downstream publishing must not start until all required upstream checks succeed.
D:Monitor dependency skips, failures and unexpected concurrent starts for appointment_requests_highland would help detect future recurrence, but metrics alone do not deliver the target approach. The appointment_requests_highland requirement is that downstream publishing must not start until all required upstream checks succeed.
Question 884
Consider the vessel_position_events_delta workload at Maritime safety agency: vessel_position_events_delta tracks successive device configurations and needs the most recent per device. Inspection found that the raw table contains equal device_id rows with varying event timestamps. The governed outcome must ensure that exactly one latest row per device must be selected using deterministic tie-breaks. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. How should the team verify the original fault has been addressed?
- Publish the window transform with stable ordering and preserved raw input
- Insert tied timestamps and verify deterministic version selection
- Inspect per-device timestamps and tie possibilities for vessel_position_events_delta
- Call dropDuplicates(device_id) without an explicit ordering rule at Maritime safety agency
Explanation
Correct Answer
B:Insert tied timestamps and verify deterministic version selection directly tests the behavior that should change following the correction. With the observed evidence (the raw table contains equal device_id rows with varying event timestamps), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that exactly one latest row per device must be selected using deterministic tie-breaks.
Incorrect Answers
A:Publish the window transform with stable ordering and preserved raw input may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the raw table contains equal device_id rows with varying event timestamps. This matters here because consider the vessel_position_events_delta workload at Maritime safety agency: vessel_position_events_delta tracks….
C:Inspect per-device timestamps and tie possibilities for vessel_position_events_delta could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The vessel_position_events_delta workflow still requires that exactly one latest row per device must be selected using deterministic tie-breaks.
D:An unordered dedup does not guarantee selection of the newest record. The proposed action (Call dropDuplicates(device_id) without an explicit ordering rule at Maritime safety agency) does not meet the requirement that exactly one latest row per device must be selected using deterministic tie-breaks, nor does it constitute the post-change acceptance test.
Question 885
Consider the harvest_purchase_orders_west workload at National farm supplier: harvest_purchase_orders_west silver records pass ingestion despite negative billed quantities. Inspection found that validation sample identifies impossible values in otherwise well-formed JSON. The governed outcome must ensure that bad records need a defined reject/quarantine policy without hiding valid data. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Monitor expectation violation counts and changed data quality trends in harvest_purchase_orders_west
- Define explicit data-quality expectations with documented action for invalid records
- Quantify invalid predicate occurrences and source impact for harvest_purchase_orders_west
- Delete invalid rows silently and report the entire batch as error-free at National farm supplier
Explanation
Correct Answer
B:Define explicit data-quality expectations with documented action for invalid records is the intended durable approach for harvest_purchase_orders_west: it addresses the verified problem (harvest_purchase_orders_west silver records pass ingestion despite negative billed quantities) while preserving the required behavior (bad records need a defined reject/quarantine policy without hiding valid data). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor expectation violation counts and changed data quality trends in harvest_purchase_orders_west would help detect future recurrence, but metrics alone do not deliver the target approach. The harvest_purchase_orders_west requirement is that bad records need a defined reject/quarantine policy without hiding valid data.
C:Quantify invalid predicate occurrences and source impact for harvest_purchase_orders_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The harvest_purchase_orders_west workflow still requires that bad records need a defined reject/quarantine policy without hiding valid data.
D:Silent loss hides quality issues and masks upstream defects. The proposed action (Delete invalid rows silently and report the entire batch as error-free at National farm supplier) does not meet the requirement that bad records need a defined reject/quarantine policy without hiding valid data, nor does it constitute the target approach.
Question 886
The pollution_measurements_west pipeline at Air quality nonprofit has this failure: two concurrent writers update pollution_measurements_west and a reader sometimes sees inconsistent exported copies. The team observed that the write log shows independent files were replaced while an ETL job was reading them. Business requirement: readers require consistent committed versions without pausing ingest. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Read pollution_measurements_west during overlapping test writes and verify a consistent committed snapshot
- Allow direct writers to replace arbitrary Parquet files while readers scan them at Air quality nonprofit
- Inspect commit history and concurrent writer conflict details for pollution_measurements_west
- Convert the staging copy and cut over readers only after commit and rollback tests
Explanation
Correct Answer
A:Read pollution_measurements_west during overlapping test writes and verify a consistent committed snapshot directly tests the behavior that should change after the correction. With the observed evidence (the write log shows independent files were replaced while an ETL job was reading them), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that readers require consistent committed versions without pausing ingest.
Incorrect Answers
B:Uncoordinated file replacement cannot provide delta transaction guarantees. The proposed action (Allow direct writers to replace arbitrary Parquet files while readers scan them at Air quality nonprofit) does not meet the requirement that readers require consistent committed versions without pausing ingest, nor does it constitute the post-change acceptance test.
C:Inspect commit history and concurrent writer conflict details for pollution_measurements_west could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The pollution_measurements_west workflow still requires that readers require consistent committed versions without pausing ingest.
D:Convert the staging copy and cut over readers only after commit and rollback tests may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the write log shows independent files were replaced while an ETL job was reading them. This matters here because the pollution_measurements_west pipeline at Air quality nonprofit has this failure: two concurrent writers update….
Question 887
At Air quality nonprofit, the pollution measurements workflow depends on pollution_measurements_urban. Engineers report that pollution_measurements_urban former intern still reads a sensitive table after leaving the team; the evidence is that UC audit shows the intern belongs to a group with lingering SELECT privilege. They require that departed identities must lose data access promptly. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Attempt access as the removed principal and confirm denial
- Trace effective access through group memberships and inherited grants for pollution_measurements_urban
- Revoke access in controlled scope and test authorized user continuity
- Rename the sensitive table instead of revoking access at Air quality nonprofit
Explanation
Correct Answer
A:Attempt access as the removed principal and confirm denial directly tests the behavior that should change following the correction. With the observed evidence (UC audit shows the intern belongs to a group with lingering SELECT privilege), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that departed identities must lose data access promptly.
Incorrect Answers
B:Trace effective access through group memberships and inherited grants for pollution_measurements_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The pollution_measurements_urban workflow still requires that departed identities must lose data access promptly.
C:Revoke access in controlled scope and test authorized user continuity may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that UC audit shows the intern belongs to a group with lingering SELECT privilege. Here, the relevant situation is: the pollution measurements workflow depends on pollution_measurements_urban. Engineers report that….
D:Renaming an object is not an access-control boundary. The proposed action (Rename the sensitive table instead of revoking access at Air quality nonprofit) does not meet the requirement that departed identities must lose data access promptly, nor does it constitute the post-change acceptance test.
Question 888
The shipment_manifests_west pipeline at Coastal freight alliance has this failure: a new optional field appears in shipment_manifests_west JSON files and the ingestion job starts rejecting rows. The team observed that failure details identify a field absent from the previously inferred schema. Business requirement: new attributes must be captured without silently corrupting existing columns. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Silently drop every unexpected field and label ingestion complete at Coastal freight alliance
- Pilot the new field, persist the updated schema and restart as required
- Configure supported Auto Loader schema evolution with an explicit schema location and review process
- Ingest old and new records and verify preserved fields and captured additions
Explanation
Correct Answer
B:Pilot the new field, persist the updated schema and restart as required provides a bounded way to introduce the approved solution into shipment_manifests_west and detect an early mismatch. The existing signal is failure details identify a field absent from the previously inferred schema; a staged change protects the service requirement (new attributes must be captured without silently corrupting existing columns) and makes rollback practical.
Incorrect Answers
A:Dropping added fields hides source changes and loses information. The proposed action (Silently drop every unexpected field and label ingestion complete at Coastal freight alliance) does not meet the requirement that new attributes must be captured without silently corrupting existing columns, nor does it constitute the controlled implementation step.
C:Configure supported Auto Loader schema evolution with an explicit schema location and review process is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the shipment_manifests_west scenario, the observed evidence is that failure details identify a field absent from the previously inferred schema; the requirement remains: new attributes must be captured without silently corrupting existing columns.
D:Ingest old and new records and verify preserved fields and captured additions is a one-time acceptance check. It does not supply the controlled implementation step for shipment_manifests_west; a passing test cannot substitute for the specific task now required.
Question 889
A data engineer at Cloud gaming cooperative is responsible for match-session events. The groupBy distinct metrics issue is that match_session_events_west revenue reporting counts each customer event as if it were a unique customer. The supporting evidence is that a sample shows three transactions from the same account on one date. The engineer must ensure that dashboard needs daily total revenue and distinct paying accounts. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Use sum(account_id) or count of rows as unique-customer count at Cloud gaming cooperative
- GroupBy day with sum(amount) and countDistinct(account_id) for unique accounts
- Publish the aggregate behind a reconciled silver-to-gold transform
- Test a day with repeated account IDs and verify sum and distinct count
Explanation
Correct Answer
C:Publish the aggregate behind a reconciled silver-to-gold transform provides a bounded way to introduce the approved solution into match_session_events_west and detect an early mismatch. The existing signal is a sample shows three transactions from the same account on one date; a staged change protects the service requirement (dashboard needs daily total revenue and distinct paying accounts) and makes rollback practical.
Incorrect Answers
A:Row counts or numeric sums cannot measure distinct account identifiers. The proposed action (Use sum(account_id) or count of rows as unique-customer count at Cloud gaming cooperative) does not meet the requirement that dashboard needs daily total revenue and distinct paying accounts, nor does it constitute the controlled implementation step.
B:GroupBy day with sum(amount) and countDistinct(account_id) for unique accounts is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the match_session_events_west scenario, the observed evidence is that a sample shows three transactions from the same account on one date; the requirement remains: dashboard needs daily total revenue and distinct paying accounts.
D:Test a day with repeated account IDs and verify sum and distinct count is a one-time acceptance check. It does not supply the controlled implementation step for match_session_events_west; a passing test cannot substitute for the specific task now required.
Question 890
At Agricultural credit union, the farm-loan transaction history workflow depends on farm_loan_transaction_history_south. Engineers report that farm_loan_transaction_history_south notebook hardcodes a development catalog and writes there during production runs; the evidence is that job run settings differ from values embedded in the notebook code. They require that the same notebook must respect runtime environment configuration. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Remove hardcoded target paths and test parameterized notebook invocation
- Edit the source notebook by hand every time the job changes environment at Agricultural credit union
- Run dev and prod parameters and confirm each writes only to its own catalog
- Identify job parameter keys and where farm_loan_transaction_history_south notebook resolves the catalog
Explanation
Correct Answer
C:Run dev and prod parameters and confirm each writes only to its own catalog directly tests the behavior that should change following the correction. With the observed evidence (job run settings differ from values embedded in the notebook code), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that the same notebook must respect runtime environment configuration.
Incorrect Answers
A:Remove hardcoded target paths and test parameterized notebook invocation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that job run settings differ from values embedded in the notebook code. Here, the relevant situation is: the farm-loan transaction history workflow depends on farm_loan_transaction_history_south. Engineers report that….
B:Manual code edits are not reproducible parameterization. The proposed action (Edit the source notebook by hand every time the job changes environment at Agricultural credit union) does not meet the requirement that the same notebook must respect runtime environment configuration, nor does it constitute the post-change acceptance test.
D:Identify job parameter keys and where farm_loan_transaction_history_south notebook resolves the catalog could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The farm_loan_transaction_history_south workflow still requires that the same notebook must respect runtime environment configuration.