Databricks Certified Data Engineer Associate Practice Test 95
Question 940
At Wholesale produce exchange, the trade settlement files workflow depends on trade_settlement_files_urban. Engineers report that trade_settlement_files_urban Gold dashboard shows wrong revenue and owners cannot trace the upstream dataset; the evidence is that lineage view is missing a newly added silver transformation. They require that impact analysis needs upstream and downstream dependency visibility. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Compare inferred lineage to an actual source-to-gold test transformation
- Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies
- Monitor missing lineage links and changed downstream consumers for trade_settlement_files_urban
- Rely on file naming conventions as proof of full lineage at Wholesale produce exchange
Explanation
Correct Answer
C:Monitor missing lineage links and changed downstream consumers for trade_settlement_files_urban creates recurring visibility into the failure mode (trade_settlement_files_urban Gold dashboard shows wrong revenue and owners cannot trace the upstream dataset). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while impact analysis needs upstream and downstream dependency visibility.
Incorrect Answers
A:Compare inferred lineage to an actual source-to-gold test transformation is a one-time acceptance check. It does not supply continuing operational detection for trade_settlement_files_urban; a passing test cannot substitute for the specific task now required.
B:Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the trade_settlement_files_urban scenario, the observed evidence is that lineage view is missing a newly added silver transformation; the requirement remains: impact analysis needs upstream and downstream dependency visibility.
D:Names alone cannot prove transformations and dependencies. The proposed action (Rely on file naming conventions as proof of full lineage at Wholesale produce exchange) does not meet the requirement that impact analysis needs upstream and downstream dependency visibility, nor does it constitute continuing operational detection.
Question 941
The monthly_pension_movements_rural pipeline at Public pension trustee has this failure: the monthly_pension_movements_rural CSV feed has unrecognized optional columns and the ingest silently discards them. The team observed that raw samples show new attributes that do not appear in the bronze output. Business requirement: unknown values must remain auditable even before mapping is approved. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Overwrite source files after dropping all unrecognized fields at Public pension trustee
- Compare incoming headers with inferred schema and rescued fields for monthly_pension_movements_rural
- Verify unexpected columns are still recoverable without breaking known fields
- Roll out controlled schema rules and record each new rescued field
Explanation
Correct Answer
C:Verify unexpected columns are still recoverable without breaking known fields directly tests the behavior that should change following the correction. With the observed evidence (raw samples show new attributes that do not appear in the bronze output), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that unknown values must remain auditable even before mapping is approved.
Incorrect Answers
A:Discarded raw fields cannot be reconstructed during audit. The proposed action (Overwrite source files after dropping all unrecognized fields at Public pension trustee) does not meet the requirement that unknown values must remain auditable even before mapping is approved, nor does it constitute the post-change acceptance test.
B:Compare incoming headers with inferred schema and rescued fields for monthly_pension_movements_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The monthly_pension_movements_rural workflow still requires that unknown values must remain auditable even before mapping is approved.
D:Roll out controlled schema rules and record each new rescued field may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that raw samples show new attributes that do not appear in the bronze output. This matters here because the monthly_pension_movements_rural pipeline at Public pension trustee has this failure: the….
Question 942
Consider the trade_settlement_files_central workload at Wholesale produce exchange: trade_settlement_files_central deployment works only when the developer logs in interactively. Inspection found that CI pipeline fails with an expired human authentication token. The governed outcome must ensure that unattended deployments require restricted non-personal credentials. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Configure CI with an approved service principal and scoped deployment grants
- Store the developer's personal token unencrypted in source control at Wholesale produce exchange
- Monitor deployment identity use and privilege drift for trade_settlement_files_central
- Inspect authentication identity, workspace permissions and token expiry for trade_settlement_files_central
Explanation
Correct Answer
A:Configure CI with an approved service principal and scoped deployment grants is the intended durable approach for trade_settlement_files_central: it addresses the verified problem (trade_settlement_files_central deployment works only when the developer logs in interactively) while preserving the required behavior (unattended deployments require restricted non-personal credentials). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Source-controlled long-lived personal secrets create exposure and ownership risk. The proposed action (Store the developer's personal token unencrypted in source control at Wholesale produce exchange) does not meet the requirement that unattended deployments require restricted non-personal credentials, nor does it constitute the target approach.
C:Monitor deployment identity use and privilege drift for trade_settlement_files_central would help detect future recurrence, but metrics alone do not deliver the target approach. The trade_settlement_files_central requirement is that unattended deployments require restricted non-personal credentials.
D:Inspect authentication identity, workspace permissions and token expiry for trade_settlement_files_central could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The trade_settlement_files_central workflow still requires that unattended deployments require restricted non-personal credentials.
Question 943
The warehouse_movement_logs_north pipeline at Multinational parts distributor has this failure: a new optional field appears in warehouse_movement_logs_north JSON files and the ingestion job starts rejecting rows. The team observed that failure details identify a field absent from the previously inferred schema. Business requirement: new attributes must be captured without silently corrupting existing columns. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What test most directly proves the requirement is satisfied?
- Ingest old and new records and verify preserved fields and captured additions
- Inspect schema inference, evolution mode and rescued data behavior on warehouse_movement_logs_north
- Pilot the new field, persist the updated schema and restart as required
- Silently drop every unexpected field and label ingestion complete at Multinational parts distributor
Explanation
Correct Answer
A:Ingest old and new records and verify preserved fields and captured additions directly tests the behavior that should change after the correction. With the observed evidence (failure details identify a field absent from the previously inferred schema), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that new attributes must be captured without silently corrupting existing columns. This matters here because the warehouse_movement_logs_north pipeline at Multinational parts distributor has this failure: a new optional field….
Incorrect Answers
B:Inspect schema inference, evolution mode and rescued data behavior on warehouse_movement_logs_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The warehouse_movement_logs_north workflow still requires that new attributes must be captured without silently corrupting existing columns.
C:Pilot the new field, persist the updated schema and restart as required may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that failure details identify a field absent from the previously inferred schema. This matters here because the warehouse_movement_logs_north pipeline at Multinational parts distributor has this failure: a new optional field….
D:Dropping added fields hides source changes and loses information. The proposed action (Silently drop every unexpected field and label ingestion complete at Multinational parts distributor) does not meet the requirement that new attributes must be captured without silently corrupting existing columns, nor does it constitute the post-change acceptance test.
Question 944
At Wholesale produce exchange, the Unity Catalog lineage workflow handles trade settlement files. The problem is that trade_settlement_files_urban Gold dashboard shows wrong revenue and owners cannot trace the upstream dataset. Evidence: lineage view is missing a newly added silver transformation. Constraint: impact analysis needs upstream and downstream dependency visibility. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Rely on file naming conventions as proof of full lineage at Wholesale produce exchange
- Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies
- Inspect lineage graph and actual query/job references for trade_settlement_files_urban
- Instrument or update the supported job dependency record before release
Explanation
Correct Answer
C:Inspect lineage graph and actual query/job references for trade_settlement_files_urban directly investigates the evidence (lineage view is missing a newly added silver transformation) and distinguishes possible causes of trade_settlement_files_urban Gold dashboard shows wrong revenue and owners cannot trace the upstream dataset. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: impact analysis needs upstream and downstream dependency visibility.
Incorrect Answers
A:Names alone cannot prove transformations and dependencies. The proposed action (Rely on file naming conventions as proof of full lineage at Wholesale produce exchange) does not meet the requirement that impact analysis needs upstream and downstream dependency visibility, nor does it constitute the required pre-change investigation.
B:Use Unity Catalog lineage and supported pipeline metadata to trace data dependencies is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the trade_settlement_files_urban scenario, the observed evidence is that lineage view is missing a newly added silver transformation; the requirement remains: impact analysis needs upstream and downstream dependency visibility.
D:Instrument or update the supported job dependency record before release may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that lineage view is missing a newly added silver transformation.
Question 945
A data engineer at Online apparel cooperative is responsible for customer order changes. The Delta log versus data files issue is that a raw Parquet copy of customer_order_changes_delta is mistaken for a complete Delta table. The supporting evidence is that the copied directory lacks _delta_log while Delta history queries fail. The engineer must ensure that restoration needs the committed schema and transaction history. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. What evidence establishes that correct output is maintained?
- Copy only a selection of Parquet part files and declare the transaction log unnecessary at Online apparel cooperative
- Use a supported backup or clone workflow and test restore in isolation
- Check customer_order_changes_delta path for the Delta log, data files and version metadata
- Query historical versions and a current snapshot after restoring customer_order_changes_delta
Explanation
Correct Answer
D:Query historical versions and a current snapshot after restoring customer_order_changes_delta directly tests the behavior that should change after the correction. With the observed evidence (the copied directory lacks _delta_log while Delta history queries fail), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that restoration needs the committed schema and transaction history.
Incorrect Answers
A:Data files alone do not preserve delta transactional history. The proposed action (Copy only a selection of Parquet part files and declare the transaction log unnecessary at Online apparel cooperative) does not meet the requirement that restoration needs the committed schema and transaction history, nor does it constitute the post-change acceptance test.
B:Use a supported backup or clone workflow and test restore in isolation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the copied directory lacks _delta_log while Delta history queries fail. This matters here because a data engineer at Online apparel cooperative is responsible for customer order changes. The Delta log versus data….
C:Check customer_order_changes_delta path for the Delta log, data files and version metadata could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The customer_order_changes_delta workflow still requires that restoration needs the committed schema and transaction history.
Question 946
Consider the product_sales_transactions_rural workload at Online bicycle retailer: product_sales_transactions_rural team schedules a SQL aggregation by opening a dashboard manually. Inspection found that history shows a query can run on SQL warehouse but has no job task. The governed outcome must ensure that the query must run automatically before downstream export. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which data-engineering approach resolves the documented weakness?
- Inspect SQL statement, warehouse privileges and desired task dependencies for product_sales_transactions_rural
- Ask analysts to click Run on the query each morning at Online bicycle retailer
- Use a Lakeflow SQL query task configured with suitable warehouse and dependencies
- Monitor SQL task errors and warehouse availability for product_sales_transactions_rural
Explanation
Correct Answer
C:Use a Lakeflow SQL query task configured with suitable warehouse and dependencies is the intended durable approach for product_sales_transactions_rural: it addresses the verified problem (product_sales_transactions_rural team schedules a SQL aggregation by opening a dashboard manually) while preserving the required behavior (the query must run automatically before downstream export). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Inspect SQL statement, warehouse privileges and desired task dependencies for product_sales_transactions_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The product_sales_transactions_rural workflow still requires that the query must run automatically before downstream export.
B:Manual invocation does not provide reliable orchestration. The proposed action (Ask analysts to click Run on the query each morning at Online bicycle retailer) does not meet the requirement that the query must run automatically before downstream export, nor does it constitute the target approach.
D:Monitor SQL task errors and warehouse availability for product_sales_transactions_rural would help detect future recurrence, but metrics alone do not deliver the target approach. The product_sales_transactions_rural requirement is that the query must run automatically before downstream export.
Question 947
At Manufacturing quality network, the quality expectations pipeline workflow handles factory defect records. The problem is that factory_defect_records_urban silver records pass ingestion despite negative billed quantities. Evidence: validation sample identifies impossible values in otherwise well-formed JSON. Constraint: bad records need a defined reject/quarantine policy without hiding valid data. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which investigation is the strongest first step?
- Define explicit data-quality expectations with documented action for invalid records
- Quantify invalid predicate occurrences and source impact for factory_defect_records_urban
- Delete invalid rows silently and report the entire batch as error-free at Manufacturing quality network
- Roll out expectation checks and a quarantine audit before enforcing production policy
Explanation
Correct Answer
B:Quantify invalid predicate occurrences and source impact for factory_defect_records_urban directly investigates the evidence (validation sample identifies impossible values in otherwise well-formed JSON) and distinguishes possible causes of factory_defect_records_urban silver records pass ingestion despite negative billed quantities. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: bad records need a defined reject/quarantine policy without hiding valid data.
Incorrect Answers
A:Define explicit data-quality expectations with documented action for invalid records is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the factory_defect_records_urban scenario, the observed evidence is that validation sample identifies impossible values in otherwise well-formed JSON; the requirement remains: bad records need a defined reject/quarantine policy without hiding valid data.
C:Silent loss hides quality issues and masks upstream defects. The proposed action (Delete invalid rows silently and report the entire batch as error-free at Manufacturing quality network) does not meet the requirement that bad records need a defined reject/quarantine policy without hiding valid data, nor does it constitute the required pre-change investigation.
D:Roll out expectation checks and a quarantine audit before enforcing production policy may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that validation sample identifies impossible values in otherwise well-formed JSON. Here, the relevant situation is: the quality expectations pipeline workflow handles factory defect records. The problem is that….
Question 948
A data engineer at Regional insurance broker is responsible for claims payment events. The unionByName schema drift issue is that claims_payment_events_central daily DataFrames have the same field names in different column orders. The supporting evidence is that union positional matching puts phone numbers into postal-code fields. The engineer must ensure that combined data must align values by field name rather than column position. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Use unionByName with controlled missing-column behavior as needed
- Compare column order and compatible types in both claims_payment_events_central inputs
- Use positional union without checking source column order at Regional insurance broker
- Validate schema compatibility and replace positional union in staging
Explanation
Correct Answer
B:Compare column order and compatible types in both claims_payment_events_central inputs directly investigates the evidence (union positional matching puts phone numbers into postal-code fields) and distinguishes possible causes of claims_payment_events_central daily DataFrames have the same field names in different column orders. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: combined data must align values by field name rather than column position.
Incorrect Answers
A:Use unionByName with controlled missing-column behavior as needed is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the claims_payment_events_central scenario, the observed evidence is that union positional matching puts phone numbers into postal-code fields; the requirement remains: combined data must align values by field name rather than column position.
C:Position-based union can silently misalign values. The proposed action (Use positional union without checking source column order at Regional insurance broker) does not meet the requirement that combined data must align values by field name rather than column position, nor does it constitute the required pre-change investigation.
D:Validate schema compatibility and replace positional union in staging may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that union positional matching puts phone numbers into postal-code fields. This matters here because a data engineer at Regional insurance broker is responsible for claims payment events. The unionByName schema drift….
Question 949
At National heritage library, the digitization inventories workflow depends on digitization_inventories_highland. Engineers report that digitization_inventories_highland notebook occasionally fails on transient service throttling; the evidence is that task failure records show HTTP 429 followed by a successful manual retry. They require that safe retries must not create duplicate output or run indefinitely. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Monitor retry attempts, terminal failures and repeated throttling for digitization_inventories_highland
- Set infinite immediate retries for every failure including invalid SQL at National heritage library
- Inject a temporary failure and verify eventual success without duplicated rows
- Configure bounded Lakeflow task retries with backoff where appropriate
Explanation
Correct Answer
A:Monitor retry attempts, terminal failures and repeated throttling for digitization_inventories_highland creates recurring visibility into the failure mode (digitization_inventories_highland notebook occasionally fails on transient service throttling). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while safe retries must not create duplicate output or run indefinitely.
Incorrect Answers
B:Unbounded retries can overload services and conceal deterministic defects. The proposed action (Set infinite immediate retries for every failure including invalid SQL at National heritage library) does not meet the requirement that safe retries must not create duplicate output or run indefinitely, nor does it constitute continuing operational detection.
C:Inject a temporary failure and verify eventual success without duplicated rows is a one-time acceptance check. It does not supply continuing operational detection for digitization_inventories_highland; a passing test cannot substitute for the specific task now required.
D:Configure bounded Lakeflow task retries with backoff where appropriate is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the digitization_inventories_highland scenario, the observed evidence is that task failure records show HTTP 429 followed by a successful manual retry; the requirement remains: safe retries must not create duplicate output or run indefinitely.
Question 950
At E-commerce payments provider, the payment authorization records workflow depends on payment_authorization_records_rural. Engineers report that payment_authorization_records_rural ledger export is legally due at 06:00 even when no new records arrive; the evidence is that operators propose a file trigger that may not run on quiet days. They require that an empty but valid daily export must still be delivered. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Use only file-arrival triggers for a mandatory daily report at E-commerce payments provider
- Monitor deadline misses and incomplete empty-day acknowledgments for payment_authorization_records_rural
- Use a time-based schedule for mandatory daily reporting independent of arrivals
- Verify whether output requirement is calendar-driven or source-event-driven for payment_authorization_records_rural
Explanation
Correct Answer
C:Use a time-based schedule for mandatory daily reporting independent of arrivals is the intended durable approach for payment_authorization_records_rural: it addresses the verified problem (payment_authorization_records_rural ledger export is legally due at 06:00 even when no new records arrive) while preserving the required behavior (an empty but valid daily export must still be delivered). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Quiet source days would skip the required calendar delivery. The proposed action (Use only file-arrival triggers for a mandatory daily report at E-commerce payments provider) does not meet the requirement that an empty but valid daily export must still be delivered, nor does it constitute the target approach.
B:Monitor deadline misses and incomplete empty-day acknowledgments for payment_authorization_records_rural would help detect future recurrence, but metrics alone do not deliver the target approach. The payment_authorization_records_rural requirement is that an empty but valid daily export must still be delivered.
D:Verify whether output requirement is calendar-driven or source-event-driven for payment_authorization_records_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The payment_authorization_records_rural workflow still requires that an empty but valid daily export must still be delivered.