Databricks Certified Data Engineer Associate Practice Test 6
Question 50
A data engineer at Agricultural credit union is responsible for farm-loan transaction history. The file arrival trigger issue is that farm_loan_transaction_history_coastal job runs hourly although only one file arrives most days. The supporting evidence is that execution history shows repeated empty runs with compute startup cost. The engineer must ensure that process each new delivered file promptly without idle polling. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Monitor missed arrival events and repeated empty executions for farm_loan_transaction_history_coastal
- Use a supported file-arrival trigger for the eligible storage location
- Upload a test file and confirm exactly the expected run fires
- Run a full pipeline every minute even if no files arrive at Agricultural credit union
Explanation
Correct Answer
A:Monitor missed arrival events and repeated empty executions for farm_loan_transaction_history_coastal creates recurring visibility into the failure mode (farm_loan_transaction_history_coastal job runs hourly although only one file arrives most days). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while process each new delivered file promptly without idle polling.
Incorrect Answers
B:Use a supported file-arrival trigger for the eligible storage location is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the farm_loan_transaction_history_coastal scenario, the observed evidence is that execution history shows repeated empty runs with compute startup cost; the requirement remains: process each new delivered file promptly without idle polling.
C:Upload a test file and confirm exactly the expected run fires is a one-time acceptance check. It does not supply continuing operational detection for farm_loan_transaction_history_coastal; a passing test cannot substitute for the specific task now required.
D:Repetitive empty executions waste compute and cost. The proposed action (Run a full pipeline every minute even if no files arrive at Agricultural credit union) does not meet the requirement that process each new delivered file promptly without idle polling, nor does it constitute continuing operational detection.
Question 51
A data engineer at Retail pharmacy network is responsible for inventory adjustments. The job max concurrent runs issue is that inventory_adjustments_island high-frequency triggers create overlapping job runs that overwrite the same gold partition. The supporting evidence is that run history shows two active instances of an identical pipeline. The engineer must ensure that concurrent processing must respect destination write semantics. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Set maximum concurrent runs or isolation controls appropriate to the shared target
- Raise maximum concurrent runs without coordinating shared output writes at Retail pharmacy network
- Send overlapping triggers and confirm bounded jobs and consistent output
- Pilot concurrency limits and deterministic write keys
Explanation
Correct Answer
D:Pilot concurrency limits and deterministic write keys provides a bounded way to introduce the approved solution into inventory_adjustments_island and detect an early mismatch. The existing signal is run history shows two active instances of an identical pipeline; a staged change protects the service requirement (concurrent processing must respect destination write semantics) and makes rollback practical.
Incorrect Answers
A:Set maximum concurrent runs or isolation controls appropriate to the shared target is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the inventory_adjustments_island scenario, the observed evidence is that run history shows two active instances of an identical pipeline; the requirement remains: concurrent processing must respect destination write semantics.
B:Overlapping unsafe writers can corrupt business results or cause failures. The proposed action (Raise maximum concurrent runs without coordinating shared output writes at Retail pharmacy network) does not meet the requirement that concurrent processing must respect destination write semantics, nor does it constitute the controlled implementation step.
C:Send overlapping triggers and confirm bounded jobs and consistent output is a one-time acceptance check. It does not supply the controlled implementation step for inventory_adjustments_island; a passing test cannot substitute for the specific task now required.
Question 52
A data engineer at Public water district is responsible for pipeline flow metrics. The Silver null cleaning issue is that pipeline_flow_metrics_delta bronze records include null business IDs that break downstream joins. The supporting evidence is that profiling identifies a small fraction of missing identifiers plus valid optional fields. The engineer must ensure that silver must reject missing required keys but preserve optional null attributes. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Call fillna on every field with zero regardless of semantic type at Public water district
- Filter or quarantine null required IDs while applying explicit nullable rules to optional columns
- Profile required versus nullable fields and sample failed pipeline_flow_metrics_delta records
- Create a tested silver transform and quarantine invalid rows before promoting
Explanation
Correct Answer
C:Profile required versus nullable fields and sample failed pipeline_flow_metrics_delta records directly investigates the evidence (profiling identifies a small fraction of missing identifiers plus valid optional fields) and distinguishes possible causes of pipeline_flow_metrics_delta bronze records include null business IDs that break downstream joins. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: silver must reject missing required keys but preserve optional null attributes.
Incorrect Answers
A:Blanket replacement changes data meaning and can corrupt types. The proposed action (Call fillna on every field with zero regardless of semantic type at Public water district) does not meet the requirement that silver must reject missing required keys but preserve optional null attributes, nor does it constitute the required pre-change investigation.
B:Filter or quarantine null required IDs while applying explicit nullable rules to optional columns is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the pipeline_flow_metrics_delta scenario, the observed evidence is that profiling identifies a small fraction of missing identifiers plus valid optional fields; the requirement remains: silver must reject missing required keys but preserve optional null attributes.
D:Create a tested silver transform and quarantine invalid rows before promoting may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that profiling identifies a small fraction of missing identifiers plus valid optional fields.
Question 53
At Regional sporting venue, the admission scan events workflow depends on admission_scan_events_central. Engineers report that admission_scan_events_central contains duplicate message IDs after file retries; the evidence is that two rows share event_id but have different ingestion timestamps. They require that silver needs one deterministic event per business event identifier. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- DropDuplicates on every column when duplicates differ only by ingest timestamp at Regional sporting venue
- Pilot a dedup transform while retaining originals in bronze for audit
- Verify duplicate business keys and ordering fields within admission_scan_events_central
- Use deterministic row_number or dropDuplicates on the correct business key and ordering rule
Explanation
Correct Answer
C:Verify duplicate business keys and ordering fields within admission_scan_events_central directly investigates the evidence (two rows share event_id but have different ingestion timestamps) and distinguishes possible causes of admission_scan_events_central contains duplicate message IDs after file retries. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: silver needs one deterministic event per business event identifier.
Incorrect Answers
A:All-column comparison misses business-key duplicates. The proposed action (DropDuplicates on every column when duplicates differ only by ingest timestamp at Regional sporting venue) does not meet the requirement that silver needs one deterministic event per business event identifier, nor does it constitute the required pre-change investigation.
B:Pilot a dedup transform while retaining originals in bronze for audit may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that two rows share event_id but have different ingestion timestamps.
D:Use deterministic row_number or dropDuplicates on the correct business key and ordering rule is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the admission_scan_events_central scenario, the observed evidence is that two rows share event_id but have different ingestion timestamps; the requirement remains: silver needs one deterministic event per business event identifier.
Question 54
A data engineer at National farm supplier is responsible for harvest purchase orders. The conditional flag when otherwise issue is that harvest_purchase_orders_metro rows have statuses requiring a three-way risk category. The supporting evidence is that a simple boolean expression sends null status to a high-risk category. The engineer must ensure that business rules distinguish active, cancelled and unknown statuses. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Use when/otherwise with explicit conditions and an unknown default
- Deploy a deterministic mapping table and validate the input states
- Test all named states plus null and an unrecognized state
- Treat null as an active subscription without evidence at National farm supplier
Explanation
Correct Answer
B:Deploy a deterministic mapping table and validate the input states provides a bounded way to introduce the approved solution into harvest_purchase_orders_metro and detect an early mismatch. The existing signal is a simple boolean expression sends null status to a high-risk category; a staged change protects the service requirement (business rules distinguish active, cancelled and unknown statuses) and makes rollback practical.
Incorrect Answers
A:Use when/otherwise with explicit conditions and an unknown default is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the harvest_purchase_orders_metro scenario, the observed evidence is that a simple boolean expression sends null status to a high-risk category; the requirement remains: business rules distinguish active, cancelled and unknown statuses.
C:Test all named states plus null and an unrecognized state is a one-time acceptance check. It does not supply the controlled implementation step for harvest_purchase_orders_metro; a passing test cannot substitute for the specific task now required.
D:Missing status cannot be assumed to mean active. The proposed action (Treat null as an active subscription without evidence at National farm supplier) does not meet the requirement that business rules distinguish active, cancelled and unknown statuses, nor does it constitute the controlled implementation step.
Question 55
At Public transport authority, the DAG task dependency workflow handles fare validation events. The problem is that fare_validation_events_rural gold report launches before silver validation finishes. Evidence: a task graph shows report and validation as parallel children of ingestion. Constraint: downstream publishing must not start until all required upstream checks succeed. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Monitor dependency skips, failures and unexpected concurrent starts for fare_validation_events_rural
- Read job DAG edges and task-run timestamps for fare_validation_events_rural
- Schedule every task at the same clock time and hope upstream processing completes at Public transport authority
- Declare an explicit dependency from gold publishing to successful validation tasks
Explanation
Correct Answer
D:Declare an explicit dependency from gold publishing to successful validation tasks is the intended durable approach for fare_validation_events_rural: it addresses the verified problem (fare_validation_events_rural gold report launches before silver validation finishes) while preserving the required behavior (downstream publishing must not start until all required upstream checks succeed). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor dependency skips, failures and unexpected concurrent starts for fare_validation_events_rural would help detect future recurrence, but metrics alone do not deliver the target approach. The fare_validation_events_rural requirement is that downstream publishing must not start until all required upstream checks succeed.
B:Read job DAG edges and task-run timestamps for fare_validation_events_rural could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The fare_validation_events_rural workflow still requires that downstream publishing must not start until all required upstream checks succeed.
C:Clock coincidence does not enforce dependency correctness. The proposed action (Schedule every task at the same clock time and hope upstream processing completes at Public transport authority) does not meet the requirement that downstream publishing must not start until all required upstream checks succeed, nor does it constitute the target approach.
Question 56
The experiment_records_north pipeline at University research consortium has this failure: experiment_records_north dataset is shared with a third party that does not run Databricks. The team observed that recipient cannot authenticate to a Databricks workspace but supports the open protocol. Business requirement: the partner needs supported read-only interoperability. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Choose open Delta Sharing recipient method for eligible non-Databricks consumers
- Verify recipient client protocol and data-access obligations for experiment_records_north
- Require every external organization to obtain provider workspace administrator access at University research consortium
- Monitor recipient token expiry and access logs for experiment_records_north
Explanation
Correct Answer
A:Choose open Delta Sharing recipient method for eligible non-Databricks consumers is the intended durable approach for experiment_records_north: it addresses the verified problem (experiment_records_north dataset is shared with a third party that does not run Databricks) while preserving the required behavior (the partner needs supported read-only interoperability). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Verify recipient client protocol and data-access obligations for experiment_records_north could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The experiment_records_north workflow still requires that the partner needs supported read-only interoperability.
C:Workspace administration is not needed for open read-only sharing. The proposed action (Require every external organization to obtain provider workspace administrator access at University research consortium) does not meet the requirement that the partner needs supported read-only interoperability, nor does it constitute the target approach.
D:Monitor recipient token expiry and access logs for experiment_records_north would help detect future recurrence, but metrics alone do not deliver the target approach. The experiment_records_north requirement is that the partner needs supported read-only interoperability.
Question 57
At Media postproduction team, the render-job telemetry workflow depends on render_job_telemetry_north. Engineers report that render_job_telemetry_north analysts have SELECT on a table but get a permission error at query time; the evidence is that access review shows missing USE CATALOG on its parent catalog. They require that users must read only the authorized governed object. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Apply least-privilege grants to an analyst group and test identity
- Check current UC parent hierarchy and effective grants for render_job_telemetry_north
- Grant global metastore administration to fix one table query at Media postproduction team
- Query the table as an analyst and confirm sibling data remains denied
Explanation
Correct Answer
D:Query the table as an analyst and confirm sibling data remains denied directly tests the behavior that should change after the correction. With the observed evidence (access review shows missing USE CATALOG on its parent catalog), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that users must read only the authorized governed object.
Incorrect Answers
A:Apply least-privilege grants to an analyst group and test identity may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that access review shows missing USE CATALOG on its parent catalog.
B:Check current UC parent hierarchy and effective grants for render_job_telemetry_north could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The render_job_telemetry_north workflow still requires that users must read only the authorized governed object.
C:Global admin rights exceed simple read access needs. The proposed action (Grant global metastore administration to fix one table query at Media postproduction team) does not meet the requirement that users must read only the authorized governed object, nor does it constitute the post-change acceptance test.
Question 58
The customer_order_changes_west pipeline at Online apparel cooperative has this failure: customer_order_changes_west test run overwrites production tables because both deployment targets share one catalog. The team observed that resolved bundle targets point to the same UC prefix. Business requirement: development tests must not mutate production data. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What should the engineer inspect to establish the failure mechanism?
- Use identical production destinations and hope developers avoid dangerous input at Online apparel cooperative
- Segregate dev/test/prod catalog settings using bundle target overrides
- Compare target resolution, workspace URL and catalog bindings for customer_order_changes_west
- Deploy a nonproduction copy with unique resource namespace and service identity
Explanation
Correct Answer
C:Compare target resolution, workspace URL and catalog bindings for customer_order_changes_west directly investigates the evidence (resolved bundle targets point to the same UC prefix) and distinguishes possible causes of customer_order_changes_west test run overwrites production tables because both deployment targets share one catalog. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: development tests must not mutate production data.
Incorrect Answers
A:Shared output targets defeat environment isolation. The proposed action (Use identical production destinations and hope developers avoid dangerous input at Online apparel cooperative) does not meet the requirement that development tests must not mutate production data, nor does it constitute the required pre-change investigation.
B:Segregate dev/test/prod catalog settings using bundle target overrides is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the customer_order_changes_west scenario, the observed evidence is that resolved bundle targets point to the same UC prefix; the requirement remains: development tests must not mutate production data.
D:Deploy a nonproduction copy with unique resource namespace and service identity may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that resolved bundle targets point to the same UC prefix.
Question 59
At Urban housing fund, the COPY INTO idempotent files workflow handles rental subsidy payments. The problem is that a nightly load of rental_subsidy_payments_east repeats files from yesterday and developers fear duplicate inserts. Evidence: the same object-storage folder is scanned on each scheduled run. Constraint: only new source files should be appended without reprocessing prior paths. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Track new-file arrivals, load errors and unexpected source-file modifications for rental_subsidy_payments_east
- Use incremental idempotent COPY INTO against the governed Delta target
- Rerun the command with unchanged files and verify row counts do not double
- Run unconditional INSERT SELECT over the complete folder on every retry at Urban housing fund
Explanation
Correct Answer
A:Track new-file arrivals, load errors and unexpected source-file modifications for rental_subsidy_payments_east creates recurring visibility into the failure mode (a nightly load of rental_subsidy_payments_east repeats files from yesterday and developers fear duplicate inserts). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while only new source files should be appended without reprocessing prior paths.
Incorrect Answers
B:Use incremental idempotent COPY INTO against the governed Delta target is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the rental_subsidy_payments_east scenario, the observed evidence is that the same object-storage folder is scanned on each scheduled run; the requirement remains: only new source files should be appended without reprocessing prior paths.
C:Rerun the command with unchanged files and verify row counts do not double is a one-time acceptance check. It does not supply continuing operational detection for rental_subsidy_payments_east; a passing test cannot substitute for the specific task now required.
D:A blind append can duplicate previously processed records. The proposed action (Run unconditional INSERT SELECT over the complete folder on every retry at Urban housing fund) does not meet the requirement that only new source files should be appended without reprocessing prior paths, nor does it constitute continuing operational detection.
Question 60
At Manufacturing quality network, the factory defect records workflow depends on factory_defect_records_west. Engineers report that engineers refer to factory_defect_records_west by an ambiguous two-part name and access the wrong environment; the evidence is that the same schema and table names exist under development and production catalogs. They require that code must resolve a single governed production object. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Check current catalog, schema and resolved fully qualified table for factory_defect_records_west
- Resolve the intended table from the job identity and confirm prod/development isolation
- Depend on each user's default catalog to identify the production table at Manufacturing quality network
- Change the pipeline to explicit three-level names and test in a staging job
Explanation
Correct Answer
B:Resolve the intended table from the job identity and confirm prod/development isolation directly tests the behavior that should change after the correction. With the observed evidence (the same schema and table names exist under development and production catalogs), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that code must resolve a single governed production object.
Incorrect Answers
A:Check current catalog, schema and resolved fully qualified table for factory_defect_records_west could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The factory_defect_records_west workflow still requires that code must resolve a single governed production object.
C:Implicit current-catalog resolution makes production writes ambiguous. The proposed action (Depend on each user's default catalog to identify the production table at Manufacturing quality network) does not meet the requirement that code must resolve a single governed production object, nor does it constitute the post-change acceptance test.
D:Change the pipeline to explicit three-level names and test in a staging job may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the same schema and table names exist under development and production catalogs.