Databricks Certified Data Engineer Associate Practice Test 58
Question 570
A data engineer at Wholesale produce exchange is responsible for trade settlement files. The CI service principal issue is that trade_settlement_files_central deployment works only when the developer logs in interactively. The supporting evidence is that CI pipeline fails with an expired human authentication token. The engineer must ensure that unattended deployments require restricted non-personal credentials. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What analysis is necessary before deciding on remediation?
- Rotate the pipeline to noninteractive credentials and test target validation
- Configure CI with an approved service principal and scoped deployment grants
- Store the developer's personal token unencrypted in source control at Wholesale produce exchange
- Inspect authentication identity, workspace permissions and token expiry for trade_settlement_files_central
Explanation
Correct Answer
D:Inspect authentication identity, workspace permissions and token expiry for trade_settlement_files_central directly investigates the evidence (CI pipeline fails with an expired human authentication token) and distinguishes possible causes of trade_settlement_files_central deployment works only when the developer logs in interactively. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: unattended deployments require restricted non-personal credentials.
Incorrect Answers
A:Rotate the pipeline to noninteractive credentials and test target validation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that CI pipeline fails with an expired human authentication token.
B:Configure CI with an approved service principal and scoped deployment grants is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the trade_settlement_files_central scenario, the observed evidence is that CI pipeline fails with an expired human authentication token; the requirement remains: unattended deployments require restricted non-personal credentials.
C:Source-controlled long-lived personal secrets create exposure and ownership risk. The proposed action (Store the developer's personal token unencrypted in source control at Wholesale produce exchange) does not meet the requirement that unattended deployments require restricted non-personal credentials, nor does it constitute the required pre-change investigation.
Question 571
Consider the pipeline_flow_metrics_west workload at Public water district: pipeline_flow_metrics_west ownership team cannot explain who changed a sensitive table grant. Inspection found that investigation lacks a query of account audit events around the change. The governed outcome must ensure that privilege changes require attributable evidence and retention. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which continuing signal best reveals recurrence or drift?
- Monitor privileged changes, log delivery and unexplained event gaps for pipeline_flow_metrics_west
- Disable audit logs because granting privileges already requires admin at Public water district
- Perform a test grant and verify it appears with actor and object fields
- Use available UC audit logging and governed retention for administrative events
Explanation
Correct Answer
A:Monitor privileged changes, log delivery and unexplained event gaps for pipeline_flow_metrics_west creates recurring visibility into the failure mode (pipeline_flow_metrics_west ownership team cannot explain who changed a sensitive table grant). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while privilege changes require attributable evidence and retention.
Incorrect Answers
B:Administrative permissions do not replace audit evidence. The proposed action (Disable audit logs because granting privileges already requires admin at Public water district) does not meet the requirement that privilege changes require attributable evidence and retention, nor does it constitute continuing operational detection.
C:Perform a test grant and verify it appears with actor and object fields is a one-time acceptance check. It does not supply continuing operational detection for pipeline_flow_metrics_west; a passing test cannot substitute for the specific task now required.
D:Use available UC audit logging and governed retention for administrative events is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the pipeline_flow_metrics_west scenario, the observed evidence is that investigation lacks a query of account audit events around the change; the requirement remains: privilege changes require attributable evidence and retention.
Question 572
At Public water district, the pipeline flow metrics workflow depends on pipeline_flow_metrics_west. Engineers report that pipeline_flow_metrics_west Delta table suffers frequent filter-pattern changes and costly partition rewrites; the evidence is that workload history alternates date and customer search predicates across teams. They require that layout optimization must adapt without a rigid proliferating partition tree. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which ongoing alert or metric is most relevant?
- Create thousands of tiny static partitions for every possible predicate at Public water district
- Consider Liquid Clustering on appropriate columns with supported table features
- Compare query scan size and update overhead for representative filter sets
- Monitor clustering maintenance costs and changing query predicates for pipeline_flow_metrics_west
Explanation
Correct Answer
D:Monitor clustering maintenance costs and changing query predicates for pipeline_flow_metrics_west creates recurring visibility into the failure mode (pipeline_flow_metrics_west Delta table suffers frequent filter-pattern changes and costly partition rewrites). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while layout optimization must adapt without a rigid proliferating partition tree.
Incorrect Answers
A:Overpartitioning drives metadata overhead and inflexible layout. The proposed action (Create thousands of tiny static partitions for every possible predicate at Public water district) does not meet the requirement that layout optimization must adapt without a rigid proliferating partition tree, nor does it constitute continuing operational detection.
B:Consider Liquid Clustering on appropriate columns with supported table features is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the pipeline_flow_metrics_west scenario, the observed evidence is that workload history alternates date and customer search predicates across teams; the requirement remains: layout optimization must adapt without a rigid proliferating partition tree.
C:Compare query scan size and update overhead for representative filter sets is a one-time acceptance check. It does not supply continuing operational detection for pipeline_flow_metrics_west; a passing test cannot substitute for the specific task now required.
Question 573
A data engineer at Maritime safety agency is responsible for vessel position events. The bundle target override issue is that vessel_position_events_urban job points to the dev catalog even after deploying with the production target. The supporting evidence is that configuration shows an unresolved dev catalog literal in the bundle. The engineer must ensure that one codebase must deploy safely to different UC environments. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which durable Databricks control best addresses the requirement?
- Inspect bundle variables, target overrides and resolved job config for vessel_position_events_urban
- Parameterize environment-specific catalog and resources using Declarative Automation Bundle targets
- Replace the Git code with a different unreviewed copy for every environment at Maritime safety agency
- Monitor wrong-target resource updates and inconsistent variables for vessel_position_events_urban
Explanation
Correct Answer
B:Parameterize environment-specific catalog and resources using Declarative Automation Bundle targets is the intended durable approach for vessel_position_events_urban: it addresses the verified problem (vessel_position_events_urban job points to the dev catalog even after deploying with the production target) while preserving the required behavior (one codebase must deploy safely to different UC environments). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Inspect bundle variables, target overrides and resolved job config for vessel_position_events_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The vessel_position_events_urban workflow still requires that one codebase must deploy safely to different UC environments.
C:Diverging codebases defeat controlled promotion. The proposed action (Replace the Git code with a different unreviewed copy for every environment at Maritime safety agency) does not meet the requirement that one codebase must deploy safely to different UC environments, nor does it constitute the target approach.
D:Monitor wrong-target resource updates and inconsistent variables for vessel_position_events_urban would help detect future recurrence, but metrics alone do not deliver the target approach. The vessel_position_events_urban requirement is that one codebase must deploy safely to different UC environments.
Question 574
A data engineer at Wholesale produce exchange is responsible for trade settlement files. The compute workload selection issue is that an interactive notebook cluster runs trade_settlement_files_metro every minute even when analysts are offline. The supporting evidence is that billing shows idle all-purpose compute for a deterministic scheduled transformation. The engineer must ensure that the pipeline needs reproducible cost-controlled scheduled runs. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Verify scheduled execution succeeds and compute releases after the run
- Choose suitable job or serverless compute for the scheduled trade_settlement_files_metro task rather than an always-on interactive cluster
- Resize the interactive cluster to its maximum size and keep it on overnight at Wholesale produce exchange
- Migrate a limited workload to an automated job on the chosen compute
Explanation
Correct Answer
D:Migrate a limited workload to an automated job on the chosen compute provides a bounded way to introduce the approved solution into trade_settlement_files_metro and detect an early mismatch. The existing signal is billing shows idle all-purpose compute for a deterministic scheduled transformation; a staged change protects the service requirement (the pipeline needs reproducible cost-controlled scheduled runs) and makes rollback practical.
Incorrect Answers
A:Verify scheduled execution succeeds and compute releases after the run is a one-time acceptance check. It does not supply the controlled implementation step for trade_settlement_files_metro; a passing test cannot substitute for the specific task now required.
B:Choose suitable job or serverless compute for the scheduled trade_settlement_files_metro task rather than an always-on interactive cluster is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the trade_settlement_files_metro scenario, the observed evidence is that billing shows idle all-purpose compute for a deterministic scheduled transformation; the requirement remains: the pipeline needs reproducible cost-controlled scheduled runs.
C:Larger always-on interactive compute increases waste without fixing scheduling. The proposed action (Resize the interactive cluster to its maximum size and keep it on overnight at Wholesale produce exchange) does not meet the requirement that the pipeline needs reproducible cost-controlled scheduled runs, nor does it constitute the controlled implementation step.
Question 575
A data engineer at Clinical diagnostics network is responsible for lab sample events. The COPY INTO file format issue is that the lab_sample_events_urban import creates a single malformed column because input format settings are wrong. The supporting evidence is that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters. The engineer must ensure that all source columns must map to the intended typed Delta fields. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What is the safest migration or deployment sequence?
- Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network
- Test the file format on a small sample, then run the governed target load
- Compare parsed field count, null patterns and source record counts
- Choose COPY INTO with the correct CSV fileformat and source column mapping
Explanation
Correct Answer
B:Test the file format on a small sample, then run the governed target load provides a bounded way to introduce the approved solution into lab_sample_events_urban and detect an early mismatch. The existing signal is source inspection shows UTF-8 CSV with an explicit header and quoted delimiters; a staged change protects the service requirement (all source columns must map to the intended typed Delta fields) and makes rollback practical.
Incorrect Answers
A:The parser would misread the source schema rather than fix its mapping. The proposed action (Load comma-separated records with JSON parsing and suppress all errors at Clinical diagnostics network) does not meet the requirement that all source columns must map to the intended typed Delta fields, nor does it constitute the controlled implementation step.
C:Compare parsed field count, null patterns and source record counts is a one-time acceptance check. It does not supply the controlled implementation step for lab_sample_events_urban; a passing test cannot substitute for the specific task now required.
D:Choose COPY INTO with the correct CSV fileformat and source column mapping is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the lab_sample_events_urban scenario, the observed evidence is that source inspection shows UTF-8 CSV with an explicit header and quoted delimiters; the requirement remains: all source columns must map to the intended typed Delta fields.
Question 576
At Local government portal, the citizen service applications workflow depends on citizen_service_applications_west. Engineers report that citizen_service_applications_west needs a normalized discount amount but the pipeline overwrites the source field; the evidence is that code review shows an arithmetic expression replacing original gross_sales. They require that auditors require gross and net amounts independently. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Deploy the expression to silver with explicit numeric-type handling
- Inspect expression dependencies and column lineage for citizen_service_applications_west
- Overwrite the only gross amount and discard source values at Local government portal
- Check discount scenarios and verify both gross and net are correct
Explanation
Correct Answer
D:Check discount scenarios and verify both gross and net are correct directly tests the behavior that should change following the correction. With the observed evidence (code review shows an arithmetic expression replacing original gross_sales), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that auditors require gross and net amounts independently.
Incorrect Answers
A:Deploy the expression to silver with explicit numeric-type handling may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that code review shows an arithmetic expression replacing original gross_sales. Here, the relevant situation is: the citizen service applications workflow depends on citizen_service_applications_west. Engineers report that….
B:Inspect expression dependencies and column lineage for citizen_service_applications_west could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The citizen_service_applications_west workflow still requires that auditors require gross and net amounts independently.
C:Overwriting original financial evidence breaks reconciliation. The proposed action (Overwrite the only gross amount and discard source values at Local government portal) does not meet the requirement that auditors require gross and net amounts independently, nor does it constitute the post-change acceptance test.
Question 577
At Manufacturing quality network, the service principal data grants workflow handles factory defect records. The problem is that factory_defect_records_urban scheduled ingestion succeeds under one employee but fails under automation identity. Evidence: UC audit shows only the employee has the required table rights. Constraint: the job must operate under a managed nonhuman least-privilege principal. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Compare job run-as identity and catalog, schema and table grants for factory_defect_records_urban
- Monitor service principal grants and failed authentication for factory_defect_records_urban
- Share a workspace administrator's personal access token with all job owners at Manufacturing quality network
- Grant the required scoped privileges to an approved service principal
Explanation
Correct Answer
D:Grant the required scoped privileges to an approved service principal is the intended durable approach for factory_defect_records_urban: it addresses the verified problem (factory_defect_records_urban scheduled ingestion succeeds under one employee but fails under automation identity) while preserving the required behavior (the job must operate under a managed nonhuman least-privilege principal). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Compare job run-as identity and catalog, schema and table grants for factory_defect_records_urban could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The factory_defect_records_urban workflow still requires that the job must operate under a managed nonhuman least-privilege principal.
B:Monitor service principal grants and failed authentication for factory_defect_records_urban would help detect future recurrence, but metrics alone do not deliver the target approach. The factory_defect_records_urban requirement is that the job must operate under a managed nonhuman least-privilege principal.
C:Shared personal tokens are fragile and overprivileged. The proposed action (Share a workspace administrator's personal access token with all job owners at Manufacturing quality network) does not meet the requirement that the job must operate under a managed nonhuman least-privilege principal, nor does it constitute the target approach.
Question 578
The sampling_field_notes_urban pipeline at Environmental inspection office has this failure: an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline. The team observed that billing shows idle all-purpose compute for a deterministic scheduled transformation. Business requirement: the pipeline needs reproducible cost-controlled scheduled runs. The first acceptance run passed. The current task is to detect future regressions and changes over time. What should be tracked as an operational early warning?
- Watch idle compute costs and missed sampling_field_notes_urban job triggers
- Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster
- Verify scheduled execution succeeds and compute releases after the run
- Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office
Explanation
Correct Answer
A:Watch idle compute costs and missed sampling_field_notes_urban job triggers creates recurring visibility into the failure mode (an interactive notebook cluster runs sampling_field_notes_urban every minute even when analysts are offline). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the pipeline needs reproducible cost-controlled scheduled runs.
Incorrect Answers
B:Choose suitable job or serverless compute for the scheduled sampling_field_notes_urban task rather than an always-on interactive cluster is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the sampling_field_notes_urban scenario, the observed evidence is that billing shows idle all-purpose compute for a deterministic scheduled transformation; the requirement remains: the pipeline needs reproducible cost-controlled scheduled runs.
C:Verify scheduled execution succeeds and compute releases after the run is a one-time acceptance check. It does not supply continuing operational detection for sampling_field_notes_urban; a passing test cannot substitute for the specific task now required.
D:Larger always-on interactive compute increases waste without fixing scheduling. The proposed action (Resize the interactive cluster to its maximum size and keep it on overnight at Environmental inspection office) does not meet the requirement that the pipeline needs reproducible cost-controlled scheduled runs, nor does it constitute continuing operational detection.
Question 579
At Urban housing fund, the rental subsidy payments workflow depends on rental_subsidy_payments_east. Engineers report that a nightly load of rental_subsidy_payments_east repeats files from yesterday and developers fear duplicate inserts; the evidence is that the same object-storage folder is scanned on each scheduled run. They require that only new source files should be appended without reprocessing prior paths. The new approach is deployed. The current task is to prove correct output and authorized behavior, not just successful installation. Which post-change acceptance check is strongest?
- Run unconditional INSERT SELECT over the complete folder on every retry at Urban housing fund
- Schedule COPY INTO for rental_subsidy_payments_east and test a retry after successful ingestion
- Inspect file-level load history and path visibility for rental_subsidy_payments_east
- Rerun the command with unchanged files and verify row counts do not double
Explanation
Correct Answer
D:Rerun the command with unchanged files and verify row counts do not double directly tests the behavior that should change after the correction. With the observed evidence (the same object-storage folder is scanned on each scheduled run), the acceptance result must demonstrate actual data or permission correctness, while retaining the requirement that only new source files should be appended without reprocessing prior paths.
Incorrect Answers
A:A blind append can duplicate previously processed records. The proposed action (Run unconditional INSERT SELECT over the complete folder on every retry at Urban housing fund) does not meet the requirement that only new source files should be appended without reprocessing prior paths, nor does it constitute the post-change acceptance test.
B:Schedule COPY INTO for rental_subsidy_payments_east and test a retry after successful ingestion may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the post-change acceptance test, especially given the evidence that the same object-storage folder is scanned on each scheduled run.
C:Inspect file-level load history and path visibility for rental_subsidy_payments_east could clarify the original fault, but the available evidence already establishes its scope; it is not the post-change acceptance test now requested. The rental_subsidy_payments_east workflow still requires that only new source files should be appended without reprocessing prior paths.
Question 580
At Regional sporting venue, the Lakeflow Connect managed connector workflow handles admission scan events. The problem is that a admission_scan_events_metro enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler. Evidence: API tokens expire and source field names change without ingestion alerts. Constraint: the source must arrive in governed Delta tables with manageable credential rotation. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What governed target implementation should the engineer design?
- Monitor connector lag, source authentication errors and schema drift for admission_scan_events_metro
- Prefer a supported Lakeflow Connect managed connector with managed ingestion state
- Copy API secrets into a widely shared notebook and paste full responses manually at Regional sporting venue
- Assess managed connector source support, permissions and refresh semantics for admission_scan_events_metro
Explanation
Correct Answer
B:Prefer a supported Lakeflow Connect managed connector with managed ingestion state is the intended durable approach for admission_scan_events_metro: it addresses the verified problem (a admission_scan_events_metro enterprise SaaS table requires recurring ingestion but the team maintains a brittle custom API crawler) while preserving the required behavior (the source must arrive in governed Delta tables with manageable credential rotation). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor connector lag, source authentication errors and schema drift for admission_scan_events_metro would help detect future recurrence, but metrics alone do not deliver the target approach. The admission_scan_events_metro requirement is that the source must arrive in governed Delta tables with manageable credential rotation.
C:Shared secrets and manual copies do not provide reliable governed ingestion. The proposed action (Copy API secrets into a widely shared notebook and paste full responses manually at Regional sporting venue) does not meet the requirement that the source must arrive in governed Delta tables with manageable credential rotation, nor does it constitute the target approach.
D:Assess managed connector source support, permissions and refresh semantics for admission_scan_events_metro could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The admission_scan_events_metro workflow still requires that the source must arrive in governed Delta tables with manageable credential rotation.