Databricks Certified Data Engineer Associate Practice Test 49
Question 480
Consider the sampling_field_notes_north workload at Environmental inspection office: sampling_field_notes_north reporting team plans to drop a UC-managed table but needs its data files retained. Inspection found that table ownership review shows storage lifecycle controlled by Unity Catalog. The governed outcome must ensure that a cleanup must not accidentally delete retained source data. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which evidence-gathering action should precede an architectural change?
- Move to approved external storage only through a supported governed migration
- Assume managed and external tables always have identical drop semantics at Environmental inspection office
- Choose managed or external table lifecycle deliberately for the retention requirement
- Inspect table type, location and intended retention before dropping sampling_field_notes_north
Explanation
Correct Answer
D:Inspect table type, location and intended retention before dropping sampling_field_notes_north directly investigates the evidence (table ownership review shows storage lifecycle controlled by Unity Catalog) and distinguishes possible causes of sampling_field_notes_north reporting team plans to drop a UC-managed table but needs its data files retained. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: a cleanup must not accidentally delete retained source data.
Incorrect Answers
A:Move to approved external storage only through a supported governed migration may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that table ownership review shows storage lifecycle controlled by Unity Catalog.
B:Uc table type affects ownership and managed data lifecycle. The proposed action (Assume managed and external tables always have identical drop semantics at Environmental inspection office) does not meet the requirement that a cleanup must not accidentally delete retained source data, nor does it constitute the required pre-change investigation.
C:Choose managed or external table lifecycle deliberately for the retention requirement is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the sampling_field_notes_north scenario, the observed evidence is that table ownership review shows storage lifecycle controlled by Unity Catalog; the requirement remains: a cleanup must not accidentally delete retained source data.
Question 481
At Environmental inspection office, the sampling field notes workflow depends on sampling_field_notes_west. Engineers report that sampling_field_notes_west combines regional extracts but normal UNION removes rows that are legitimately identical across different source batches; the evidence is that sample data includes repeated values where batch lineage distinguishes observations. They require that the target must preserve all source rows for audit. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. Which platform or PySpark choice best fits the stated semantics?
- Use UNION DISTINCT and assume it preserves every source row at Environmental inspection office
- Use UNION ALL when duplicates must be retained and add a batch identifier
- Monitor row-count reconciliation and unintended dedup for sampling_field_notes_west
- Inspect expected duplicate semantics and lineage keys for sampling_field_notes_west
Explanation
Correct Answer
B:Use UNION ALL when duplicates must be retained and add a batch identifier is the intended durable approach for sampling_field_notes_west: it addresses the verified problem (sampling_field_notes_west combines regional extracts but normal UNION removes rows that are legitimately identical across different source batches) while preserving the required behavior (the target must preserve all source rows for audit). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Set union removes duplicates and can lose genuine repeated observations. The proposed action (Use UNION DISTINCT and assume it preserves every source row at Environmental inspection office) does not meet the requirement that the target must preserve all source rows for audit, nor does it constitute the target approach.
C:Monitor row-count reconciliation and unintended dedup for sampling_field_notes_west would help detect future recurrence, but metrics alone do not deliver the target approach. The sampling_field_notes_west requirement is that the target must preserve all source rows for audit.
D:Inspect expected duplicate semantics and lineage keys for sampling_field_notes_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The sampling_field_notes_west workflow still requires that the target must preserve all source rows for audit.
Question 482
At Regional sporting venue, the secret handling in bundle config workflow handles admission scan events. The problem is that admission_scan_events_west automation configuration contains an API password committed to Git. Evidence: repository scan detects a plaintext production secret in bundle variables. Constraint: configuration must remain reproducible without exposing secrets. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Reference approved secret storage or injected CI variables rather than plaintext passwords
- Scan the repo and deploy in staging to verify secrets are not printed
- Hide the password by renaming its variable key at Regional sporting venue
- Revoke exposed credentials and replace config with secure references
Explanation
Correct Answer
D:Revoke exposed credentials and replace config with secure references provides a bounded way to introduce the approved solution into admission_scan_events_west and detect an early mismatch. The existing signal is repository scan detects a plaintext production secret in bundle variables; a staged change protects the service requirement (configuration must remain reproducible without exposing secrets) and makes rollback practical.
Incorrect Answers
A:Reference approved secret storage or injected CI variables rather than plaintext passwords is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the admission_scan_events_west scenario, the observed evidence is that repository scan detects a plaintext production secret in bundle variables; the requirement remains: configuration must remain reproducible without exposing secrets.
B:Scan the repo and deploy in staging to verify secrets are not printed is a one-time acceptance check. It does not supply the controlled implementation step for admission_scan_events_west; a passing test cannot substitute for the specific task now required.
C:Renaming a plaintext secret does not protect it. The proposed action (Hide the password by renaming its variable key at Regional sporting venue) does not meet the requirement that configuration must remain reproducible without exposing secrets, nor does it constitute the controlled implementation step.
Question 483
The pipeline_flow_metrics_urban pipeline at Public water district has this failure: engineers refer to pipeline_flow_metrics_urban by an ambiguous two-part name and access the wrong environment. The team observed that the same schema and table names exist under development and production catalogs. Business requirement: code must resolve a single governed production object. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. What should be done next to deploy the approved solution?
- Resolve the intended table from the job identity and confirm prod/development isolation
- Change the pipeline to explicit three-level names and test in a staging job
- Use catalog.schema.table identifiers with explicit Unity Catalog ownership
- Depend on each user's default catalog to identify the production table at Public water district
Explanation
Correct Answer
B:Change the pipeline to explicit three-level names and test in a staging job provides a bounded way to introduce the approved solution into pipeline_flow_metrics_urban and detect an early mismatch. The existing signal is the same schema and table names exist under development and production catalogs; a staged change protects the service requirement (code must resolve a single governed production object) and makes rollback practical.
Incorrect Answers
A:Resolve the intended table from the job identity and confirm prod/development isolation is a one-time acceptance check. It does not supply the controlled implementation step for pipeline_flow_metrics_urban; a passing test cannot substitute for the specific task now required.
C:Use catalog.schema.table identifiers with explicit Unity Catalog ownership is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the pipeline_flow_metrics_urban scenario, the observed evidence is that the same schema and table names exist under development and production catalogs; the requirement remains: code must resolve a single governed production object.
D:Implicit current-catalog resolution makes production writes ambiguous. The proposed action (Depend on each user's default catalog to identify the production table at Public water district) does not meet the requirement that code must resolve a single governed production object, nor does it constitute the controlled implementation step.
Question 484
At Community energy cooperative, the column masking PII workflow handles smart meter readings. The problem is that smart_meter_readings_delta table exposes national IDs to analysts who need only transaction amounts. Evidence: query review shows raw identifier values in common reports. Constraint: users without an approved role must see masked sensitive columns. The first acceptance run passed. The current task is to detect future regressions and changes over time. Which monitoring approach will detect newly emerging defects?
- Query the same column as privileged and unprivileged groups
- Rename identifier column to a harmless label while leaving values visible at Community energy cooperative
- Monitor new PII columns, mask failures and unapproved policy changes for smart_meter_readings_delta
- Apply Unity Catalog column masks or suitable centrally governed masking policy
Explanation
Correct Answer
C:Monitor new PII columns, mask failures and unapproved policy changes for smart_meter_readings_delta creates recurring visibility into the failure mode (smart_meter_readings_delta table exposes national IDs to analysts who need only transaction amounts). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while users without an approved role must see masked sensitive columns.
Incorrect Answers
A:Query the same column as privileged and unprivileged groups is a one-time acceptance check. It does not supply continuing operational detection for smart_meter_readings_delta; a passing test cannot substitute for the specific task now required.
B:Renaming a column does not protect its contents. The proposed action (Rename identifier column to a harmless label while leaving values visible at Community energy cooperative) does not meet the requirement that users without an approved role must see masked sensitive columns, nor does it constitute continuing operational detection.
D:Apply Unity Catalog column masks or suitable centrally governed masking policy is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the smart_meter_readings_delta scenario, the observed evidence is that query review shows raw identifier values in common reports; the requirement remains: users without an approved role must see masked sensitive columns.
Question 485
At International language school, the REST pagination and retries workflow handles class enrollment data. The problem is that the class_enrollment_data_delta partner API returns 100 rows per page but the batch stores only the first page. Evidence: response metadata includes a next cursor that the client ignores. Constraint: all authorized records must be imported without exceeding API limits. The target approach is approved. The current task is to introduce it safely with bounded scope and rollback. Which change can be introduced with minimal production risk?
- Compare source advertised total and destination distinct IDs after a full pull
- Stop after one successful HTTP 200 response at International language school
- Implement cursor pagination with bounded retries and idempotent destination keys
- Test pagination on a multi-page source with backoff for HTTP 429
Explanation
Correct Answer
D:Test pagination on a multi-page source with backoff for HTTP 429 provides a bounded way to introduce the approved solution into class_enrollment_data_delta and detect an early mismatch. The existing signal is response metadata includes a next cursor that the client ignores; a staged change protects the service requirement (all authorized records must be imported without exceeding API limits) and makes rollback practical.
Incorrect Answers
A:Compare source advertised total and destination distinct IDs after a full pull is a one-time acceptance check. It does not supply the controlled implementation step for class_enrollment_data_delta; a passing test cannot substitute for the specific task now required.
B:A successful first page does not establish completeness. The proposed action (Stop after one successful HTTP 200 response at International language school) does not meet the requirement that all authorized records must be imported without exceeding API limits, nor does it constitute the controlled implementation step.
C:Implement cursor pagination with bounded retries and idempotent destination keys is a plausible lasting design once chosen, but it does not perform the controlled implementation step at this stage. In the class_enrollment_data_delta scenario, the observed evidence is that response metadata includes a next cursor that the client ignores; the requirement remains: all authorized records must be imported without exceeding API limits.
Question 486
The product_sales_transactions_island pipeline at Online bicycle retailer has this failure: product_sales_transactions_island job fails after a Python library upgrade despite unchanged notebook code. The team observed that driver logs show incompatible package versions imported at startup. Business requirement: dependency versions must be reproducible across production runs. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Monitor library drift and import failures for product_sales_transactions_island
- Pin compatible library versions with supported compute/runtime environment
- Compare installed libraries, runtime version and import trace for product_sales_transactions_island
- Install random latest packages on shared production compute at Online bicycle retailer
Explanation
Correct Answer
B:Pin compatible library versions with supported compute/runtime environment is the intended durable approach for product_sales_transactions_island: it addresses the verified problem (product_sales_transactions_island job fails after a Python library upgrade despite unchanged notebook code) while preserving the required behavior (dependency versions must be reproducible across production runs). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
A:Monitor library drift and import failures for product_sales_transactions_island would help detect future recurrence, but metrics alone do not deliver the target approach. The product_sales_transactions_island requirement is that dependency versions must be reproducible across production runs.
C:Compare installed libraries, runtime version and import trace for product_sales_transactions_island could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The product_sales_transactions_island workflow still requires that dependency versions must be reproducible across production runs.
D:Uncontrolled upgrades can introduce new incompatibilities. The proposed action (Install random latest packages on shared production compute at Online bicycle retailer) does not meet the requirement that dependency versions must be reproducible across production runs, nor does it constitute the target approach.
Question 487
A data engineer at Manufacturing quality network is responsible for factory defect records. The bundle deployment resource promotion issue is that factory_defect_records_delta pipeline configuration exists only in one engineer's workspace UI. The supporting evidence is that releasing to test requires manual reconstruction of tasks. The engineer must ensure that the same versioned workload definitions must deploy to multiple targets. The first acceptance run passed. The current task is to detect future regressions and changes over time. What repeatable measure detects this failure after go-live?
- Monitor resource drift and unmanaged manually edited production jobs for factory_defect_records_delta
- Recreate every task manually with different values in each environment at Manufacturing quality network
- Package supported jobs and pipelines as Declarative Automation Bundle resources
- Compare deployed resource properties and run results to the approved bundle
Explanation
Correct Answer
A:Monitor resource drift and unmanaged manually edited production jobs for factory_defect_records_delta creates recurring visibility into the failure mode (factory_defect_records_delta pipeline configuration exists only in one engineer's workspace UI). Unlike a single successful test, the measure can reveal drift, lag, or new failures after later source and deployment changes while the same versioned workload definitions must deploy to multiple targets.
Incorrect Answers
B:Manual recreation invites hidden differences and unreproducible releases. The proposed action (Recreate every task manually with different values in each environment at Manufacturing quality network) does not meet the requirement that the same versioned workload definitions must deploy to multiple targets, nor does it constitute continuing operational detection.
C:Package supported jobs and pipelines as Declarative Automation Bundle resources is a plausible lasting design once chosen, but it does not perform continuing operational detection at this stage. In the factory_defect_records_delta scenario, the observed evidence is that releasing to test requires manual reconstruction of tasks; the requirement remains: the same versioned workload definitions must deploy to multiple targets.
D:Compare deployed resource properties and run results to the approved bundle is a one-time acceptance check. It does not supply continuing operational detection for factory_defect_records_delta; a passing test cannot substitute for the specific task now required.
Question 488
At Online apparel cooperative, the customer order changes workflow depends on customer_order_changes_delta. Engineers report that a raw Parquet copy of customer_order_changes_delta is mistaken for a complete Delta table; the evidence is that the copied directory lacks _delta_log while Delta history queries fail. They require that restoration needs the committed schema and transaction history. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. Which pre-change diagnostic will resolve the uncertainty?
- Check customer_order_changes_delta path for the Delta log, data files and version metadata
- Use a supported backup or clone workflow and test restore in isolation
- Copy only a selection of Parquet part files and declare the transaction log unnecessary at Online apparel cooperative
- Preserve the Delta table log together with supported table data and metadata
Explanation
Correct Answer
A:Check customer_order_changes_delta path for the Delta log, data files and version metadata directly investigates the evidence (the copied directory lacks _delta_log while Delta history queries fail) and distinguishes possible causes of a raw Parquet copy of customer_order_changes_delta is mistaken for a complete Delta table. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: restoration needs the committed schema and transaction history.
Incorrect Answers
B:Use a supported backup or clone workflow and test restore in isolation may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that the copied directory lacks _delta_log while Delta history queries fail. Here, the relevant situation is: the customer order changes workflow depends on customer_order_changes_delta. Engineers report that a raw Parquet….
C:Data files alone do not preserve delta transactional history. The proposed action (Copy only a selection of Parquet part files and declare the transaction log unnecessary at Online apparel cooperative) does not meet the requirement that restoration needs the committed schema and transaction history, nor does it constitute the required pre-change investigation.
D:Preserve the Delta table log together with supported table data and metadata is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the customer_order_changes_delta scenario, the observed evidence is that the copied directory lacks _delta_log while Delta history queries fail; the requirement remains: restoration needs the committed schema and transaction history.
Question 489
The pipeline_flow_metrics_west pipeline at Public water district has this failure: pipeline_flow_metrics_west Delta table suffers frequent filter-pattern changes and costly partition rewrites. The team observed that workload history alternates date and customer search predicates across teams. Business requirement: layout optimization must adapt without a rigid proliferating partition tree. The failure and requirements have been diagnosed; the team must select the lasting pipeline or governance approach. What lasting solution should be selected for the verified conditions?
- Consider Liquid Clustering on appropriate columns with supported table features
- Create thousands of tiny static partitions for every possible predicate at Public water district
- Profile common filters, table size and clustering support for pipeline_flow_metrics_west
- Monitor clustering maintenance costs and changing query predicates for pipeline_flow_metrics_west
Explanation
Correct Answer
A:Consider Liquid Clustering on appropriate columns with supported table features is the intended durable approach for pipeline_flow_metrics_west: it addresses the verified problem (pipeline_flow_metrics_west Delta table suffers frequent filter-pattern changes and costly partition rewrites) while preserving the required behavior (layout optimization must adapt without a rigid proliferating partition tree). A diagnostic or monitoring step alone would not create this target-state behavior.
Incorrect Answers
B:Overpartitioning drives metadata overhead and inflexible layout. The proposed action (Create thousands of tiny static partitions for every possible predicate at Public water district) does not meet the requirement that layout optimization must adapt without a rigid proliferating partition tree, nor does it constitute the target approach.
C:Profile common filters, table size and clustering support for pipeline_flow_metrics_west could clarify the original fault, but the available evidence already establishes its scope; it is not the target approach now requested. The pipeline_flow_metrics_west workflow still requires that layout optimization must adapt without a rigid proliferating partition tree.
D:Monitor clustering maintenance costs and changing query predicates for pipeline_flow_metrics_west would help detect future recurrence, but metrics alone do not deliver the target approach. The pipeline_flow_metrics_west requirement is that layout optimization must adapt without a rigid proliferating partition tree.
Question 490
The pollution_measurements_urban pipeline at Air quality nonprofit has this failure: pollution_measurements_urban former intern still reads a sensitive table after leaving the team. The team observed that UC audit shows the intern belongs to a group with lingering SELECT privilege. Business requirement: departed identities must lose data access promptly. The team has not selected a remedy. It first needs evidence that distinguishes the actual dependency or data fault. What should the engineer inspect to establish the failure mechanism?
- Remove inappropriate group privileges or membership while keeping service access
- Trace effective access through group memberships and inherited grants for pollution_measurements_urban
- Rename the sensitive table instead of revoking access at Air quality nonprofit
- Revoke access in controlled scope and test authorized user continuity
Explanation
Correct Answer
B:Trace effective access through group memberships and inherited grants for pollution_measurements_urban directly investigates the evidence (UC audit shows the intern belongs to a group with lingering SELECT privilege) and distinguishes possible causes of pollution_measurements_urban former intern still reads a sensitive table after leaving the team. It establishes what must be corrected without assuming a fix before verifying the stated business requirement: departed identities must lose data access promptly.
Incorrect Answers
A:Remove inappropriate group privileges or membership while keeping service access is a plausible lasting design once chosen, but it does not perform the required pre-change investigation at this stage. In the pollution_measurements_urban scenario, the observed evidence is that UC audit shows the intern belongs to a group with lingering SELECT privilege; the requirement remains: departed identities must lose data access promptly.
C:Renaming an object is not an access-control boundary. The proposed action (Rename the sensitive table instead of revoking access at Air quality nonprofit) does not meet the requirement that departed identities must lose data access promptly, nor does it constitute the required pre-change investigation.
D:Revoke access in controlled scope and test authorized user continuity may introduce a correction, but the question does not ask for installation or migration. A rollout alone cannot replace the required pre-change investigation, especially given the evidence that UC audit shows the intern belongs to a group with lingering SELECT privilege.