Databricks Certified Data Engineer Professional Practice Test 57
Question 560
Operations at Westhaven Services owns a workload where a governance team investigates an unexpected table access event. The previously identified issue was: Workspace notebook logs do not show the full audited account activity. Which metric or audit check best detects drift?
- Alert on cost spikes and untagged spend
- Track alert evaluations and delivery failures
- Alert on freshness lag rather than only job failure
- Alert on unusual sensitive-object access patterns
Explanation
Correct Answer
D:Alert on unusual sensitive-object access patterns. This watches the failure mode described by workspace notebook logs do not show the full audited account activity. System audit tables provide security-relevant account events subject to access controls. It supplies a regression signal after remediation.
Incorrect Answers
A:Alert on cost spikes and untagged spend. This monitor action addresses a different case (billing usage monitoring), where cost reports omit some job and workspace labels. Databricks system billing tables can expose usage records for cost attribution. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
B:Monitor alert evaluations and delivery failures. This monitor action addresses a different case (sql alert threshold), where the current dashboard has no automated alert for missing units. SQL alerts can evaluate a query result against a configured threshold. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
C:Alert on freshness lag rather than only job failure. This monitor action addresses a different case (end-to-end sla), where operators monitor compute uptime rather than data freshness. SLA monitoring should measure source event time to published table availability. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
Question 561
At Westhaven Services, a new streaming pipeline revision causes wrong customer totals. A change was deployed to address: Deployers have no record of the previous working configuration. Which test result provides the strongest evidence that the requirement is now met?
- Confirm known-good logic and output metrics return without replay damage
- Submit a known broken transformation and confirm deployment is blocked
- Run the pipeline and confirm the previous error class does not recur
- Confirm the fix handles the record and leaves valid cases unchanged
Explanation
Correct Answer
A:Confirm known-good logic and output metrics return without replay damage. This tests the expected result against deployers have no record of the previous working configuration, not simply whether a job or object exists. Versioned bundle releases enable controlled rollback to a known commit.
Incorrect Answers
B:Submit a known broken transformation and confirm deployment is blocked. This validate action addresses a different case (ci quality gates), where the deployment pipeline only checks YAML syntax. CI must run transformation tests and controlled integration checks before deployment. In the stated problem, deployers have no record of the previous working configuration; this choice would not establish the required rollback deployment decision.
C:Run the pipeline and confirm the previous error class does not recur. This validate action addresses a different case (lakeflow event error classes), where the only visible dashboard status is FAILED without a dataset name. Pipeline event logs identify failing update and dataset messages. In the stated problem, deployers have no record of the previous working configuration; this choice would not establish the required rollback deployment decision.
D:Confirm the fix handles the record and leaves valid cases unchanged. This validate action addresses a different case (pipeline debug sampling), where re-running a huge source in development is slow and risky. A minimal reproducible input isolates the failure without modifying production data. In the stated problem, deployers have no record of the previous working configuration; this choice would not establish the required rollback deployment decision.
Question 562
An architecture review at Orion Capital covers a workload where account subscription tiers change over time and historical reports must reflect old tiers. The unresolved constraint is: A single current tier overwrites history in the dimension. Which design is most appropriate?
- Use immutable surrogate dimension keys mapped from source business IDs
- Model Type 2 records with effective intervals and current-row flag
- Plan an additive nullable dimension attribute with documented defaults
- Define a common country dimension with agreed identifiers and attributes
Explanation
Correct Answer
B:Model Type 2 records with effective intervals and current-row flag. This design addresses a single current tier overwrites history in the dimension. SCD Type 2 stores effective start/end intervals for distinct historical dimension versions. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Use immutable surrogate dimension keys mapped from source business IDs. This design action addresses a different case (surrogate dimension keys), where joining facts directly on mutable business IDs links history incorrectly. Stable surrogate keys decouple dimensional identity from changing source identifiers. In the stated problem, a single current tier overwrites history in the dimension; this choice would not establish the required scd type 2 effective dates decision.
C:Plan an additive nullable dimension attribute with documented defaults. This design action addresses a different case (dimension evolution), where a destructive table recreation would invalidate downstream consumers. Additive schema evolution can preserve contracts when null defaults are acceptable. In the stated problem, a single current tier overwrites history in the dimension; this choice would not establish the required scd type 2 effective dates decision.
D:Define a common country dimension with agreed identifiers and attributes. This design action addresses a different case (conformed dimensions), where the same country appears under conflicting dimension keys across marts. A conformed dimension provides common attribute definitions across fact models. In the stated problem, a single current tier overwrites history in the dimension; this choice would not establish the required scd type 2 effective dates decision.
Question 563
A data engineer at Bayview Insurance must troubleshoot this case: a transformation package is imported by several scheduled Databricks tasks. Evidence: A refactor broke a notebook-relative import in the deployed job. What should be inspected first to confirm the failure mechanism?
- Inspect dependency graph and upstream task statuses
- Inspect wheel tags, runtime Python version and library load error
- Inspect wheel contents, import paths and the task's installed package version
- Inspect task invocation mode and module entrypoint expectations
Explanation
Correct Answer
C:Inspect wheel contents, import paths and the task's installed package version. This checks the specific evidence behind a refactor broke a notebook-relative import in the deployed job. A properly packaged versioned wheel gives Python code stable import paths outside notebooks. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect dependency graph and upstream task statuses. This diagnose action addresses a different case (job task dag), where dependent tasks sometimes run before the bronze load finishes. Lakeflow Job task dependencies form a directed acyclic execution graph. In the stated problem, a refactor broke a notebook-relative import in the deployed job; this choice would not establish the required python wheel packaging decision.
B:Inspect wheel tags, runtime Python version and library load error. This diagnose action addresses a different case (wheel abi compatibility), where the wheel works on a developer laptop but fails with a binary compatibility error. Compiled extensions must match the target runtime platform and Python ABI. In the stated problem, a refactor broke a notebook-relative import in the deployed job; this choice would not establish the required python wheel packaging decision.
D:Inspect task invocation mode and module entrypoint expectations. This diagnose action addresses a different case (python task entrypoints), where the task exits before setting up its argument parser. A standard Python entrypoint and explicit arguments avoid notebook runtime assumptions. In the stated problem, a refactor broke a notebook-relative import in the deployed job; this choice would not establish the required python wheel packaging decision.
Question 564
At Fairhaven Transport, a finance team needs daily attribution of Databricks compute charges by workload. Observed issue: Cost reports omit some job and workspace labels. Before applying a fix, which investigation is most directly relevant?
- Inspect run intervals, executor utilization and billed usage
- Inspect query history for SQL text identity, duration and warehouse
- Inspect run status, task IDs and time windows in supported jobs system tables
- Inspect the relevant billing usage system table and available tags
Explanation
Correct Answer
D:Inspect the relevant billing usage system table and available tags. This checks the specific evidence behind cost reports omit some job and workspace labels. Databricks system billing tables can expose usage records for cost attribution. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect run intervals, executor utilization and billed usage. This diagnose action addresses a different case (compute utilization), where most provisioned resources sit idle between job runs. Compute metrics and usage history distinguish idle capacity from active work. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
B:Inspect query history for SQL text identity, duration and warehouse. This diagnose action addresses a different case (sql query history), where no baseline is available for the warehouse query execution. Query history/system query records support comparison of execution time and workload. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
C:Inspect run status, task IDs and time windows in supported jobs system tables. This diagnose action addresses a different case (job operational history), where operators only see the most recent run in the Jobs UI. Jobs system records support historical analysis of runs and tasks. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
Question 565
At Westridge Research, many Unity Catalog managed tables require routine maintenance. Architecture constraint: Operators run blanket manual OPTIMIZE jobs regardless of table use. Which design best addresses this requirement?
- Use predictive optimization on supported managed Delta tables
- Use supported AQE with appropriate shuffle and join settings
- Collect useful statistics for frequently filtered columns within supported limits
- Choose a supported columnar Delta or Parquet layout for analytics
Explanation
Correct Answer
A:Use predictive optimization on supported managed Delta tables. This design addresses operators run blanket manual OPTIMIZE jobs regardless of table use. Predictive optimization can automate supported managed-table maintenance based on workload signals. It establishes the right contract or architecture before execution changes.
Incorrect Answers
B:Use supported AQE with appropriate shuffle and join settings. This design action addresses a different case (adaptive execution), where static join strategy performs poorly at varying input volumes. Adaptive Query Execution can adjust supported shuffle partitions and join strategies at runtime. In the stated problem, operators run blanket manual OPTIMIZE jobs regardless of table use; this choice would not establish the required predictive optimization decision.
C:Collect useful statistics for frequently filtered columns within supported limits. This design action addresses a different case (data skipping statistics), where file-level statistics are missing for the filter column. Delta data skipping uses collected column statistics to eliminate files. In the stated problem, operators run blanket manual OPTIMIZE jobs regardless of table use; this choice would not establish the required predictive optimization decision.
D:Choose a supported columnar Delta or Parquet layout for analytics. This design action addresses a different case (columnar compression), where row-oriented text storage increases scans and transfer volumes. Columnar formats and appropriate encoding improve analytical read efficiency. In the stated problem, operators run blanket manual OPTIMIZE jobs regardless of table use; this choice would not establish the required predictive optimization decision.
Question 566
At Summit Consumer Goods, a CDC feed contains inserts, updates and deletes for account records. A change was deployed to address: Applying events as append-only rows leaves outdated active accounts. Which test result provides the strongest evidence that the requirement is now met?
- Replay representative late events and verify expected acceptance or exclusion
- Replay update and delete events and confirm one accurate current row per key
- Replay a batch ID and confirm target rows are not duplicated
- Append new files and confirm only new input is processed under checkpoint tracking
Explanation
Correct Answer
B:Replay update and delete events and confirm one accurate current row per key. This tests the expected result against applying events as append-only rows leaves outdated active accounts, not simply whether a job or object exists. AUTO CDC or applicable APPLY CHANGES needs stable keys and sequence ordering for stateful upserts.
Incorrect Answers
A:Replay representative late events and verify expected acceptance or exclusion. This validate action addresses a different case (late event semantics), where reports silently discard legitimate late events under an aggressive watermark. A watermark trades supported lateness for state size and timeliness. In the stated problem, applying events as append-only rows leaves outdated active accounts; this choice would not establish the required auto cdc keys decision.
C:Replay a batch ID and confirm target rows are not duplicated. This validate action addresses a different case (streaming idempotent sink), where a retry of a completed batch produces duplicate sink rows. foreachBatch can execute a batch again and requires idempotent external writes for exactly-once effects. In the stated problem, applying events as append-only rows leaves outdated active accounts; this choice would not establish the required auto cdc keys decision.
D:Append new files and confirm only new input is processed under checkpoint tracking. This validate action addresses a different case (streaming table choice), where periodic full-refresh queries miss required incremental freshness. A streaming table tracks continuously arriving source data incrementally. In the stated problem, applying events as append-only rows leaves outdated active accounts; this choice would not establish the required auto cdc keys decision.
Question 567
Operations at Westridge Research owns a workload where a gold revenue table shows a monthly discrepancy. The previously identified issue was: Investigators cannot tell which upstream transformation produced it. Which metric or audit check best detects drift?
- Track ownership transfers and stale personal owners
- Monitor unexpected new tables entering the governed schema
- Monitor new unapproved lineage dependencies
- Audit unapproved external paths and location changes
Explanation
Correct Answer
C:Monitor new unapproved lineage dependencies. This watches the failure mode described by investigators cannot tell which upstream transformation produced it. Unity Catalog lineage records relationships between governed data assets. It supplies a regression signal after remediation.
Incorrect Answers
A:Monitor ownership transfers and stale personal owners. This monitor action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
B:Monitor unexpected new tables entering the governed schema. This monitor action addresses a different case (schema-level grant inheritance), where analysts must repeatedly request identical SELECT grants for each table. Unity Catalog schema-level privileges can apply to existing and future child objects. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
D:Audit unapproved external paths and location changes. This monitor action addresses a different case (managed storage ownership), where the data platform cannot apply consistent lifecycle governance. Managed locations centralize storage ownership for Unity Catalog managed assets. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
Question 568
At Pinecrest Holdings, a compliance export should exclude free-text notes containing PII. Observed issue: A broad SELECT still includes unstructured notes. Before applying a fix, which investigation is most directly relevant?
- Inspect consumer business need and raw table grants
- Inspect notebook and folder ACLs for broad edit permissions
- Inspect user identity mapping and current filter-policy attachment
- Inspect the approved export schema against current selected columns
Explanation
Correct Answer
D:Inspect the approved export schema against current selected columns. This checks the specific evidence behind a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect consumer business need and raw table grants. This diagnose action addresses a different case (secure view sharing), where granting SELECT on the raw fact table violates minimization. A governed aggregation view can expose only approved derived information. In the stated problem, a broad SELECT still includes unstructured notes; this choice would not establish the required sensitive data suppression decision.
B:Inspect notebook and folder ACLs for broad edit permissions. This diagnose action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, a broad SELECT still includes unstructured notes; this choice would not establish the required sensitive data suppression decision.
C:Inspect user identity mapping and current filter-policy attachment. This diagnose action addresses a different case (unity catalog row filter), where a shared table currently returns all regions to every reader. Unity Catalog row filters can restrict row visibility through governed policies. In the stated problem, a broad SELECT still includes unstructured notes; this choice would not establish the required sensitive data suppression decision.
Question 569
At Cedar Brook Commerce, a job should run data repair only after a quality check reports failure. A change was deployed to address: Both the normal and repair tasks run despite a branching requirement. Which test result provides the strongest evidence that the requirement is now met?
- Simulate passing and failing checks and verify only the intended path runs
- Run the workflow while the author is inactive and verify intended access
- Observe a Spark job only after the action runs
- Inject malformed and null cases and verify tests fail correctly
Explanation
Correct Answer
A:Simulate passing and failing checks and verify only the intended path runs. This tests the expected result against both the normal and repair tasks run despite a branching requirement, not simply whether a job or object exists. Lakeflow Jobs condition tasks can route downstream execution based on a result.
Incorrect Answers
B:Run the workflow while the author is inactive and verify intended access. This validate action addresses a different case (job run-as identity), where an employee departure causes permissions failures during scheduled runs. A stable least-privilege service principal can provide durable job identity. In the stated problem, both the normal and repair tasks run despite a branching requirement; this choice would not establish the required conditional task branches decision.
C:Observe a Spark job only after the action runs. This validate action addresses a different case (spark lazy evaluation), where engineers assume an intermediate filter executed before any action. Spark transformations are lazy until an action triggers a job. In the stated problem, both the normal and repair tasks run despite a branching requirement; this choice would not establish the required conditional task branches decision.
D:Inject malformed and null cases and verify tests fail correctly. This validate action addresses a different case (dataframe testing), where tests only assert that the DataFrame is nonempty. DataFrame equality and schema assertions test data behavior and contracts. In the stated problem, both the normal and repair tasks run despite a branching requirement; this choice would not establish the required conditional task branches decision.
Question 570
Quality assurance at Redwood Civic Services checks a corrected workload where a slow query uses a complex chain of joins and projections. The original fault was: Developers tune executor size without inspecting actual exchanges. Which verification is most decisive?
- Confirm dashboard results refresh after source data updates
- Confirm target exchange or join behavior changed and query results remain equivalent
- Confirm deployment reflects the reviewed configuration without extra changes
- Replay a batch ID and confirm target rows are not duplicated
Explanation
Correct Answer
B:Confirm target exchange or join behavior changed and query results remain equivalent. This tests the expected result against developers tune executor size without inspecting actual exchanges, not simply whether a job or object exists. The physical execution plan exposes exchanges, scan filters and join strategy.
Incorrect Answers
A:Confirm dashboard results refresh after source data updates. This validate action addresses a different case (materialized view choice), where each dashboard query recomputes the same expensive aggregation. A materialized view maintains a precomputed query result through refresh. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.
C:Confirm deployment reflects the reviewed configuration without extra changes. This validate action addresses a different case (databricks cli resource updates), where production configuration drifts from repository source definitions. Declarative deployment describes resources as reviewed version-controlled artifacts. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.
D:Replay a batch ID and confirm target rows are not duplicated. This validate action addresses a different case (streaming idempotent sink), where a retry of a completed batch produces duplicate sink rows. foreachBatch can execute a batch again and requires idempotent external writes for exactly-once effects. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.