Databricks Certified Data Engineer Professional Practice Test 21
Question 200
A deployment owner at Silver Ridge Logistics needs to implement a remedy: developers need to test pipeline code without altering production governance controls. The present failure is: All developers currently own production catalogs and can grant access. Which change should be applied?
- Set up the approved network access control for the workspace
- Remove overly broad edit access and grant view permission to readers
- Grant only required read privileges on the external location
- Revoke unnecessary production ownership and grant task-specific roles
Explanation
Correct Answer
D:Revoke unnecessary production ownership and grant task-specific roles. This directly changes the feature or logic behind all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Configure the approved network access control for the workspace. This implement action addresses a different case (ip-based workspace restrictions), where a Unity Catalog table grant does not restrict web-console network entry. Workspace access controls and data-object privileges address different security layers. In the stated problem, all developers currently own production catalogs and can grant access; this choice would not establish the required separation of duties decision.
B:Remove overly broad edit access and grant view permission to readers. This implement action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, all developers currently own production catalogs and can grant access; this choice would not establish the required separation of duties decision.
C:Grant only required read privileges on the external location. This implement action addresses a different case (storage credential scope), where engineers propose a credential allowing access to all company buckets. Unity Catalog storage credentials and external locations can constrain storage access. In the stated problem, all developers currently own production catalogs and can grant access; this choice would not establish the required separation of duties decision.
Question 201
At Bayview Insurance, a small reference DataFrame is reused many times within one batch job. Observed issue: Repeated recomputation dominates each branch's execution. Before applying a fix, which investigation is most directly relevant?
- Inspect repeated lineage and memory availability for the reference data
- Inspect compute capabilities and supported physical plan operators
- Inspect table ownership and whether external storage paths are actually required
- Inspect job task support, runtime constraints and cluster startup times
Explanation
Correct Answer
A:Inspect repeated lineage and memory availability for the reference data. This checks the specific evidence behind repeated recomputation dominates each branch's execution. Persistence can avoid repeated work if reused data fits the memory budget. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
B:Inspect compute capabilities and supported physical plan operators. This diagnose action addresses a different case (photon query execution), where an unsupported execution mode limits vectorized engine use. Photon can accelerate supported SQL and DataFrame operators on compatible compute. In the stated problem, repeated recomputation dominates each branch's execution; this choice would not establish the required cache reuse decision.
C:Inspect table ownership and whether external storage paths are actually required. This diagnose action addresses a different case (managed table maintenance), where each table has custom file cleanup jobs and broad storage permissions. Unity Catalog managed tables provide platform-managed data placement and maintenance capabilities. In the stated problem, repeated recomputation dominates each branch's execution; this choice would not establish the required cache reuse decision.
D:Inspect job task support, runtime constraints and cluster startup times. This diagnose action addresses a different case (serverless job fit), where provisioning overhead exceeds useful task execution time. Supported serverless jobs can reduce infrastructure management and startup overhead. In the stated problem, repeated recomputation dominates each branch's execution; this choice would not establish the required cache reuse decision.
Question 202
A data engineer at Arbor Medical must troubleshoot this case: business users cannot distinguish certified customer metrics from experimental tables. Evidence: Table and column metadata lack meaningful descriptions. What should be inspected first to confirm the failure mechanism?
- Inspect notebook defaults and catalog settings for both environments
- Inspect asset comments and ownership for critical reporting tables
- Inspect the available information_schema tables and caller grants
- Inspect current owner and authorized ownership transfer process
Explanation
Correct Answer
B:Inspect asset comments and ownership for critical reporting tables. This checks the specific evidence behind table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect notebook defaults and catalog settings for both environments. This diagnose action addresses a different case (environment catalog isolation), where both environments use the same default catalog name in notebooks. Environment-specific catalogs and explicit target names reduce cross-environment writes. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
C:Inspect the available information_schema tables and caller grants. This diagnose action addresses a different case (information schema discovery), where it uses notebook-specific private metadata APIs that break after upgrades. INFORMATION_SCHEMA provides SQL metadata views subject to visibility permissions. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
D:Inspect current owner and authorized ownership transfer process. This diagnose action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
Question 203
At Arbor Medical, a Spark transformation produces incorrect null handling after a refactor. Architecture constraint: Tests only assert that the DataFrame is nonempty. Which design best addresses this requirement?
- Refactor business rules as pure DataFrame transform functions
- Use one managed and repeatable dependency source for the workload
- Add representative expected DataFrame fixtures and schema assertions
- Separate fast local DataFrame unit tests from targeted integration suites
Explanation
Correct Answer
C:Add representative expected DataFrame fixtures and schema assertions. This design addresses tests only assert that the DataFrame is nonempty. DataFrame equality and schema assertions test data behavior and contracts. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Refactor business rules as pure DataFrame transform functions. This design action addresses a different case (transform composability), where business logic depends on notebook state and widgets. DataFrame.transform supports composable DataFrame-to-DataFrame functions. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
B:Use one managed and repeatable dependency source for the workload. This design action addresses a different case (library precedence), where a notebook-scoped installation overrides the expected cluster version. The runtime can resolve conflicting versions from different installation scopes. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
D:Separate fast local DataFrame unit tests from targeted integration suites. This design action addresses a different case (unit versus integration tests), where small logic regressions are discovered late and costly to debug. Unit tests isolate transformations while integration tests validate external contracts. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
Question 204
A data engineer at Westridge Research must troubleshoot this case: a sales fact table mixes order-level rows with order-line-level rows. Evidence: Summing revenue double-counts orders with multiple items. What should be inspected first to confirm the failure mechanism?
- Inspect table grains and dimension join paths used by reports
- Inspect membership cardinalities and duplicated fact amounts
- Inspect fact query predicates and current data-skipping statistics
- Inspect fact primary keys and duplicates at candidate grains
Explanation
Correct Answer
D:Inspect fact primary keys and duplicates at candidate grains. This checks the specific evidence behind summing revenue double-counts orders with multiple items. A dimensional fact must have one clearly documented row grain. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect table grains and dimension join paths used by reports. This diagnose action addresses a different case (star schema analytics), where a denormalized mixed-grain table produces redundant attributes and expensive corrections. A star schema links a clear-grain fact to reusable dimensions for consistent analytics. In the stated problem, summing revenue double-counts orders with multiple items; this choice would not establish the required fact table grain decision.
B:Inspect membership cardinalities and duplicated fact amounts. This diagnose action addresses a different case (many-to-many bridge), where joining facts directly to the membership table multiplies totals. A bridge table models many-to-many relationships at an explicit membership grain. In the stated problem, summing revenue double-counts orders with multiple items; this choice would not establish the required fact table grain decision.
C:Inspect fact query predicates and current data-skipping statistics. This diagnose action addresses a different case (liquid clustering for fact models), where rigid daily partitions offer little pruning for customer filters. Liquid clustering enables query-aware data layout without high-cardinality partitioning. In the stated problem, summing revenue double-counts orders with multiple items; this choice would not establish the required fact table grain decision.
Question 205
At Riverbend Energy, two data science teams must join events without exposing raw customer IDs. The known risk is: A naive hash without controlled key management risks predictable identifiers. After remediation, which ongoing signal best detects recurrence?
- Audit token service access and key rotation schedules
- Audit ownership changes and privilege grants
- Audit unauthorized changes to workspace objects
- Monitor view definition changes and access to raw source
Explanation
Correct Answer
A:Audit token service access and key rotation schedules. This watches the failure mode described by a naive hash without controlled key management risks predictable identifiers. Keyed pseudonymization can preserve joins while reducing identifier exposure. It supplies a regression signal after remediation.
Incorrect Answers
B:Audit ownership changes and privilege grants. This monitor action addresses a different case (separation of duties), where all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
C:Audit unauthorized changes to workspace objects. This monitor action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
D:Monitor view definition changes and access to raw source. This monitor action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
Question 206
At Redwood Civic Services, a slow query uses a complex chain of joins and projections. A change is required because: Developers tune executor size without inspecting actual exchanges. Which implementation action most directly corrects the configuration?
- Tune slow operators or capacity and keep a realistic trigger interval
- Modify the problematic transformation and compare updated physical plans
- Update the task dependency list and deploy a tested wheel or requirements set
- Apply watermark before supported stateful aggregation with matching event-time column
Explanation
Correct Answer
B:Modify the problematic transformation and compare updated physical plans. This directly changes the feature or logic behind developers tune executor size without inspecting actual exchanges. The physical execution plan exposes exchanges, scan filters and join strategy. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Tune slow operators or capacity and keep a realistic trigger interval. This implement action addresses a different case (streaming trigger tuning), where microbatch processing time exceeds the configured trigger interval. Shortening a trigger cannot make a saturated single streaming query process overlapping batches faster. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.
C:Update the task dependency list and deploy a tested wheel or requirements set. This implement action addresses a different case (library version pinning), where a transitive dependency updated to an incompatible version. Explicit compatible dependency versions improve reproducibility across new compute environments. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.
D:Apply watermark before supported stateful aggregation with matching event-time column. This implement action addresses a different case (event-time watermarking), where old keys remain in state indefinitely without a lateness bound. Watermarks provide a lateness threshold for bounded stateful streaming operations. In the stated problem, developers tune executor size without inspecting actual exchanges; this choice would not establish the required spark explain plans decision.
Question 207
At Northfield Analytics, a production task can read source tables but fails writing its silver output. A change is required because: The run-as principal lacks MODIFY on the target table. Which implementation action most directly corrects the configuration?
- Pin or rebuild incompatible wheels and update the bundle library
- Run databricks bundle validate for the intended target in CI
- Apply minimal MODIFY and usage grants to the dedicated principal
- Deploy using an explicit reviewed production target
Explanation
Correct Answer
C:Apply minimal MODIFY and usage grants to the dedicated principal. This directly changes the feature or logic behind the run-as principal lacks MODIFY on the target table. Unity Catalog authorization applies to the job execution identity. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Pin or rebuild incompatible wheels and update the bundle library. This implement action addresses a different case (python dependency triage), where a package import error appears only on the target compute. Runtime-specific wheel compatibility and pinning must be tested in CI. In the stated problem, the run-as principal lacks MODIFY on the target table; this choice would not establish the required job run permission debug decision.
B:Run databricks bundle validate for the intended target in CI. This implement action addresses a different case (bundle validation), where an invalid resource key would be rejected only after production change. Bundle validation detects many configuration problems before deployment. In the stated problem, the run-as principal lacks MODIFY on the target table; this choice would not establish the required job run permission debug decision.
D:Deploy using an explicit reviewed production target. This implement action addresses a different case (target-safe deployment), where the wrong workspace is selected because target is implicit. Explicit bundle target selection prevents accidental environment deployment. In the stated problem, the run-as principal lacks MODIFY on the target table; this choice would not establish the required job run permission debug decision.
Question 208
An architecture review at Meadowland Software covers a workload where a notebook defines transformations on a large dataset. The unresolved constraint is: Engineers assume an intermediate filter executed before any action. Which design is most appropriate?
- Model bronze as predecessor to both independent silver tasks
- Choose a materialized view for refreshable precomputed analytics
- Make writes idempotent before enabling retries
- Defer expensive materialization until the required action
Explanation
Correct Answer
D:Defer expensive materialization until the required action. This design addresses engineers assume an intermediate filter executed before any action. Spark transformations are lazy until an action triggers a job. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Model bronze as predecessor to both independent silver tasks. This design action addresses a different case (job task dag), where dependent tasks sometimes run before the bronze load finishes. Lakeflow Job task dependencies form a directed acyclic execution graph. In the stated problem, engineers assume an intermediate filter executed before any action; this choice would not establish the required spark lazy evaluation decision.
B:Choose a materialized view for refreshable precomputed analytics. This design action addresses a different case (materialized view choice), where each dashboard query recomputes the same expensive aggregation. A materialized view maintains a precomputed query result through refresh. In the stated problem, engineers assume an intermediate filter executed before any action; this choice would not establish the required spark lazy evaluation decision.
C:Make writes idempotent before enabling retries. This design action addresses a different case (job retry semantics), where the downstream write repeats non-idempotent side effects on retry. Retries re-execute task logic; application code must protect repeated effects. In the stated problem, engineers assume an intermediate filter executed before any action; this choice would not establish the required spark lazy evaluation decision.
Question 209
At Arbor Medical, business users cannot distinguish certified customer metrics from experimental tables. A change is required because: Table and column metadata lack meaningful descriptions. Which implementation action most directly corrects the configuration?
- Add meaningful table and column comments through supported metadata commands
- Transfer ownership to the approved group under supported permissions
- Query supported lineage records or Catalog Explorer for dependencies
- Configure the supported managed location and create tables under it
Explanation
Correct Answer
A:Add meaningful table and column comments through supported metadata commands. This directly changes the feature or logic behind table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. It is the concrete configuration for the stated incident.
Incorrect Answers
B:Transfer ownership to the approved group under supported permissions. This implement action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
C:Query supported lineage records or Catalog Explorer for dependencies. This implement action addresses a different case (lineage tracking), where investigators cannot tell which upstream transformation produced it. Unity Catalog lineage records relationships between governed data assets. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
D:Set the supported managed location and create tables under it. This implement action addresses a different case (managed storage ownership), where the data platform cannot apply consistent lifecycle governance. Managed locations centralize storage ownership for Unity Catalog managed assets. In the stated problem, table and column metadata lack meaningful descriptions; this choice would not establish the required catalog descriptions decision.
Question 210
A deployment owner at Vantage Security needs to implement a remedy: a raw ingestion feed occasionally contains personal identifiers in a supposedly anonymized field. The present failure is: The silver pipeline allows unexpected identifiers into a broad analyst dataset. Which change should be applied?
- Create an explicit column projection that excludes free-text notes
- Route sensitive-pattern matches to a protected quarantine table
- Remove overly broad edit access and grant view permission to readers
- Transform join IDs consistently under controlled secret access
Explanation
Correct Answer
B:Route sensitive-pattern matches to a protected quarantine table. This directly changes the feature or logic behind the silver pipeline allows unexpected identifiers into a broad analyst dataset. A data-quality filter can isolate suspect records before release. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Create an explicit column projection that excludes free-text notes. This implement action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, the silver pipeline allows unexpected identifiers into a broad analyst dataset; this choice would not establish the required pii quarantine decision.
C:Remove overly broad edit access and grant view permission to readers. This implement action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, the silver pipeline allows unexpected identifiers into a broad analyst dataset; this choice would not establish the required pii quarantine decision.
D:Transform join IDs consistently under controlled secret access. This implement action addresses a different case (pseudonymized join keys), where a naive hash without controlled key management risks predictable identifiers. Keyed pseudonymization can preserve joins while reducing identifier exposure. In the stated problem, the silver pipeline allows unexpected identifiers into a broad analyst dataset; this choice would not establish the required pii quarantine decision.