cert
cert-1
cert-2

Pass Databricks Certified Data Engineer Professional Exam in First Attempt Guaranteed!

Get 100% Latest Exam Questions, Accurate & Verified Answers to Pass the Actual Exam!
30 Days Free Updates, Instant Download!

cert-5
cert-6
Certified Data Engineer Professional Exam - Verified By Experts
Certified Data Engineer Professional Premium Bundle
$14.99

Certified Data Engineer Professional Premium Bundle

$74.99
$89.98
  • Premium File 339 Questions & Answers. Last update: Oct 30, 2026
  • Training Course 33 Video Lectures
 
$89.98
$74.99
accept 91 downloads in last 7 days
block-screenshots
Purchase Databricks Certified Data Engineer Professional Exam Training Products Individually
Databricks Certified Data Engineer Professional Premium File
Premium File 339 Q&A
$76.99$69.99
Databricks Certified Data Engineer Professional Video Training Course
Training Course 33 Lectures
$21.99 $19.99
Databricks Certified Data Engineer Professional Practice Test 48

Question 470

At Horizon Travel, a dashboard repeatedly groups detailed events by day and product. Architecture constraint: Interactive queries scan billions of detail rows for identical totals. Which design best addresses this requirement?

  1. Plan an additive nullable dimension attribute with documented defaults
  2. Create a gold aggregate keyed by day and product with documented measures
  3. Choose one order-line grain for transaction detail metrics
  4. Design a customer-plan bridge with valid membership periods

Explanation

Correct Answer

B:

Create a gold aggregate keyed by day and product with documented measures. This design addresses interactive queries scan billions of detail rows for identical totals. A summarized gold table can serve a stable reporting grain efficiently. It establishes the right contract or architecture before execution changes.

Incorrect Answers

A:

Plan an additive nullable dimension attribute with documented defaults. This design action addresses a different case (dimension evolution), where a destructive table recreation would invalidate downstream consumers. Additive schema evolution can preserve contracts when null defaults are acceptable. In the stated problem, interactive queries scan billions of detail rows for identical totals; this choice would not establish the required aggregate gold model decision.

C:

Choose one order-line grain for transaction detail metrics. This design action addresses a different case (fact table grain), where summing revenue double-counts orders with multiple items. A dimensional fact must have one clearly documented row grain. In the stated problem, interactive queries scan billions of detail rows for identical totals; this choice would not establish the required aggregate gold model decision.

D:

Design a customer-plan bridge with valid membership periods. This design action addresses a different case (many-to-many bridge), where joining facts directly to the membership table multiplies totals. A bridge table models many-to-many relationships at an explicit membership grain. In the stated problem, interactive queries scan billions of detail rows for identical totals; this choice would not establish the required aggregate gold model decision.

Question 471

Quality assurance at Cobalt Biotech checks a corrected workload where incoming transaction files continuously arrive and must feed downstream tables. The original fault was: Periodic full-refresh queries miss required incremental freshness. Which verification is most decisive?

  1. Confirm dashboard results refresh after source data updates
  2. Replay update and delete events and confirm one accurate current row per key
  3. Append new files and confirm only new input is processed under checkpoint tracking
  4. Restart and confirm previously committed input is not reprocessed unexpectedly

Explanation

Correct Answer

C:

Append new files and confirm only new input is processed under checkpoint tracking. This tests the expected result against periodic full-refresh queries miss required incremental freshness, not simply whether a job or object exists. A streaming table tracks continuously arriving source data incrementally.

Incorrect Answers

A:

Confirm dashboard results refresh after source data updates. This validate action addresses a different case (materialized view choice), where each dashboard query recomputes the same expensive aggregation. A materialized view maintains a precomputed query result through refresh. In the stated problem, periodic full-refresh queries miss required incremental freshness; this choice would not establish the required streaming table choice decision.

B:

Replay update and delete events and confirm one accurate current row per key. This validate action addresses a different case (auto cdc keys), where applying events as append-only rows leaves outdated active accounts. AUTO CDC or applicable APPLY CHANGES needs stable keys and sequence ordering for stateful upserts. In the stated problem, periodic full-refresh queries miss required incremental freshness; this choice would not establish the required streaming table choice decision.

D:

Restart and confirm previously committed input is not reprocessed unexpectedly. This validate action addresses a different case (streaming checkpoint identity), where a newly selected checkpoint location makes the stream reread historical input. Streaming checkpoint metadata records progress and state for restart continuity. In the stated problem, periodic full-refresh queries miss required incremental freshness; this choice would not establish the required streaming table choice decision.

Question 472

An architecture review at Oak Valley Retail covers a workload where a new optional field is added to a bronze event feed. The unresolved constraint is: The silver writer rejects every new record after the upstream schema change. Which design is most appropriate?

  1. Enforce one active record per key with deterministic conflict rules
  2. Use drop semantics only when invalid records may be excluded by policy
  3. Separate valid silver rows from a restricted quarantine table
  4. Define a reviewable additive-column evolution policy

Explanation

Correct Answer

D:

Define a reviewable additive-column evolution policy. This design addresses the silver writer rejects every new record after the upstream schema change. Schema evolution must be reviewed rather than enabling unrestricted acceptance for every column. It establishes the right contract or architecture before execution changes.

Incorrect Answers

A:

Enforce one active record per key with deterministic conflict rules. This design action addresses a different case (uniqueness quality rule), where an upstream replay creates multiple active versions. An explicit uniqueness check identifies duplicate business keys before serving data. In the stated problem, the silver writer rejects every new record after the upstream schema change; this choice would not establish the required controlled schema evolution decision.

B:

Use drop semantics only when invalid records may be excluded by policy. This design action addresses a different case (expectation drop action), where invalid rows currently reach downstream aggregates. A Lakeflow expectation configured to drop invalid rows filters violations from target output. In the stated problem, the silver writer rejects every new record after the upstream schema change; this choice would not establish the required controlled schema evolution decision.

C:

Separate valid silver rows from a restricted quarantine table. This design action addresses a different case (quarantine bad records), where dropping invalid rows silently hides upstream quality failures. Quarantine preserves invalid events separately while allowing valid records through. In the stated problem, the silver writer rejects every new record after the upstream schema change; this choice would not establish the required controlled schema evolution decision.

Question 473

A data engineer at Eastern Star Foods must troubleshoot this case: an existing unpartitioned table is being migrated to liquid clustering. Evidence: The proposed maintenance script also runs ZORDER on that clustered table. What should be inspected first to confirm the failure mechanism?

  1. Inspect existing clustering metadata and OPTIMIZE commands
  2. Inspect runtime support and predictive optimization status
  3. Inspect filters, cardinalities and existing partition layout
  4. Inspect managed table eligibility and current optimization settings

Explanation

Correct Answer

A:

Inspect existing clustering metadata and OPTIMIZE commands. This checks the specific evidence behind the proposed maintenance script also runs ZORDER on that clustered table. Liquid clustering is incompatible with concurrently applying ZORDER to the same table. The investigation distinguishes the mechanism from an unrelated operational symptom.

Incorrect Answers

B:

Inspect runtime support and predictive optimization status. This diagnose action addresses a different case (automatic clustering), where manual clustering keys quickly become stale. Automatic liquid clustering can select keys using query workload when platform prerequisites are met. In the stated problem, the proposed maintenance script also runs ZORDER on that clustered table; this choice would not establish the required clustering versus zorder decision.

C:

Inspect filters, cardinalities and existing partition layout. This diagnose action addresses a different case (liquid clustering cardinality), where partitioning by device would produce many tiny partitions. Liquid clustering organizes data by useful filter keys without high-cardinality partition directories. In the stated problem, the proposed maintenance script also runs ZORDER on that clustered table; this choice would not establish the required clustering versus zorder decision.

D:

Inspect managed table eligibility and current optimization settings. This diagnose action addresses a different case (predictive optimization), where operators run blanket manual OPTIMIZE jobs regardless of table use. Predictive optimization can automate supported managed-table maintenance based on workload signals. In the stated problem, the proposed maintenance script also runs ZORDER on that clustered table; this choice would not establish the required clustering versus zorder decision.

Question 474

At Riverbend Energy, a logistics partner sends XML with repeated line-item elements. A change was deployed to address: An XML ingest incorrectly flattens multiple line items into one text field. Which test result provides the strongest evidence that the requirement is now met?

  1. Parse a quoted comma and confirm original column boundaries are preserved
  2. Parse an order with three line items and confirm all three survive
  3. Ingest an unknown field and confirm it is retained for triage
  4. Evaluate output content length and checksum to the original object

Explanation

Correct Answer

B:

Parse an order with three line items and confirm all three survive. This tests the expected result against an XML ingest incorrectly flattens multiple line items into one text field, not simply whether a job or object exists. XML ingestion must specify the repeating row element and preserve nested structure.

Incorrect Answers

A:

Parse a quoted comma and confirm original column boundaries are preserved. This validate action addresses a different case (malformed csv quotes), where an ingestion reader splits quoted names into extra columns. CSV quoting and escape configurations must match the source serialization. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.

C:

Ingest an unknown field and confirm it is retained for triage. This validate action addresses a different case (auto loader rescued data), where unknown or mismatched fields disappear during the bronze load. The rescued data column can preserve records with unexpected schema content for later remediation. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.

D:

Compare output content length and checksum to the original object. This validate action addresses a different case (binary payload metadata), where a line-oriented text reader corrupts the raw binary payload. binaryFile input preserves raw file bytes and path metadata rather than decoding lines. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.

Question 475

Quality assurance at Orion Capital checks a corrected workload where an aggregation pipeline uses a Python UDF for lowercase normalization. The original fault was: The Python UDF creates an avoidable cross-language execution boundary. Which verification is most decisive?

  1. Evaluate outputs on edge cases and measure stage time on representative data
  2. Run two regional jobs with distinct parameters and compare target outputs
  3. Compare normalized outputs including Unicode and null samples
  4. Verify the job authenticates without the token appearing in code or logs

Explanation

Correct Answer

C:

Compare normalized outputs including Unicode and null samples. This tests the expected result against the Python UDF creates an avoidable cross-language execution boundary, not simply whether a job or object exists. Built-in Spark SQL functions can execute in optimized expressions without Python UDF overhead.

Incorrect Answers

A:

Compare outputs on edge cases and measure stage time on representative data. This validate action addresses a different case (vectorized udf), where row-by-row Python invocation dominates stage runtime. Pandas UDFs process batches through Arrow rather than per-row Python calls. In the stated problem, the Python UDF creates an avoidable cross-language execution boundary; this choice would not establish the required avoid python udf for sql decision.

B:

Run two regional jobs with distinct parameters and compare target outputs. This validate action addresses a different case (job parameters), where code contains hard-coded region IDs and catalog names. Task parameters allow runtime-specific values without changing notebook source. In the stated problem, the Python UDF creates an avoidable cross-language execution boundary; this choice would not establish the required avoid python udf for sql decision.

D:

Verify the job authenticates without the token appearing in code or logs. This validate action addresses a different case (secure configuration), where an API token is committed in a Python notebook tracked in Git. Secret-backed configuration avoids embedding credentials in notebooks or deployment YAML. In the stated problem, the Python UDF creates an avoidable cross-language execution boundary; this choice would not establish the required avoid python udf for sql decision.

Question 476

At Westhaven Services, a daily aggregation groups click events by campaign. Architecture constraint: A single campaign dominates rows and one reduce task runs for minutes. Which design best addresses this requirement?

  1. Create separate dashboards for rejected data and failed pipeline updates
  2. Model a one-to-many child table at order_id plus item position grain
  3. Define a reviewable additive-column evolution policy
  4. Select appropriate salting or staged aggregation for a hot key

Explanation

Correct Answer

D:

Select appropriate salting or staged aggregation for a hot key. This design addresses a single campaign dominates rows and one reduce task runs for minutes. A hot aggregation key causes skew despite ample parallelism. It establishes the right contract or architecture before execution changes.

Incorrect Answers

A:

Create separate dashboards for rejected data and failed pipeline updates. This design action addresses a different case (quality metric interpretation), where analysts misread a quality count as the number of pipeline task failures. Expectation metrics describe data rows and must be interpreted separately from orchestration status. In the stated problem, a single campaign dominates rows and one reduce task runs for minutes; this choice would not establish the required skewed group aggregation decision.

B:

Model a one-to-many child table at order_id plus item position grain. This design action addresses a different case (array explosion), where an order-level aggregation mistakenly treats the array as a single item. explode creates item-level rows when the business grain requires each array element. In the stated problem, a single campaign dominates rows and one reduce task runs for minutes; this choice would not establish the required skewed group aggregation decision.

C:

Define a reviewable additive-column evolution policy. This design action addresses a different case (controlled schema evolution), where the silver writer rejects every new record after the upstream schema change. Schema evolution must be reviewed rather than enabling unrestricted acceptance for every column. In the stated problem, a single campaign dominates rows and one reduce task runs for minutes; this choice would not establish the required skewed group aggregation decision.

Question 477

At Oak Valley Retail, a production Delta table needs obsolete data files cleaned up. Observed issue: An operator proposes aggressive VACUUM retention during active long-running readers. Before applying a fix, which investigation is most directly relevant?

  1. Inspect table retention policy and active readers or stream checkpoints
  2. Inspect MERGE condition and target files read
  3. Inspect watermark, state operator metrics and checkpoint size
  4. Inspect per-task shuffle read bytes and spilled data

Explanation

Correct Answer

A:

Inspect table retention policy and active readers or stream checkpoints. This checks the specific evidence behind an operator proposes aggressive VACUUM retention during active long-running readers. VACUUM retention must protect older snapshots still needed by readers and streams. The investigation distinguishes the mechanism from an unrelated operational symptom.

Incorrect Answers

B:

Inspect MERGE condition and target files read. This diagnose action addresses a different case (predicate-limited merge), where the merge scans unrelated historical partitions. Constraining merge matches to relevant partitions can reduce unnecessary target scanning. In the stated problem, an operator proposes aggressive VACUUM retention during active long-running readers; this choice would not establish the required vacuum retention safety decision.

C:

Inspect watermark, state operator metrics and checkpoint size. This diagnose action addresses a different case (streaming state growth), where executor memory pressure grows even though input rate is stable. State retention and checkpoint state-store configuration affect memory requirements. In the stated problem, an operator proposes aggressive VACUUM retention during active long-running readers; this choice would not establish the required vacuum retention safety decision.

D:

Inspect per-task shuffle read bytes and spilled data. This diagnose action addresses a different case (shuffle partition count), where the current partition count is too low for data volume. Shuffle partition sizing affects memory pressure and task parallelism. In the stated problem, an operator proposes aggressive VACUUM retention during active long-running readers; this choice would not establish the required vacuum retention safety decision.

Question 478

A deployment owner at Northfield Analytics needs to implement a remedy: a Python ETL workload runs reliably in development but fails after the next cluster restart. The present failure is: A transitive dependency updated to an incompatible version. Which change should be applied?

  1. Build and attach the published wheel and update the job's library reference
  2. Update the task dependency list and deploy a tested wheel or requirements set
  3. Move task source under version control and declare jobs or pipelines in bundle resources
  4. Remove conflicting notebook installation and attach the tested library version

Explanation

Correct Answer

B:

Update the task dependency list and deploy a tested wheel or requirements set. This directly changes the feature or logic behind a transitive dependency updated to an incompatible version. Explicit compatible dependency versions improve reproducibility across new compute environments. It is the concrete configuration for the stated incident.

Incorrect Answers

A:

Build and attach the published wheel and update the job's library reference. This implement action addresses a different case (python wheel packaging), where a refactor broke a notebook-relative import in the deployed job. A properly packaged versioned wheel gives Python code stable import paths outside notebooks. In the stated problem, a transitive dependency updated to an incompatible version; this choice would not establish the required library version pinning decision.

C:

Move task source under version control and declare jobs or pipelines in bundle resources. This implement action addresses a different case (bundle repository layout), where source files and deployment definitions are coupled to one developer workspace. A versioned Declarative Automation Bundle defines code and resource configurations separately from the target workspace. In the stated problem, a transitive dependency updated to an incompatible version; this choice would not establish the required library version pinning decision.

D:

Remove conflicting notebook installation and attach the tested library version. This implement action addresses a different case (library precedence), where a notebook-scoped installation overrides the expected cluster version. The runtime can resolve conflicting versions from different installation scopes. In the stated problem, a transitive dependency updated to an incompatible version; this choice would not establish the required library version pinning decision.

Question 479

A data engineer at Riverbend Energy must troubleshoot this case: an engineering team owns many internal Delta tables with no need for external file lifecycle control. Evidence: Each table has custom file cleanup jobs and broad storage permissions. What should be inspected first to confirm the failure mechanism?

  1. Inspect repeated lineage and memory availability for the reference data
  2. Inspect table stats collection and skipped-file counts
  3. Inspect table ownership and whether external storage paths are actually required
  4. Inspect current table features, delete patterns and runtime compatibility

Explanation

Correct Answer

C:

Inspect table ownership and whether external storage paths are actually required. This checks the specific evidence behind each table has custom file cleanup jobs and broad storage permissions. Unity Catalog managed tables provide platform-managed data placement and maintenance capabilities. The investigation distinguishes the mechanism from an unrelated operational symptom.

Incorrect Answers

A:

Inspect repeated lineage and memory availability for the reference data. This diagnose action addresses a different case (cache reuse), where repeated recomputation dominates each branch's execution. Persistence can avoid repeated work if reused data fits the memory budget. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.

B:

Inspect table stats collection and skipped-file counts. This diagnose action addresses a different case (data skipping statistics), where file-level statistics are missing for the filter column. Delta data skipping uses collected column statistics to eliminate files. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.

D:

Inspect current table features, delete patterns and runtime compatibility. This diagnose action addresses a different case (deletion vectors), where each small delete rewrites large data files and increases write cost. Deletion vectors can mark deleted rows without immediate whole-file rewrite when supported. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.

Question 480

At Silver Ridge Logistics, a streaming pipeline fails only for one nested record. The known risk is: Re-running a huge source in development is slow and risky. After remediation, which ongoing signal best detects recurrence?

  1. Monitor library compatibility on future runtime upgrades
  2. Monitor pipeline error events by dataset and update
  3. Audit repeated authorization errors and new broad grants
  4. Monitor recurrence of the parsing error class

Explanation

Correct Answer

D:

Monitor recurrence of the parsing error class. This watches the failure mode described by re-running a huge source in development is slow and risky. A minimal reproducible input isolates the failure without modifying production data. It supplies a regression signal after remediation.

Incorrect Answers

A:

Monitor library compatibility on future runtime upgrades. This monitor action addresses a different case (python dependency triage), where a package import error appears only on the target compute. Runtime-specific wheel compatibility and pinning must be tested in CI. In the stated problem, re-running a huge source in development is slow and risky; this choice would not establish the required pipeline debug sampling decision.

B:

Monitor pipeline error events by dataset and update. This monitor action addresses a different case (lakeflow event error classes), where the only visible dashboard status is FAILED without a dataset name. Pipeline event logs identify failing update and dataset messages. In the stated problem, re-running a huge source in development is slow and risky; this choice would not establish the required pipeline debug sampling decision.

C:

Audit repeated authorization errors and new broad grants. This monitor action addresses a different case (job run permission debug), where the run-as principal lacks MODIFY on the target table. Unity Catalog authorization applies to the job execution identity. In the stated problem, re-running a huge source in development is slow and risky; this choice would not establish the required pipeline debug sampling decision.

Certified Data Engineer Professional Practice Tests