Databricks Certified Data Engineer Professional Practice Test 5
Question 40
At Riverbend Energy, a logistics partner sends XML with repeated line-item elements. Observed issue: An XML ingest incorrectly flattens multiple line items into one text field. Before applying a fix, which investigation is most directly relevant?
- Inspect inferred schemas and rescued or null fields in recently ingested rows
- Inspect duplicate file IDs and the ingestion checkpoint state
- Inspect file media types and current input source format
- Inspect raw XML row element nesting and inferred schema
Explanation
Correct Answer
D:Inspect raw XML row element nesting and inferred schema. This checks the specific evidence behind an XML ingest incorrectly flattens multiple line items into one text field. XML ingestion must specify the repeating row element and preserve nested structure. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect inferred schemas and rescued or null fields in recently ingested rows. This diagnose action addresses a different case (nested json ingest), where the initial reader assumes one unchanging flat schema and loses new fields. Explicit schema management and rescued data handling protect evolving semi-structured ingestion. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.
B:Inspect duplicate file IDs and the ingestion checkpoint state. This diagnose action addresses a different case (retry-safe file loads), where a partially processed input file is loaded twice into Delta. Checkpointed incremental ingestion or stable event-level deduplication prevents repeated effects. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.
C:Inspect file media types and current input source format. This diagnose action addresses a different case (binary payload metadata), where a line-oriented text reader corrupts the raw binary payload. binaryFile input preserves raw file bytes and path metadata rather than decoding lines. In the stated problem, an XML ingest incorrectly flattens multiple line items into one text field; this choice would not establish the required xml repeating elements decision.
Question 41
At Silver Ridge Logistics, an ingestion job uses automatic retries after transient API timeouts. A change was deployed to address: The downstream write repeats non-idempotent side effects on retry. Which test result provides the strongest evidence that the requirement is now met?
- Force a retry and verify no duplicated sink rows
- Verify production tasks receive the production catalog and input paths
- Reverse input arrival order and verify identical final target state
- Verify the job authenticates without the token appearing in code or logs
Explanation
Correct Answer
A:Force a retry and verify no duplicated sink rows. This tests the expected result against the downstream write repeats non-idempotent side effects on retry, not simply whether a job or object exists. Retries re-execute task logic; application code must protect repeated effects.
Incorrect Answers
B:Verify production tasks receive the production catalog and input paths. This validate action addresses a different case (bundle target overrides), where development job arguments were deployed into the production target. Bundle targets can override environment-specific variables and resource settings. In the stated problem, the downstream write repeats non-idempotent side effects on retry; this choice would not establish the required job retry semantics decision.
C:Reverse input arrival order and verify identical final target state. This validate action addresses a different case (cdc duplicate sequence), where the processing order for tied source events is nondeterministic. A deterministic sequencing contract needs a unique ordered event position. In the stated problem, the downstream write repeats non-idempotent side effects on retry; this choice would not establish the required job retry semantics decision.
D:Verify the job authenticates without the token appearing in code or logs. This validate action addresses a different case (secure configuration), where an API token is committed in a Python notebook tracked in Git. Secret-backed configuration avoids embedding credentials in notebooks or deployment YAML. In the stated problem, the downstream write repeats non-idempotent side effects on retry; this choice would not establish the required job retry semantics decision.
Question 42
Quality assurance at Harborline Utilities checks a corrected workload where a consumer group needs sales totals but not transaction-level customer IDs. The original fault was: Granting SELECT on the raw fact table violates minimization. Which verification is most decisive?
- Confirm deployment works while a developer cannot grant themselves table access
- Confirm totals match while customer identifiers cannot be queried
- Confirm equal source IDs map to equal pseudonyms without exposing originals
- Query the export view and confirm prohibited fields are absent
Explanation
Correct Answer
B:Confirm totals match while customer identifiers cannot be queried. This tests the expected result against granting SELECT on the raw fact table violates minimization, not simply whether a job or object exists. A governed aggregation view can expose only approved derived information.
Incorrect Answers
A:Confirm deployment works while a developer cannot grant themselves table access. This validate action addresses a different case (separation of duties), where all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. In the stated problem, granting SELECT on the raw fact table violates minimization; this choice would not establish the required secure view sharing decision.
C:Confirm equal source IDs map to equal pseudonyms without exposing originals. This validate action addresses a different case (pseudonymized join keys), where a naive hash without controlled key management risks predictable identifiers. Keyed pseudonymization can preserve joins while reducing identifier exposure. In the stated problem, granting SELECT on the raw fact table violates minimization; this choice would not establish the required secure view sharing decision.
D:Query the export view and confirm prohibited fields are absent. This validate action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, granting SELECT on the raw fact table violates minimization; this choice would not establish the required secure view sharing decision.
Question 43
An architecture review at Fairhaven Transport covers a workload where a finance team needs daily attribution of Databricks compute charges by workload. The unresolved constraint is: Cost reports omit some job and workspace labels. Which design is most appropriate?
- Create a historical failure and runtime dashboard by workflow
- Design an approved incident destination for failed job events
- Design a governed cost dashboard grouped by job/workload labels
- Define an alert query counting missing active units
Explanation
Correct Answer
C:Design a governed cost dashboard grouped by job/workload labels. This design addresses cost reports omit some job and workspace labels. Databricks system billing tables can expose usage records for cost attribution. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Create a historical failure and runtime dashboard by workflow. This design action addresses a different case (job operational history), where operators only see the most recent run in the Jobs UI. Jobs system records support historical analysis of runs and tasks. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
B:Design an approved incident destination for failed job events. This design action addresses a different case (job webhook destination), where only personal email notifications are configured. Supported job notification destinations can integrate workflow status with an incident system. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
D:Define an alert query counting missing active units. This design action addresses a different case (sql alert threshold), where the current dashboard has no automated alert for missing units. SQL alerts can evaluate a query result against a configured threshold. In the stated problem, cost reports omit some job and workspace labels; this choice would not establish the required billing usage monitoring decision.
Question 44
At Cobalt Biotech, a federated analyst can see a foreign catalog but cannot query its tables. A change is required because: Catalog discovery was mistaken for full table access. Which implementation action most directly corrects the configuration?
- Rewrite the federated query to preserve pushdown-compatible predicates
- Rotate the recipient credential according to the supported sharing workflow
- Create a supported connection and foreign catalog with least-privilege credentials
- Apply minimal catalog, schema and table grants for the analyst
Explanation
Correct Answer
D:Apply minimal catalog, schema and table grants for the analyst. This directly changes the feature or logic behind catalog discovery was mistaken for full table access. Unity Catalog usage and object privileges are still required for foreign data objects. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Rewrite the federated query to preserve pushdown-compatible predicates. This implement action addresses a different case (federated pushdown), where an analyst pulls millions of rows before a selective filter. Supported predicate pushdown can reduce data transferred from a federated source. In the stated problem, catalog discovery was mistaken for full table access; this choice would not establish the required foreign catalog permission decision.
B:Rotate the recipient credential according to the supported sharing workflow. This implement action addresses a different case (sharing credential rotation), where partners risk losing access or using a leaked long-lived credential. Credential rotation must be coordinated without unnecessarily broadening permissions. In the stated problem, catalog discovery was mistaken for full table access; this choice would not establish the required foreign catalog permission decision.
C:Create a supported connection and foreign catalog with least-privilege credentials. This implement action addresses a different case (federated connection), where engineers export the full source database into cloud object storage each hour. Lakehouse Federation can query supported external sources through a catalog connection. In the stated problem, catalog discovery was mistaken for full table access; this choice would not establish the required foreign catalog permission decision.
Question 45
At Harborline Utilities, analysts report that a reporting query is suddenly slower. Observed issue: No baseline is available for the warehouse query execution. Before applying a fix, which investigation is most directly relevant?
- Inspect query history for SQL text identity, duration and warehouse
- Inspect the unit-coverage query and expected threshold
- Inspect source offsets, processed offsets and per-batch duration
- Inspect Query Profile operators for scan volume and pruning
Explanation
Correct Answer
A:Inspect query history for SQL text identity, duration and warehouse. This checks the specific evidence behind no baseline is available for the warehouse query execution. Query history/system query records support comparison of execution time and workload. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
B:Inspect the unit-coverage query and expected threshold. This diagnose action addresses a different case (sql alert threshold), where the current dashboard has no automated alert for missing units. SQL alerts can evaluate a query result against a configured threshold. In the stated problem, no baseline is available for the warehouse query execution; this choice would not establish the required sql query history decision.
C:Inspect source offsets, processed offsets and per-batch duration. This diagnose action addresses a different case (streaming backlog), where consumer lag grows while microbatch intervals appear stable. Backlog growth reveals insufficient sustainable processing throughput. In the stated problem, no baseline is available for the warehouse query execution; this choice would not establish the required sql query history decision.
D:Inspect Query Profile operators for scan volume and pruning. This diagnose action addresses a different case (query profile scans), where operators assume the query is always CPU-bound. Query Profile identifies scan, pruning and shuffle behavior for SQL workloads. In the stated problem, no baseline is available for the warehouse query execution; this choice would not establish the required sql query history decision.
Question 46
At Westridge Research, a gold revenue table shows a monthly discrepancy. A change is required because: Investigators cannot tell which upstream transformation produced it. Which implementation action most directly corrects the configuration?
- Add meaningful table and column comments through supported metadata commands
- Query supported lineage records or Catalog Explorer for dependencies
- Transfer ownership to the approved group under supported permissions
- Set the supported managed location and create tables under it
Explanation
Correct Answer
B:Query supported lineage records or Catalog Explorer for dependencies. This directly changes the feature or logic behind investigators cannot tell which upstream transformation produced it. Unity Catalog lineage records relationships between governed data assets. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Add meaningful table and column comments through supported metadata commands. This implement action addresses a different case (catalog descriptions), where table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
C:Transfer ownership to the approved group under supported permissions. This implement action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
D:Set the supported managed location and create tables under it. This implement action addresses a different case (managed storage ownership), where the data platform cannot apply consistent lifecycle governance. Managed locations centralize storage ownership for Unity Catalog managed assets. In the stated problem, investigators cannot tell which upstream transformation produced it; this choice would not establish the required lineage tracking decision.
Question 47
An architecture review at Eastern Star Foods covers a workload where a consumer queries shared Delta table snapshots at different times. The unresolved constraint is: Consumers assume the share is a nightly static export. Which design is most appropriate?
- Use a governed connection and foreign catalog for appropriate federated reads
- Define a minimal table-level share membership contract
- Use a live share when consumers require current provider-managed data
- Choose D2D sharing for supported Databricks managed recipients
Explanation
Correct Answer
C:Use a live share when consumers require current provider-managed data. This design addresses consumers assume the share is a nightly static export. Delta Sharing exposes current authorized data as the provider updates the source. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Use a governed connection and foreign catalog for appropriate federated reads. This design action addresses a different case (federated connection), where engineers export the full source database into cloud object storage each hour. Lakehouse Federation can query supported external sources through a catalog connection. In the stated problem, consumers assume the share is a nightly static export; this choice would not establish the required shared table freshness decision.
B:Define a minimal table-level share membership contract. This design action addresses a different case (share catalog scope), where the recipient can discover unintended datasets. A Delta Sharing share should contain only explicitly approved assets. In the stated problem, consumers assume the share is a nightly static export; this choice would not establish the required shared table freshness decision.
D:Choose D2D sharing for supported Databricks managed recipients. This design action addresses a different case (d2d managed recipient), where a recipient team copies files manually and loses timely updates. Databricks-to-Databricks Delta Sharing supports governed live access without manual copying. In the stated problem, consumers assume the share is a nightly static export; this choice would not establish the required shared table freshness decision.
Question 48
Quality assurance at Cascade Manufacturing checks a corrected workload where compliance needs to identify all tables containing restricted PII. The original fault was: Naming conventions alone are inconsistent across teams. Which verification is most decisive?
- Confirm users can discover metadata but cannot read restricted table rows
- Confirm stewards can manage the table while readers retain intended access
- Search Catalog Explorer and verify definitions distinguish the assets
- Search tagged assets and confirm all known PII columns are classified
Explanation
Correct Answer
D:Search tagged assets and confirm all known PII columns are classified. This tests the expected result against naming conventions alone are inconsistent across teams, not simply whether a job or object exists. Governed tags can classify assets for discovery and policy workflows.
Incorrect Answers
A:Confirm users can discover metadata but cannot read restricted table rows. This validate action addresses a different case (browse metadata privilege), where teams grant SELECT merely to expose object listings. BROWSE enables controlled metadata discovery without granting data read access. In the stated problem, naming conventions alone are inconsistent across teams; this choice would not establish the required governed tags decision.
B:Confirm stewards can manage the table while readers retain intended access. This validate action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, naming conventions alone are inconsistent across teams; this choice would not establish the required governed tags decision.
C:Search Catalog Explorer and verify definitions distinguish the assets. This validate action addresses a different case (catalog descriptions), where table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. In the stated problem, naming conventions alone are inconsistent across teams; this choice would not establish the required governed tags decision.
Question 49
At Harborline Utilities, a daily pipeline must load bronze before parallel silver transformations. Observed issue: Dependent tasks sometimes run before the bronze load finishes. Before applying a fix, which investigation is most directly relevant?
- Inspect dependency graph and upstream task statuses
- Inspect pip resolution output and the installed dependency tree
- Inspect per-key sequence collisions and upstream log offsets
- Inspect task invocation mode and module entrypoint expectations
Explanation
Correct Answer
A:Inspect dependency graph and upstream task statuses. This checks the specific evidence behind dependent tasks sometimes run before the bronze load finishes. Lakeflow Job task dependencies form a directed acyclic execution graph. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
B:Inspect pip resolution output and the installed dependency tree. This diagnose action addresses a different case (library version pinning), where a transitive dependency updated to an incompatible version. Explicit compatible dependency versions improve reproducibility across new compute environments. In the stated problem, dependent tasks sometimes run before the bronze load finishes; this choice would not establish the required job task dag decision.
C:Inspect per-key sequence collisions and upstream log offsets. This diagnose action addresses a different case (cdc duplicate sequence), where the processing order for tied source events is nondeterministic. A deterministic sequencing contract needs a unique ordered event position. In the stated problem, dependent tasks sometimes run before the bronze load finishes; this choice would not establish the required job task dag decision.
D:Inspect task invocation mode and module entrypoint expectations. This diagnose action addresses a different case (python task entrypoints), where the task exits before setting up its argument parser. A standard Python entrypoint and explicit arguments avoid notebook runtime assumptions. In the stated problem, dependent tasks sometimes run before the bronze load finishes; this choice would not establish the required job task dag decision.
Question 50
At Riverbend Energy, two Databricks workspaces in an organization share a curated catalog. A change was deployed to address: A recipient team copies files manually and loses timely updates. Which test result provides the strongest evidence that the requirement is now met?
- Verify recipient sees the selected dataset but not excluded tables
- Verify the recipient can query the shared table without a file copy
- Confirm the partner reads only the approved shared dataset
- Compare remote rows scanned and local query results before and after
Explanation
Correct Answer
B:Verify the recipient can query the shared table without a file copy. This tests the expected result against a recipient team copies files manually and loses timely updates, not simply whether a job or object exists. Databricks-to-Databricks Delta Sharing supports governed live access without manual copying.
Incorrect Answers
A:Verify recipient sees the selected dataset but not excluded tables. This validate action addresses a different case (share catalog scope), where the recipient can discover unintended datasets. A Delta Sharing share should contain only explicitly approved assets. In the stated problem, a recipient team copies files manually and loses timely updates; this choice would not establish the required d2d managed recipient decision.
C:Confirm the partner reads only the approved shared dataset. This validate action addresses a different case (open protocol recipient), where the partner cannot use an internal Databricks-to-Databricks credential flow. Open Delta Sharing can support non-Databricks recipients using the sharing protocol. In the stated problem, a recipient team copies files manually and loses timely updates; this choice would not establish the required d2d managed recipient decision.
D:Compare remote rows scanned and local query results before and after. This validate action addresses a different case (federated pushdown), where an analyst pulls millions of rows before a selective filter. Supported predicate pushdown can reduce data transferred from a federated source. In the stated problem, a recipient team copies files manually and loses timely updates; this choice would not establish the required d2d managed recipient decision.