Databricks Certified Data Engineer Professional Practice Test 80
Question 790
At Lakewood Distribution, a team wants governed read access to a supported external relational database. A change is required because: Engineers export the full source database into cloud object storage each hour. Which implementation action most directly corrects the configuration?
- Create a share, authorize the recipient and attach the approved tables
- Create a supported connection and foreign catalog with least-privilege credentials
- Create a scoped sharing recipient and distribute credentials through an approved channel
- Apply minimal catalog, schema and table grants for the analyst
Explanation
Correct Answer
B:Create a supported connection and foreign catalog with least-privilege credentials. This directly changes the feature or logic behind engineers export the full source database into cloud object storage each hour. Lakehouse Federation can query supported external sources through a catalog connection. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Create a share, authorize the recipient and attach the approved tables. This implement action addresses a different case (d2d managed recipient), where a recipient team copies files manually and loses timely updates. Databricks-to-Databricks Delta Sharing supports governed live access without manual copying. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.
C:Create a scoped sharing recipient and distribute credentials through an approved channel. This implement action addresses a different case (open protocol recipient), where the partner cannot use an internal Databricks-to-Databricks credential flow. Open Delta Sharing can support non-Databricks recipients using the sharing protocol. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.
D:Apply minimal catalog, schema and table grants for the analyst. This implement action addresses a different case (foreign catalog permission), where catalog discovery was mistaken for full table access. Unity Catalog usage and object privileges are still required for foreign data objects. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.
Question 791
At Clearstone Media, customer emails must be hidden from most analytics users. A change is required because: A raw SELECT on an approved table exposes plaintext email. Which implementation action most directly corrects the configuration?
- Create an explicit column projection that excludes free-text notes
- Configure the approved network access control for the workspace
- Attach a supported mask function to the email column
- Create the aggregation view and grant SELECT only on the view
Explanation
Correct Answer
C:Attach a supported mask function to the email column. This directly changes the feature or logic behind a raw SELECT on an approved table exposes plaintext email. Unity Catalog column masks can transform sensitive values at read time. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Create an explicit column projection that excludes free-text notes. This implement action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, a raw SELECT on an approved table exposes plaintext email; this choice would not establish the required column masking decision.
B:Configure the approved network access control for the workspace. This implement action addresses a different case (ip-based workspace restrictions), where a Unity Catalog table grant does not restrict web-console network entry. Workspace access controls and data-object privileges address different security layers. In the stated problem, a raw SELECT on an approved table exposes plaintext email; this choice would not establish the required column masking decision.
D:Create the aggregation view and grant SELECT only on the view. This implement action addresses a different case (secure view sharing), where granting SELECT on the raw fact table violates minimization. A governed aggregation view can expose only approved derived information. In the stated problem, a raw SELECT on an approved table exposes plaintext email; this choice would not establish the required column masking decision.
Question 792
At Riverbend Energy, two data science teams must join events without exposing raw customer IDs. A change is required because: A naive hash without controlled key management risks predictable identifiers. Which implementation action most directly corrects the configuration?
- Revoke unnecessary production ownership and grant task-specific roles
- Update the approved secret store and database credential without code literals
- Grant only required read privileges on the external location
- Transform join IDs consistently under controlled secret access
Explanation
Correct Answer
D:Transform join IDs consistently under controlled secret access. This directly changes the feature or logic behind a naive hash without controlled key management risks predictable identifiers. Keyed pseudonymization can preserve joins while reducing identifier exposure. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Revoke unnecessary production ownership and grant task-specific roles. This implement action addresses a different case (separation of duties), where all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
B:Update the approved secret store and database credential without code literals. This implement action addresses a different case (credential rotation procedure), where the hard-coded service password has not rotated for a year. Secret management and controlled rotation reduce long-lived credential exposure. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
C:Grant only required read privileges on the external location. This implement action addresses a different case (storage credential scope), where engineers propose a credential allowing access to all company buckets. Unity Catalog storage credentials and external locations can constrain storage access. In the stated problem, a naive hash without controlled key management risks predictable identifiers; this choice would not establish the required pseudonymized join keys decision.
Question 793
Quality assurance at Northfield Analytics checks a corrected workload where an automated pipeline update fails after a schema change. The original fault was: The Jobs status only reports a high-level failure. Which verification is most decisive?
- Find the expected schema error and confirm it disappears after correction
- Reconcile daily grouped usage against account-level totals
- Trigger a controlled failure and confirm notification delivery
- Cause a safe test failure and confirm exactly one incident is created
Explanation
Correct Answer
A:Find the expected schema error and confirm it disappears after correction. This tests the expected result against the Jobs status only reports a high-level failure, not simply whether a job or object exists. Lakeflow pipeline event logs include update-level errors and progress events.
Incorrect Answers
B:Reconcile daily grouped usage against account-level totals. This validate action addresses a different case (billing usage monitoring), where cost reports omit some job and workspace labels. Databricks system billing tables can expose usage records for cost attribution. In the stated problem, the Jobs status only reports a high-level failure; this choice would not establish the required pipeline event log decision.
C:Trigger a controlled failure and confirm notification delivery. This validate action addresses a different case (job email notification), where operators manually check the run page every morning. Lakeflow Jobs support status-triggered notifications for run outcomes. In the stated problem, the Jobs status only reports a high-level failure; this choice would not establish the required pipeline event log decision.
D:Cause a safe test failure and confirm exactly one incident is created. This validate action addresses a different case (job webhook destination), where only personal email notifications are configured. Supported job notification destinations can integrate workflow status with an incident system. In the stated problem, the Jobs status only reports a high-level failure; this choice would not establish the required pipeline event log decision.
Question 794
An architecture review at Harborline Utilities covers a workload where a query's estimated join sizes differ greatly from actual stage sizes. The unresolved constraint is: Static join strategy performs poorly at varying input volumes. Which design is most appropriate?
- Choose a supported columnar Delta or Parquet layout for analytics
- Use supported AQE with appropriate shuffle and join settings
- Choose adaptive skew join handling or a justified hot-key strategy
- Bound state with appropriate watermark or TTL behavior under the application SLA
Explanation
Correct Answer
B:Use supported AQE with appropriate shuffle and join settings. This design addresses static join strategy performs poorly at varying input volumes. Adaptive Query Execution can adjust supported shuffle partitions and join strategies at runtime. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Choose a supported columnar Delta or Parquet layout for analytics. This design action addresses a different case (columnar compression), where row-oriented text storage increases scans and transfer volumes. Columnar formats and appropriate encoding improve analytical read efficiency. In the stated problem, static join strategy performs poorly at varying input volumes; this choice would not establish the required adaptive execution decision.
C:Choose adaptive skew join handling or a justified hot-key strategy. This design action addresses a different case (skewed joins), where a single join partition spills heavily to disk. Adaptive skew handling or key salting can mitigate a hot join key. In the stated problem, static join strategy performs poorly at varying input volumes; this choice would not establish the required adaptive execution decision.
D:Bound state with appropriate watermark or TTL behavior under the application SLA. This design action addresses a different case (streaming state growth), where executor memory pressure grows even though input rate is stable. State retention and checkpoint state-store configuration affect memory requirements. In the stated problem, static join strategy performs poorly at varying input volumes; this choice would not establish the required adaptive execution decision.
Question 795
Quality assurance at Pinecrest Holdings checks a corrected workload where a failed regional load has the wrong processing date. The original fault was: The scheduler launches a full rebuild instead of rerunning the affected date. Which verification is most decisive?
- Verify only intended tasks rerun and final outputs reconcile
- Confirm job and pipeline IDs appear only in the intended workspace
- Verify only the intended date partition is recalculated
- Rerun and verify the intended write succeeds while other tables stay blocked
Explanation
Correct Answer
C:Verify only the intended date partition is recalculated. This tests the expected result against the scheduler launches a full rebuild instead of rerunning the affected date, not simply whether a job or object exists. Job repair or rerun parameters can target a specific processing window.
Incorrect Answers
A:Confirm only intended tasks rerun and final outputs reconcile. This validate action addresses a different case (repair failed tasks), where operators rerun the entire job and duplicate completed side effects. Repair runs can rerun failed or selected tasks while preserving successful predecessor work under supported semantics. In the stated problem, the scheduler launches a full rebuild instead of rerunning the affected date; this choice would not establish the required override run parameters decision.
B:Confirm job and pipeline IDs appear only in the intended workspace. This validate action addresses a different case (target-safe deployment), where the wrong workspace is selected because target is implicit. Explicit bundle target selection prevents accidental environment deployment. In the stated problem, the scheduler launches a full rebuild instead of rerunning the affected date; this choice would not establish the required override run parameters decision.
D:Rerun and verify the intended write succeeds while other tables stay blocked. This validate action addresses a different case (job run permission debug), where the run-as principal lacks MODIFY on the target table. Unity Catalog authorization applies to the job execution identity. In the stated problem, the scheduler launches a full rebuild instead of rerunning the affected date; this choice would not establish the required override run parameters decision.
Question 796
A data engineer at Clearstone Media must troubleshoot this case: a product dimension adds a new optional classification attribute. Evidence: A destructive table recreation would invalidate downstream consumers. What should be inspected first to confirm the failure mechanism?
- Inspect membership cardinalities and duplicated fact amounts
- Inspect dimension history and event order for each account key
- Inspect source-to-dashboard lineage for missing quality layers
- Inspect consumer schemas and whether the new attribute is backward compatible
Explanation
Correct Answer
D:Inspect consumer schemas and whether the new attribute is backward compatible. This checks the specific evidence behind a destructive table recreation would invalidate downstream consumers. Additive schema evolution can preserve contracts when null defaults are acceptable. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect membership cardinalities and duplicated fact amounts. This diagnose action addresses a different case (many-to-many bridge), where joining facts directly to the membership table multiplies totals. A bridge table models many-to-many relationships at an explicit membership grain. In the stated problem, a destructive table recreation would invalidate downstream consumers; this choice would not establish the required dimension evolution decision.
B:Inspect dimension history and event order for each account key. This diagnose action addresses a different case (scd type 2 effective dates), where a single current tier overwrites history in the dimension. SCD Type 2 stores effective start/end intervals for distinct historical dimension versions. In the stated problem, a destructive table recreation would invalidate downstream consumers; this choice would not establish the required dimension evolution decision.
C:Inspect source-to-dashboard lineage for missing quality layers. This diagnose action addresses a different case (medallion bronze silver gold), where malformed source events contaminate metrics without an intermediate quality boundary. Bronze, silver and gold layers separate raw capture, validated refinement and business presentation. In the stated problem, a destructive table recreation would invalidate downstream consumers; this choice would not establish the required dimension evolution decision.
Question 797
At Riverbend Energy, an engineering team owns many internal Delta tables with no need for external file lifecycle control. Architecture constraint: Each table has custom file cleanup jobs and broad storage permissions. Which design best addresses this requirement?
- Prefer Unity Catalog managed tables for fully governed internal datasets
- Use predictive optimization on supported managed Delta tables
- Cache only frequently reused and appropriately sized intermediate data
- Choose a supported columnar Delta or Parquet layout for analytics
Explanation
Correct Answer
A:Prefer Unity Catalog managed tables for fully governed internal datasets. This design addresses each table has custom file cleanup jobs and broad storage permissions. Unity Catalog managed tables provide platform-managed data placement and maintenance capabilities. It establishes the right contract or architecture before execution changes.
Incorrect Answers
B:Use predictive optimization on supported managed Delta tables. This design action addresses a different case (predictive optimization), where operators run blanket manual OPTIMIZE jobs regardless of table use. Predictive optimization can automate supported managed-table maintenance based on workload signals. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.
C:Cache only frequently reused and appropriately sized intermediate data. This design action addresses a different case (cache reuse), where repeated recomputation dominates each branch's execution. Persistence can avoid repeated work if reused data fits the memory budget. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.
D:Choose a supported columnar Delta or Parquet layout for analytics. This design action addresses a different case (columnar compression), where row-oriented text storage increases scans and transfer volumes. Columnar formats and appropriate encoding improve analytical read efficiency. In the stated problem, each table has custom file cleanup jobs and broad storage permissions; this choice would not establish the required managed table maintenance decision.
Question 798
Operations at Bayview Insurance owns a workload where a team has SELECT on a table but receives a permission-denied error. The previously identified issue was: The team lacks USE CATALOG and USE SCHEMA on the parent containers. Which metric or audit check best detects drift?
- Monitor unexpected new tables entering the governed schema
- Audit missing-parent-usage failures and overly broad grants
- Audit subsequent data access requests and grants
- Audit new location definitions and path overlaps
Explanation
Correct Answer
B:Audit missing-parent-usage failures and overly broad grants. This watches the failure mode described by the team lacks USE CATALOG and USE SCHEMA on the parent containers. Unity Catalog object access generally requires relevant parent usage privileges. It supplies a regression signal after remediation.
Incorrect Answers
A:Monitor unexpected new tables entering the governed schema. This monitor action addresses a different case (schema-level grant inheritance), where analysts must repeatedly request identical SELECT grants for each table. Unity Catalog schema-level privileges can apply to existing and future child objects. In the stated problem, the team lacks USE CATALOG and USE SCHEMA on the parent containers; this choice would not establish the required catalog privilege inheritance decision.
C:Audit subsequent data access requests and grants. This monitor action addresses a different case (browse metadata privilege), where teams grant SELECT merely to expose object listings. BROWSE enables controlled metadata discovery without granting data read access. In the stated problem, the team lacks USE CATALOG and USE SCHEMA on the parent containers; this choice would not establish the required catalog privilege inheritance decision.
D:Audit new location definitions and path overlaps. This monitor action addresses a different case (external location governance), where raw cloud permissions bypass central catalog governance. External locations map cloud paths to governed Unity Catalog storage credentials. In the stated problem, the team lacks USE CATALOG and USE SCHEMA on the parent containers; this choice would not establish the required catalog privilege inheritance decision.
Question 799
A data engineer at Arbor Medical must troubleshoot this case: cI deploys bundles using a developer personal access token. Evidence: Scheduled production deployment fails when the developer's token expires. What should be inspected first to confirm the failure mechanism?
- Inspect CI stages for tests, bundle validation and approvals
- Inspect pipeline event log update IDs and error messages
- Inspect CI auth mode and token expiry without exposing credentials
- Inspect the bundle manifest schema and validation result
Explanation
Correct Answer
C:Inspect CI auth mode and token expiry without exposing credentials. This checks the specific evidence behind scheduled production deployment fails when the developer's token expires. Workload identity or service principal authentication decouples CI from employees. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect CI stages for tests, bundle validation and approvals. This diagnose action addresses a different case (ci quality gates), where the deployment pipeline only checks YAML syntax. CI must run transformation tests and controlled integration checks before deployment. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.
B:Inspect pipeline event log update IDs and error messages. This diagnose action addresses a different case (lakeflow event error classes), where the only visible dashboard status is FAILED without a dataset name. Pipeline event logs identify failing update and dataset messages. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.
D:Inspect the bundle manifest schema and validation result. This diagnose action addresses a different case (bundle validation), where an invalid resource key would be rejected only after production change. Bundle validation detects many configuration problems before deployment. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.
Question 800
Operations at Bayview Insurance owns a workload where a telemetry pipeline receives occasionally invalid event timestamps. The previously identified issue was: Dropping invalid rows silently hides upstream quality failures. Which metric or audit check best detects drift?
- Alert when active-key uniqueness violations recur
- Trend both quality failure rates and pipeline status separately
- Monitor expectation-drop counts and upstream correction rates
- Alert on increasing quarantine rates and source schemas
Explanation
Correct Answer
D:Alert on increasing quarantine rates and source schemas. This watches the failure mode described by dropping invalid rows silently hides upstream quality failures. Quarantine preserves invalid events separately while allowing valid records through. It supplies a regression signal after remediation.
Incorrect Answers
A:Alert when active-key uniqueness violations recur. This monitor action addresses a different case (uniqueness quality rule), where an upstream replay creates multiple active versions. An explicit uniqueness check identifies duplicate business keys before serving data. In the stated problem, dropping invalid rows silently hides upstream quality failures; this choice would not establish the required quarantine bad records decision.
B:Trend both quality failure rates and pipeline status separately. This monitor action addresses a different case (quality metric interpretation), where analysts misread a quality count as the number of pipeline task failures. Expectation metrics describe data rows and must be interpreted separately from orchestration status. In the stated problem, dropping invalid rows silently hides upstream quality failures; this choice would not establish the required quarantine bad records decision.
C:Monitor expectation-drop counts and upstream correction rates. This monitor action addresses a different case (expectation drop action), where invalid rows currently reach downstream aggregates. A Lakeflow expectation configured to drop invalid rows filters violations from target output. In the stated problem, dropping invalid rows silently hides upstream quality failures; this choice would not establish the required quarantine bad records decision.