Databricks Certified Data Engineer Professional Practice Test 79
Question 780
At Summit Consumer Goods, a team directly edits shared production notebook code in the workspace. Architecture constraint: There is no controlled code review or rollback history. Which design best addresses this requirement?
- Define a controlled change-management path for resource configuration
- Plan rollback of code/resources while protecting compatible state and schema
- Require unit and integration tests plus deployment validation
- Use branch-based review and merge before deployment
Explanation
Correct Answer
D:Use branch-based review and merge before deployment. This design addresses there is no controlled code review or rollback history. Databricks Git folders connect workspace development to version control. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Define a controlled change-management path for resource configuration. This design action addresses a different case (unmanaged resource drift), where subsequent CI redeployment unexpectedly overwrites it. Declarative source of truth should include intentional job-resource changes. In the stated problem, there is no controlled code review or rollback history; this choice would not establish the required git folder collaboration decision.
B:Plan rollback of code/resources while protecting compatible state and schema. This design action addresses a different case (rollback deployment), where deployers have no record of the previous working configuration. Versioned bundle releases enable controlled rollback to a known commit. In the stated problem, there is no controlled code review or rollback history; this choice would not establish the required git folder collaboration decision.
C:Require unit and integration tests plus deployment validation. This design action addresses a different case (ci quality gates), where the deployment pipeline only checks YAML syntax. CI must run transformation tests and controlled integration checks before deployment. In the stated problem, there is no controlled code review or rollback history; this choice would not establish the required git folder collaboration decision.
Question 781
Quality assurance at Orion Capital checks a corrected workload where global feeds supply timestamps with inconsistent local time zones. The original fault was: Events from different regions are ordered incorrectly in a UTC dashboard. Which verification is most decisive?
- Compare known local times from two regions against the same UTC instant
- Shuffle source row order and verify the same account record survives
- Count retained fact rows and confirm null-key records are represented
- Compare injected bad-row counts to quality metrics and task status
Explanation
Correct Answer
A:Compare known local times from two regions against the same UTC instant. This tests the expected result against events from different regions are ordered incorrectly in a UTC dashboard, not simply whether a job or object exists. Time-zone normalization is required before comparing timestamps from different sources.
Incorrect Answers
B:Shuffle source row order and verify the same account record survives. This validate action addresses a different case (latest-per-key with ties), where two events have the same event time and yield different surviving rows. A deterministic tie-breaker is required in a per-key window ranking. In the stated problem, events from different regions are ordered incorrectly in a UTC dashboard; this choice would not establish the required timestamp timezone normalization decision.
C:Count retained fact rows and confirm null-key records are represented. This validate action addresses a different case (join with nullable keys), where rows with null external IDs disappear from an inner join. SQL null equality and join type determine whether unmatched rows survive. In the stated problem, events from different regions are ordered incorrectly in a UTC dashboard; this choice would not establish the required timestamp timezone normalization decision.
D:Compare injected bad-row counts to quality metrics and task status. This validate action addresses a different case (quality metric interpretation), where analysts misread a quality count as the number of pipeline task failures. Expectation metrics describe data rows and must be interpreted separately from orchestration status. In the stated problem, events from different regions are ordered incorrectly in a UTC dashboard; this choice would not establish the required timestamp timezone normalization decision.
Question 782
Operations at Oak Valley Retail owns a workload where an internal metadata crawler must list table columns across catalogs. The previously identified issue was: It uses notebook-specific private metadata APIs that break after upgrades. Which metric or audit check best detects drift?
- Monitor unexpected new tables entering the governed schema
- Monitor crawler failures and schema drift
- Monitor description coverage on newly published tables
- Audit missing-parent-usage failures and overly broad grants
Explanation
Correct Answer
B:Monitor crawler failures and schema drift. This watches the failure mode described by it uses notebook-specific private metadata APIs that break after upgrades. INFORMATION_SCHEMA provides SQL metadata views subject to visibility permissions. It supplies a regression signal after remediation.
Incorrect Answers
A:Monitor unexpected new tables entering the governed schema. This monitor action addresses a different case (schema-level grant inheritance), where analysts must repeatedly request identical SELECT grants for each table. Unity Catalog schema-level privileges can apply to existing and future child objects. In the stated problem, it uses notebook-specific private metadata APIs that break after upgrades; this choice would not establish the required information schema discovery decision.
C:Monitor description coverage on newly published tables. This monitor action addresses a different case (catalog descriptions), where table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. In the stated problem, it uses notebook-specific private metadata APIs that break after upgrades; this choice would not establish the required information schema discovery decision.
D:Audit missing-parent-usage failures and overly broad grants. This monitor action addresses a different case (catalog privilege inheritance), where the team lacks USE CATALOG and USE SCHEMA on the parent containers. Unity Catalog object access generally requires relevant parent usage privileges. In the stated problem, it uses notebook-specific private metadata APIs that break after upgrades; this choice would not establish the required information schema discovery decision.
Question 783
Quality assurance at Redwood Civic Services checks a corrected workload where data engineers need access to a shared external cloud storage prefix. The original fault was: Raw cloud permissions bypass central catalog governance. Which verification is most decisive?
- Search Catalog Explorer and verify definitions distinguish the assets
- Confirm stewards can manage the table while readers retain intended access
- Read the intended dataset and verify access is denied outside the scope
- Confirm managed table storage resolves to the approved location
Explanation
Correct Answer
C:Read the intended dataset and verify access is denied outside the scope. This tests the expected result against raw cloud permissions bypass central catalog governance, not simply whether a job or object exists. External locations map cloud paths to governed Unity Catalog storage credentials.
Incorrect Answers
A:Search Catalog Explorer and verify definitions distinguish the assets. This validate action addresses a different case (catalog descriptions), where table and column metadata lack meaningful descriptions. Unity Catalog comments improve discoverability of governed data assets. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
B:Confirm stewards can manage the table while readers retain intended access. This validate action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
D:Confirm managed table storage resolves to the approved location. This validate action addresses a different case (managed storage ownership), where the data platform cannot apply consistent lifecycle governance. Managed locations centralize storage ownership for Unity Catalog managed assets. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
Question 784
A deployment owner at Westhaven Services needs to implement a remedy: a JDBC ingestion task authenticates to a third-party database. The present failure is: The hard-coded service password has not rotated for a year. Which change should be applied?
- Configure the approved network access control for the workspace
- Transform join IDs consistently under controlled secret access
- Attach a supported mask function to the email column
- Update the approved secret store and database credential without code literals
Explanation
Correct Answer
D:Update the approved secret store and database credential without code literals. This directly changes the feature or logic behind the hard-coded service password has not rotated for a year. Secret management and controlled rotation reduce long-lived credential exposure. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Configure the approved network access control for the workspace. This implement action addresses a different case (ip-based workspace restrictions), where a Unity Catalog table grant does not restrict web-console network entry. Workspace access controls and data-object privileges address different security layers. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
B:Transform join IDs consistently under controlled secret access. This implement action addresses a different case (pseudonymized join keys), where a naive hash without controlled key management risks predictable identifiers. Keyed pseudonymization can preserve joins while reducing identifier exposure. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
C:Attach a supported mask function to the email column. This implement action addresses a different case (column masking), where a raw SELECT on an approved table exposes plaintext email. Unity Catalog column masks can transform sensitive values at read time. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
Question 785
At Arbor Medical, a streaming table has a data quality expectation that drops invalid records. Observed issue: Analysts confuse successful pipeline status with zero rejected records. Before applying a fix, which investigation is most directly relevant?
- Inspect expectation metric counts in the event log
- Inspect event log messages, error class and dataset name around the failed update
- Inspect schedule and last successful update timestamps
- Inspect run status, task IDs and time windows in supported jobs system tables
Explanation
Correct Answer
A:Inspect expectation metric counts in the event log. This checks the specific evidence behind analysts confuse successful pipeline status with zero rejected records. Quality metric events reveal input and dropped records separately from update status. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
B:Inspect event log messages, error class and dataset name around the failed update. This diagnose action addresses a different case (pipeline event log), where the Jobs status only reports a high-level failure. Lakeflow pipeline event logs include update-level errors and progress events. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
C:Inspect schedule and last successful update timestamps. This diagnose action addresses a different case (pipeline update cadence), where scheduled updates are spaced several hours apart. Pipeline update frequency determines available end-to-end freshness. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
D:Inspect run status, task IDs and time windows in supported jobs system tables. This diagnose action addresses a different case (job operational history), where operators only see the most recent run in the Jobs UI. Jobs system records support historical analysis of runs and tasks. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
Question 786
At Westridge Research, an ETL repo only has end-to-end tests that require a live warehouse. A change is required because: Small logic regressions are discovered late and costly to debug. Which implementation action most directly corrects the configuration?
- Update the task dependency list and deploy a tested wheel or requirements set
- Mock external reads in unit tests and run real dependency checks only in integration stages
- Use assertDataFrameEqual and assertSchemaEqual in isolated tests
- Use row_number over the window and retain only rank one
Explanation
Correct Answer
B:Mock external reads in unit tests and run real dependency checks only in integration stages. This directly changes the feature or logic behind small logic regressions are discovered late and costly to debug. Unit tests isolate transformations while integration tests validate external contracts. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Update the task dependency list and deploy a tested wheel or requirements set. This implement action addresses a different case (library version pinning), where a transitive dependency updated to an incompatible version. Explicit compatible dependency versions improve reproducibility across new compute environments. In the stated problem, small logic regressions are discovered late and costly to debug; this choice would not establish the required unit versus integration tests decision.
C:Use assertDataFrameEqual and assertSchemaEqual in isolated tests. This implement action addresses a different case (dataframe testing), where tests only assert that the DataFrame is nonempty. DataFrame equality and schema assertions test data behavior and contracts. In the stated problem, small logic regressions are discovered late and costly to debug; this choice would not establish the required unit versus integration tests decision.
D:Use row_number over the window and retain only rank one. This implement action addresses a different case (window latest record), where the pipeline picks an arbitrary record instead of the newest sequence. ROW_NUMBER ordered by a deterministic sequence within each key selects the desired latest row. In the stated problem, small logic regressions are discovered late and costly to debug; this choice would not establish the required unit versus integration tests decision.
Question 787
At Arbor Medical, a streaming table has a data quality expectation that drops invalid records. A change is required because: Analysts confuse successful pipeline status with zero rejected records. Which implementation action most directly corrects the configuration?
- Query the pipeline event log for the failed dataset and update ID
- Configure the supported job notification destination for failed runs
- Create a supported metrics query for failed expectation records
- Implement Jobs API run enumeration and status extraction
Explanation
Correct Answer
C:Create a supported metrics query for failed expectation records. This directly changes the feature or logic behind analysts confuse successful pipeline status with zero rejected records. Quality metric events reveal input and dropped records separately from update status. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Query the pipeline event log for the failed dataset and update ID. This implement action addresses a different case (pipeline event log), where the Jobs status only reports a high-level failure. Lakeflow pipeline event logs include update-level errors and progress events. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
B:Set the supported job notification destination for failed runs. This implement action addresses a different case (job email notification), where operators manually check the run page every morning. Lakeflow Jobs support status-triggered notifications for run outcomes. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
D:Implement Jobs API run enumeration and status extraction. This implement action addresses a different case (jobs rest monitoring), where a manual UI report omits failed tasks and paginated runs. The Jobs API exposes run records that a program can paginate and aggregate. In the stated problem, analysts confuse successful pipeline status with zero rejected records; this choice would not establish the required expectation monitoring decision.
Question 788
At Lakewood Distribution, a new workspace team needs read-only access to a vendor landing bucket. Observed issue: Engineers propose a credential allowing access to all company buckets. Before applying a fix, which investigation is most directly relevant?
- Inspect current workspace network access controls and identity sign-in rules
- Inspect notebook and folder ACLs for broad edit permissions
- Inspect ownership and grant-management privileges in production
- Inspect storage credential permissions and external-location path scopes
Explanation
Correct Answer
D:Inspect storage credential permissions and external-location path scopes. This checks the specific evidence behind engineers propose a credential allowing access to all company buckets. Unity Catalog storage credentials and external locations can constrain storage access. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect current workspace network access controls and identity sign-in rules. This diagnose action addresses a different case (ip-based workspace restrictions), where a Unity Catalog table grant does not restrict web-console network entry. Workspace access controls and data-object privileges address different security layers. In the stated problem, engineers propose a credential allowing access to all company buckets; this choice would not establish the required storage credential scope decision.
B:Inspect notebook and folder ACLs for broad edit permissions. This diagnose action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, engineers propose a credential allowing access to all company buckets; this choice would not establish the required storage credential scope decision.
C:Inspect ownership and grant-management privileges in production. This diagnose action addresses a different case (separation of duties), where all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. In the stated problem, engineers propose a credential allowing access to all company buckets; this choice would not establish the required storage credential scope decision.
Question 789
At Westhaven Services, a JDBC ingestion task authenticates to a third-party database. Architecture constraint: The hard-coded service password has not rotated for a year. Which design best addresses this requirement?
- Plan secret rotation with a new value and safe rollback
- Plan deletion and eventual physical cleanup consistent with regulatory policy
- Publish a minimal secure view with only approved attributes
- Assign a dedicated production service principal with only required grants
Explanation
Correct Answer
A:Plan secret rotation with a new value and safe rollback. This design addresses the hard-coded service password has not rotated for a year. Secret management and controlled rotation reduce long-lived credential exposure. It establishes the right contract or architecture before execution changes.
Incorrect Answers
B:Plan deletion and eventual physical cleanup consistent with regulatory policy. This design action addresses a different case (retention purge), where expired records remain available in historical serving tables. Retention design must remove records and account for Delta time travel and obsolete files. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
C:Publish a minimal secure view with only approved attributes. This design action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
D:Assign a dedicated production service principal with only required grants. This design action addresses a different case (service principal access), where the individual's credentials create unnecessary privilege and lifecycle risk. Production automation should use least-privilege service principals for stable identity. In the stated problem, the hard-coded service password has not rotated for a year; this choice would not establish the required credential rotation procedure decision.
Question 790
At Lakewood Distribution, a team wants governed read access to a supported external relational database. A change is required because: Engineers export the full source database into cloud object storage each hour. Which implementation action most directly corrects the configuration?
- Create a share, authorize the recipient and attach the approved tables
- Create a supported connection and foreign catalog with least-privilege credentials
- Create a scoped sharing recipient and distribute credentials through an approved channel
- Apply minimal catalog, schema and table grants for the analyst
Explanation
Correct Answer
B:Create a supported connection and foreign catalog with least-privilege credentials. This directly changes the feature or logic behind engineers export the full source database into cloud object storage each hour. Lakehouse Federation can query supported external sources through a catalog connection. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Create a share, authorize the recipient and attach the approved tables. This implement action addresses a different case (d2d managed recipient), where a recipient team copies files manually and loses timely updates. Databricks-to-Databricks Delta Sharing supports governed live access without manual copying. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.
C:Create a scoped sharing recipient and distribute credentials through an approved channel. This implement action addresses a different case (open protocol recipient), where the partner cannot use an internal Databricks-to-Databricks credential flow. Open Delta Sharing can support non-Databricks recipients using the sharing protocol. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.
D:Apply minimal catalog, schema and table grants for the analyst. This implement action addresses a different case (foreign catalog permission), where catalog discovery was mistaken for full table access. Unity Catalog usage and object privileges are still required for foreign data objects. In the stated problem, engineers export the full source database into cloud object storage each hour; this choice would not establish the required federated connection decision.