Databricks Certified Data Engineer Professional Practice Test 36
Question 350
At Redwood Civic Services, an engineer can edit every shared notebook in a production workspace. The known risk is: The team needs read-only access for most users. After remediation, which ongoing signal best detects recurrence?
- Audit row filter changes and unexpectedly broad query results
- Audit unauthorized changes to workspace objects
- Audit deletion request completion and failed dependencies
- Monitor view definition changes and access to raw source
Explanation
Correct Answer
B:Audit unauthorized changes to workspace objects. This watches the failure mode described by the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. It supplies a regression signal after remediation.
Incorrect Answers
A:Audit row filter changes and unexpectedly broad query results. This monitor action addresses a different case (unity catalog row filter), where a shared table currently returns all regions to every reader. Unity Catalog row filters can restrict row visibility through governed policies. In the stated problem, the team needs read-only access for most users; this choice would not establish the required workspace object acl decision.
C:Audit deletion request completion and failed dependencies. This monitor action addresses a different case (data subject request), where deleting a row from only the gold table leaves copies elsewhere. A complete delete workflow tracks identifiers and propagation across all governed copies. In the stated problem, the team needs read-only access for most users; this choice would not establish the required workspace object acl decision.
D:Monitor view definition changes and access to raw source. This monitor action addresses a different case (sensitive data suppression), where a broad SELECT still includes unstructured notes. Column suppression and data minimization prevent unnecessary sensitive-field release. In the stated problem, the team needs read-only access for most users; this choice would not establish the required workspace object acl decision.
Question 351
At Cascade Manufacturing, a reporting table must always contain at least one row per active business unit. A change was deployed to address: The current dashboard has no automated alert for missing units. Which test result provides the strongest evidence that the requirement is now met?
- Cause a safe test failure and confirm exactly one incident is created
- Reconcile a known set of run IDs to the dashboard counts
- Remove one test unit and verify the alert condition is met
- Run an on-time and delayed batch and verify measured lag matches reality
Explanation
Correct Answer
C:Remove one test unit and verify the alert condition is met. This tests the expected result against the current dashboard has no automated alert for missing units, not simply whether a job or object exists. SQL alerts can evaluate a query result against a configured threshold.
Incorrect Answers
A:Cause a safe test failure and confirm exactly one incident is created. This validate action addresses a different case (job webhook destination), where only personal email notifications are configured. Supported job notification destinations can integrate workflow status with an incident system. In the stated problem, the current dashboard has no automated alert for missing units; this choice would not establish the required sql alert threshold decision.
B:Reconcile a known set of run IDs to the dashboard counts. This validate action addresses a different case (jobs rest monitoring), where a manual UI report omits failed tasks and paginated runs. The Jobs API exposes run records that a program can paginate and aggregate. In the stated problem, the current dashboard has no automated alert for missing units; this choice would not establish the required sql alert threshold decision.
D:Run an on-time and delayed batch and verify measured lag matches reality. This validate action addresses a different case (end-to-end sla), where operators monitor compute uptime rather than data freshness. SLA monitoring should measure source event time to published table availability. In the stated problem, the current dashboard has no automated alert for missing units; this choice would not establish the required sql alert threshold decision.
Question 352
An architecture review at Clearstone Media covers a workload where a message bus sends Avro-encoded order events with added optional fields. The unresolved constraint is: An older consumer cannot deserialize records from a newer producer schema. Which design is most appropriate?
- Use a stable checkpoint with a compatible idempotent Delta sink
- Use a governed nested schema contract with an approved evolution policy
- Enforce a common ingestion schema or controlled conversion before append
- Choose compatible Avro schema evolution and default-value conventions
Explanation
Correct Answer
D:Choose compatible Avro schema evolution and default-value conventions. This design addresses an older consumer cannot deserialize records from a newer producer schema. Avro writer-reader schema compatibility must be maintained for evolution. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Use a stable checkpoint with a compatible idempotent Delta sink. This design action addresses a different case (kafka offset durability), where restarting with a fresh checkpoint replays previously ingested messages. A stable streaming checkpoint maintains Kafka offsets and sink progress across restarts. In the stated problem, an older consumer cannot deserialize records from a newer producer schema; this choice would not establish the required avro schema evolution decision.
B:Use a governed nested schema contract with an approved evolution policy. This design action addresses a different case (nested json ingest), where the initial reader assumes one unchanging flat schema and loses new fields. Explicit schema management and rescued data handling protect evolving semi-structured ingestion. In the stated problem, an older consumer cannot deserialize records from a newer producer schema; this choice would not establish the required avro schema evolution decision.
C:Enforce a common ingestion schema or controlled conversion before append. This design action addresses a different case (parquet schema mismatch), where a merge step fails after a producer changes an integer field to string. Parquet schema compatibility matters even when column names are unchanged. In the stated problem, an older consumer cannot deserialize records from a newer producer schema; this choice would not establish the required avro schema evolution decision.
Question 353
At Redwood Civic Services, a streaming source may resend a message with the same event ID. The known risk is: A plain dropDuplicates retains state without a practical bound for never-ending keys. After remediation, which ongoing signal best detects recurrence?
- Monitor state size and duplicates arriving after the retention bound
- Monitor merge conflicts and duplicate source-key exceptions
- Monitor unexpected incompatible type changes
- Alert on failed expectations and blocked pipeline updates
Explanation
Correct Answer
A:Monitor state size and duplicates arriving after the retention bound. This watches the failure mode described by a plain dropDuplicates retains state without a practical bound for never-ending keys. Watermarked streaming deduplication can bound retained duplicate state under an explicit lateness policy. It supplies a regression signal after remediation.
Incorrect Answers
B:Monitor merge conflicts and duplicate source-key exceptions. This monitor action addresses a different case (cdc merge semantics), where the current INSERT-only target contains duplicate customer keys. A keyed Delta MERGE can update existing rows and insert new keys. In the stated problem, a plain dropDuplicates retains state without a practical bound for never-ending keys; this choice would not establish the required streaming dedup watermark decision.
C:Monitor unexpected incompatible type changes. This monitor action addresses a different case (controlled schema evolution), where the silver writer rejects every new record after the upstream schema change. Schema evolution must be reviewed rather than enabling unrestricted acceptance for every column. In the stated problem, a plain dropDuplicates retains state without a practical bound for never-ending keys; this choice would not establish the required streaming dedup watermark decision.
D:Alert on failed expectations and blocked pipeline updates. This monitor action addresses a different case (expectation fail action), where the pipeline continues despite critical null records. Fail-on-violation expectations stop updates rather than silently filtering rows. In the stated problem, a plain dropDuplicates retains state without a practical bound for never-ending keys; this choice would not establish the required streaming dedup watermark decision.
Question 354
At Westhaven Services, a governance team investigates an unexpected table access event. A change is required because: Workspace notebook logs do not show the full audited account activity. Which implementation action most directly corrects the configuration?
- Query supported billing system tables and join approved usage metadata
- Build an access-controlled audit query or dashboard for the event category
- Query the pipeline event log for the failed dataset and update ID
- Configure SQL alert evaluation and approved notification destination
Explanation
Correct Answer
B:Build an access-controlled audit query or dashboard for the event category. This directly changes the feature or logic behind workspace notebook logs do not show the full audited account activity. System audit tables provide security-relevant account events subject to access controls. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Query supported billing system tables and join approved usage metadata. This implement action addresses a different case (billing usage monitoring), where cost reports omit some job and workspace labels. Databricks system billing tables can expose usage records for cost attribution. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
C:Query the pipeline event log for the failed dataset and update ID. This implement action addresses a different case (pipeline event log), where the Jobs status only reports a high-level failure. Lakeflow pipeline event logs include update-level errors and progress events. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
D:Configure SQL alert evaluation and approved notification destination. This implement action addresses a different case (sql alert threshold), where the current dashboard has no automated alert for missing units. SQL alerts can evaluate a query result against a configured threshold. In the stated problem, workspace notebook logs do not show the full audited account activity; this choice would not establish the required audit log review decision.
Question 355
A deployment owner at Pinecrest Holdings needs to implement a remedy: a Delta fact table receives thousands of tiny append files per hour. The present failure is: Read overhead grows because query plans open excessive small files. Which change should be applied?
- Enable predictive optimization for eligible catalog objects under governance
- Enable Photon on the selected supported warehouse or compute
- Run OPTIMIZE or enable managed optimization where supported
- Enable automatic clustering and required predictive optimization settings
Explanation
Correct Answer
C:Run OPTIMIZE or enable managed optimization where supported. This directly changes the feature or logic behind read overhead grows because query plans open excessive small files. OPTIMIZE can compact compatible Delta files without changing logical table contents. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Enable predictive optimization for eligible catalog objects under governance. This implement action addresses a different case (predictive optimization), where operators run blanket manual OPTIMIZE jobs regardless of table use. Predictive optimization can automate supported managed-table maintenance based on workload signals. In the stated problem, read overhead grows because query plans open excessive small files; this choice would not establish the required small file compaction decision.
B:Enable Photon on the selected supported warehouse or compute. This implement action addresses a different case (photon query execution), where an unsupported execution mode limits vectorized engine use. Photon can accelerate supported SQL and DataFrame operators on compatible compute. In the stated problem, read overhead grows because query plans open excessive small files; this choice would not establish the required small file compaction decision.
D:Enable automatic clustering and required predictive optimization settings. This implement action addresses a different case (automatic clustering), where manual clustering keys quickly become stale. Automatic liquid clustering can select keys using query workload when platform prerequisites are met. In the stated problem, read overhead grows because query plans open excessive small files; this choice would not establish the required small file compaction decision.
Question 356
At Arbor Medical, a Spark transformation produces incorrect null handling after a refactor. A change was deployed to address: Tests only assert that the DataFrame is nonempty. Which test result provides the strongest evidence that the requirement is now met?
- Simulate passing and failing checks and verify only the intended path runs
- Force a retry and verify no duplicated sink rows
- Observe a Spark job only after the action runs
- Inject malformed and null cases and verify tests fail correctly
Explanation
Correct Answer
D:Inject malformed and null cases and verify tests fail correctly. This tests the expected result against tests only assert that the DataFrame is nonempty, not simply whether a job or object exists. DataFrame equality and schema assertions test data behavior and contracts.
Incorrect Answers
A:Simulate passing and failing checks and verify only the intended path runs. This validate action addresses a different case (conditional task branches), where both the normal and repair tasks run despite a branching requirement. Lakeflow Jobs condition tasks can route downstream execution based on a result. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
B:Force a retry and verify no duplicated sink rows. This validate action addresses a different case (job retry semantics), where the downstream write repeats non-idempotent side effects on retry. Retries re-execute task logic; application code must protect repeated effects. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
C:Observe a Spark job only after the action runs. This validate action addresses a different case (spark lazy evaluation), where engineers assume an intermediate filter executed before any action. Spark transformations are lazy until an action triggers a job. In the stated problem, tests only assert that the DataFrame is nonempty; this choice would not establish the required dataframe testing decision.
Question 357
Operations at Cascade Manufacturing owns a workload where a notebook uses a third-party package also installed as a cluster library. The previously identified issue was: A notebook-scoped installation overrides the expected cluster version. Which metric or audit check best detects drift?
- Detect unexpected package version changes in startup validation
- Audit access to the secret scope and changes to job identity
- Monitor divergence between tested package and deployed code version
- Detect unmanaged changes to deployed job resources
Explanation
Correct Answer
A:Detect unexpected package version changes in startup validation. This watches the failure mode described by a notebook-scoped installation overrides the expected cluster version. The runtime can resolve conflicting versions from different installation scopes. It supplies a regression signal after remediation.
Incorrect Answers
B:Audit access to the secret scope and changes to job identity. This monitor action addresses a different case (secure configuration), where an API token is committed in a Python notebook tracked in Git. Secret-backed configuration avoids embedding credentials in notebooks or deployment YAML. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.
C:Monitor divergence between tested package and deployed code version. This monitor action addresses a different case (transform composability), where business logic depends on notebook state and widgets. DataFrame.transform supports composable DataFrame-to-DataFrame functions. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.
D:Detect unmanaged changes to deployed job resources. This monitor action addresses a different case (databricks cli resource updates), where production configuration drifts from repository source definitions. Declarative deployment describes resources as reviewed version-controlled artifacts. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.
Question 358
At Fairhaven Transport, a repository change breaks SQL transformations in the production bundle. A change is required because: The deployment pipeline only checks YAML syntax. Which implementation action most directly corrects the configuration?
- Pin or rebuild incompatible wheels and update the bundle library
- Add relevant test jobs and environment approval gates to the pipeline
- Fix the affected dataset definition or upstream schema contract
- Run databricks bundle validate for the intended target in CI
Explanation
Correct Answer
B:Add relevant test jobs and environment approval gates to the pipeline. This directly changes the feature or logic behind the deployment pipeline only checks YAML syntax. CI must run transformation tests and controlled integration checks before deployment. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Pin or rebuild incompatible wheels and update the bundle library. This implement action addresses a different case (python dependency triage), where a package import error appears only on the target compute. Runtime-specific wheel compatibility and pinning must be tested in CI. In the stated problem, the deployment pipeline only checks YAML syntax; this choice would not establish the required ci quality gates decision.
C:Fix the affected dataset definition or upstream schema contract. This implement action addresses a different case (lakeflow event error classes), where the only visible dashboard status is FAILED without a dataset name. Pipeline event logs identify failing update and dataset messages. In the stated problem, the deployment pipeline only checks YAML syntax; this choice would not establish the required ci quality gates decision.
D:Run databricks bundle validate for the intended target in CI. This implement action addresses a different case (bundle validation), where an invalid resource key would be rejected only after production change. Bundle validation detects many configuration problems before deployment. In the stated problem, the deployment pipeline only checks YAML syntax; this choice would not establish the required ci quality gates decision.
Question 359
At Fairhaven Transport, security wants to limit interactive workspace logins from untrusted networks. Architecture constraint: A Unity Catalog table grant does not restrict web-console network entry. Which design best addresses this requirement?
- Use group-based least-privilege workspace object permissions
- Assign distinct deployment operators and data stewards with scoped privileges
- Use supported workspace network restrictions in addition to UC data permissions
- Design an auditable deletion workflow spanning every relevant layer
Explanation
Correct Answer
C:Use supported workspace network restrictions in addition to UC data permissions. This design addresses a Unity Catalog table grant does not restrict web-console network entry. Workspace access controls and data-object privileges address different security layers. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Use group-based least-privilege workspace object permissions. This design action addresses a different case (workspace object acl), where the team needs read-only access for most users. Workspace object permissions can restrict who can edit or manage shared code. In the stated problem, a Unity Catalog table grant does not restrict web-console network entry; this choice would not establish the required ip-based workspace restrictions decision.
B:Assign distinct deployment operators and data stewards with scoped privileges. This design action addresses a different case (separation of duties), where all developers currently own production catalogs and can grant access. Separate deploy and governance roles reduce accidental privilege escalation. In the stated problem, a Unity Catalog table grant does not restrict web-console network entry; this choice would not establish the required ip-based workspace restrictions decision.
D:Design an auditable deletion workflow spanning every relevant layer. This design action addresses a different case (data subject request), where deleting a row from only the gold table leaves copies elsewhere. A complete delete workflow tracks identifiers and propagation across all governed copies. In the stated problem, a Unity Catalog table grant does not restrict web-console network entry; this choice would not establish the required ip-based workspace restrictions decision.
Question 360
Quality assurance at Arbor Medical checks a corrected workload where cI deploys bundles using a developer personal access token. The original fault was: Scheduled production deployment fails when the developer's token expires. Which verification is most decisive?
- Submit a known broken transformation and confirm deployment is blocked
- Repair the task and verify one notification per batch
- Introduce an invalid key and confirm CI prevents deployment
- Rotate the human token and verify CI deployment still authenticates
Explanation
Correct Answer
D:Rotate the human token and verify CI deployment still authenticates. This tests the expected result against scheduled production deployment fails when the developer's token expires, not simply whether a job or object exists. Workload identity or service principal authentication decouples CI from employees.
Incorrect Answers
A:Submit a known broken transformation and confirm deployment is blocked. This validate action addresses a different case (ci quality gates), where the deployment pipeline only checks YAML syntax. CI must run transformation tests and controlled integration checks before deployment. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.
B:Repair the task and verify one notification per batch. This validate action addresses a different case (idempotent retry repair), where customers receive repeated notifications for the same batch. Task retries need idempotent side effects even when upstream work is reused. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.
C:Introduce an invalid key and confirm CI prevents deployment. This validate action addresses a different case (bundle validation), where an invalid resource key would be rejected only after production change. Bundle validation detects many configuration problems before deployment. In the stated problem, scheduled production deployment fails when the developer's token expires; this choice would not establish the required api deployment authentication decision.