Databricks Certified Data Engineer Professional Practice Test 73
Question 720
At Granite Edge Labs, a provider exposes a whole schema when only one vetted table was approved. A change is required because: The recipient can discover unintended datasets. Which implementation action most directly corrects the configuration?
- Configure the share without building redundant daily copy pipelines
- Create a scoped sharing recipient and distribute credentials through an approved channel
- Create a share, authorize the recipient and attach the approved tables
- Remove unapproved assets and add only the vetted table to the share
Explanation
Correct Answer
D:Remove unapproved assets and add only the vetted table to the share. This directly changes the feature or logic behind the recipient can discover unintended datasets. A Delta Sharing share should contain only explicitly approved assets. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Configure the share without building redundant daily copy pipelines. This implement action addresses a different case (shared table freshness), where consumers assume the share is a nightly static export. Delta Sharing exposes current authorized data as the provider updates the source. In the stated problem, the recipient can discover unintended datasets; this choice would not establish the required share catalog scope decision.
B:Create a scoped sharing recipient and distribute credentials through an approved channel. This implement action addresses a different case (open protocol recipient), where the partner cannot use an internal Databricks-to-Databricks credential flow. Open Delta Sharing can support non-Databricks recipients using the sharing protocol. In the stated problem, the recipient can discover unintended datasets; this choice would not establish the required share catalog scope decision.
C:Create a share, authorize the recipient and attach the approved tables. This implement action addresses a different case (d2d managed recipient), where a recipient team copies files manually and loses timely updates. Databricks-to-Databricks Delta Sharing supports governed live access without manual copying. In the stated problem, the recipient can discover unintended datasets; this choice would not establish the required share catalog scope decision.
Question 721
At Vantage Security, an events table has high-cardinality device IDs and unpredictable daily volumes. Architecture constraint: Partitioning by device would produce many tiny partitions. Which design best addresses this requirement?
- Choose supported liquid clustering on commonly filtered device fields
- Collect useful statistics for frequently filtered columns within supported limits
- Use CLUSTER BY AUTO for supported Unity Catalog managed Delta tables
- Choose a supported columnar Delta or Parquet layout for analytics
Explanation
Correct Answer
A:Choose supported liquid clustering on commonly filtered device fields. This design addresses partitioning by device would produce many tiny partitions. Liquid clustering organizes data by useful filter keys without high-cardinality partition directories. It establishes the right contract or architecture before execution changes.
Incorrect Answers
B:Collect useful statistics for frequently filtered columns within supported limits. This design action addresses a different case (data skipping statistics), where file-level statistics are missing for the filter column. Delta data skipping uses collected column statistics to eliminate files. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
C:Use CLUSTER BY AUTO for supported Unity Catalog managed Delta tables. This design action addresses a different case (automatic clustering), where manual clustering keys quickly become stale. Automatic liquid clustering can select keys using query workload when platform prerequisites are met. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
D:Choose a supported columnar Delta or Parquet layout for analytics. This design action addresses a different case (columnar compression), where row-oriented text storage increases scans and transfer volumes. Columnar formats and appropriate encoding improve analytical read efficiency. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
Question 722
A data engineer at Vantage Security must troubleshoot this case: an events table has high-cardinality device IDs and unpredictable daily volumes. Evidence: Partitioning by device would produce many tiny partitions. What should be inspected first to confirm the failure mechanism?
- Inspect per-task shuffle read bytes and spilled data
- Inspect filters, cardinalities and existing partition layout
- Inspect MERGE condition and target files read
- Inspect task skew and key-frequency histograms
Explanation
Correct Answer
B:Inspect filters, cardinalities and existing partition layout. This checks the specific evidence behind partitioning by device would produce many tiny partitions. Liquid clustering organizes data by useful filter keys without high-cardinality partition directories. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect per-task shuffle read bytes and spilled data. This diagnose action addresses a different case (shuffle partition count), where the current partition count is too low for data volume. Shuffle partition sizing affects memory pressure and task parallelism. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
C:Inspect MERGE condition and target files read. This diagnose action addresses a different case (predicate-limited merge), where the merge scans unrelated historical partitions. Constraining merge matches to relevant partitions can reduce unnecessary target scanning. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
D:Inspect task skew and key-frequency histograms. This diagnose action addresses a different case (skewed joins), where a single join partition spills heavily to disk. Adaptive skew handling or key salting can mitigate a hot join key. In the stated problem, partitioning by device would produce many tiny partitions; this choice would not establish the required liquid clustering cardinality decision.
Question 723
At Meadowland Software, a CI pipeline modifies jobs through ad hoc unversioned API calls. A change was deployed to address: Production configuration drifts from repository source definitions. Which test result provides the strongest evidence that the requirement is now met?
- Confirm unit tests run without credentials and integrations run in an approved test workspace
- Deploy the same revision to test and staging using distinct bundle targets
- Confirm deployment reflects the reviewed configuration without extra changes
- Confirm target exchange or join behavior changed and query results remain equivalent
Explanation
Correct Answer
C:Confirm deployment reflects the reviewed configuration without extra changes. This tests the expected result against production configuration drifts from repository source definitions, not simply whether a job or object exists. Declarative deployment describes resources as reviewed version-controlled artifacts.
Incorrect Answers
A:Confirm unit tests run without credentials and integrations run in an approved test workspace. This validate action addresses a different case (unit versus integration tests), where small logic regressions are discovered late and costly to debug. Unit tests isolate transformations while integration tests validate external contracts. In the stated problem, production configuration drifts from repository source definitions; this choice would not establish the required databricks cli resource updates decision.
B:Deploy the same revision to test and staging using distinct bundle targets. This validate action addresses a different case (bundle repository layout), where source files and deployment definitions are coupled to one developer workspace. A versioned Declarative Automation Bundle defines code and resource configurations separately from the target workspace. In the stated problem, production configuration drifts from repository source definitions; this choice would not establish the required databricks cli resource updates decision.
D:Confirm target exchange or join behavior changed and query results remain equivalent. This validate action addresses a different case (spark explain plans), where developers tune executor size without inspecting actual exchanges. The physical execution plan exposes exchanges, scan filters and join strategy. In the stated problem, production configuration drifts from repository source definitions; this choice would not establish the required databricks cli resource updates decision.
Question 724
At Meadowland Software, an ETL team writes a large analytic table with high-cardinality strings. A change is required because: Row-oriented text storage increases scans and transfer volumes. Which implementation action most directly corrects the configuration?
- Create the managed table under the approved catalog and migrate governed data
- Add supported partition or clustering predicates to MERGE match conditions
- Migrate a compatible task to serverless execution with approved permissions
- Write governed Delta/Parquet output with compatible compression settings
Explanation
Correct Answer
D:Write governed Delta/Parquet output with compatible compression settings. This directly changes the feature or logic behind row-oriented text storage increases scans and transfer volumes. Columnar formats and appropriate encoding improve analytical read efficiency. It is the concrete configuration for the stated incident.
Incorrect Answers
A:Create the managed table under the approved catalog and migrate governed data. This implement action addresses a different case (managed table maintenance), where each table has custom file cleanup jobs and broad storage permissions. Unity Catalog managed tables provide platform-managed data placement and maintenance capabilities. In the stated problem, row-oriented text storage increases scans and transfer volumes; this choice would not establish the required columnar compression decision.
B:Add supported partition or clustering predicates to MERGE match conditions. This implement action addresses a different case (predicate-limited merge), where the merge scans unrelated historical partitions. Constraining merge matches to relevant partitions can reduce unnecessary target scanning. In the stated problem, row-oriented text storage increases scans and transfer volumes; this choice would not establish the required columnar compression decision.
C:Migrate a compatible task to serverless execution with approved permissions. This implement action addresses a different case (serverless job fit), where provisioning overhead exceeds useful task execution time. Supported serverless jobs can reduce infrastructure management and startup overhead. In the stated problem, row-oriented text storage increases scans and transfer volumes; this choice would not establish the required columnar compression decision.
Question 725
A data engineer at Northfield Analytics must troubleshoot this case: a streaming table may accept only rows with nonnull transaction IDs. Evidence: Invalid rows currently reach downstream aggregates. What should be inspected first to confirm the failure mechanism?
- Inspect the streaming table definition and expectation violation counts
- Inspect existing expectation rules and failed-update event details
- Inspect malformed timestamps and pipeline data-quality rules
- Inspect array lengths and expected order-item row counts
Explanation
Correct Answer
A:Inspect the streaming table definition and expectation violation counts. This checks the specific evidence behind invalid rows currently reach downstream aggregates. A Lakeflow expectation configured to drop invalid rows filters violations from target output. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
B:Inspect existing expectation rules and failed-update event details. This diagnose action addresses a different case (expectation fail action), where the pipeline continues despite critical null records. Fail-on-violation expectations stop updates rather than silently filtering rows. In the stated problem, invalid rows currently reach downstream aggregates; this choice would not establish the required expectation drop action decision.
C:Inspect malformed timestamps and pipeline data-quality rules. This diagnose action addresses a different case (quarantine bad records), where dropping invalid rows silently hides upstream quality failures. Quarantine preserves invalid events separately while allowing valid records through. In the stated problem, invalid rows currently reach downstream aggregates; this choice would not establish the required expectation drop action decision.
D:Inspect array lengths and expected order-item row counts. This diagnose action addresses a different case (array explosion), where an order-level aggregation mistakenly treats the array as a single item. explode creates item-level rows when the business grain requires each array element. In the stated problem, invalid rows currently reach downstream aggregates; this choice would not establish the required expectation drop action decision.
Question 726
At Cedar Brook Commerce, operators change a production job setting in the UI after deployment. Architecture constraint: Subsequent CI redeployment unexpectedly overwrites it. Which design best addresses this requirement?
- Gate deployment on successful bundle validation
- Define a controlled change-management path for resource configuration
- Use branch-based review and merge before deployment
- Plan rollback of code/resources while protecting compatible state and schema
Explanation
Correct Answer
B:Define a controlled change-management path for resource configuration. This design addresses subsequent CI redeployment unexpectedly overwrites it. Declarative source of truth should include intentional job-resource changes. It establishes the right contract or architecture before execution changes.
Incorrect Answers
A:Gate deployment on successful bundle validation. This design action addresses a different case (bundle validation), where an invalid resource key would be rejected only after production change. Bundle validation detects many configuration problems before deployment. In the stated problem, subsequent CI redeployment unexpectedly overwrites it; this choice would not establish the required unmanaged resource drift decision.
C:Use branch-based review and merge before deployment. This design action addresses a different case (git folder collaboration), where there is no controlled code review or rollback history. Databricks Git folders connect workspace development to version control. In the stated problem, subsequent CI redeployment unexpectedly overwrites it; this choice would not establish the required unmanaged resource drift decision.
D:Plan rollback of code/resources while protecting compatible state and schema. This design action addresses a different case (rollback deployment), where deployers have no record of the previous working configuration. Versioned bundle releases enable controlled rollback to a known commit. In the stated problem, subsequent CI redeployment unexpectedly overwrites it; this choice would not establish the required unmanaged resource drift decision.
Question 727
A data engineer at Redwood Civic Services must troubleshoot this case: data engineers need access to a shared external cloud storage prefix. Evidence: Raw cloud permissions bypass central catalog governance. What should be inspected first to confirm the failure mechanism?
- Review notebook defaults and catalog settings for both environments
- Inspect catalog BROWSE and SELECT grants for the discovery group
- Inspect external location paths and grants against business scope
- Inspect current owner and authorized ownership transfer process
Explanation
Correct Answer
C:Inspect external location paths and grants against business scope. This checks the specific evidence behind raw cloud permissions bypass central catalog governance. External locations map cloud paths to governed Unity Catalog storage credentials. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Inspect notebook defaults and catalog settings for both environments. This diagnose action addresses a different case (environment catalog isolation), where both environments use the same default catalog name in notebooks. Environment-specific catalogs and explicit target names reduce cross-environment writes. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
B:Inspect catalog BROWSE and SELECT grants for the discovery group. This diagnose action addresses a different case (browse metadata privilege), where teams grant SELECT merely to expose object listings. BROWSE enables controlled metadata discovery without granting data read access. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
D:Inspect current owner and authorized ownership transfer process. This diagnose action addresses a different case (ownership reassignment), where new data stewards cannot maintain its grants. Unity Catalog ownership should be assigned to a maintained principal. In the stated problem, raw cloud permissions bypass central catalog governance; this choice would not establish the required external location governance decision.
Question 728
Quality assurance at Horizon Travel checks a corrected workload where an ETL workload provisioned large clusters for short jobs. The original fault was: Most provisioned resources sit idle between job runs. Which verification is most decisive?
- Reconcile a known set of run IDs to the dashboard counts
- Correlate a known failed run to its constituent failed task
- Find the expected schema error and confirm it disappears after correction
- Compare total runtime and spend before and after
Explanation
Correct Answer
D:Compare total runtime and spend before and after. This tests the expected result against most provisioned resources sit idle between job runs, not simply whether a job or object exists. Compute metrics and usage history distinguish idle capacity from active work.
Incorrect Answers
A:Reconcile a known set of run IDs to the dashboard counts. This validate action addresses a different case (jobs rest monitoring), where a manual UI report omits failed tasks and paginated runs. The Jobs API exposes run records that a program can paginate and aggregate. In the stated problem, most provisioned resources sit idle between job runs; this choice would not establish the required compute utilization decision.
B:Correlate a known failed run to its constituent failed task. This validate action addresses a different case (job operational history), where operators only see the most recent run in the Jobs UI. Jobs system records support historical analysis of runs and tasks. In the stated problem, most provisioned resources sit idle between job runs; this choice would not establish the required compute utilization decision.
C:Find the expected schema error and confirm it disappears after correction. This validate action addresses a different case (pipeline event log), where the Jobs status only reports a high-level failure. Lakeflow pipeline event logs include update-level errors and progress events. In the stated problem, most provisioned resources sit idle between job runs; this choice would not establish the required compute utilization decision.
Question 729
At Vantage Security, a stream groups clicks by event time in ten-minute windows. Architecture constraint: Old keys remain in state indefinitely without a lateness bound. Which design best addresses this requirement?
- Choose a watermark tolerance based on allowed late-arrival behavior
- Choose tuning steps based on join and shuffle operators shown in the plan
- Set a documented lateness policy reflecting source delays and reporting SLA
- Choose tracked history columns and a Type 2 CDC target
Explanation
Correct Answer
A:Choose a watermark tolerance based on allowed late-arrival behavior. This design addresses old keys remain in state indefinitely without a lateness bound. Watermarks provide a lateness threshold for bounded stateful streaming operations. It establishes the right contract or architecture before execution changes.
Incorrect Answers
B:Choose tuning steps based on join and shuffle operators shown in the plan. This design action addresses a different case (spark explain plans), where developers tune executor size without inspecting actual exchanges. The physical execution plan exposes exchanges, scan filters and join strategy. In the stated problem, old keys remain in state indefinitely without a lateness bound; this choice would not establish the required event-time watermarking decision.
C:Set a documented lateness policy reflecting source delays and reporting SLA. This design action addresses a different case (late event semantics), where reports silently discard legitimate late events under an aggressive watermark. A watermark trades supported lateness for state size and timeliness. In the stated problem, old keys remain in state indefinitely without a lateness bound; this choice would not establish the required event-time watermarking decision.
D:Choose tracked history columns and a Type 2 CDC target. This design action addresses a different case (scd type 2 history), where overwrite-style updates destroy historical state needed for point-in-time reporting. SCD Type 2 records effective history instead of replacing the previous version. In the stated problem, old keys remain in state indefinitely without a lateness bound; this choice would not establish the required event-time watermarking decision.
Question 730
At Cascade Manufacturing, a notebook uses a third-party package also installed as a cluster library. Observed issue: A notebook-scoped installation overrides the expected cluster version. Before applying a fix, which investigation is most directly relevant?
- Compare production deployment variables with bundle target overrides
- Compare notebook and cluster package versions and import origins
- Compare deployed job JSON with the version-controlled bundle
- Compare job parameter definitions to hard-coded notebook literals
Explanation
Correct Answer
B:Compare notebook and cluster package versions and import origins. This checks the specific evidence behind a notebook-scoped installation overrides the expected cluster version. The runtime can resolve conflicting versions from different installation scopes. The investigation distinguishes the mechanism from an unrelated operational symptom.
Incorrect Answers
A:Compare production deployment variables with bundle target overrides. This diagnose action addresses a different case (bundle target overrides), where development job arguments were deployed into the production target. Bundle targets can override environment-specific variables and resource settings. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.
C:Compare deployed job JSON with the version-controlled bundle. This diagnose action addresses a different case (databricks cli resource updates), where production configuration drifts from repository source definitions. Declarative deployment describes resources as reviewed version-controlled artifacts. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.
D:Compare job parameter definitions to hard-coded notebook literals. This diagnose action addresses a different case (job parameters), where code contains hard-coded region IDs and catalog names. Task parameters allow runtime-specific values without changing notebook source. In the stated problem, a notebook-scoped installation overrides the expected cluster version; this choice would not establish the required library precedence decision.