Databricks Certified Machine Learning Professional Practice Test 50
Question 490
Consider the following fictional Databricks production case: A research group wants to register a custom classification model in Unity Catalog but uses a local path as its complete model identity and has no governed model name. Which observation most directly tests the suspected failure boundary?
- Compare current endpoint settings with source-controlled deployment configuration and documented backup state.
- Compare response creation time, endpoint model version and cache keys before and after rollback.
- Compare sandbox/prod identities, model grants and sanitized deployment authorization errors.
- Inspect model artifact source, planned three-level Unity Catalog name and effective registration permissions.
Explanation
Correct Answer
D:This is the most discriminating check for the observed symptoms. Inspect model artifact source, planned three-level Unity Catalog name and effective registration permissions. The underlying technical issue is that governed custom-model registration requires a model artifact plus catalog/schema/model identity and appropriate permissions.
Incorrect Answers
A:That diagnostic evidence is directed at a different custom model serving situation: A platform engineer creates a custom serving endpoint manually and assumes the exact settings can be recovered after an accidental deletion. For the stated incident, the decisive observation is inspect model artifact source, planned three-level Unity Catalog name and effective registration permissions.
B:That diagnostic evidence is directed at a different custom model serving situation: An integration caches predictions without recording the model version and returns yesterday's values after a controlled rollback. For the stated incident, the decisive observation is inspect model artifact source, planned three-level Unity Catalog name and effective registration permissions.
C:That diagnostic evidence is directed at a different custom model serving situation: A test engineer can create a model-serving endpoint in a sandbox but the production deployment fails because the automation identity lacks registered-model access. For the stated incident, the decisive observation is inspect model artifact source, planned three-level Unity Catalog name and effective registration permissions.
Question 491
The engineering team encounters the following issue: A feature stream loses half its source events and a retraining policy treats the resulting input shift as proof that the learned concept changed. What direct consequence should the owner prioritize if no fix is made?
- Random sampling noise causes frequent unnecessary production model swaps.
- The winning model cannot serve requests on time or within allocated capacity.
- A statistically better average model causes larger losses for the protected operational segment.
- Training on incomplete observations worsens the model instead of correcting the ingestion outage.
Explanation
Correct Answer
D:This consequence follows from the specific unresolved condition. Training on incomplete observations worsens the model instead of correcting the ingestion outage. The causal constraint is: Data pipeline outages must be distinguished from genuine population shift before retraining.
Incorrect Answers
A:That direct consequence is directed at a different automated retraining situation: A new model beats the champion by 0.1 percentage points on a tiny evaluation set, and the team automatically promotes it despite large uncertainty. The more immediate risk here is training on incomplete observations worsens the model instead of correcting the ingestion outage.
B:That direct consequence is directed at a different automated retraining situation: An AutoML training job always chooses the model with the lowest training loss, even when the deployed service has a strict memory and P95 latency budget. The more immediate risk here is training on incomplete observations worsens the model instead of correcting the ingestion outage.
C:That direct consequence is directed at a different automated retraining situation: A new fraud classifier improves overall F1 but doubles false negatives for high-value payment accounts, and an automated policy chooses it on F1 alone. The more immediate risk here is training on incomplete observations worsens the model instead of correcting the ingestion outage.
Question 492
A production ML review contains this situation: A customer product-category feature acquires many new category values and analysts try to detect the change using only the overall row count. Which diagnostic check provides the strongest direct evidence?
- Compare baseline and current per-category shares, unseen categories and sample counts.
- Compare historical baselines, current seasonal patterns and change approvals for the existing threshold.
- Check label availability, label delay and prediction-to-label matching IDs in the inference data.
- Inspect baseline table versions and the order of writes relative to metric computations.
Explanation
Correct Answer
A:This is the most discriminating check for the observed symptoms. Compare baseline and current per-category shares, unseen categories and sample counts. The underlying technical issue is that categorical distribution drift needs category frequency or supported categorical distance measures, not only volume.
Incorrect Answers
B:That diagnostic evidence is directed at a different drift detection and lakehouse monitoring situation: A production alert threshold is hard-coded against last year's baseline, but seasonal traffic has shifted and the owner never reviewed the threshold. For the stated incident, the decisive observation is compare baseline and current per-category shares, unseen categories and sample counts.
C:That diagnostic evidence is directed at a different drift detection and lakehouse monitoring situation: A model's inference table records output probabilities but omits ground-truth labels, yet reviewers expect immediate precision and recall metrics. For the stated incident, the decisive observation is compare baseline and current per-category shares, unseen categories and sample counts.
D:That diagnostic evidence is directed at a different drift detection and lakehouse monitoring situation: A baseline table is overwritten every night with the current day's data before a drift calculation, making the comparison always look unchanged. For the stated incident, the decisive observation is compare baseline and current per-category shares, unseen categories and sample counts.
Question 493
In an enterprise ML workflow, the reported issue is: A new Spark developer calls transform on an unfitted StringIndexer instance and expects learned category labels to appear automatically. How should the engineer validate the correction?
- A representative training job completes through executor tasks without materializing all training rows on the driver.
- A small synthetic record passes every pipeline stage and yields a numeric feature vector of expected dimension.
- The selected candidate has the minimum validated RMSE among comparable parameter configurations.
- A controlled example maps known training categories to stable numeric indices using the fitted model.
Explanation
Correct Answer
D:This verification measures the required result rather than just process liveness. A controlled example maps known training categories to stable numeric indices using the fitted model. It confirms whether the targeted action succeeded: call fit on appropriate training observations and transform with the resulting StringIndexerModel.
Incorrect Answers
A:That acceptance test is directed at a different using spark ml situation: A retailer trains a demand classifier on 180 million Delta rows already partitioned across a Spark cluster, but an analyst attempts to convert the entire training set to a local pandas object. Here the actual success criterion is a controlled example maps known training categories to stable numeric indices using the fitted model.
B:That acceptance test is directed at a different using spark ml situation: An IoT classifier passes raw text categories directly into VectorAssembler ahead of StringIndexer and OneHotEncoder, generating incompatible vector inputs. Here the actual success criterion is a controlled example maps known training categories to stable numeric indices using the fitted model.
C:That acceptance test is directed at a different using spark ml situation: A SparkML grid-search experiment selects the model with the largest error metric even though the evaluator reports RMSE to minimize. Here the actual success criterion is a controlled example maps known training categories to stable numeric indices using the fitted model.
Question 494
A production ML review contains this situation: A sensor feature pipeline computes rolling 30-minute averages by arrival time, although delayed events carry trustworthy event timestamps. Which statement best explains the failure mode?
- Streaming feature windows should use appropriate event-time semantics and a stated lateness policy.
- Historical feature timelines must be retained when reproducible point-in-time joins depend on prior values.
- A time-series feature table needs a documented timestamp key and an as-of lookup to avoid multiplying labels or attaching future values.
- On-demand feature serving must account for dependency latency and failure budgets within the endpoint SLA.
Explanation
Correct Answer
A:The technical constraint is specific to the reported failure. Streaming feature windows should use appropriate event-time semantics and a stated lateness policy. To test it, compare event timestamps, ingestion timestamps and window assignment for late synthetic readings.
Incorrect Answers
B:That underlying principle is directed at a different advanced feature store concepts situation: A model's feature generation step overwrites all feature-table history daily even though time-aware training requires earlier snapshots. The current incident instead turns on streaming feature windows should use appropriate event-time semantics and a stated lateness policy.
C:That underlying principle is directed at a different advanced feature store concepts situation: A training dataset combines a feature table with multiple timestamped rows per device using an equality join on device ID only. The current incident instead turns on streaming feature windows should use appropriate event-time semantics and a stated lateness policy.
D:That underlying principle is directed at a different advanced feature store concepts situation: A streaming recommender's request-time feature function calls a slow third-party API synchronously on every prediction. The current incident instead turns on streaming feature windows should use appropriate event-time semantics and a stated lateness policy.
Question 495
A production ML review contains this situation: A retraining pipeline ranks candidate models using metrics calculated on different dataset versions, then selects the numerically highest result. Which statement best explains the failure mode?
- Retraining triggers and production promotion are different stages with separate evaluation and rollout gates.
- Drift-triggered retraining needs statistically and operationally justified thresholds, not arbitrary raw metric movement.
- Model candidates need evaluation on the same versioned holdout and metric definition for fair comparison.
- Data pipeline outages must be distinguished from genuine population shift before retraining.
Explanation
Correct Answer
C:The technical constraint is specific to the reported failure. Model candidates need evaluation on the same versioned holdout and metric definition for fair comparison. To test it, compare holdout snapshot IDs, label maturity and metric computation versions in candidate MLflow runs.
Incorrect Answers
A:That underlying principle is directed at a different automated retraining situation: An alert from a feature monitor automatically replaces the live model with a newly trained artifact without testing or approval. The current incident instead turns on model candidates need evaluation on the same versioned holdout and metric definition for fair comparison.
B:That underlying principle is directed at a different automated retraining situation: An automated retraining job triggers whenever a numerical feature mean shifts by 0.1, regardless of normal seasonal changes or sample size. The current incident instead turns on model candidates need evaluation on the same versioned holdout and metric definition for fair comparison.
D:That underlying principle is directed at a different automated retraining situation: A feature stream loses half its source events and a retraining policy treats the resulting input shift as proof that the learned concept changed. The current incident instead turns on model candidates need evaluation on the same versioned holdout and metric definition for fair comparison.
Question 496
In an enterprise ML workflow, the reported issue is: A team wants to convert several numeric inputs into one features vector but treats VectorAssembler as a clustering Estimator that should output predictions. Which change addresses the real cause without undermining other requirements?
- Hold out a final test set before tuning and score the selected pipeline exactly once after selection.
- Choose a justified supported unknown-category handling strategy and test it without retraining on confidential evaluation labels.
- Create an appropriate holdout design, including relevant new-user or time-split cohorts, and evaluate there.
- Apply VectorAssembler to produce the features vector before fitting the chosen learning algorithm.
Explanation
Correct Answer
D:This corrects the relevant failure boundary instead of merely hiding the symptom. Apply VectorAssembler to produce the features vector before fitting the chosen learning algorithm. The issue matters because a predictor is given nonexistent features or operators expect labels from a nonpredictive stage.
Incorrect Answers
A:That corrective action is directed at a different using spark ml situation: After choosing the best parameter map, a data scientist reports the same cross-validation score as an independent final test result without any untouched data. The relevant corrective action here is apply VectorAssembler to produce the features vector before fitting the chosen learning algorithm.
B:That corrective action is directed at a different using spark ml situation: An inference pipeline sends new categorical labels unseen during training to StringIndexerModel with error handling configured to reject unknown categories. The relevant corrective action here is apply VectorAssembler to produce the features vector before fitting the chosen learning algorithm.
C:That corrective action is directed at a different using spark ml situation: A recommender experiment computes all evaluation metrics on training interactions and reports the result as generalization to new customers. The relevant corrective action here is apply VectorAssembler to produce the features vector before fitting the chosen learning algorithm.
Question 497
In an enterprise ML workflow, the reported issue is: A time-series monitor uses a string-formatted date that cannot be reliably converted to timestamps and silently groups most rows into an unknown bucket. How should the engineer validate the correction?
- Matching-filter fixtures show no artificial drift while a real within-segment change remains detectable.
- The shifted synthetic cohort triggers the expected numeric distribution alert and the baseline cohort does not.
- All accepted test timestamps land in the correct expected monitoring interval.
- The profile generates expected current-table completeness and distribution statistics without inventing prediction metadata.
Explanation
Correct Answer
C:This verification measures the required result rather than just process liveness. All accepted test timestamps land in the correct expected monitoring interval. It confirms whether the targeted action succeeded: normalize and validate a supported timestamp field before applying the configured temporal profile.
Incorrect Answers
A:That acceptance test is directed at a different drift detection and lakehouse monitoring situation: A customer-risk monitoring job compares an unfiltered current high-risk segment to an all-customer historical baseline and interprets the difference as temporal drift. Here the actual success criterion is all accepted test timestamps land in the correct expected monitoring interval.
B:That acceptance test is directed at a different drift detection and lakehouse monitoring situation: A loan-risk feature usually has median debt-to-income 0.34, but a new cohort has median 0.61 while the average stays almost unchanged due to outliers. Here the actual success criterion is all accepted test timestamps land in the correct expected monitoring interval.
D:That acceptance test is directed at a different drift detection and lakehouse monitoring situation: An analyst wants to inspect today’s static customer table for missing values and profile changes but chooses an inference monitor requiring model IDs and predictions. Here the actual success criterion is all accepted test timestamps land in the correct expected monitoring interval.
Question 498
The engineering team encounters the following issue: A nightly scoring feed drops all null-feature rows before calculating drift, making missingness jump invisible. Which technical principle most directly explains the root of the issue?
- Input distribution and predictive outcome quality are complementary monitoring signals with different evidence needs.
- Missing-value changes can be a quality or distribution signal and should not be silently discarded from monitored populations.
- Monitor creation and ongoing metric writes depend on governed resource access and configured output locations.
- Global thresholds can hide local critical slices; alerting should reflect operational segmentation where justified.
Explanation
Correct Answer
B:The technical constraint is specific to the reported failure. Missing-value changes can be a quality or distribution signal and should not be silently discarded from monitored populations. To test it, compare null counts and prefilter event totals between baseline and current windows.
Incorrect Answers
A:That underlying principle is directed at a different drift detection and lakehouse monitoring situation: A risk service measures feature drift but neglects observed-label performance and continues serving an accurate-looking yet ineffective model. The current incident instead turns on missing-value changes can be a quality or distribution signal and should not be silently discarded from monitored populations.
C:That underlying principle is directed at a different drift detection and lakehouse monitoring situation: A monitor is pointed at a Unity Catalog table but the automation identity lacks the privileges needed to generate profile outputs. The current incident instead turns on missing-value changes can be a quality or distribution signal and should not be silently discarded from monitored populations.
D:That underlying principle is directed at a different drift detection and lakehouse monitoring situation: An alert query uses one global transaction-failure count and masks a complete outage in a small high-value region. The current incident instead turns on missing-value changes can be a quality or distribution signal and should not be silently discarded from monitored populations.
Question 499
Review this production model incident: A drift alert fires but its message contains only the word anomaly without dataset, model version or baseline window. Which failure risk follows most closely from the unresolved behavior?
- Users cannot receive predictions because of infrastructure failures that retraining cannot fix.
- On-call responders cannot reproduce or prioritize the reported shift.
- A material disparity is hidden inside the overall average model performance.
- False optimism or pessimism distorts the model's apparent accuracy and promotion decisions.
Explanation
Correct Answer
B:This consequence follows from the specific unresolved condition. On-call responders cannot reproduce or prioritize the reported shift. The causal constraint is: Alert payloads should carry sufficient metric and lineage context for safe triage.
Incorrect Answers
A:That direct consequence is directed at a different drift detection and lakehouse monitoring situation: An endpoint's error rate spikes while data profiles look normal, and responders attempt to retrain the model instead of checking serving infrastructure. The more immediate risk here is on-call responders cannot reproduce or prioritize the reported shift.
C:That direct consequence is directed at a different drift detection and lakehouse monitoring situation: A fairness reviewer needs the difference in false-negative rates between two approved cohorts, but the monitor computes an aggregate without cohort labels. The more immediate risk here is on-call responders cannot reproduce or prioritize the reported shift.
D:That direct consequence is directed at a different drift detection and lakehouse monitoring situation: A fraud model predicts instantly but labels arrive 21 days later; an inference dashboard treats unlabelled transactions as negative examples. The more immediate risk here is on-call responders cannot reproduce or prioritize the reported shift.
Question 500
A production ML review contains this situation: A fraud detector predicts the majority no-fraud class for 99.4% of cases and advertises 99.4% accuracy while missing most positives. Which check shows that this particular problem has been resolved?
- Load tests meet prediction latency and feature freshness objectives at planned peak traffic.
- Every validation segment follows its training cutoff with no post-cutoff feature inputs.
- The assembled vector contains the ordered numeric fields and the estimator can consume it.
- A held-out minority-class confusion matrix and precision-recall curve satisfy documented detection targets.
Explanation
Correct Answer
D:This verification measures the required result rather than just process liveness. A held-out minority-class confusion matrix and precision-recall curve satisfy documented detection targets. It confirms whether the targeted action succeeded: evaluate the model with class-sensitive metrics and choose thresholds aligned with false-positive and missed-fraud tradeoffs.
Incorrect Answers
A:That acceptance test is directed at a different using spark ml situation: A mobile app requires thousands of concurrent low-latency scores with online features, but a team plans to query an offline historical feature Delta table for every request. Here the actual success criterion is a held-out minority-class confusion matrix and precision-recall curve satisfy documented detection targets.
B:That acceptance test is directed at a different using spark ml situation: A time-ordered customer-retention dataset includes events from the future, yet a developer randomly cross-validates across time and then claims a forward-looking forecast is unbiased. Here the actual success criterion is a held-out minority-class confusion matrix and precision-recall curve satisfy documented detection targets.
C:That acceptance test is directed at a different using spark ml situation: A team wants to convert several numeric inputs into one features vector but treats VectorAssembler as a clustering Estimator that should output predictions. Here the actual success criterion is a held-out minority-class confusion matrix and precision-recall curve satisfy documented detection targets.