Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 73
Question 720
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Engineers must avoid changing unrelated source partitions. Which verification result BEST demonstrates that the issue is resolved?
- Validated records preserve the expected label and field order while malformed inputs are reported separately.
- A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values.
- Agreement on a held-out gold set rises without silently discarding rare legitimate classes.
- No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.
Explanation
Correct Answer
C:Agreement on a held-out gold set rises without silently discarding rare legitimate classes. This is the acceptance evidence for the described ground truth labeling agreement review scenario. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. The corrective implementation it validates is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. This could validate median imputation fitted on training split, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This could validate group-leakage train and validation split, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 721
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. The experiment must be compared fairly against its prior baseline. Which verification result BEST demonstrates that the issue is resolved?
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
- A forced interruption resumes near the last saved epoch and restores optimizer and model state.
- A production endpoint resolves to one approved model package version with traceable training lineage.
- Reviewers can identify stable feature drivers for representative decisions without misleading causal claims.
Explanation
Correct Answer
D:Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. This is the acceptance evidence for the described interpretability for high-stakes prediction scenario. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. The corrective implementation it validates is: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:A forced interruption resumes near the last saved epoch and restores optimizer and model state. This could validate managed spot training checkpoint recovery, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:A production endpoint resolves to one approved model package version with traceable training lineage. This could validate sagemaker model registry candidate approval, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 722
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. The dataset contract must remain reproducible for a backfill. Which corrective action most directly addresses this ML workflow problem?
- Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
Explanation
Correct Answer
D:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This is the appropriate controlled remedy for streaming feature rolling window correctness. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. Verify the cause with: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. Then confirm: A controlled out-of-order replay yields the expected window totals and bounded late-event treatment. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. This addresses a different issue involving kinesis data streams shard hot key. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This addresses a different issue involving chronological split for forecast evaluation. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 723
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. The release is blocked until the underlying model behavior is understood. Which corrective action most directly addresses this ML workflow problem?
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
- Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
Explanation
Correct Answer
A:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This is the appropriate controlled remedy for feature selection to reduce overparameterization. Unnecessary high-dimensional inputs can increase variance and compute cost; selection itself must avoid evaluation leakage. Verify the cause with: Inspect feature importance stability, variance across folds, regularization and model dimensionality. Then confirm: Holdout quality stays acceptable while model size and run-to-run instability decrease. Reported signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This addresses a different issue involving regression versus classification problem formulation. It does not correct the stated feature selection to reduce overparameterization mechanism. The targeted response is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Case evidence: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This addresses a different issue involving rmse versus mae outlier sensitivity. It does not correct the stated feature selection to reduce overparameterization mechanism. The targeted response is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Case evidence: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This addresses a different issue involving training image compatibility for byoc. It does not correct the stated feature selection to reduce overparameterization mechanism. The targeted response is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Case evidence: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 724
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. The dataset contract must remain reproducible for a backfill. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
- Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
- Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
Explanation
Correct Answers
C:Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. This directly tests glue job bookmark state error in the reported AWS ML workflow. Glue job bookmarks track supported processed state and must be managed deliberately during job changes. It distinguishes the problem before choosing a change. The related targeted response is: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This is the appropriate controlled remedy for glue job bookmark state error. Glue job bookmarks track supported processed state and must be managed deliberately during job changes. Verify the cause with: Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. Then confirm: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for glue job bookmark state error. Use evidence: Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. and the matching correction: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. Signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This selection concerns text tokenization mismatch in serving rather than the required diagnostic-and-remedy pair for glue job bookmark state error. Use evidence: Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. and the matching correction: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. Signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This selection concerns clarify label imbalance measurement rather than the required diagnostic-and-remedy pair for glue job bookmark state error. Use evidence: Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. and the matching correction: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. Signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 725
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The release is blocked until the underlying model behavior is understood. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Enable patience-based early stopping and restore the checkpoint with the best validation metric.
Explanation
Correct Answers
A:Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. This directly tests xgboost tabular classification baseline in the reported AWS ML workflow. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. It distinguishes the problem before choosing a change. The related targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is the appropriate controlled remedy for xgboost tabular classification baseline. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. Verify the cause with: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. Then confirm: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. This selection concerns model debugger exploding gradient diagnosis rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Enable patience-based early stopping and restore the checkpoint with the best validation metric. This selection concerns early stopping on validation plateau rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 726
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. The release is blocked until the underlying model behavior is understood. Which corrective action most directly addresses this ML workflow problem?
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
- Enable patience-based early stopping and restore the checkpoint with the best validation metric.
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
Explanation
Correct Answer
C:Enable patience-based early stopping and restore the checkpoint with the best validation metric. This is the appropriate controlled remedy for early stopping on validation plateau. More epochs are not always better; validation loss can worsen while training loss continues to decrease. Verify the cause with: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. Then confirm: Training stops before extended overfitting and the retained model corresponds to the best validated epoch. Reported signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This addresses a different issue involving roc-auc versus pr-auc for rare events. It does not correct the stated early stopping on validation plateau mechanism. The targeted response is: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Case evidence: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This addresses a different issue involving sagemaker built-in blazingtext choice. It does not correct the stated early stopping on validation plateau mechanism. The targeted response is: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Case evidence: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated early stopping on validation plateau mechanism. The targeted response is: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Case evidence: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 727
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The release is blocked until the underlying model behavior is understood. What targeted change should be implemented after verifying the stated cause?
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
- Read the configured SageMaker training channel path or environment variable and fail clearly on missing input.
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
Explanation
Correct Answer
B:Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This is the appropriate controlled remedy for sagemaker script-mode data channel mismatch. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. Verify the cause with: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. Then confirm: The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This addresses a different issue involving managed ai service versus custom ocr model. It does not correct the stated sagemaker script-mode data channel mismatch mechanism. The targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Case evidence: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated sagemaker script-mode data channel mismatch mechanism. The targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Case evidence: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This addresses a different issue involving sagemaker built-in blazingtext choice. It does not correct the stated sagemaker script-mode data channel mismatch mechanism. The targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Case evidence: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 728
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Change control requires measurable endpoint or pipeline acceptance evidence. What targeted change should be implemented after verifying the stated cause?
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit.
Explanation
Correct Answer
D:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is the appropriate controlled remedy for bring-your-own-inference-container contract. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. Verify the cause with: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. Then confirm: Endpoint health becomes Ready and inference returns the specified payload type for a known test request. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 729
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The team needs a defensible technical decision rather than an untracked workaround. Which verification result BEST demonstrates that the issue is resolved?
- A rolling-origin backtest improves multi-step forecast error and respects temporal order.
- Reviewers can identify stable feature drivers for representative decisions without misleading causal claims.
- The tested alert rate and precision match the production workload rather than an optimistic single ROC figure.
- Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage.
Explanation
Correct Answer
C:The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This is the acceptance evidence for the described roc-auc versus pr-auc for rare events scenario. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. The corrective implementation it validates is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:A rolling-origin backtest improves multi-step forecast error and respects temporal order. This could validate time-series forecast horizon and seasonality, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. This could validate interpretability for high-stakes prediction, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This could validate reproducible sagemaker experiments comparisons, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 730
During an approved rollout of an AWS ML inference workload, the following condition is observed: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. The team must meet its documented availability and rollback constraints. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure.
- Inspect model sizes, framework compatibility, per-model request rates, load latency, and isolation requirements.
Explanation
Correct Answer
B:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This directly tests endpoint scale-to-zero cold capacity planning in the reported AWS ML workflow. Reactive scaling takes time and is bounded by quotas; zero spare capacity may not absorb an instantaneous burst. It distinguishes the problem before choosing a change. The related targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Reported signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. This is a possible diagnostic for ecr immutable image digest for inference, but it does not directly test the endpoint scale-to-zero cold capacity planning failure reported here. Prioritize: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. The relevant case is: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. This is a possible diagnostic for canary variant rollout for model changes, but it does not directly test the endpoint scale-to-zero cold capacity planning failure reported here. Prioritize: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. The relevant case is: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Inspect model sizes, framework compatibility, per-model request rates, load latency, and isolation requirements. This is a possible diagnostic for multi-model endpoint hosting tradeoff, but it does not directly test the endpoint scale-to-zero cold capacity planning failure reported here. Prioritize: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. The relevant case is: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an approved rollout of an AWS ML inference workload.