Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 46
Question 450
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. The dataset contract must remain reproducible for a backfill. Which corrective action most directly addresses this ML workflow problem?
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
Explanation
Correct Answer
B:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This is the appropriate controlled remedy for point-in-time feature data leakage. A feature created after the prediction event cannot legitimately inform that earlier prediction. Verify the cause with: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. Then confirm: For every training row the joined feature timestamp is at or before its prediction timestamp and no label-derived value leaks. Reported signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This addresses a different issue involving glue job bookmark state error. It does not correct the stated point-in-time feature data leakage mechanism. The targeted response is: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Case evidence: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This addresses a different issue involving standardization of numerical features. It does not correct the stated point-in-time feature data leakage mechanism. The targeted response is: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Case evidence: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This addresses a different issue involving class imbalance handled inside cross-validation. It does not correct the stated point-in-time feature data leakage mechanism. The targeted response is: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Case evidence: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 451
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. The release is blocked until the underlying model behavior is understood. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
- Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons.
- Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
Explanation
Correct Answers
D:Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. This directly tests interpretability for high-stakes prediction in the reported AWS ML workflow. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. It distinguishes the problem before choosing a change. The related targeted response is: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This is the appropriate controlled remedy for interpretability for high-stakes prediction. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. Verify the cause with: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. Then confirm: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. This selection concerns hyperparameter bayesian tuning strategy rather than the required diagnostic-and-remedy pair for interpretability for high-stakes prediction. Use evidence: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. and the matching correction: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This selection concerns training image compatibility for byoc rather than the required diagnostic-and-remedy pair for interpretability for high-stakes prediction. Use evidence: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. and the matching correction: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. This selection concerns time-series forecast horizon and seasonality rather than the required diagnostic-and-remedy pair for interpretability for high-stakes prediction. Use evidence: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. and the matching correction: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 452
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. The team must demonstrate a repeatable monitoring or security control. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis.
- Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses.
- Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions.
- Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics.
Explanation
Correct Answers
D:Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This is the appropriate controlled remedy for target-label delay in production quality monitoring. True supervised production quality generally needs observed outcomes; prediction outputs alone are not ground truth. Verify the cause with: Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. Then confirm: Model quality updates only for labeled cohorts while latency and feature drift are monitored promptly. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
E:Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. This directly tests target-label delay in production quality monitoring in the reported AWS ML workflow. True supervised production quality generally needs observed outcomes; prediction outputs alone are not ground truth. It distinguishes the problem before choosing a change. The related targeted response is: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This selection concerns cross-account s3 bucket exfiltration protection rather than the required diagnostic-and-remedy pair for target-label delay in production quality monitoring. Use evidence: Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. and the matching correction: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. This selection concerns model monitor ground truth association rather than the required diagnostic-and-remedy pair for target-label delay in production quality monitoring. Use evidence: Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. and the matching correction: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. This selection concerns cloudwatch invocations and modellatency distinction rather than the required diagnostic-and-remedy pair for target-label delay in production quality monitoring. Use evidence: Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. and the matching correction: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 453
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. The proposed change must preserve logging and least privilege. Which verification result BEST demonstrates that the issue is resolved?
- Training jobs reach the intended service privately while unauthorized external egress stays blocked.
- The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change.
- Cost reports attribute the majority of in-scope ML spend to the correct team without altering access controls.
- Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals.
Explanation
Correct Answer
C:Cost reports attribute the majority of in-scope ML spend to the correct team without altering access controls. This is the acceptance evidence for the described tag-based ml training cost attribution scenario. Cost Explorer grouping requires supported activated resource tags; naming resources does not automatically allocate charges. The corrective implementation it validates is: Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. Reported signal: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Training jobs reach the intended service privately while unauthorized external egress stays blocked. This could validate private vpc endpoint policy for sagemaker apis, but it does not establish that tag-based ml training cost attribution is resolved for this workload. Confirm instead: Cost reports attribute the majority of in-scope ML spend to the correct team without altering access controls. Observed problem: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. This could validate cloudwatch invocations and modellatency distinction, but it does not establish that tag-based ml training cost attribution is resolved for this workload. Confirm instead: Cost reports attribute the majority of in-scope ML spend to the correct team without altering access controls. Observed problem: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals. This could validate clarify postdeployment group bias monitoring, but it does not establish that tag-based ml training cost attribution is resolved for this workload. Confirm instead: Cost reports attribute the majority of in-scope ML spend to the correct team without altering access controls. Observed problem: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 454
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. The team must demonstrate a repeatable monitoring or security control. Which verification result BEST demonstrates that the issue is resolved?
- Measured training cost drops while interrupted test jobs resume from checkpoints within the delivery window.
- An authorized training read emits attributable S3 object-access events while alerting detects unexpected access.
- The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics.
- The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change.
Explanation
Correct Answer
D:The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. This is the acceptance evidence for the described cloudwatch invocations and modellatency distinction scenario. Model compute time and overall endpoint latency are distinct signals; blaming model code without tracing overhead is premature. The corrective implementation it validates is: Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. Reported signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Measured training cost drops while interrupted test jobs resume from checkpoints within the delivery window. This could validate spot training cost versus interruption recovery, but it does not establish that cloudwatch invocations and modellatency distinction is resolved for this workload. Confirm instead: The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. Observed problem: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. This could validate cloudtrail training data access audit coverage, but it does not establish that cloudwatch invocations and modellatency distinction is resolved for this workload. Confirm instead: The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. Observed problem: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics. This could validate model monitor ground truth association, but it does not establish that cloudwatch invocations and modellatency distinction is resolved for this workload. Confirm instead: The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. Observed problem: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 455
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. The team must demonstrate a repeatable monitoring or security control. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation.
- Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence.
- Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
Explanation
Correct Answer
A:Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. This directly tests model monitor violation alert calibration in the reported AWS ML workflow. Monitoring must balance sensitivity and alert fatigue; treating every small statistical change as an incident is unreliable. It distinguishes the problem before choosing a change. The related targeted response is: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. Reported signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
B:Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. This is a possible diagnostic for sagemaker execution role s3 least privilege, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. This is a possible diagnostic for cross-account s3 bucket exfiltration protection, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This is a possible diagnostic for sagemaker model monitor feature drift baseline, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 456
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Change control requires measurable endpoint or pipeline acceptance evidence. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost.
- Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests.
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
Explanation
Correct Answer
B:Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. This directly tests sagemaker endpoint provisioned concurrency tradeoff in the reported AWS ML workflow. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. It distinguishes the problem before choosing a change. The related targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This is a possible diagnostic for sagemaker neo edge compiler compatibility, but it does not directly test the sagemaker endpoint provisioned concurrency tradeoff failure reported here. Prioritize: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. The relevant case is: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. This is a possible diagnostic for blue-green endpoint rollback after health failure, but it does not directly test the sagemaker endpoint provisioned concurrency tradeoff failure reported here. Prioritize: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. The relevant case is: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This is a possible diagnostic for cloudformation stack parameter drift, but it does not directly test the sagemaker endpoint provisioned concurrency tradeoff failure reported here. Prioritize: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. The relevant case is: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 457
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A supply-chain demand forecast ignores weekly seasonality and uses an ordinary row-shuffled classifier for a 14-day continuous forecast. The team needs a defensible technical decision rather than an untracked workaround. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event.
- Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates.
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
Explanation
Correct Answer
A:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This directly tests time-series forecast horizon and seasonality in the reported AWS ML workflow. Forecasting requires horizon-aware validation and temporal structure, not a shuffled categorical target. It distinguishes the problem before choosing a change. The related targeted response is: Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. Reported signal: A supply-chain demand forecast ignores weekly seasonality and uses an ordinary row-shuffled classifier for a 14-day continuous forecast. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event. This is a possible diagnostic for clarify feature attribution against target leakage, but it does not directly test the time-series forecast horizon and seasonality failure reported here. Prioritize: Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. The relevant case is: A supply-chain demand forecast ignores weekly seasonality and uses an ordinary row-shuffled classifier for a 14-day continuous forecast. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. This is a possible diagnostic for fine-tuning pretrained model learning-rate stability, but it does not directly test the time-series forecast horizon and seasonality failure reported here. Prioritize: Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. The relevant case is: A supply-chain demand forecast ignores weekly seasonality and uses an ordinary row-shuffled classifier for a 14-day continuous forecast. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This is a possible diagnostic for regression versus classification problem formulation, but it does not directly test the time-series forecast horizon and seasonality failure reported here. Prioritize: Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. The relevant case is: A supply-chain demand forecast ignores weekly seasonality and uses an ordinary row-shuffled classifier for a 14-day continuous forecast. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 458
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The dataset contract must remain reproducible for a backfill. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
- Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
Explanation
Correct Answers
A:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is the appropriate controlled remedy for clarify label imbalance measurement. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. Verify the cause with: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. Then confirm: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This directly tests clarify label imbalance measurement in the reported AWS ML workflow. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. It distinguishes the problem before choosing a change. The related targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This selection concerns rds extraction overload into ml rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This selection concerns group-leakage train and validation split rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 459
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. The deployment must be reproducible without manual console-only fixes. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.
- Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
- Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure.
- Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
Explanation
Correct Answers
C:Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. This directly tests canary variant rollout for model changes in the reported AWS ML workflow. Progressive exposure limits blast radius; immediate cutover obscures whether regressions occurred during ramp-up. It distinguishes the problem before choosing a change. The related targeted response is: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This is the appropriate controlled remedy for canary variant rollout for model changes. Progressive exposure limits blast radius; immediate cutover obscures whether regressions occurred during ramp-up. Verify the cause with: Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. Then confirm: A limited slice serves the new version while metrics are monitored before any broad rollout. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This selection concerns sagemaker pipelines parameterized retraining rather than the required diagnostic-and-remedy pair for canary variant rollout for model changes. Use evidence: Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. and the matching correction: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This selection concerns bring-your-own-inference-container contract rather than the required diagnostic-and-remedy pair for canary variant rollout for model changes. Use evidence: Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. and the matching correction: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This selection concerns multi-model endpoint hosting tradeoff rather than the required diagnostic-and-remedy pair for canary variant rollout for model changes. Use evidence: Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. and the matching correction: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 460
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. The deployment must be reproducible without manual console-only fixes. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
Explanation
Correct Answers
C:Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. This directly tests blue-green endpoint rollback after health failure in the reported AWS ML workflow. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. It distinguishes the problem before choosing a change. The related targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This is the appropriate controlled remedy for blue-green endpoint rollback after health failure. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. Verify the cause with: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. Then confirm: A simulated green regression returns traffic to the last healthy model without extended outage. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This selection concerns cloudformation stack parameter drift rather than the required diagnostic-and-remedy pair for blue-green endpoint rollback after health failure. Use evidence: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. and the matching correction: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This selection concerns continuous integration unit and endpoint contract tests rather than the required diagnostic-and-remedy pair for blue-green endpoint rollback after health failure. Use evidence: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. and the matching correction: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This selection concerns bring-your-own-inference-container contract rather than the required diagnostic-and-remedy pair for blue-green endpoint rollback after health failure. Use evidence: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. and the matching correction: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.