Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 17
Question 160
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. The data team must preserve event-time meaning and lineage. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint.
Explanation
Correct Answer
A:Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. This directly tests point-in-time feature data leakage in the reported AWS ML workflow. A feature created after the prediction event cannot legitimately inform that earlier prediction. It distinguishes the problem before choosing a change. The related targeted response is: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Reported signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This is a possible diagnostic for s3 versus efs training storage choice, but it does not directly test the point-in-time feature data leakage failure reported here. Prioritize: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. The relevant case is: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the point-in-time feature data leakage failure reported here. Prioritize: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. The relevant case is: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. This is a possible diagnostic for glue job bookmark state error, but it does not directly test the point-in-time feature data leakage failure reported here. Prioritize: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. The relevant case is: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 161
During an approved rollout of an AWS ML inference workload, the following condition is observed: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. The team must meet its documented availability and rollback constraints. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
- Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost.
Explanation
Correct Answers
A:Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. This directly tests serverless inference for intermittent requests in the reported AWS ML workflow. Serverless capacity trades some cold-start behavior and resource limits for reduced idle endpoint commitment. It distinguishes the problem before choosing a change. The related targeted response is: Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This is the appropriate controlled remedy for serverless inference for intermittent requests. Serverless capacity trades some cold-start behavior and resource limits for reduced idle endpoint commitment. Verify the cause with: Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. Then confirm: Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This selection concerns endpoint scale-to-zero cold capacity planning rather than the required diagnostic-and-remedy pair for serverless inference for intermittent requests. Use evidence: Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. and the matching correction: Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. Signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This selection concerns model registry version promotion provenance rather than the required diagnostic-and-remedy pair for serverless inference for intermittent requests. Use evidence: Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. and the matching correction: Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. Signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
E:Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. This selection concerns gpu versus cpu inference fit rather than the required diagnostic-and-remedy pair for serverless inference for intermittent requests. Use evidence: Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. and the matching correction: Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. Signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 162
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. The experiment must be compared fairly against its prior baseline. What postchange observation provides the strongest acceptance evidence?
- Training stops before extended overfitting and the retained model corresponds to the best validated epoch.
- A forced interruption resumes near the last saved epoch and restores optimizer and model state.
- Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs.
- The evaluation report shows both typical error and extreme-error impact with a justified primary metric.
Explanation
Correct Answer
C:Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. This is the acceptance evidence for the described precision versus recall fraud threshold scenario. Accuracy can conceal poor minority-class detection; threshold selection trades recall against precision. The corrective implementation it validates is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Reported signal: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Training stops before extended overfitting and the retained model corresponds to the best validated epoch. This could validate early stopping on validation plateau, but it does not establish that precision versus recall fraud threshold is resolved for this workload. Confirm instead: Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. Observed problem: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:A forced interruption resumes near the last saved epoch and restores optimizer and model state. This could validate managed spot training checkpoint recovery, but it does not establish that precision versus recall fraud threshold is resolved for this workload. Confirm instead: Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. Observed problem: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:The evaluation report shows both typical error and extreme-error impact with a justified primary metric. This could validate rmse versus mae outlier sensitivity, but it does not establish that precision versus recall fraud threshold is resolved for this workload. Confirm instead: Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. Observed problem: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 163
During a production MLOps reliability and security review, the following condition is observed: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. The owner needs an auditable resolution without broadening privileges. Which observation most directly identifies the root cause of the reported behavior?
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
- Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.
- Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics.
Explanation
Correct Answer
A:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This directly tests tag-based ml training cost attribution in the reported AWS ML workflow. Cost Explorer grouping requires supported activated resource tags; naming resources does not automatically allocate charges. It distinguishes the problem before choosing a change. The related targeted response is: Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. Reported signal: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
B:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This is a possible diagnostic for sagemaker model monitor feature drift baseline, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: During a production MLOps reliability and security review.
C:Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This is a possible diagnostic for clarify postdeployment group bias monitoring, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: During a production MLOps reliability and security review.
D:Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. This is a possible diagnostic for asynchronous inference queue backlog alert, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: During a production MLOps reliability and security review.
Question 164
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. The team must demonstrate a repeatable monitoring or security control. Which observation most directly identifies the root cause of the reported behavior?
- Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
- Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics.
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
Explanation
Correct Answer
D:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This directly tests aws budgets spend threshold for experimentation in the reported AWS ML workflow. Budgets detect or warn about costs but do not automatically limit every ML training request; job limits are also needed. It distinguishes the problem before choosing a change. The related targeted response is: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. Reported signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This is a possible diagnostic for training-serving feature skew incident, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. This is a possible diagnostic for asynchronous inference queue backlog alert, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This is a possible diagnostic for cloudtrail training data access audit coverage, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 165
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
- Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
- Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates.
- Compare training and validation curves, coefficient magnitudes, and error by split.
Explanation
Correct Answer
A:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This directly tests regression versus classification problem formulation in the reported AWS ML workflow. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. It distinguishes the problem before choosing a change. The related targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This is a possible diagnostic for managed ai service versus custom ocr model, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. This is a possible diagnostic for fine-tuning pretrained model learning-rate stability, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 166
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. The team needs a defensible technical decision rather than an untracked workaround. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints.
- Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements.
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
- Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks.
Explanation
Correct Answer
D:Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. This directly tests model debugger exploding gradient diagnosis in the reported AWS ML workflow. Divergent gradients can cause nonfinite optimization; more epochs do not repair an unstable update rule. It distinguishes the problem before choosing a change. The related targeted response is: Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. Reported signal: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. This is a possible diagnostic for hyperparameter bayesian tuning strategy, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. This is a possible diagnostic for xgboost tabular classification baseline, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This is a possible diagnostic for roc-auc versus pr-auc for rare events, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 167
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The release is blocked until the underlying model behavior is understood. Which measured outcome would confirm that the correction worked as intended?
- A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records.
- The production response remains on the primary while shadow metrics reveal candidate performance and resource needs.
- Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs.
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
Explanation
Correct Answer
A:A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. This is the acceptance evidence for the described regression versus classification problem formulation scenario. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. The corrective implementation it validates is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:The production response remains on the primary while shadow metrics reveal candidate performance and resource needs. This could validate shadow deployment model evaluation without response change, but it does not establish that regression versus classification problem formulation is resolved for this workload. Confirm instead: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. Observed problem: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. This could validate precision versus recall fraud threshold, but it does not establish that regression versus classification problem formulation is resolved for this workload. Confirm instead: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. Observed problem: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that regression versus classification problem formulation is resolved for this workload. Confirm instead: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. Observed problem: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 168
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. The proposed change must preserve logging and least privilege. What postchange observation provides the strongest acceptance evidence?
- A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
- The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation.
- Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner.
Explanation
Correct Answer
C:The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. This is the acceptance evidence for the described model artifact supply-chain integrity scenario. Object names alone do not guarantee model provenance; supply-chain checks bind deployment to reviewed bytes. The corrective implementation it validates is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Reported signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This could validate cross-account s3 bucket exfiltration protection, but it does not establish that model artifact supply-chain integrity is resolved for this workload. Confirm instead: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. Observed problem: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This could validate inference recommender benchmarking instance family, but it does not establish that model artifact supply-chain integrity is resolved for this workload. Confirm instead: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. Observed problem: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner. This could validate model monitor violation alert calibration, but it does not establish that model artifact supply-chain integrity is resolved for this workload. Confirm instead: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. Observed problem: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 169
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. The deployment must be reproducible without manual console-only fixes. Which observation most directly identifies the root cause of the reported behavior?
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
- Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories.
- Inspect versioned request schema, unit-test coverage, container
/invocations behavior, and pipeline gate logs. - Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
Explanation
Correct Answer
C:Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. This directly tests continuous integration unit and endpoint contract tests in the reported AWS ML workflow. A successful training job does not prove the deployed inference API still satisfies consumer contracts. It distinguishes the problem before choosing a change. The related targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This is a possible diagnostic for cloudformation stack parameter drift, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories. This is a possible diagnostic for eventbridge conditional retraining trigger, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 170
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. The experiment must be compared fairly against its prior baseline. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
- Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract.
Explanation
Correct Answers
B:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This directly tests reproducible sagemaker experiments comparisons in the reported AWS ML workflow. Performance claims are meaningful only when experiments control relevant changes and expose comparable evidence. It distinguishes the problem before choosing a change. The related targeted response is: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This is the appropriate controlled remedy for reproducible sagemaker experiments comparisons. Performance claims are meaningful only when experiments control relevant changes and expose comparable evidence. Verify the cause with: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. Then confirm: Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This selection concerns clarify feature attribution against target leakage rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.