Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 120
Question 1190
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. The dataset contract must remain reproducible for a backfill. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query.
- Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job.
Explanation
Correct Answers
C:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This is the appropriate controlled remedy for point-in-time feature data leakage. A feature created after the prediction event cannot legitimately inform that earlier prediction. Verify the cause with: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. Then confirm: For every training row the joined feature timestamp is at or before its prediction timestamp and no label-derived value leaks. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. This directly tests point-in-time feature data leakage in the reported AWS ML workflow. A feature created after the prediction event cannot legitimately inform that earlier prediction. It distinguishes the problem before choosing a change. The related targeted response is: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This selection concerns glue data quality non-null contract rather than the required diagnostic-and-remedy pair for point-in-time feature data leakage. Use evidence: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. and the matching correction: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This selection concerns streaming feature rolling window correctness rather than the required diagnostic-and-remedy pair for point-in-time feature data leakage. Use evidence: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. and the matching correction: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. This selection concerns csv schema ambiguity during ingestion rather than the required diagnostic-and-remedy pair for point-in-time feature data leakage. Use evidence: Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. and the matching correction: Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. Signal: An offline churn dataset uses the latest cancellation-status feature for all historical rows, exposing outcomes not known when earlier predictions would run. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1191
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. The data team must preserve event-time meaning and lineage. Which engineering response resolves the actual issue without masking the symptoms?
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
Explanation
Correct Answer
D:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This is the appropriate controlled remedy for standardization of numerical features. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. Verify the cause with: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. Then confirm: Training converges more consistently, and the same raw request gives aligned standardized values online. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This addresses a different issue involving s3 versus efs training storage choice. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This addresses a different issue involving glue job bookmark state error. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This addresses a different issue involving glue spark join skew on dominant identifier. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1192
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. The dataset contract must remain reproducible for a backfill. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions.
- Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics.
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
Explanation
Correct Answer
B:Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. This directly tests glue spark join skew on dominant identifier in the reported AWS ML workflow. A low-cardinality or skewed key can concentrate a distributed join into one expensive partition. It distinguishes the problem before choosing a change. The related targeted response is: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. Reported signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. This is a possible diagnostic for pii masking before model labeling, but it does not directly test the glue spark join skew on dominant identifier failure reported here. Prioritize: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. The relevant case is: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Inspect feature availability timestamps and whether each label time follows the last feature observation. This is a possible diagnostic for chronological split for forecast evaluation, but it does not directly test the glue spark join skew on dominant identifier failure reported here. Prioritize: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. The relevant case is: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This is a possible diagnostic for text tokenization mismatch in serving, but it does not directly test the glue spark join skew on dominant identifier failure reported here. Prioritize: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. The relevant case is: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1193
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. The team needs a defensible technical decision rather than an untracked workaround. Which observation most directly identifies the root cause of the reported behavior?
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Inspect feature importance stability, variance across folds, regularization and model dimensionality.
- Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
Explanation
Correct Answer
D:Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This directly tests managed ai service versus custom ocr model in the reported AWS ML workflow. Managed document extraction can solve standard OCR and key-value needs without owning an entire model-training pipeline. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Reported signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This is a possible diagnostic for shadow deployment model evaluation without response change, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect feature importance stability, variance across folds, regularization and model dimensionality. This is a possible diagnostic for feature selection to reduce overparameterization, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1194
During an approved rollout of an AWS ML inference workload, the following condition is observed: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. The team must meet its documented availability and rollback constraints. Which corrective action most directly addresses this ML workflow problem?
- Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
- Grant the build role only required object and key operations for its specific artifact prefix and encryption key.
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
Explanation
Correct Answer
D:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This is the appropriate controlled remedy for model registry version promotion provenance. Immutable package versions and approval metadata connect evaluation with deployment; mutable S3 nicknames do not. Verify the cause with: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. Then confirm: The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. Reported signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This addresses a different issue involving multi-container inference pipeline responsibilities. It does not correct the stated model registry version promotion provenance mechanism. The targeted response is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Case evidence: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This addresses a different issue involving multi-model endpoint hosting tradeoff. It does not correct the stated model registry version promotion provenance mechanism. The targeted response is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Case evidence: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Grant the build role only required object and key operations for its specific artifact prefix and encryption key. This addresses a different issue involving codebuild iam least-privilege artifact upload. It does not correct the stated model registry version promotion provenance mechanism. The targeted response is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Case evidence: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1195
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. The team needs a defensible technical decision rather than an untracked workaround. Which corrective action most directly addresses this ML workflow problem?
- Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
Explanation
Correct Answer
A:Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This is the appropriate controlled remedy for hyperparameter bayesian tuning strategy. Hyperparameter optimization needs a defined objective and controlled comparable trials, not arbitrary parameter changes. Verify the cause with: Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. Then confirm: Trials record comparable objective values and a selected candidate meets an independent validation target within budget. Reported signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated hyperparameter bayesian tuning strategy mechanism. The targeted response is: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Case evidence: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This addresses a different issue involving clustering for unlabeled customer segments. It does not correct the stated hyperparameter bayesian tuning strategy mechanism. The targeted response is: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Case evidence: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated hyperparameter bayesian tuning strategy mechanism. The targeted response is: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Case evidence: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1196
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?
- Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks.
- Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.
- Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds.
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
Explanation
Correct Answer
A:Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. This directly tests model debugger exploding gradient diagnosis in the reported AWS ML workflow. Divergent gradients can cause nonfinite optimization; more epochs do not repair an unstable update rule. It distinguishes the problem before choosing a change. The related targeted response is: Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. Reported signal: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This is a possible diagnostic for training image compatibility for byoc, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. This is a possible diagnostic for precision versus recall fraud threshold, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This is a possible diagnostic for regression versus classification problem formulation, but it does not directly test the model debugger exploding gradient diagnosis failure reported here. Prioritize: Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. The relevant case is: A deep model begins producing NaN loss midway through training and the team increases epochs instead of checking gradient stability. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1197
During a production MLOps reliability and security review, the following condition is observed: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. The owner needs an auditable resolution without broadening privileges. Which corrective action most directly addresses this ML workflow problem?
- Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
- Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes.
- Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions.
Explanation
Correct Answer
D:Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This is the appropriate controlled remedy for target-label delay in production quality monitoring. True supervised production quality generally needs observed outcomes; prediction outputs alone are not ground truth. Verify the cause with: Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. Then confirm: Model quality updates only for labeled cohorts while latency and feature drift are monitored promptly. Reported signal: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. This addresses a different issue involving cloudwatch logs insights error correlation. It does not correct the stated target-label delay in production quality monitoring mechanism. The targeted response is: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Case evidence: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: During a production MLOps reliability and security review.
B:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This addresses a different issue involving inference recommender benchmarking instance family. It does not correct the stated target-label delay in production quality monitoring mechanism. The targeted response is: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Case evidence: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: During a production MLOps reliability and security review.
C:Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. This addresses a different issue involving clarify postdeployment group bias monitoring. It does not correct the stated target-label delay in production quality monitoring mechanism. The targeted response is: Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. Case evidence: A loan default label becomes available months after inference, but a dashboard falsely reports current prediction accuracy using unlabeled requests. Operational setting: During a production MLOps reliability and security review.
Question 1198
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. The proposed change must preserve logging and least privilege. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
- Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence.
Explanation
Correct Answer
B:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This directly tests tag-based ml training cost attribution in the reported AWS ML workflow. Cost Explorer grouping requires supported activated resource tags; naming resources does not automatically allocate charges. It distinguishes the problem before choosing a change. The related targeted response is: Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. Reported signal: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This is a possible diagnostic for champion challenger a/b assignment consistency, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This is a possible diagnostic for aws budgets spend threshold for experimentation, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. This is a possible diagnostic for cross-account s3 bucket exfiltration protection, but it does not directly test the tag-based ml training cost attribution failure reported here. Prioritize: Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. The relevant case is: An organization cannot allocate expensive SageMaker training jobs among departments because jobs and dependent storage lack common cost allocation tags. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 1199
During an approved rollout of an AWS ML inference workload, the following condition is observed: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. The team must meet its documented availability and rollback constraints. Which engineering response resolves the actual issue without masking the symptoms?
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings.
- Grant the build role only required object and key operations for its specific artifact prefix and encryption key.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
Explanation
Correct Answer
A:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This is the appropriate controlled remedy for blue-green endpoint rollback after health failure. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. Verify the cause with: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. Then confirm: A simulated green regression returns traffic to the last healthy model without extended outage. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings. This addresses a different issue involving asynchronous endpoint for large payloads. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Grant the build role only required object and key operations for its specific artifact prefix and encryption key. This addresses a different issue involving codebuild iam least-privilege artifact upload. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This addresses a different issue involving sagemaker endpoint provisioned concurrency tradeoff. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1200
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?
- Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints.
- Inspect feature importance stability, variance across folds, regularization and model dimensionality.
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.
Explanation
Correct Answer
D:Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This directly tests rmse versus mae outlier sensitivity in the reported AWS ML workflow. Squaring residuals gives large errors disproportionately high weight; MAE weights magnitudes linearly. It distinguishes the problem before choosing a change. The related targeted response is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Reported signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. This is a possible diagnostic for hyperparameter bayesian tuning strategy, but it does not directly test the rmse versus mae outlier sensitivity failure reported here. Prioritize: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. The relevant case is: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Inspect feature importance stability, variance across folds, regularization and model dimensionality. This is a possible diagnostic for feature selection to reduce overparameterization, but it does not directly test the rmse versus mae outlier sensitivity failure reported here. Prioritize: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. The relevant case is: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This is a possible diagnostic for shadow deployment model evaluation without response change, but it does not directly test the rmse versus mae outlier sensitivity failure reported here. Prioritize: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. The relevant case is: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: During production evaluation of a SageMaker AI model candidate.