Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 94
Question 930
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. The data team must preserve event-time meaning and lineage. Which measured outcome would confirm that the correction worked as intended?
- Training converges more consistently, and the same raw request gives aligned standardized values online.
- A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts.
- Memory use stays within limits and previously unseen categories are processed without dimension mismatch.
- An equivalent recent-date query reads only its selected partitions while returning the same labeled rows.
Explanation
Correct Answer
A:Training converges more consistently, and the same raw request gives aligned standardized values online. This is the acceptance evidence for the described standardization of numerical features scenario. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. The corrective implementation it validates is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This could validate model training data residency boundary, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Memory use stays within limits and previously unseen categories are processed without dimension mismatch. This could validate high-cardinality categorical encoding, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. This could validate partition pruning in s3 parquet training input, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 931
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. The deployment must be reproducible without manual console-only fixes. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost.
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit.
Explanation
Correct Answers
C:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This directly tests bring-your-own-inference-container contract in the reported AWS ML workflow. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. It distinguishes the problem before choosing a change. The related targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is the appropriate controlled remedy for bring-your-own-inference-container contract. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. Verify the cause with: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. Then confirm: Endpoint health becomes Ready and inference returns the specified payload type for a known test request. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. This selection concerns real-time versus batch inference decision rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This selection concerns sagemaker vpc endpoint access for private artifacts rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This selection concerns blue-green endpoint rollback after health failure rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 932
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The experiment must be compared fairly against its prior baseline. Which corrective action most directly addresses this ML workflow problem?
- Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
- Read the configured SageMaker training channel path or environment variable and fail clearly on missing input.
Explanation
Correct Answer
C:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This is the appropriate controlled remedy for regression versus classification problem formulation. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. Verify the cause with: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. Then confirm: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This addresses a different issue involving hyperparameter bayesian tuning strategy. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This addresses a different issue involving sagemaker script-mode data channel mismatch. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 933
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. The team needs a defensible technical decision rather than an untracked workaround. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
- Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses.
- Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
Explanation
Correct Answers
A:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This directly tests clustering for unlabeled customer segments in the reported AWS ML workflow. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. It distinguishes the problem before choosing a change. The related targeted response is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This is the appropriate controlled remedy for clustering for unlabeled customer segments. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. Verify the cause with: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. Then confirm: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This selection concerns shadow deployment model evaluation without response change rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This selection concerns early stopping on validation plateau rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This selection concerns managed ai service versus custom ocr model rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 934
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. The proposed change must preserve logging and least privilege. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
- Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
Explanation
Correct Answer
A:Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This directly tests spot training cost versus interruption recovery in the reported AWS ML workflow. Spot savings depend on interruption handling; a lower hourly rate is not a guarantee of lower total job cost. It distinguishes the problem before choosing a change. The related targeted response is: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Reported signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
B:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This is a possible diagnostic for aws budgets spend threshold for experimentation, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This is a possible diagnostic for clarify postdeployment group bias monitoring, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 935
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Engineers must avoid changing unrelated source partitions. What targeted change should be implemented after verifying the stated cause?
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
Explanation
Correct Answer
D:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This is the appropriate controlled remedy for high-cardinality categorical encoding. One-hot encoding every nearly unique identifier can waste capacity and overfit identities instead of learning transferable patterns. Verify the cause with: Inspect categorical cardinality, sparse matrix dimensions, feature contribution, and generalization to unseen identifiers. Then confirm: Memory use stays within limits and previously unseen categories are processed without dimension mismatch. Reported signal: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This addresses a different issue involving clarify label imbalance measurement. It does not correct the stated high-cardinality categorical encoding mechanism. The targeted response is: Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. Case evidence: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This addresses a different issue involving sagemaker feature store online offline consistency. It does not correct the stated high-cardinality categorical encoding mechanism. The targeted response is: Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. Case evidence: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This addresses a different issue involving glue job bookmark state error. It does not correct the stated high-cardinality categorical encoding mechanism. The targeted response is: Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. Case evidence: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 936
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. The deployment must be reproducible without manual console-only fixes. Which measured outcome would confirm that the correction worked as intended?
- A simulated green regression returns traffic to the last healthy model without extended outage.
- A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end.
- A limited slice serves the new version while metrics are monitored before any broad rollout.
- The overnight batch completes within its service window while there is no idle always-on inference endpoint charge.
Explanation
Correct Answer
D:The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. This is the acceptance evidence for the described real-time versus batch inference decision scenario. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. The corrective implementation it validates is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:A simulated green regression returns traffic to the last healthy model without extended outage. This could validate blue-green endpoint rollback after health failure, but it does not establish that real-time versus batch inference decision is resolved for this workload. Confirm instead: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. Observed problem: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. This could validate continuous integration unit and endpoint contract tests, but it does not establish that real-time versus batch inference decision is resolved for this workload. Confirm instead: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. Observed problem: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:A limited slice serves the new version while metrics are monitored before any broad rollout. This could validate canary variant rollout for model changes, but it does not establish that real-time versus batch inference decision is resolved for this workload. Confirm instead: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. Observed problem: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 937
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. The data team must preserve event-time meaning and lineage. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect prediction errors around midnight and feature representations for the periodic hour variable.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
Explanation
Correct Answer
C:Inspect feature availability timestamps and whether each label time follows the last feature observation. This directly tests chronological split for forecast evaluation in the reported AWS ML workflow. Random splits violate temporal causality when future observations influence features or train data. It distinguishes the problem before choosing a change. The related targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect prediction errors around midnight and feature representations for the periodic hour variable. This is a possible diagnostic for time-series cyclical calendar feature, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This is a possible diagnostic for class imbalance handled inside cross-validation, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This is a possible diagnostic for skewed numerical feature log transformation, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 938
During a production MLOps reliability and security review, the following condition is observed: SageMaker Model Monitor model-quality jobs cannot match later labels to predictions because inference requests lack stable inference IDs. The owner needs an auditable resolution without broadening privileges. Which engineering response resolves the actual issue without masking the symptoms?
- Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window.
- Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable.
- Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it.
- Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis.
Explanation
Correct Answer
D:Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. This is the appropriate controlled remedy for model monitor ground truth association. Model quality analysis requires reliable association between predictions and subsequent truth records. Verify the cause with: Inspect captured request IDs, ground-truth keys, and the quality monitor dataset schema. Then confirm: The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics. Reported signal: SageMaker Model Monitor model-quality jobs cannot match later labels to predictions because inference requests lack stable inference IDs. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. This addresses a different issue involving cloudwatch 5xxerrors endpoint saturation. It does not correct the stated model monitor ground truth association mechanism. The targeted response is: Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. Case evidence: SageMaker Model Monitor model-quality jobs cannot match later labels to predictions because inference requests lack stable inference IDs. Operational setting: During a production MLOps reliability and security review.
B:Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. This addresses a different issue involving champion challenger a/b assignment consistency. It does not correct the stated model monitor ground truth association mechanism. The targeted response is: Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. Case evidence: SageMaker Model Monitor model-quality jobs cannot match later labels to predictions because inference requests lack stable inference IDs. Operational setting: During a production MLOps reliability and security review.
C:Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. This addresses a different issue involving spot training cost versus interruption recovery. It does not correct the stated model monitor ground truth association mechanism. The targeted response is: Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. Case evidence: SageMaker Model Monitor model-quality jobs cannot match later labels to predictions because inference requests lack stable inference IDs. Operational setting: During a production MLOps reliability and security review.
Question 939
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. The proposed change must preserve logging and least privilege. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
Explanation
Correct Answers
C:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This directly tests s3 sse-kms cross-account model artifact access in the reported AWS ML workflow. S3 object permission does not imply access to the KMS encryption key used on the object. It distinguishes the problem before choosing a change. The related targeted response is: Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. This is the appropriate controlled remedy for s3 sse-kms cross-account model artifact access. S3 object permission does not imply access to the KMS encryption key used on the object. Verify the cause with: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. Then confirm: The endpoint loads the intended encrypted artifact while unrelated principals cannot decrypt it. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This selection concerns sagemaker execution role s3 least privilege rather than the required diagnostic-and-remedy pair for s3 sse-kms cross-account model artifact access. Use evidence: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. and the matching correction: Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. Signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This selection concerns inference recommender benchmarking instance family rather than the required diagnostic-and-remedy pair for s3 sse-kms cross-account model artifact access. Use evidence: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. and the matching correction: Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. Signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This selection concerns sagemaker model monitor feature drift baseline rather than the required diagnostic-and-remedy pair for s3 sse-kms cross-account model artifact access. Use evidence: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. and the matching correction: Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. Signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 940
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. The deployment must be reproducible without manual console-only fixes. What targeted change should be implemented after verifying the stated cause?
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
Explanation
Correct Answer
A:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This is the appropriate controlled remedy for endpoint scale-to-zero cold capacity planning. Reactive scaling takes time and is bounded by quotas; zero spare capacity may not absorb an instantaneous burst. Verify the cause with: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. Then confirm: A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. Reported signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
B:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This addresses a different issue involving codepipeline approval gate on model metrics. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.