Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 10
Question 90
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. The proposed change must preserve logging and least privilege. Which measured outcome would confirm that the correction worked as intended?
- A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
- Changed feature distributions produce attributable violations even while endpoint availability remains healthy.
- The endpoint loads the intended encrypted artifact while unrelated principals cannot decrypt it.
- Repeated requests for one test user reach the same assigned variant and measured outcomes remain comparable.
Explanation
Correct Answer
A:A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This is the acceptance evidence for the described cross-account s3 bucket exfiltration protection scenario. Least privilege must constrain the destination resource; an unrestricted object-write policy can enable data exfiltration. The corrective implementation it validates is: Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. Reported signal: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
B:Changed feature distributions produce attributable violations even while endpoint availability remains healthy. This could validate sagemaker model monitor feature drift baseline, but it does not establish that cross-account s3 bucket exfiltration protection is resolved for this workload. Confirm instead: A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. Observed problem: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:The endpoint loads the intended encrypted artifact while unrelated principals cannot decrypt it. This could validate s3 sse-kms cross-account model artifact access, but it does not establish that cross-account s3 bucket exfiltration protection is resolved for this workload. Confirm instead: A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. Observed problem: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Repeated requests for one test user reach the same assigned variant and measured outcomes remain comparable. This could validate champion challenger a/b assignment consistency, but it does not establish that cross-account s3 bucket exfiltration protection is resolved for this workload. Confirm instead: A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. Observed problem: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 91
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The dataset contract must remain reproducible for a backfill. What targeted change should be implemented after verifying the stated cause?
- Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
Explanation
Correct Answer
B:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is the appropriate controlled remedy for clarify label imbalance measurement. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. Verify the cause with: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. Then confirm: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This addresses a different issue involving glue schema evolution with mixed input types. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This addresses a different issue involving high-cardinality categorical encoding. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This addresses a different issue involving model training data residency boundary. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 92
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. The proposed change must preserve logging and least privilege. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes.
- Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence.
- Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
- Pin an immutable approved artifact version or content digest and verify integrity before deployment.
- Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
Explanation
Correct Answers
B:Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. This directly tests sagemaker execution role s3 least privilege in the reported AWS ML workflow. Least-privilege IAM and resource policy alignment are preferable to broad global data permissions. It distinguishes the problem before choosing a change. The related targeted response is: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This is the appropriate controlled remedy for sagemaker execution role s3 least privilege. Least-privilege IAM and resource policy alignment are preferable to broad global data permissions. Verify the cause with: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. Then confirm: The job reads authorized training data while attempts to access unrelated buckets remain denied. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. This selection concerns clarify postdeployment group bias monitoring rather than the required diagnostic-and-remedy pair for sagemaker execution role s3 least privilege. Use evidence: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. and the matching correction: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. Signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This selection concerns champion challenger a/b assignment consistency rather than the required diagnostic-and-remedy pair for sagemaker execution role s3 least privilege. Use evidence: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. and the matching correction: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. Signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Pin an immutable approved artifact version or content digest and verify integrity before deployment. This selection concerns model artifact supply-chain integrity rather than the required diagnostic-and-remedy pair for sagemaker execution role s3 least privilege. Use evidence: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. and the matching correction: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. Signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 93
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. The team must demonstrate a repeatable monitoring or security control. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
- Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
Explanation
Correct Answer
D:Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This directly tests spot training cost versus interruption recovery in the reported AWS ML workflow. Spot savings depend on interruption handling; a lower hourly rate is not a guarantee of lower total job cost. It distinguishes the problem before choosing a change. The related targeted response is: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Reported signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This is a possible diagnostic for iam passrole constraint for model deployment, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This is a possible diagnostic for cloudwatch 5xxerrors endpoint saturation, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 94
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Change control requires measurable endpoint or pipeline acceptance evidence. What targeted change should be implemented after verifying the stated cause?
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
Explanation
Correct Answer
A:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This is the appropriate controlled remedy for blue-green endpoint rollback after health failure. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. Verify the cause with: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. Then confirm: A simulated green regression returns traffic to the last healthy model without extended outage. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This addresses a different issue involving model registry version promotion provenance. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This addresses a different issue involving sagemaker neo edge compiler compatibility. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This addresses a different issue involving sagemaker endpoint provisioned concurrency tradeoff. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 95
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. The team needs a defensible technical decision rather than an untracked workaround. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates.
- Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
- Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
- Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses.
Explanation
Correct Answers
B:Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This directly tests rmse versus mae outlier sensitivity in the reported AWS ML workflow. Squaring residuals gives large errors disproportionately high weight; MAE weights magnitudes linearly. It distinguishes the problem before choosing a change. The related targeted response is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This is the appropriate controlled remedy for rmse versus mae outlier sensitivity. Squaring residuals gives large errors disproportionately high weight; MAE weights magnitudes linearly. Verify the cause with: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. Then confirm: The evaluation report shows both typical error and extreme-error impact with a justified primary metric. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. This selection concerns fine-tuning pretrained model learning-rate stability rather than the required diagnostic-and-remedy pair for rmse versus mae outlier sensitivity. Use evidence: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. and the matching correction: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This selection concerns managed ai service versus custom ocr model rather than the required diagnostic-and-remedy pair for rmse versus mae outlier sensitivity. Use evidence: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. and the matching correction: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This selection concerns clarify feature attribution against target leakage rather than the required diagnostic-and-remedy pair for rmse versus mae outlier sensitivity. Use evidence: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. and the matching correction: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 96
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. The team needs a defensible technical decision rather than an untracked workaround. Which corrective action most directly addresses this ML workflow problem?
- Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
- Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation.
- Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
Explanation
Correct Answer
C:Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. This is the appropriate controlled remedy for training batch size causes gpu memory exhaustion. Per-step activation memory generally scales with batch size; safe accumulation can preserve an effective larger batch. Verify the cause with: Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs. Then confirm: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Reported signal: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. This addresses a different issue involving time-series forecast horizon and seasonality. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This addresses a different issue involving interpretability for high-stakes prediction. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This addresses a different issue involving hyperparameter bayesian tuning strategy. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 97
During a production MLOps reliability and security review, the following condition is observed: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. The owner needs an auditable resolution without broadening privileges. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time.
- Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs.
- Identify the component contributing to total request time and optimize network or overhead separately from actual model inference.
Explanation
Correct Answers
A:Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. This is the appropriate controlled remedy for cloudwatch logs insights error correlation. Querying structured centralized logs scales better than visual browsing of unrelated service output. Verify the cause with: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. Then confirm: A query isolates the failing job versions and recurring error class within the incident interval. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.
D:Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. This directly tests cloudwatch logs insights error correlation in the reported AWS ML workflow. Querying structured centralized logs scales better than visual browsing of unrelated service output. It distinguishes the problem before choosing a change. The related targeted response is: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
B:Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. This selection concerns cross-account s3 bucket exfiltration protection rather than the required diagnostic-and-remedy pair for cloudwatch logs insights error correlation. Use evidence: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. and the matching correction: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. Signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.
C:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This selection concerns iam passrole constraint for model deployment rather than the required diagnostic-and-remedy pair for cloudwatch logs insights error correlation. Use evidence: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. and the matching correction: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. Signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.
E:Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. This selection concerns cloudwatch invocations and modellatency distinction rather than the required diagnostic-and-remedy pair for cloudwatch logs insights error correlation. Use evidence: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. and the matching correction: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. Signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.
Question 98
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The release is blocked until the underlying model behavior is understood. Which engineering response resolves the actual issue without masking the symptoms?
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
- Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
Explanation
Correct Answer
A:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This is the appropriate controlled remedy for regression versus classification problem formulation. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. Verify the cause with: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. Then confirm: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. This addresses a different issue involving managed spot training checkpoint recovery. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated regression versus classification problem formulation mechanism. The targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Case evidence: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 99
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. The data team must preserve event-time meaning and lineage. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
- Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
Explanation
Correct Answer
B:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This directly tests text tokenization mismatch in serving in the reported AWS ML workflow. Model embeddings depend on stable token-ID semantics; swapping tokenizers changes the feature representation. It distinguishes the problem before choosing a change. The related targeted response is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Reported signal: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. This is a possible diagnostic for pii masking before model labeling, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This is a possible diagnostic for skewed numerical feature log transformation, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 100
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. The dataset contract must remain reproducible for a backfill. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
Explanation
Correct Answers
A:Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. This directly tests sagemaker feature store online offline consistency in the reported AWS ML workflow. Online current state and offline historical records answer different temporal queries; blind latest-value joins cause leakage. It distinguishes the problem before choosing a change. The related targeted response is: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This is the appropriate controlled remedy for sagemaker feature store online offline consistency. Online current state and offline historical records answer different temporal queries; blind latest-value joins cause leakage. Verify the cause with: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. Then confirm: Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This selection concerns median imputation fitted on training split rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This selection concerns model training data residency boundary rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This selection concerns s3 object event at-least-once processing rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.