Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 61
Question 600
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. The deployment must be reproducible without manual console-only fixes. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
- Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
Explanation
Correct Answers
B:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This is the appropriate controlled remedy for sagemaker endpoint auto scaling metric selection. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. Verify the cause with: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. Then confirm: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. This directly tests sagemaker endpoint auto scaling metric selection in the reported AWS ML workflow. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. It distinguishes the problem before choosing a change. The related targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This selection concerns endpoint scale-to-zero cold capacity planning rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This selection concerns model registry version promotion provenance rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This selection concerns codebuild iam least-privilege artifact upload rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 601
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Change control requires measurable endpoint or pipeline acceptance evidence. Which engineering response resolves the actual issue without masking the symptoms?
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Reference an approved immutable image digest or controlled version tag and retain a reproducible build record.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
Explanation
Correct Answer
C:Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. This is the appropriate controlled remedy for ecr immutable image digest for inference. Mutable container tags can point to different images; reproducible ML deployment needs immutable artifact references. Verify the cause with: Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. Then confirm: Identical deployment revisions resolve to the same container image digest and environment dependencies. Reported signal: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated ecr immutable image digest for inference mechanism. The targeted response is: Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. Case evidence: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This addresses a different issue involving sagemaker neo edge compiler compatibility. It does not correct the stated ecr immutable image digest for inference mechanism. The targeted response is: Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. Case evidence: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated ecr immutable image digest for inference mechanism. The targeted response is: Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. Case evidence: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 602
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. The proposed change must preserve logging and least privilege. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
- Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time.
- Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
Explanation
Correct Answers
A:Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is the appropriate controlled remedy for sagemaker model monitor feature drift baseline. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. Verify the cause with: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. Then confirm: Changed feature distributions produce attributable violations even while endpoint availability remains healthy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This directly tests sagemaker model monitor feature drift baseline in the reported AWS ML workflow. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. It distinguishes the problem before choosing a change. The related targeted response is: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
C:Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. This selection concerns cloudwatch logs insights error correlation rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. This selection concerns model monitor ground truth association rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This selection concerns s3 sse-kms cross-account model artifact access rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 603
During a production MLOps reliability and security review, the following condition is observed: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. The owner needs an auditable resolution without broadening privileges. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service.
- Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence.
- Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it.
- Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
Explanation
Correct Answers
D:Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This is the appropriate controlled remedy for aws budgets spend threshold for experimentation. Budgets detect or warn about costs but do not automatically limit every ML training request; job limits are also needed. Verify the cause with: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. Then confirm: A test forecast crossing the approved spend threshold alerts before uncontrolled parallel job growth. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
E:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This directly tests aws budgets spend threshold for experimentation in the reported AWS ML workflow. Budgets detect or warn about costs but do not automatically limit every ML training request; job limits are also needed. It distinguishes the problem before choosing a change. The related targeted response is: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. This selection concerns secret rotation for inference container credentials rather than the required diagnostic-and-remedy pair for aws budgets spend threshold for experimentation. Use evidence: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. and the matching correction: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. Signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
B:Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. This selection concerns sagemaker execution role s3 least privilege rather than the required diagnostic-and-remedy pair for aws budgets spend threshold for experimentation. Use evidence: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. and the matching correction: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. Signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
C:Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. This selection concerns spot training cost versus interruption recovery rather than the required diagnostic-and-remedy pair for aws budgets spend threshold for experimentation. Use evidence: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. and the matching correction: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. Signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
Question 604
During a production MLOps reliability and security review, the following condition is observed: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. The owner needs an auditable resolution without broadening privileges. What targeted change should be implemented after verifying the stated cause?
- Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting.
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
- Pin an immutable approved artifact version or content digest and verify integrity before deployment.
Explanation
Correct Answer
C:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This is the appropriate controlled remedy for inference recommender benchmarking instance family. Rightsizing depends on workload measurements rather than the training machine or instance size alone. Verify the cause with: Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. Then confirm: A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. Reported signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. This addresses a different issue involving tag-based ml training cost attribution. It does not correct the stated inference recommender benchmarking instance family mechanism. The targeted response is: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Case evidence: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
B:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This addresses a different issue involving cross-account s3 bucket exfiltration protection. It does not correct the stated inference recommender benchmarking instance family mechanism. The targeted response is: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Case evidence: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
D:Pin an immutable approved artifact version or content digest and verify integrity before deployment. This addresses a different issue involving model artifact supply-chain integrity. It does not correct the stated inference recommender benchmarking instance family mechanism. The targeted response is: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Case evidence: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
Question 605
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. The deployment must be reproducible without manual console-only fixes. Which observation most directly identifies the root cause of the reported behavior?
- Inspect model sizes, framework compatibility, per-model request rates, load latency, and isolation requirements.
- Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure.
- Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs.
- Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy.
Explanation
Correct Answer
D:Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. This directly tests sagemaker endpoint auto scaling metric selection in the reported AWS ML workflow. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. It distinguishes the problem before choosing a change. The related targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect model sizes, framework compatibility, per-model request rates, load latency, and isolation requirements. This is a possible diagnostic for multi-model endpoint hosting tradeoff, but it does not directly test the sagemaker endpoint auto scaling metric selection failure reported here. Prioritize: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. The relevant case is: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. This is a possible diagnostic for canary variant rollout for model changes, but it does not directly test the sagemaker endpoint auto scaling metric selection failure reported here. Prioritize: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. The relevant case is: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. This is a possible diagnostic for sagemaker vpc endpoint access for private artifacts, but it does not directly test the sagemaker endpoint auto scaling metric selection failure reported here. Prioritize: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. The relevant case is: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 606
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Change control requires measurable endpoint or pipeline acceptance evidence. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory.
- Inspect versioned request schema, unit-test coverage, container
/invocations behavior, and pipeline gate logs. - Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.
Explanation
Correct Answers
B:Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. This directly tests continuous integration unit and endpoint contract tests in the reported AWS ML workflow. A successful training job does not prove the deployed inference API still satisfies consumer contracts. It distinguishes the problem before choosing a change. The related targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This is the appropriate controlled remedy for continuous integration unit and endpoint contract tests. A successful training job does not prove the deployed inference API still satisfies consumer contracts. Verify the cause with: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. Then confirm: A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. This selection concerns ecr immutable image digest for inference rather than the required diagnostic-and-remedy pair for continuous integration unit and endpoint contract tests. Use evidence: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. and the matching correction: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This selection concerns endpoint scale-to-zero cold capacity planning rather than the required diagnostic-and-remedy pair for continuous integration unit and endpoint contract tests. Use evidence: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. and the matching correction: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This selection concerns sagemaker pipelines parameterized retraining rather than the required diagnostic-and-remedy pair for continuous integration unit and endpoint contract tests. Use evidence: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. and the matching correction: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 607
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. The team needs a defensible technical decision rather than an untracked workaround. Which observation most directly identifies the root cause of the reported behavior?
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests.
Explanation
Correct Answer
B:Profile model memory, throughput, communication overhead, and per-device utilization. This directly tests data parallelism versus model parallelism in the reported AWS ML workflow. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. It distinguishes the problem before choosing a change. The related targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This is a possible diagnostic for sagemaker script-mode data channel mismatch, but it does not directly test the data parallelism versus model parallelism failure reported here. Prioritize: Profile model memory, throughput, communication overhead, and per-device utilization. The relevant case is: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This is a possible diagnostic for shadow deployment model evaluation without response change, but it does not directly test the data parallelism versus model parallelism failure reported here. Prioritize: Profile model memory, throughput, communication overhead, and per-device utilization. The relevant case is: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. This is a possible diagnostic for interpretability for high-stakes prediction, but it does not directly test the data parallelism versus model parallelism failure reported here. Prioritize: Profile model memory, throughput, communication overhead, and per-device utilization. The relevant case is: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 608
During production evaluation of a SageMaker AI model candidate, the following condition is observed: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts.
Explanation
Correct Answer
D:Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts. This directly tests managed spot training checkpoint recovery in the reported AWS ML workflow. Spot capacity can be interrupted; durable checkpoints prevent full retraining when restoration is correctly implemented. It distinguishes the problem before choosing a change. The related targeted response is: Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. Reported signal: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the managed spot training checkpoint recovery failure reported here. Prioritize: Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts. The relevant case is: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This is a possible diagnostic for sagemaker jumpstart template provenance, but it does not directly test the managed spot training checkpoint recovery failure reported here. Prioritize: Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts. The relevant case is: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This is a possible diagnostic for reproducible sagemaker experiments comparisons, but it does not directly test the managed spot training checkpoint recovery failure reported here. Prioritize: Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts. The relevant case is: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 609
During an approved rollout of an AWS ML inference workload, the following condition is observed: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. The team must meet its documented availability and rollback constraints. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
- Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost.
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
Explanation
Correct Answers
C:Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. This directly tests real-time versus batch inference decision in the reported AWS ML workflow. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. It distinguishes the problem before choosing a change. The related targeted response is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an approved rollout of an AWS ML inference workload.
E:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This is the appropriate controlled remedy for real-time versus batch inference decision. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. Verify the cause with: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. Then confirm: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This selection concerns sagemaker pipelines parameterized retraining rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This selection concerns codebuild iam least-privilege artifact upload rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This selection concerns multi-model endpoint hosting tradeoff rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 610
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. The deployment must be reproducible without manual console-only fixes. Which engineering response resolves the actual issue without masking the symptoms?
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
- Grant the build role only required object and key operations for its specific artifact prefix and encryption key.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
Explanation
Correct Answer
C:Grant the build role only required object and key operations for its specific artifact prefix and encryption key. This is the appropriate controlled remedy for codebuild iam least-privilege artifact upload. Artifact publishing often requires S3 and KMS permissions, but broad administrative permissions are unnecessary and unsafe. Verify the cause with: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. Then confirm: The build uploads signed artifacts successfully while unauthorized buckets and prefixes remain denied. Reported signal: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This addresses a different issue involving sagemaker endpoint auto scaling metric selection. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This addresses a different issue involving sagemaker endpoint provisioned concurrency tradeoff. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: While testing a second region for recoverable deployment of the same ML service.