Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 59
Question 580
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The release is blocked until the underlying model behavior is understood. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
Explanation
Correct Answers
C:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This directly tests sagemaker jumpstart template provenance in the reported AWS ML workflow. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. It distinguishes the problem before choosing a change. The related targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is the appropriate controlled remedy for sagemaker jumpstart template provenance. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. Verify the cause with: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. Then confirm: The chosen version meets task metrics and license conditions and its inference contract is reproducible. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Profile model memory, throughput, communication overhead, and per-device utilization. This selection concerns data parallelism versus model parallelism rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This selection concerns interpretability for high-stakes prediction rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This selection concerns roc-auc versus pr-auc for rare events rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 581
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. The deployment must be reproducible without manual console-only fixes. Which measured outcome would confirm that the correction worked as intended?
- The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver.
- A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end.
- Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost.
- The compiled artifact runs on the target device with validated outputs and acceptable memory and latency.
Explanation
Correct Answer
C:Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. This is the acceptance evidence for the described multi-model endpoint hosting tradeoff scenario. Multi-model hosting shares inference compute but can incur cache misses and is unsuitable when models require incompatible runtimes. The corrective implementation it validates is: Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. Reported signal: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. This could validate model registry version promotion provenance, but it does not establish that multi-model endpoint hosting tradeoff is resolved for this workload. Confirm instead: Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. Observed problem: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. This could validate continuous integration unit and endpoint contract tests, but it does not establish that multi-model endpoint hosting tradeoff is resolved for this workload. Confirm instead: Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. Observed problem: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:The compiled artifact runs on the target device with validated outputs and acceptable memory and latency. This could validate sagemaker neo edge compiler compatibility, but it does not establish that multi-model endpoint hosting tradeoff is resolved for this workload. Confirm instead: Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. Observed problem: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 582
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. The dataset contract must remain reproducible for a backfill. Which measured outcome would confirm that the correction worked as intended?
- Memory use stays within limits and previously unseen categories are processed without dimension mismatch.
- Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract.
- Validated records preserve the expected label and field order while malformed inputs are reported separately.
- Application p95 latency returns to target while exported records meet a measured completeness and staleness objective.
Explanation
Correct Answer
A:Memory use stays within limits and previously unseen categories are processed without dimension mismatch. This is the acceptance evidence for the described high-cardinality categorical encoding scenario. One-hot encoding every nearly unique identifier can waste capacity and overfit identities instead of learning transferable patterns. The corrective implementation it validates is: Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. Reported signal: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This could validate sagemaker feature store online offline consistency, but it does not establish that high-cardinality categorical encoding is resolved for this workload. Confirm instead: Memory use stays within limits and previously unseen categories are processed without dimension mismatch. Observed problem: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that high-cardinality categorical encoding is resolved for this workload. Confirm instead: Memory use stays within limits and previously unseen categories are processed without dimension mismatch. Observed problem: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. This could validate rds extraction overload into ml, but it does not establish that high-cardinality categorical encoding is resolved for this workload. Confirm instead: Memory use stays within limits and previously unseen categories are processed without dimension mismatch. Observed problem: A new marketing campaign adds hundreds of thousands of unique user IDs, making naïve one-hot features extremely sparse and too large to maintain. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 583
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. The proposed change must preserve logging and least privilege. What postchange observation provides the strongest acceptance evidence?
- The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics.
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
- A test forecast crossing the approved spend threshold alerts before uncontrolled parallel job growth.
- Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts.
Explanation
Correct Answer
D:Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. This is the acceptance evidence for the described serving output confidence calibration drift scenario. A good ranking metric does not guarantee calibrated probabilities; calibration must be verified against observed outcomes. The corrective implementation it validates is: Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. Reported signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics. This could validate model monitor ground truth association, but it does not establish that serving output confidence calibration drift is resolved for this workload. Confirm instead: Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. Observed problem: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This could validate inference recommender benchmarking instance family, but it does not establish that serving output confidence calibration drift is resolved for this workload. Confirm instead: Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. Observed problem: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:A test forecast crossing the approved spend threshold alerts before uncontrolled parallel job growth. This could validate aws budgets spend threshold for experimentation, but it does not establish that serving output confidence calibration drift is resolved for this workload. Confirm instead: Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. Observed problem: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 584
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. The proposed change must preserve logging and least privilege. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses.
- Identify the component contributing to total request time and optimize network or overhead separately from actual model inference.
- Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
Explanation
Correct Answers
A:Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. This directly tests cloudwatch invocations and modellatency distinction in the reported AWS ML workflow. Model compute time and overall endpoint latency are distinct signals; blaming model code without tracing overhead is premature. It distinguishes the problem before choosing a change. The related targeted response is: Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. This is the appropriate controlled remedy for cloudwatch invocations and modellatency distinction. Model compute time and overall endpoint latency are distinct signals; blaming model code without tracing overhead is premature. Verify the cause with: Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. Then confirm: The chosen fix reduces measured end-to-end p95 latency and component metrics explain the change. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
C:Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This selection concerns aws budgets spend threshold for experimentation rather than the required diagnostic-and-remedy pair for cloudwatch invocations and modellatency distinction. Use evidence: Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. and the matching correction: Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. Signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This selection concerns sagemaker model monitor feature drift baseline rather than the required diagnostic-and-remedy pair for cloudwatch invocations and modellatency distinction. Use evidence: Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. and the matching correction: Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. Signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This selection concerns iam passrole constraint for model deployment rather than the required diagnostic-and-remedy pair for cloudwatch invocations and modellatency distinction. Use evidence: Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. and the matching correction: Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. Signal: An endpoint's client-side response time rises, but the team only examines SageMaker ModelLatency and concludes the model is slow. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 585
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. The experiment must be compared fairly against its prior baseline. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
Explanation
Correct Answers
A:Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This is the appropriate controlled remedy for data parallelism versus model parallelism. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. Verify the cause with: Profile model memory, throughput, communication overhead, and per-device utilization. Then confirm: Multiple workers reduce epoch time with acceptable convergence and measured communication overhead. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Profile model memory, throughput, communication overhead, and per-device utilization. This directly tests data parallelism versus model parallelism in the reported AWS ML workflow. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. It distinguishes the problem before choosing a change. The related targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
C:Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This selection concerns reproducible sagemaker experiments comparisons rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This selection concerns managed ai service versus custom ocr model rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 586
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. The data team must preserve event-time meaning and lineage. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag.
- Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions.
Explanation
Correct Answer
A:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This directly tests model training data residency boundary in the reported AWS ML workflow. Encrypting copied data does not automatically satisfy geographic residency constraints; placement and access must be controlled. It distinguishes the problem before choosing a change. The related targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Reported signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This is a possible diagnostic for median imputation fitted on training split, but it does not directly test the model training data residency boundary failure reported here. Prioritize: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. The relevant case is: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. This is a possible diagnostic for kinesis data streams shard hot key, but it does not directly test the model training data residency boundary failure reported here. Prioritize: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. The relevant case is: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. This is a possible diagnostic for pii masking before model labeling, but it does not directly test the model training data residency boundary failure reported here. Prioritize: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. The relevant case is: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 587
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Change control requires measurable endpoint or pipeline acceptance evidence. Which corrective action most directly addresses this ML workflow problem?
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
Explanation
Correct Answer
A:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This is the appropriate controlled remedy for sagemaker endpoint auto scaling metric selection. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. Verify the cause with: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. Then confirm: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This addresses a different issue involving blue-green endpoint rollback after health failure. It does not correct the stated sagemaker endpoint auto scaling metric selection mechanism. The targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Case evidence: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated sagemaker endpoint auto scaling metric selection mechanism. The targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Case evidence: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated sagemaker endpoint auto scaling metric selection mechanism. The targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Case evidence: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 588
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. The dataset contract must remain reproducible for a backfill. What postchange observation provides the strongest acceptance evidence?
- Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering.
- Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals.
- A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values.
- Validated records preserve the expected label and field order while malformed inputs are reported separately.
Explanation
Correct Answer
B:Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. This is the acceptance evidence for the described glue job bookmark state error scenario. Glue job bookmarks track supported processed state and must be managed deliberately during job changes. The corrective implementation it validates is: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. Reported signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. This could validate chronological split for forecast evaluation, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. This could validate median imputation fitted on training split, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 589
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The team must demonstrate a repeatable monitoring or security control. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks.
- Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
Explanation
Correct Answers
D:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This is the appropriate controlled remedy for iam passrole constraint for model deployment. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. Verify the cause with: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. Then confirm: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
E:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This directly tests iam passrole constraint for model deployment in the reported AWS ML workflow. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. It distinguishes the problem before choosing a change. The related targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This selection concerns cross-account s3 bucket exfiltration protection rather than the required diagnostic-and-remedy pair for iam passrole constraint for model deployment. Use evidence: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. and the matching correction: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. This selection concerns model monitor violation alert calibration rather than the required diagnostic-and-remedy pair for iam passrole constraint for model deployment. Use evidence: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. and the matching correction: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. This selection concerns target-label delay in production quality monitoring rather than the required diagnostic-and-remedy pair for iam passrole constraint for model deployment. Use evidence: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. and the matching correction: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 590
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. The data team must preserve event-time meaning and lineage. What targeted change should be implemented after verifying the stated cause?
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
- Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features.
Explanation
Correct Answer
A:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This is the appropriate controlled remedy for median imputation fitted on training split. Preprocessing parameters learned from held-out records leak information into model selection. Verify the cause with: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. Then confirm: A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. Reported signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This addresses a different issue involving point-in-time feature data leakage. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This addresses a different issue involving glue spark join skew on dominant identifier. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This addresses a different issue involving glue schema evolution with mixed input types. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.