cert
cert-1
cert-2

Pass Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam in First Attempt Guaranteed!

Get 100% Latest Exam Questions, Accurate & Verified Answers to Pass the Actual Exam!
30 Days Free Updates, Instant Download!

cert-5
cert-6
AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam - Verified By Experts
AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle
$29.98

AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle

$79.99
$109.97
  • Premium File 270 Questions & Answers. Last update: Oct 24, 2026
  • Training Course 244 Video Lectures
  • Study Guide 548 Pages
 
$109.97
$79.99
accept 42 downloads in last 7 days
block-screenshots
Purchase Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam Training Products Individually
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium File
Premium File 270 Q&A
$76.99$69.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Video Training Course
Training Course 244 Lectures
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 PDF Study Guide
Study Guide 548 Pages
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 18

Question 170

While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. The experiment must be compared fairly against its prior baseline. Select TWO: the appropriate diagnostic check and the targeted implementation change.

  1. Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
  2. Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
  3. Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
  4. Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
  5. Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract.

Explanation

Correct Answers

B:

Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This directly tests reproducible sagemaker experiments comparisons in the reported AWS ML workflow. Performance claims are meaningful only when experiments control relevant changes and expose comparable evidence. It distinguishes the problem before choosing a change. The related targeted response is: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

E:

Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This is the appropriate controlled remedy for reproducible sagemaker experiments comparisons. Performance claims are meaningful only when experiments control relevant changes and expose comparable evidence. Verify the cause with: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. Then confirm: Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Incorrect Answers

A:

Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

C:

Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

D:

Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This selection concerns clarify feature attribution against target leakage rather than the required diagnostic-and-remedy pair for reproducible sagemaker experiments comparisons. Use evidence: Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. and the matching correction: Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. Signal: A team declares a new model better by comparing metrics from runs that used different target definitions and data partitions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Question 171

During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Change control requires measurable endpoint or pipeline acceptance evidence. Which verification result BEST demonstrates that the issue is resolved?

  1. A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag.
  2. Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost.
  3. Cold-start p95 improves during planned demand windows while capacity cost remains measured.
  4. Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs.

Explanation

Correct Answer

C:

Cold-start p95 improves during planned demand windows while capacity cost remains measured. This is the acceptance evidence for the described sagemaker endpoint provisioned concurrency tradeoff scenario. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. The corrective implementation it validates is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

Incorrect Answers

A:

A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. This could validate endpoint scale-to-zero cold capacity planning, but it does not establish that sagemaker endpoint provisioned concurrency tradeoff is resolved for this workload. Confirm instead: Cold-start p95 improves during planned demand windows while capacity cost remains measured. Observed problem: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

B:

Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. This could validate multi-model endpoint hosting tradeoff, but it does not establish that sagemaker endpoint provisioned concurrency tradeoff is resolved for this workload. Confirm instead: Cold-start p95 improves during planned demand windows while capacity cost remains measured. Observed problem: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

D:

Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs. This could validate sagemaker pipelines parameterized retraining, but it does not establish that sagemaker endpoint provisioned concurrency tradeoff is resolved for this workload. Confirm instead: Cold-start p95 improves during planned demand windows while capacity cost remains measured. Observed problem: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

Question 172

During an approved rollout of an AWS ML inference workload, the following condition is observed: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. The team must meet its documented availability and rollback constraints. What targeted change should be implemented after verifying the stated cause?

  1. Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
  2. Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
  3. Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
  4. Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.

Explanation

Correct Answer

A:

Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This is the appropriate controlled remedy for canary variant rollout for model changes. Progressive exposure limits blast radius; immediate cutover obscures whether regressions occurred during ramp-up. Verify the cause with: Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. Then confirm: A limited slice serves the new version while metrics are monitored before any broad rollout. Reported signal: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: During an approved rollout of an AWS ML inference workload.

Incorrect Answers

B:

Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This addresses a different issue involving sagemaker endpoint auto scaling metric selection. It does not correct the stated canary variant rollout for model changes mechanism. The targeted response is: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Case evidence: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: During an approved rollout of an AWS ML inference workload.

C:

Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This addresses a different issue involving multi-container inference pipeline responsibilities. It does not correct the stated canary variant rollout for model changes mechanism. The targeted response is: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Case evidence: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: During an approved rollout of an AWS ML inference workload.

D:

Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This addresses a different issue involving model registry version promotion provenance. It does not correct the stated canary variant rollout for model changes mechanism. The targeted response is: Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. Case evidence: A new recommendation model has uncertain online behavior but the team plans to replace 100 percent of production traffic immediately. Operational setting: During an approved rollout of an AWS ML inference workload.

Question 173

During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Change control requires measurable endpoint or pipeline acceptance evidence. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage.
  2. Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost.
  3. Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
  4. Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.

Explanation

Correct Answer

D:

Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This directly tests codebuild iam least-privilege artifact upload in the reported AWS ML workflow. Artifact publishing often requires S3 and KMS permissions, but broad administrative permissions are unnecessary and unsafe. It distinguishes the problem before choosing a change. The related targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Reported signal: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

Incorrect Answers

A:

Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. This is a possible diagnostic for sagemaker pipelines parameterized retraining, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

B:

Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. This is a possible diagnostic for sagemaker endpoint provisioned concurrency tradeoff, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

C:

Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This is a possible diagnostic for endpoint scale-to-zero cold capacity planning, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.

Question 174

While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. The deployment must be reproducible without manual console-only fixes. Which engineering response resolves the actual issue without masking the symptoms?

  1. Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
  2. Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
  3. Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
  4. Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.

Explanation

Correct Answer

D:

Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This is the appropriate controlled remedy for continuous integration unit and endpoint contract tests. A successful training job does not prove the deployed inference API still satisfies consumer contracts. Verify the cause with: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. Then confirm: A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Incorrect Answers

A:

Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated continuous integration unit and endpoint contract tests mechanism. The targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Case evidence: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.

B:

Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated continuous integration unit and endpoint contract tests mechanism. The targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Case evidence: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.

C:

Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This addresses a different issue involving multi-container inference pipeline responsibilities. It does not correct the stated continuous integration unit and endpoint contract tests mechanism. The targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Case evidence: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Question 175

As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The team must demonstrate a repeatable monitoring or security control. Which corrective action most directly addresses this ML workflow problem?

  1. Identify the component contributing to total request time and optimize network or overhead separately from actual model inference.
  2. Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
  3. Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
  4. Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis.

Explanation

Correct Answer

B:

Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This is the appropriate controlled remedy for iam passrole constraint for model deployment. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. Verify the cause with: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. Then confirm: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Incorrect Answers

A:

Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. This addresses a different issue involving cloudwatch invocations and modellatency distinction. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

C:

Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This addresses a different issue involving sagemaker execution role s3 least privilege. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

D:

Capture stable prediction identifiers and ingest verified labels with matching keys for model-quality analysis. This addresses a different issue involving model monitor ground truth association. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Question 176

While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The experiment must be compared fairly against its prior baseline. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.

  1. Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
  2. Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs.
  3. Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
  4. Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
  5. Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.

Explanation

Correct Answers

A:

Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This directly tests regression versus classification problem formulation in the reported AWS ML workflow. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. It distinguishes the problem before choosing a change. The related targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

E:

Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This is the appropriate controlled remedy for regression versus classification problem formulation. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. Verify the cause with: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. Then confirm: A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Incorrect Answers

B:

Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs. This selection concerns training batch size causes gpu memory exhaustion rather than the required diagnostic-and-remedy pair for regression versus classification problem formulation. Use evidence: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. and the matching correction: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

C:

Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This selection concerns interpretability for high-stakes prediction rather than the required diagnostic-and-remedy pair for regression versus classification problem formulation. Use evidence: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. and the matching correction: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

D:

Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This selection concerns hyperparameter bayesian tuning strategy rather than the required diagnostic-and-remedy pair for regression versus classification problem formulation. Use evidence: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. and the matching correction: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Question 177

While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. The experiment must be compared fairly against its prior baseline. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.

  1. Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
  2. Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses.
  3. Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
  4. Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
  5. Enable patience-based early stopping and restore the checkpoint with the best validation metric.

Explanation

Correct Answers

B:

Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This is the appropriate controlled remedy for shadow deployment model evaluation without response change. Shadow evaluation measures candidates on live traffic while withholding their output from the customer response path. Verify the cause with: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. Then confirm: The production response remains on the primary while shadow metrics reveal candidate performance and resource needs. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

C:

Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This directly tests shadow deployment model evaluation without response change in the reported AWS ML workflow. Shadow evaluation measures candidates on live traffic while withholding their output from the customer response path. It distinguishes the problem before choosing a change. The related targeted response is: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Incorrect Answers

A:

Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This selection concerns managed ai service versus custom ocr model rather than the required diagnostic-and-remedy pair for shadow deployment model evaluation without response change. Use evidence: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. and the matching correction: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

D:

Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This selection concerns roc-auc versus pr-auc for rare events rather than the required diagnostic-and-remedy pair for shadow deployment model evaluation without response change. Use evidence: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. and the matching correction: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

E:

Enable patience-based early stopping and restore the checkpoint with the best validation metric. This selection concerns early stopping on validation plateau rather than the required diagnostic-and-remedy pair for shadow deployment model evaluation without response change. Use evidence: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. and the matching correction: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Question 178

At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?

  1. An equivalent recent-date query reads only its selected partitions while returning the same labeled rows.
  2. Validated records preserve the expected label and field order while malformed inputs are reported separately.
  3. No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
  4. No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.

Explanation

Correct Answer

A:

An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. This is the acceptance evidence for the described partition pruning in s3 parquet training input scenario. Partition-aware columnar scans reduce irrelevant I/O; naming a date column without partition metadata does not create pruning. The corrective implementation it validates is: Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. Reported signal: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Incorrect Answers

B:

Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that partition pruning in s3 parquet training input is resolved for this workload. Confirm instead: An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. Observed problem: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

C:

No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that partition pruning in s3 parquet training input is resolved for this workload. Confirm instead: An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. Observed problem: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

D:

No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This could validate group-leakage train and validation split, but it does not establish that partition pruning in s3 parquet training input is resolved for this workload. Confirm instead: An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. Observed problem: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Question 179

While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The experiment must be compared fairly against its prior baseline. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
  2. Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
  3. Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state.
  4. Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.

Explanation

Correct Answer

B:

Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This directly tests regression versus classification problem formulation in the reported AWS ML workflow. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. It distinguishes the problem before choosing a change. The related targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Incorrect Answers

A:

Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This is a possible diagnostic for sagemaker jumpstart template provenance, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

C:

Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. This is a possible diagnostic for sagemaker model registry candidate approval, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

D:

Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This is a possible diagnostic for training image compatibility for byoc, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Question 180

While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The proposed change must preserve logging and least privilege. Which engineering response resolves the actual issue without masking the symptoms?

  1. Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
  2. Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
  3. Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks.
  4. Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it.

Explanation

Correct Answer

A:

Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This is the appropriate controlled remedy for iam passrole constraint for model deployment. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. Verify the cause with: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. Then confirm: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Incorrect Answers

B:

Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This addresses a different issue involving sagemaker execution role s3 least privilege. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

C:

Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. This addresses a different issue involving model monitor violation alert calibration. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

D:

Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. This addresses a different issue involving spot training cost versus interruption recovery. It does not correct the stated iam passrole constraint for model deployment mechanism. The targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Case evidence: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Tests