cert
cert-1
cert-2

Pass Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam in First Attempt Guaranteed!

Get 100% Latest Exam Questions, Accurate & Verified Answers to Pass the Actual Exam!
30 Days Free Updates, Instant Download!

cert-5
cert-6
AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam - Verified By Experts
AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle
$29.98

AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle

$79.99
$109.97
  • Premium File 270 Questions & Answers. Last update: Oct 24, 2026
  • Training Course 244 Video Lectures
  • Study Guide 548 Pages
 
$109.97
$79.99
accept 42 downloads in last 7 days
block-screenshots
Purchase Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam Training Products Individually
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium File
Premium File 270 Q&A
$76.99$69.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Video Training Course
Training Course 244 Lectures
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 PDF Study Guide
Study Guide 548 Pages
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 28

Question 270

While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. The proposed change must preserve logging and least privilege. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?

  1. Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
  2. Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
  3. Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
  4. Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.

Explanation

Correct Answer

D:

Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This directly tests clarify postdeployment group bias monitoring in the reported AWS ML workflow. Aggregate performance can mask group-specific shifts; fairness monitoring must examine appropriate group metrics. It distinguishes the problem before choosing a change. The related targeted response is: Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. Reported signal: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Incorrect Answers

A:

Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This is a possible diagnostic for champion challenger a/b assignment consistency, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

B:

Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

C:

Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This is a possible diagnostic for tag-based ml training cost attribution, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Question 271

While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. The experiment must be compared fairly against its prior baseline. Which engineering response resolves the actual issue without masking the symptoms?

  1. Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
  2. Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation.
  3. Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
  4. Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.

Explanation

Correct Answer

B:

Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. This is the appropriate controlled remedy for training batch size causes gpu memory exhaustion. Per-step activation memory generally scales with batch size; safe accumulation can preserve an effective larger batch. Verify the cause with: Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs. Then confirm: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Reported signal: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Incorrect Answers

A:

Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This addresses a different issue involving roc-auc versus pr-auc for rare events. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

C:

Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

D:

Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This addresses a different issue involving overfitting reduced with l2 regularization. It does not correct the stated training batch size causes gpu memory exhaustion mechanism. The targeted response is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Case evidence: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.

Question 272

During production evaluation of a SageMaker AI model candidate, the following condition is observed: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. The release is blocked until the underlying model behavior is understood. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state.
  2. Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
  3. Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
  4. Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.

Explanation

Correct Answer

B:

Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This directly tests managed ai service versus custom ocr model in the reported AWS ML workflow. Managed document extraction can solve standard OCR and key-value needs without owning an entire model-training pipeline. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Reported signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: During production evaluation of a SageMaker AI model candidate.

Incorrect Answers

A:

Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. This is a possible diagnostic for sagemaker model registry candidate approval, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: During production evaluation of a SageMaker AI model candidate.

C:

Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This is a possible diagnostic for regression versus classification problem formulation, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: During production evaluation of a SageMaker AI model candidate.

D:

Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This is a possible diagnostic for rmse versus mae outlier sensitivity, but it does not directly test the managed ai service versus custom ocr model failure reported here. Prioritize: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. The relevant case is: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: During production evaluation of a SageMaker AI model candidate.

Question 273

At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Engineers must avoid changing unrelated source partitions. Which measured outcome would confirm that the correction worked as intended?

  1. Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path.
  2. Long-tail task duration and shuffle spill decline without changing the joined record counts.
  3. Training read time and object operations decline while the resulting row count and checksums match.
  4. The transformed distribution is less skewed and inference uses identical guarded transformations.

Explanation

Correct Answer

B:

Long-tail task duration and shuffle spill decline without changing the joined record counts. This is the acceptance evidence for the described glue spark join skew on dominant identifier scenario. A low-cardinality or skewed key can concentrate a distributed join into one expensive partition. The corrective implementation it validates is: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. Reported signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Incorrect Answers

A:

Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. This could validate glue schema evolution with mixed input types, but it does not establish that glue spark join skew on dominant identifier is resolved for this workload. Confirm instead: Long-tail task duration and shuffle spill decline without changing the joined record counts. Observed problem: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

C:

Training read time and object operations decline while the resulting row count and checksums match. This could validate columnar file compaction for small objects, but it does not establish that glue spark join skew on dominant identifier is resolved for this workload. Confirm instead: Long-tail task duration and shuffle spill decline without changing the joined record counts. Observed problem: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

D:

The transformed distribution is less skewed and inference uses identical guarded transformations. This could validate skewed numerical feature log transformation, but it does not establish that glue spark join skew on dominant identifier is resolved for this workload. Confirm instead: Long-tail task duration and shuffle spill decline without changing the joined record counts. Observed problem: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Question 274

While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. The deployment must be reproducible without manual console-only fixes. Select TWO: the appropriate diagnostic check and the targeted implementation change.

  1. Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings.
  2. Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage.
  3. Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
  4. Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost.
  5. Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.

Explanation

Correct Answers

B:

Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. This directly tests sagemaker pipelines parameterized retraining in the reported AWS ML workflow. Pipelines make dependencies explicit; manually ordered notebook operations are difficult to repeat or audit. It distinguishes the problem before choosing a change. The related targeted response is: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: While testing a second region for recoverable deployment of the same ML service.

E:

Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This is the appropriate controlled remedy for sagemaker pipelines parameterized retraining. Pipelines make dependencies explicit; manually ordered notebook operations are difficult to repeat or audit. Verify the cause with: Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. Then confirm: Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Incorrect Answers

A:

Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings. This selection concerns asynchronous endpoint for large payloads rather than the required diagnostic-and-remedy pair for sagemaker pipelines parameterized retraining. Use evidence: Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. and the matching correction: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: While testing a second region for recoverable deployment of the same ML service.

C:

Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This selection concerns model registry version promotion provenance rather than the required diagnostic-and-remedy pair for sagemaker pipelines parameterized retraining. Use evidence: Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. and the matching correction: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: While testing a second region for recoverable deployment of the same ML service.

D:

Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. This selection concerns real-time versus batch inference decision rather than the required diagnostic-and-remedy pair for sagemaker pipelines parameterized retraining. Use evidence: Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. and the matching correction: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Question 275

As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. The team must demonstrate a repeatable monitoring or security control. Which verification result BEST demonstrates that the issue is resolved?

  1. Backlog age stabilizes and requests complete within the agreed service-level window.
  2. Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts.
  3. A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
  4. A query isolates the failing job versions and recurring error class within the incident interval.

Explanation

Correct Answer

D:

A query isolates the failing job versions and recurring error class within the incident interval. This is the acceptance evidence for the described cloudwatch logs insights error correlation scenario. Querying structured centralized logs scales better than visual browsing of unrelated service output. The corrective implementation it validates is: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. Reported signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Incorrect Answers

A:

Backlog age stabilizes and requests complete within the agreed service-level window. This could validate asynchronous inference queue backlog alert, but it does not establish that cloudwatch logs insights error correlation is resolved for this workload. Confirm instead: A query isolates the failing job versions and recurring error class within the incident interval. Observed problem: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

B:

Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. This could validate serving output confidence calibration drift, but it does not establish that cloudwatch logs insights error correlation is resolved for this workload. Confirm instead: A query isolates the failing job versions and recurring error class within the incident interval. Observed problem: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

C:

A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This could validate cross-account s3 bucket exfiltration protection, but it does not establish that cloudwatch logs insights error correlation is resolved for this workload. Confirm instead: A query isolates the failing job versions and recurring error class within the incident interval. Observed problem: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Question 276

During a production MLOps reliability and security review, the following condition is observed: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. The owner needs an auditable resolution without broadening privileges. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
  2. Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
  3. Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence.
  4. Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.

Explanation

Correct Answer

C:

Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. This directly tests sagemaker execution role s3 least privilege in the reported AWS ML workflow. Least-privilege IAM and resource policy alignment are preferable to broad global data permissions. It distinguishes the problem before choosing a change. The related targeted response is: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. Reported signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: During a production MLOps reliability and security review.

Incorrect Answers

A:

Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This is a possible diagnostic for spot training cost versus interruption recovery, but it does not directly test the sagemaker execution role s3 least privilege failure reported here. Prioritize: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. The relevant case is: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: During a production MLOps reliability and security review.

B:

Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This is a possible diagnostic for training-serving feature skew incident, but it does not directly test the sagemaker execution role s3 least privilege failure reported here. Prioritize: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. The relevant case is: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: During a production MLOps reliability and security review.

D:

Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This is a possible diagnostic for iam passrole constraint for model deployment, but it does not directly test the sagemaker execution role s3 least privilege failure reported here. Prioritize: Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. The relevant case is: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: During a production MLOps reliability and security review.

Question 277

During a production MLOps reliability and security review, the following condition is observed: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. The owner needs an auditable resolution without broadening privileges. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?

  1. Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
  2. Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs.
  3. Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
  4. Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.

Explanation

Correct Answer

B:

Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. This directly tests cloudwatch logs insights error correlation in the reported AWS ML workflow. Querying structured centralized logs scales better than visual browsing of unrelated service output. It distinguishes the problem before choosing a change. The related targeted response is: Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. Reported signal: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.

Incorrect Answers

A:

Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This is a possible diagnostic for sagemaker model monitor feature drift baseline, but it does not directly test the cloudwatch logs insights error correlation failure reported here. Prioritize: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. The relevant case is: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.

C:

Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This is a possible diagnostic for aws budgets spend threshold for experimentation, but it does not directly test the cloudwatch logs insights error correlation failure reported here. Prioritize: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. The relevant case is: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.

D:

Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This is a possible diagnostic for iam passrole constraint for model deployment, but it does not directly test the cloudwatch logs insights error correlation failure reported here. Prioritize: Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. The relevant case is: A training fleet runs many jobs and operators manually search thousands of unstructured log files to locate recurring data-channel failures. Operational setting: During a production MLOps reliability and security review.

Question 278

During production evaluation of a SageMaker AI model candidate, the following condition is observed: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?

  1. Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs.
  2. Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
  3. Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
  4. Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates.

Explanation

Correct Answer

D:

Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. This directly tests fine-tuning pretrained model learning-rate stability in the reported AWS ML workflow. Large updates on small data can overwrite pretrained features; careful transfer learning limits destructive forgetting. It distinguishes the problem before choosing a change. The related targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Reported signal: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.

Incorrect Answers

A:

Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs. This is a possible diagnostic for training batch size causes gpu memory exhaustion, but it does not directly test the fine-tuning pretrained model learning-rate stability failure reported here. Prioritize: Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. The relevant case is: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.

B:

Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This is a possible diagnostic for managed ai service versus custom ocr model, but it does not directly test the fine-tuning pretrained model learning-rate stability failure reported here. Prioritize: Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. The relevant case is: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.

C:

Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the fine-tuning pretrained model learning-rate stability failure reported here. Prioritize: Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. The relevant case is: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.

Question 279

At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. The team needs a defensible technical decision rather than an untracked workaround. Which engineering response resolves the actual issue without masking the symptoms?

  1. Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses.
  2. Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
  3. Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
  4. Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.

Explanation

Correct Answer

B:

Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This is the appropriate controlled remedy for precision versus recall fraud threshold. Accuracy can conceal poor minority-class detection; threshold selection trades recall against precision. Verify the cause with: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. Then confirm: Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. Reported signal: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: At the model-governance gate before promotion of a new ML artifact.

Incorrect Answers

A:

Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This addresses a different issue involving rmse versus mae outlier sensitivity. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: At the model-governance gate before promotion of a new ML artifact.

C:

Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This addresses a different issue involving training image compatibility for byoc. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: At the model-governance gate before promotion of a new ML artifact.

D:

Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: At the model-governance gate before promotion of a new ML artifact.

Question 280

During production evaluation of a SageMaker AI model candidate, the following condition is observed: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. The release is blocked until the underlying model behavior is understood. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements.
  2. Inspect feature importance stability, variance across folds, regularization and model dimensionality.
  3. Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
  4. Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.

Explanation

Correct Answer

D:

Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This directly tests early stopping on validation plateau in the reported AWS ML workflow. More epochs are not always better; validation loss can worsen while training loss continues to decrease. It distinguishes the problem before choosing a change. The related targeted response is: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Reported signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.

Incorrect Answers

A:

Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. This is a possible diagnostic for xgboost tabular classification baseline, but it does not directly test the early stopping on validation plateau failure reported here. Prioritize: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. The relevant case is: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.

B:

Inspect feature importance stability, variance across folds, regularization and model dimensionality. This is a possible diagnostic for feature selection to reduce overparameterization, but it does not directly test the early stopping on validation plateau failure reported here. Prioritize: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. The relevant case is: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.

C:

Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This is a possible diagnostic for shadow deployment model evaluation without response change, but it does not directly test the early stopping on validation plateau failure reported here. Prioritize: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. The relevant case is: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: During production evaluation of a SageMaker AI model candidate.

AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Tests