cert
cert-1
cert-2

Pass Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam in First Attempt Guaranteed!

Get 100% Latest Exam Questions, Accurate & Verified Answers to Pass the Actual Exam!
30 Days Free Updates, Instant Download!

cert-5
cert-6
AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam - Verified By Experts
AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle
$29.98

AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium Bundle

$79.99
$109.97
  • Premium File 270 Questions & Answers. Last update: Oct 24, 2026
  • Training Course 244 Video Lectures
  • Study Guide 548 Pages
 
$109.97
$79.99
accept 42 downloads in last 7 days
block-screenshots
Purchase Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Exam Training Products Individually
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Premium File
Premium File 270 Q&A
$76.99$69.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Video Training Course
Training Course 244 Lectures
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 PDF Study Guide
Study Guide 548 Pages
$21.99 $19.99
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 27

Question 260

During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. The dataset contract must remain reproducible for a backfill. Which verification result BEST demonstrates that the issue is resolved?

  1. No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
  2. Agreement on a held-out gold set rises without silently discarding rare legitimate classes.
  3. Training read time and object operations decline while the resulting row count and checksums match.
  4. Application p95 latency returns to target while exported records meet a measured completeness and staleness objective.

Explanation

Correct Answer

D:

Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. This is the acceptance evidence for the described rds extraction overload into ml scenario. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. The corrective implementation it validates is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Incorrect Answers

A:

No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that rds extraction overload into ml is resolved for this workload. Confirm instead: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. Observed problem: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

B:

Agreement on a held-out gold set rises without silently discarding rare legitimate classes. This could validate ground truth labeling agreement review, but it does not establish that rds extraction overload into ml is resolved for this workload. Confirm instead: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. Observed problem: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

C:

Training read time and object operations decline while the resulting row count and checksums match. This could validate columnar file compaction for small objects, but it does not establish that rds extraction overload into ml is resolved for this workload. Confirm instead: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. Observed problem: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Question 261

During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. The dataset contract must remain reproducible for a backfill. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
  2. Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
  3. Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
  4. Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.

Explanation

Correct Answer

B:

Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This directly tests s3 object event at-least-once processing in the reported AWS ML workflow. Event notifications can be delivered more than once; consuming an event is not proof of exactly-once effects. It distinguishes the problem before choosing a change. The related targeted response is: Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. Reported signal: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Incorrect Answers

A:

Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This is a possible diagnostic for rds extraction overload into ml, but it does not directly test the s3 object event at-least-once processing failure reported here. Prioritize: Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. The relevant case is: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

C:

Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the s3 object event at-least-once processing failure reported here. Prioritize: Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. The relevant case is: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

D:

Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This is a possible diagnostic for class imbalance handled inside cross-validation, but it does not directly test the s3 object event at-least-once processing failure reported here. Prioritize: Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. The relevant case is: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Question 262

During production evaluation of a SageMaker AI model candidate, the following condition is observed: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. The release is blocked until the underlying model behavior is understood. What postchange observation provides the strongest acceptance evidence?

  1. Held-out messages receive the intended class predictions and macro-averaged quality is measurable.
  2. The model no longer relies on future-only flags and held-out results reflect features available at inference.
  3. Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
  4. Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage.

Explanation

Correct Answer

C:

Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This is the acceptance evidence for the described clustering for unlabeled customer segments scenario. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. The corrective implementation it validates is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.

Incorrect Answers

A:

Held-out messages receive the intended class predictions and macro-averaged quality is measurable. This could validate sagemaker built-in blazingtext choice, but it does not establish that clustering for unlabeled customer segments is resolved for this workload. Confirm instead: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. Observed problem: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.

B:

The model no longer relies on future-only flags and held-out results reflect features available at inference. This could validate clarify feature attribution against target leakage, but it does not establish that clustering for unlabeled customer segments is resolved for this workload. Confirm instead: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. Observed problem: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.

D:

Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This could validate reproducible sagemaker experiments comparisons, but it does not establish that clustering for unlabeled customer segments is resolved for this workload. Confirm instead: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. Observed problem: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.

Question 263

While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. The deployment must be reproducible without manual console-only fixes. Which corrective action most directly addresses this ML workflow problem?

  1. Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
  2. Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost.
  3. Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
  4. Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.

Explanation

Correct Answer

B:

Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. This is the appropriate controlled remedy for gpu versus cpu inference fit. Accelerators can improve matrix-heavy inference, but service choice should be measured against workload size and economics. Verify the cause with: Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. Then confirm: The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure. Reported signal: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Incorrect Answers

A:

Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This addresses a different issue involving canary variant rollout for model changes. It does not correct the stated gpu versus cpu inference fit mechanism. The targeted response is: Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. Case evidence: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: While testing a second region for recoverable deployment of the same ML service.

C:

Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This addresses a different issue involving model registry version promotion provenance. It does not correct the stated gpu versus cpu inference fit mechanism. The targeted response is: Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. Case evidence: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: While testing a second region for recoverable deployment of the same ML service.

D:

Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This addresses a different issue involving sagemaker pipelines parameterized retraining. It does not correct the stated gpu versus cpu inference fit mechanism. The targeted response is: Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. Case evidence: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: While testing a second region for recoverable deployment of the same ML service.

Question 264

At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Engineers must avoid changing unrelated source partitions. What targeted change should be implemented after verifying the stated cause?

  1. Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering.
  2. Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
  3. Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
  4. Encode hour with sine and cosine cyclic features and validate with a time-aware split.

Explanation

Correct Answer

C:

Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This is the appropriate controlled remedy for text tokenization mismatch in serving. Model embeddings depend on stable token-ID semantics; swapping tokenizers changes the feature representation. Verify the cause with: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. Then confirm: Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. Reported signal: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Incorrect Answers

A:

Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. This addresses a different issue involving kinesis data streams shard hot key. It does not correct the stated text tokenization mismatch in serving mechanism. The targeted response is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Case evidence: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

B:

Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This addresses a different issue involving point-in-time feature data leakage. It does not correct the stated text tokenization mismatch in serving mechanism. The targeted response is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Case evidence: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

D:

Encode hour with sine and cosine cyclic features and validate with a time-aware split. This addresses a different issue involving time-series cyclical calendar feature. It does not correct the stated text tokenization mismatch in serving mechanism. The targeted response is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Case evidence: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.

Question 265

As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The team must demonstrate a repeatable monitoring or security control. Which verification result BEST demonstrates that the issue is resolved?

  1. The pipeline deploys with the authorized role and cannot assign an unrelated privileged role.
  2. Training jobs reach the intended service privately while unauthorized external egress stays blocked.
  3. Backlog age stabilizes and requests complete within the agreed service-level window.
  4. Model quality updates only for labeled cohorts while latency and feature drift are monitored promptly.

Explanation

Correct Answer

A:

The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. This is the acceptance evidence for the described iam passrole constraint for model deployment scenario. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. The corrective implementation it validates is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Incorrect Answers

B:

Training jobs reach the intended service privately while unauthorized external egress stays blocked. This could validate private vpc endpoint policy for sagemaker apis, but it does not establish that iam passrole constraint for model deployment is resolved for this workload. Confirm instead: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. Observed problem: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

C:

Backlog age stabilizes and requests complete within the agreed service-level window. This could validate asynchronous inference queue backlog alert, but it does not establish that iam passrole constraint for model deployment is resolved for this workload. Confirm instead: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. Observed problem: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

D:

Model quality updates only for labeled cohorts while latency and feature drift are monitored promptly. This could validate target-label delay in production quality monitoring, but it does not establish that iam passrole constraint for model deployment is resolved for this workload. Confirm instead: The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. Observed problem: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.

Question 266

As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. The data team must preserve event-time meaning and lineage. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.

  1. Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval.
  2. Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot.
  3. Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
  4. Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
  5. Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.

Explanation

Correct Answers

A:

Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This is the appropriate controlled remedy for sagemaker feature store online offline consistency. Online current state and offline historical records answer different temporal queries; blind latest-value joins cause leakage. Verify the cause with: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. Then confirm: Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

B:

Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. This directly tests sagemaker feature store online offline consistency in the reported AWS ML workflow. Online current state and offline historical records answer different temporal queries; blind latest-value joins cause leakage. It distinguishes the problem before choosing a change. The related targeted response is: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

Incorrect Answers

C:

Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This selection concerns group-leakage train and validation split rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

D:

Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This selection concerns standardization of numerical features rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

E:

Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This selection concerns model training data residency boundary rather than the required diagnostic-and-remedy pair for sagemaker feature store online offline consistency. Use evidence: Compare online Feature Store record values and offline event-time keyed feature history for the same entity and model snapshot. and the matching correction: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

Question 267

As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. The data team must preserve event-time meaning and lineage. Which measured outcome would confirm that the correction worked as intended?

  1. No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.
  2. Write throttles and iterator age fall under burst load without losing required ordering for related records.
  3. The transformed distribution is less skewed and inference uses identical guarded transformations.
  4. Long-tail task duration and shuffle spill decline without changing the joined record counts.

Explanation

Correct Answer

C:

The transformed distribution is less skewed and inference uses identical guarded transformations. This is the acceptance evidence for the described skewed numerical feature log transformation scenario. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. The corrective implementation it validates is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

Incorrect Answers

A:

No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This could validate group-leakage train and validation split, but it does not establish that skewed numerical feature log transformation is resolved for this workload. Confirm instead: The transformed distribution is less skewed and inference uses identical guarded transformations. Observed problem: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

B:

Write throttles and iterator age fall under burst load without losing required ordering for related records. This could validate kinesis data streams shard hot key, but it does not establish that skewed numerical feature log transformation is resolved for this workload. Confirm instead: The transformed distribution is less skewed and inference uses identical guarded transformations. Observed problem: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

D:

Long-tail task duration and shuffle spill decline without changing the joined record counts. This could validate glue spark join skew on dominant identifier, but it does not establish that skewed numerical feature log transformation is resolved for this workload. Confirm instead: The transformed distribution is less skewed and inference uses identical guarded transformations. Observed problem: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.

Question 268

While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. The proposed change must preserve logging and least privilege. Which investigation provides the most decisive FIRST evidence for the underlying problem?

  1. Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation.
  2. Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
  3. Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
  4. Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.

Explanation

Correct Answer

D:

Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This directly tests sagemaker model monitor feature drift baseline in the reported AWS ML workflow. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. It distinguishes the problem before choosing a change. The related targeted response is: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Incorrect Answers

A:

Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. This is a possible diagnostic for model monitor violation alert calibration, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

B:

Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This is a possible diagnostic for s3 sse-kms cross-account model artifact access, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

C:

Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This is a possible diagnostic for aws budgets spend threshold for experimentation, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Question 269

During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. The dataset contract must remain reproducible for a backfill. Which measured outcome would confirm that the correction worked as intended?

  1. Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings.
  2. Replaying the same notification leaves exactly one corresponding logical training record and records deduplication.
  3. Validated records preserve the expected label and field order while malformed inputs are reported separately.
  4. Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering.

Explanation

Correct Answer

D:

Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. This is the acceptance evidence for the described chronological split for forecast evaluation scenario. Random splits violate temporal causality when future observations influence features or train data. The corrective implementation it validates is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Incorrect Answers

A:

Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. This could validate pii masking before model labeling, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

B:

Replaying the same notification leaves exactly one corresponding logical training record and records deduplication. This could validate s3 object event at-least-once processing, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

C:

Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.

Question 270

While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. The proposed change must preserve logging and least privilege. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?

  1. Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
  2. Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
  3. Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
  4. Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.

Explanation

Correct Answer

D:

Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This directly tests clarify postdeployment group bias monitoring in the reported AWS ML workflow. Aggregate performance can mask group-specific shifts; fairness monitoring must examine appropriate group metrics. It distinguishes the problem before choosing a change. The related targeted response is: Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. Reported signal: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

Incorrect Answers

A:

Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This is a possible diagnostic for champion challenger a/b assignment consistency, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

B:

Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

C:

Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This is a possible diagnostic for tag-based ml training cost attribution, but it does not directly test the clarify postdeployment group bias monitoring failure reported here. Prioritize: Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. The relevant case is: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: While reproducing the alert in an isolated AWS ML integration account.

AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Tests