Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 55
Question 540
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. The dataset contract must remain reproducible for a backfill. Which observation most directly identifies the root cause of the reported behavior?
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
- Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
- Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
Explanation
Correct Answer
C:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This directly tests s3 versus efs training storage choice in the reported AWS ML workflow. S3 object semantics differ from mounted shared filesystems; choose storage for workload access behavior. It distinguishes the problem before choosing a change. The related targeted response is: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Reported signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This is a possible diagnostic for skewed numerical feature log transformation, but it does not directly test the s3 versus efs training storage choice failure reported here. Prioritize: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. The relevant case is: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. This is a possible diagnostic for group-leakage train and validation split, but it does not directly test the s3 versus efs training storage choice failure reported here. Prioritize: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. The relevant case is: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This is a possible diagnostic for rds extraction overload into ml, but it does not directly test the s3 versus efs training storage choice failure reported here. Prioritize: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. The relevant case is: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 541
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. The data team must preserve event-time meaning and lineage. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
- Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls.
Explanation
Correct Answers
A:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This directly tests model training data residency boundary in the reported AWS ML workflow. Encrypting copied data does not automatically satisfy geographic residency constraints; placement and access must be controlled. It distinguishes the problem before choosing a change. The related targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This is the appropriate controlled remedy for model training data residency boundary. Encrypting copied data does not automatically satisfy geographic residency constraints; placement and access must be controlled. Verify the cause with: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. Then confirm: A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This selection concerns partition pruning in s3 parquet training input rather than the required diagnostic-and-remedy pair for model training data residency boundary. Use evidence: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. and the matching correction: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This selection concerns streaming feature rolling window correctness rather than the required diagnostic-and-remedy pair for model training data residency boundary. Use evidence: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. and the matching correction: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. This selection concerns pii masking before model labeling rather than the required diagnostic-and-remedy pair for model training data residency boundary. Use evidence: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. and the matching correction: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 542
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. The team must demonstrate a repeatable monitoring or security control. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses.
- Use a consistent versioned feature definition and test offline/online values at the same observation cutoff.
- Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy.
- Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
Explanation
Correct Answers
D:Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is the appropriate controlled remedy for sagemaker model monitor feature drift baseline. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. Verify the cause with: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. Then confirm: Changed feature distributions produce attributable violations even while endpoint availability remains healthy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
E:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This directly tests sagemaker model monitor feature drift baseline in the reported AWS ML workflow. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. It distinguishes the problem before choosing a change. The related targeted response is: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Compare ModelLatency with OverheadLatency, client network timing, invocation counts, and endpoint 5XX responses. This selection concerns cloudwatch invocations and modellatency distinction rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. This selection concerns training-serving feature skew incident rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This selection concerns aws budgets spend threshold for experimentation rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 543
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The release is blocked until the underlying model behavior is understood. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
Explanation
Correct Answer
D:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This directly tests roc-auc versus pr-auc for rare events in the reported AWS ML workflow. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the roc-auc versus pr-auc for rare events failure reported here. Prioritize: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. The relevant case is: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This is a possible diagnostic for shadow deployment model evaluation without response change, but it does not directly test the roc-auc versus pr-auc for rare events failure reported here. Prioritize: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. The relevant case is: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This is a possible diagnostic for clustering for unlabeled customer segments, but it does not directly test the roc-auc versus pr-auc for rare events failure reported here. Prioritize: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. The relevant case is: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 544
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Change control requires measurable endpoint or pipeline acceptance evidence. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Inspect versioned request schema, unit-test coverage, container
/invocations behavior, and pipeline gate logs. - Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories.
Explanation
Correct Answer
C:Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. This directly tests continuous integration unit and endpoint contract tests in the reported AWS ML workflow. A successful training job does not prove the deployed inference API still satisfies consumer contracts. It distinguishes the problem before choosing a change. The related targeted response is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This is a possible diagnostic for bring-your-own-inference-container contract, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This is a possible diagnostic for endpoint scale-to-zero cold capacity planning, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories. This is a possible diagnostic for eventbridge conditional retraining trigger, but it does not directly test the continuous integration unit and endpoint contract tests failure reported here. Prioritize: Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. The relevant case is: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 545
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. The experiment must be compared fairly against its prior baseline. Which corrective action most directly addresses this ML workflow problem?
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
- Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
Explanation
Correct Answer
C:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This is the appropriate controlled remedy for overfitting reduced with l2 regularization. L2 penalizes large weights and can reduce variance but excessive regularization also causes underfitting. Verify the cause with: Compare training and validation curves, coefficient magnitudes, and error by split. Then confirm: The train-validation gap narrows without losing acceptable validation performance. Reported signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This addresses a different issue involving sagemaker built-in blazingtext choice. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This addresses a different issue involving data parallelism versus model parallelism. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This addresses a different issue involving interpretability for high-stakes prediction. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 546
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. The data team must preserve event-time meaning and lineage. What targeted change should be implemented after verifying the stated cause?
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering.
Explanation
Correct Answer
A:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This is the appropriate controlled remedy for streaming feature rolling window correctness. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. Verify the cause with: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. Then confirm: A controlled out-of-order replay yields the expected window totals and bounded late-event treatment. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This addresses a different issue involving glue spark join skew on dominant identifier. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This addresses a different issue involving point-in-time feature data leakage. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. This addresses a different issue involving kinesis data streams shard hot key. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 547
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. The dataset contract must remain reproducible for a backfill. What postchange observation provides the strongest acceptance evidence?
- Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path.
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- Training read time and object operations decline while the resulting row count and checksums match.
- Long-tail task duration and shuffle spill decline without changing the joined record counts.
Explanation
Correct Answer
A:Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. This is the acceptance evidence for the described glue schema evolution with mixed input types scenario. A catalog entry does not automatically reconcile incompatible field types across all source partitions. The corrective implementation it validates is: Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. Reported signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that glue schema evolution with mixed input types is resolved for this workload. Confirm instead: Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. Observed problem: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Training read time and object operations decline while the resulting row count and checksums match. This could validate columnar file compaction for small objects, but it does not establish that glue schema evolution with mixed input types is resolved for this workload. Confirm instead: Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. Observed problem: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Long-tail task duration and shuffle spill decline without changing the joined record counts. This could validate glue spark join skew on dominant identifier, but it does not establish that glue schema evolution with mixed input types is resolved for this workload. Confirm instead: Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. Observed problem: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 548
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Engineers must avoid changing unrelated source partitions. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
- Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job.
- Increase appropriate retention before long maintenance and persist a durable downstream historical copy for replay beyond retention.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
Explanation
Correct Answers
A:Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. This is the appropriate controlled remedy for csv schema ambiguity during ingestion. CSV parsing must respect quoting and schema; splitting on every comma corrupts valid quoted fields. Verify the cause with: Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. Then confirm: Validated records preserve the expected label and field order while malformed inputs are reported separately. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. This directly tests csv schema ambiguity during ingestion in the reported AWS ML workflow. CSV parsing must respect quoting and schema; splitting on every comma corrupts valid quoted fields. It distinguishes the problem before choosing a change. The related targeted response is: Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This selection concerns skewed numerical feature log transformation rather than the required diagnostic-and-remedy pair for csv schema ambiguity during ingestion. Use evidence: Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. and the matching correction: Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. Signal: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Increase appropriate retention before long maintenance and persist a durable downstream historical copy for replay beyond retention. This selection concerns kinesis consumer retention gap rather than the required diagnostic-and-remedy pair for csv schema ambiguity during ingestion. Use evidence: Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. and the matching correction: Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. Signal: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
E:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This selection concerns class imbalance handled inside cross-validation rather than the required diagnostic-and-remedy pair for csv schema ambiguity during ingestion. Use evidence: Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. and the matching correction: Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. Signal: A raw CSV field contains quoted commas and a header is sometimes missing, so naïve delimiter splitting shifts the label into the wrong column. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 549
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Engineers must avoid changing unrelated source partitions. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
- Measure file-size distribution, object request count, Spark task scheduling overhead, and read throughput.
- Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions.
- Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job.
Explanation
Correct Answer
A:Inspect feature availability timestamps and whether each label time follows the last feature observation. This directly tests chronological split for forecast evaluation in the reported AWS ML workflow. Random splits violate temporal causality when future observations influence features or train data. It distinguishes the problem before choosing a change. The related targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Measure file-size distribution, object request count, Spark task scheduling overhead, and read throughput. This is a possible diagnostic for columnar file compaction for small objects, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. This is a possible diagnostic for pii masking before model labeling, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. This is a possible diagnostic for csv schema ambiguity during ingestion, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 550
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. The release is blocked until the underlying model behavior is understood. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.
- Inspect the supervised labels, text representation, model-input format, and the desired classification output.
- Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds.
- Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.
Explanation
Correct Answer
C:Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. This directly tests precision versus recall fraud threshold in the reported AWS ML workflow. Accuracy can conceal poor minority-class detection; threshold selection trades recall against precision. It distinguishes the problem before choosing a change. The related targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Reported signal: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This is a possible diagnostic for training image compatibility for byoc, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Inspect the supervised labels, text representation, model-input format, and the desired classification output. This is a possible diagnostic for sagemaker built-in blazingtext choice, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This is a possible diagnostic for rmse versus mae outlier sensitivity, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.