Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 92
Question 910
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. The data team must preserve event-time meaning and lineage. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
- Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
Explanation
Correct Answers
A:Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This directly tests rds extraction overload into ml in the reported AWS ML workflow. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. It distinguishes the problem before choosing a change. The related targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This is the appropriate controlled remedy for rds extraction overload into ml. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. Verify the cause with: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. Then confirm: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This selection concerns group-leakage train and validation split rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This selection concerns median imputation fitted on training split rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This selection concerns glue job bookmark state error rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 911
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Change control requires measurable endpoint or pipeline acceptance evidence. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
- Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
- Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
Explanation
Correct Answers
C:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is the appropriate controlled remedy for bring-your-own-inference-container contract. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. Verify the cause with: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. Then confirm: Endpoint health becomes Ready and inference returns the specified payload type for a known test request. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This directly tests bring-your-own-inference-container contract in the reported AWS ML workflow. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. It distinguishes the problem before choosing a change. The related targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This selection concerns sagemaker endpoint provisioned concurrency tradeoff rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. This selection concerns real-time versus batch inference decision rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This selection concerns canary variant rollout for model changes rather than the required diagnostic-and-remedy pair for bring-your-own-inference-container contract. Use evidence: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. and the matching correction: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 912
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. The release is blocked until the underlying model behavior is understood. Which observation most directly identifies the root cause of the reported behavior?
- Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks.
- Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.
- Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.
- Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.
Explanation
Correct Answer
C:Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This directly tests training image compatibility for byoc in the reported AWS ML workflow. Custom containers must implement the hosting or training contract; building a valid Docker image alone is insufficient. It distinguishes the problem before choosing a change. The related targeted response is: Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. Reported signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. This is a possible diagnostic for model debugger exploding gradient diagnosis, but it does not directly test the training image compatibility for byoc failure reported here. Prioritize: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. The relevant case is: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This is a possible diagnostic for early stopping on validation plateau, but it does not directly test the training image compatibility for byoc failure reported here. Prioritize: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. The relevant case is: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This is a possible diagnostic for rmse versus mae outlier sensitivity, but it does not directly test the training image compatibility for byoc failure reported here. Prioritize: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. The relevant case is: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 913
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The release is blocked until the underlying model behavior is understood. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
- Inspect the supervised labels, text representation, model-input format, and the desired classification output.
- Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability.
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
Explanation
Correct Answers
A:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This is the appropriate controlled remedy for roc-auc versus pr-auc for rare events. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. Verify the cause with: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. Then confirm: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This directly tests roc-auc versus pr-auc for rare events in the reported AWS ML workflow. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Inspect the supervised labels, text representation, model-input format, and the desired classification output. This selection concerns sagemaker built-in blazingtext choice rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. This selection concerns model debugger exploding gradient diagnosis rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This selection concerns feature selection to reduce overparameterization rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 914
During an approved rollout of an AWS ML inference workload, the following condition is observed: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. The team must meet its documented availability and rollback constraints. Which observation most directly identifies the root cause of the reported behavior?
- Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
Explanation
Correct Answer
A:Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. This directly tests gpu versus cpu inference fit in the reported AWS ML workflow. Accelerators can improve matrix-heavy inference, but service choice should be measured against workload size and economics. It distinguishes the problem before choosing a change. The related targeted response is: Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. Reported signal: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the gpu versus cpu inference fit failure reported here. Prioritize: Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. The relevant case is: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. This is a possible diagnostic for ecr immutable image digest for inference, but it does not directly test the gpu versus cpu inference fit failure reported here. Prioritize: Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. The relevant case is: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This is a possible diagnostic for codebuild iam least-privilege artifact upload, but it does not directly test the gpu versus cpu inference fit failure reported here. Prioritize: Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. The relevant case is: A latency-sensitive transformer endpoint runs on a small CPU instance with severe token-processing latency and no cost comparison. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 915
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. The dataset contract must remain reproducible for a backfill. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
- Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
Explanation
Correct Answers
A:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This directly tests median imputation fitted on training split in the reported AWS ML workflow. Preprocessing parameters learned from held-out records leak information into model selection. It distinguishes the problem before choosing a change. The related targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This is the appropriate controlled remedy for median imputation fitted on training split. Preprocessing parameters learned from held-out records leak information into model selection. Verify the cause with: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. Then confirm: A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This selection concerns ground truth labeling agreement review rather than the required diagnostic-and-remedy pair for median imputation fitted on training split. Use evidence: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. and the matching correction: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. This selection concerns kinesis consumer retention gap rather than the required diagnostic-and-remedy pair for median imputation fitted on training split. Use evidence: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. and the matching correction: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for median imputation fitted on training split. Use evidence: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. and the matching correction: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 916
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. The proposed change must preserve logging and least privilege. What postchange observation provides the strongest acceptance evidence?
- A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
- Training jobs reach the intended service privately while unauthorized external egress stays blocked.
- A test forecast crossing the approved spend threshold alerts before uncontrolled parallel job growth.
- Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms.
Explanation
Correct Answer
B:Training jobs reach the intended service privately while unauthorized external egress stays blocked. This is the acceptance evidence for the described private vpc endpoint policy for sagemaker apis scenario. An IAM role permits API actions but network access and endpoint policies must also support the private path. The corrective implementation it validates is: Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access. Reported signal: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This could validate cross-account s3 bucket exfiltration protection, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:A test forecast crossing the approved spend threshold alerts before uncontrolled parallel job growth. This could validate aws budgets spend threshold for experimentation, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms. This could validate cloudwatch 5xxerrors endpoint saturation, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 917
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. The release is blocked until the underlying model behavior is understood. Which corrective action most directly addresses this ML workflow problem?
- Register immutable model package versions with lineage and require explicit approval before promotion to production.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
- Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
- Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery.
Explanation
Correct Answer
B:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This is the appropriate controlled remedy for precision versus recall fraud threshold. Accuracy can conceal poor minority-class detection; threshold selection trades recall against precision. Verify the cause with: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. Then confirm: Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. Reported signal: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Register immutable model package versions with lineage and require explicit approval before promotion to production. This addresses a different issue involving sagemaker model registry candidate approval. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This addresses a different issue involving clarify feature attribution against target leakage. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. This addresses a different issue involving managed spot training checkpoint recovery. It does not correct the stated precision versus recall fraud threshold mechanism. The targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Case evidence: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 918
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. The dataset contract must remain reproducible for a backfill. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics.
- Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
Explanation
Correct Answers
A:Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. This directly tests glue spark join skew on dominant identifier in the reported AWS ML workflow. A low-cardinality or skewed key can concentrate a distributed join into one expensive partition. It distinguishes the problem before choosing a change. The related targeted response is: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This is the appropriate controlled remedy for glue spark join skew on dominant identifier. A low-cardinality or skewed key can concentrate a distributed join into one expensive partition. Verify the cause with: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. Then confirm: Long-tail task duration and shuffle spill decline without changing the joined record counts. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. This selection concerns kinesis consumer retention gap rather than the required diagnostic-and-remedy pair for glue spark join skew on dominant identifier. Use evidence: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. and the matching correction: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. Signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This selection concerns high-cardinality categorical encoding rather than the required diagnostic-and-remedy pair for glue spark join skew on dominant identifier. Use evidence: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. and the matching correction: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. Signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This selection concerns chronological split for forecast evaluation rather than the required diagnostic-and-remedy pair for glue spark join skew on dominant identifier. Use evidence: Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. and the matching correction: Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. Signal: A Spark transformation joins billions of records on a region key, and one region contains most observations, stalling one shuffle task. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 919
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. The release is blocked until the underlying model behavior is understood. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery.
Explanation
Correct Answers
B:Compare training and validation curves, coefficient magnitudes, and error by split. This directly tests overfitting reduced with l2 regularization in the reported AWS ML workflow. L2 penalizes large weights and can reduce variance but excessive regularization also causes underfitting. It distinguishes the problem before choosing a change. The related targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This is the appropriate controlled remedy for overfitting reduced with l2 regularization. L2 penalizes large weights and can reduce variance but excessive regularization also causes underfitting. Verify the cause with: Compare training and validation curves, coefficient magnitudes, and error by split. Then confirm: The train-validation gap narrows without losing acceptable validation performance. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for overfitting reduced with l2 regularization. Use evidence: Compare training and validation curves, coefficient magnitudes, and error by split. and the matching correction: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This selection concerns shadow deployment model evaluation without response change rather than the required diagnostic-and-remedy pair for overfitting reduced with l2 regularization. Use evidence: Compare training and validation curves, coefficient magnitudes, and error by split. and the matching correction: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. This selection concerns managed spot training checkpoint recovery rather than the required diagnostic-and-remedy pair for overfitting reduced with l2 regularization. Use evidence: Compare training and validation curves, coefficient magnitudes, and error by split. and the matching correction: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 920
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. The team must demonstrate a repeatable monitoring or security control. What postchange observation provides the strongest acceptance evidence?
- Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts.
- An authorized training read emits attributable S3 object-access events while alerting detects unexpected access.
- Training jobs reach the intended service privately while unauthorized external egress stays blocked.
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
Explanation
Correct Answer
B:An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. This is the acceptance evidence for the described cloudtrail training data access audit coverage scenario. CloudTrail management events do not by default include every S3 object read; data-event selection provides that visibility. The corrective implementation it validates is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Reported signal: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. This could validate serving output confidence calibration drift, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Training jobs reach the intended service privately while unauthorized external egress stays blocked. This could validate private vpc endpoint policy for sagemaker apis, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This could validate inference recommender benchmarking instance family, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.