Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 38
Question 370
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. The proposed change must preserve logging and least privilege. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
- Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
Explanation
Correct Answers
C:Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This directly tests spot training cost versus interruption recovery in the reported AWS ML workflow. Spot savings depend on interruption handling; a lower hourly rate is not a guarantee of lower total job cost. It distinguishes the problem before choosing a change. The related targeted response is: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. This is the appropriate controlled remedy for spot training cost versus interruption recovery. Spot savings depend on interruption handling; a lower hourly rate is not a guarantee of lower total job cost. Verify the cause with: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. Then confirm: Measured training cost drops while interrupted test jobs resume from checkpoints within the delivery window. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This selection concerns champion challenger a/b assignment consistency rather than the required diagnostic-and-remedy pair for spot training cost versus interruption recovery. Use evidence: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. and the matching correction: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This selection concerns iam passrole constraint for model deployment rather than the required diagnostic-and-remedy pair for spot training cost versus interruption recovery. Use evidence: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. and the matching correction: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This selection concerns inference recommender benchmarking instance family rather than the required diagnostic-and-remedy pair for spot training cost versus interruption recovery. Use evidence: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. and the matching correction: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 371
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. The team needs a defensible technical decision rather than an untracked workaround. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Register immutable model package versions with lineage and require explicit approval before promotion to production.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Inspect squared versus absolute residual contributions, target distribution, and large-error business costs.
- Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput.
Explanation
Correct Answers
A:Profile model memory, throughput, communication overhead, and per-device utilization. This directly tests data parallelism versus model parallelism in the reported AWS ML workflow. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. It distinguishes the problem before choosing a change. The related targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This is the appropriate controlled remedy for data parallelism versus model parallelism. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. Verify the cause with: Profile model memory, throughput, communication overhead, and per-device utilization. Then confirm: Multiple workers reduce epoch time with acceptable convergence and measured communication overhead. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Register immutable model package versions with lineage and require explicit approval before promotion to production. This selection concerns sagemaker model registry candidate approval rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This selection concerns xgboost tabular classification baseline rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. This selection concerns rmse versus mae outlier sensitivity rather than the required diagnostic-and-remedy pair for data parallelism versus model parallelism. Use evidence: Profile model memory, throughput, communication overhead, and per-device utilization. and the matching correction: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 372
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Engineers must avoid changing unrelated source partitions. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
- Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
- Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results.
Explanation
Correct Answer
D:Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. This directly tests group-leakage train and validation split in the reported AWS ML workflow. Correlated records from one entity across splits can inflate performance without improving true generalization. It distinguishes the problem before choosing a change. The related targeted response is: Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. Reported signal: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This is a possible diagnostic for rds extraction overload into ml, but it does not directly test the group-leakage train and validation split failure reported here. Prioritize: Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. The relevant case is: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. This is a possible diagnostic for partition pruning in s3 parquet training input, but it does not directly test the group-leakage train and validation split failure reported here. Prioritize: Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. The relevant case is: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This is a possible diagnostic for clarify label imbalance measurement, but it does not directly test the group-leakage train and validation split failure reported here. Prioritize: Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. The relevant case is: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 373
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. The team needs a defensible technical decision rather than an untracked workaround. Which observation most directly identifies the root cause of the reported behavior?
- Inspect feature importance stability, variance across folds, regularization and model dimensionality.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
Explanation
Correct Answer
A:Inspect feature importance stability, variance across folds, regularization and model dimensionality. This directly tests feature selection to reduce overparameterization in the reported AWS ML workflow. Unnecessary high-dimensional inputs can increase variance and compute cost; selection itself must avoid evaluation leakage. It distinguishes the problem before choosing a change. The related targeted response is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Reported signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Profile model memory, throughput, communication overhead, and per-device utilization. This is a possible diagnostic for data parallelism versus model parallelism, but it does not directly test the feature selection to reduce overparameterization failure reported here. Prioritize: Inspect feature importance stability, variance across folds, regularization and model dimensionality. The relevant case is: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. This is a possible diagnostic for precision versus recall fraud threshold, but it does not directly test the feature selection to reduce overparameterization failure reported here. Prioritize: Inspect feature importance stability, variance across folds, regularization and model dimensionality. The relevant case is: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This is a possible diagnostic for clustering for unlabeled customer segments, but it does not directly test the feature selection to reduce overparameterization failure reported here. Prioritize: Inspect feature importance stability, variance across folds, regularization and model dimensionality. The relevant case is: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 374
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. The experiment must be compared fairly against its prior baseline. What targeted change should be implemented after verifying the stated cause?
- Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
- Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses.
Explanation
Correct Answer
D:Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This is the appropriate controlled remedy for shadow deployment model evaluation without response change. Shadow evaluation measures candidates on live traffic while withholding their output from the customer response path. Verify the cause with: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. Then confirm: The production response remains on the primary while shadow metrics reveal candidate performance and resource needs. Reported signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This addresses a different issue involving clarify feature attribution against target leakage. It does not correct the stated shadow deployment model evaluation without response change mechanism. The targeted response is: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Case evidence: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This addresses a different issue involving feature selection to reduce overparameterization. It does not correct the stated shadow deployment model evaluation without response change mechanism. The targeted response is: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Case evidence: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This addresses a different issue involving managed ai service versus custom ocr model. It does not correct the stated shadow deployment model evaluation without response change mechanism. The targeted response is: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Case evidence: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 375
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. The team needs a defensible technical decision rather than an untracked workaround. Which verification result BEST demonstrates that the issue is resolved?
- Trials record comparable objective values and a selected candidate meets an independent validation target within budget.
- The tested alert rate and precision match the production workload rather than an optimistic single ROC figure.
- Training stops before extended overfitting and the retained model corresponds to the best validated epoch.
- A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records.
Explanation
Correct Answer
A:Trials record comparable objective values and a selected candidate meets an independent validation target within budget. This is the acceptance evidence for the described hyperparameter bayesian tuning strategy scenario. Hyperparameter optimization needs a defined objective and controlled comparable trials, not arbitrary parameter changes. The corrective implementation it validates is: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Reported signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This could validate roc-auc versus pr-auc for rare events, but it does not establish that hyperparameter bayesian tuning strategy is resolved for this workload. Confirm instead: Trials record comparable objective values and a selected candidate meets an independent validation target within budget. Observed problem: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Training stops before extended overfitting and the retained model corresponds to the best validated epoch. This could validate early stopping on validation plateau, but it does not establish that hyperparameter bayesian tuning strategy is resolved for this workload. Confirm instead: Trials record comparable objective values and a selected candidate meets an independent validation target within budget. Observed problem: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. This could validate regression versus classification problem formulation, but it does not establish that hyperparameter bayesian tuning strategy is resolved for this workload. Confirm instead: Trials record comparable objective values and a selected candidate meets an independent validation target within budget. Observed problem: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 376
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. The experiment must be compared fairly against its prior baseline. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state.
- Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Register immutable model package versions with lineage and require explicit approval before promotion to production.
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
Explanation
Correct Answers
A:Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. This directly tests sagemaker model registry candidate approval in the reported AWS ML workflow. A human-readable model nickname is not a reproducible deployment identifier; versioned registry artifacts support controlled promotion. It distinguishes the problem before choosing a change. The related targeted response is: Register immutable model package versions with lineage and require explicit approval before promotion to production. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Register immutable model package versions with lineage and require explicit approval before promotion to production. This is the appropriate controlled remedy for sagemaker model registry candidate approval. A human-readable model nickname is not a reproducible deployment identifier; versioned registry artifacts support controlled promotion. Verify the cause with: Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. Then confirm: A production endpoint resolves to one approved model package version with traceable training lineage. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
B:Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. This selection concerns training batch size causes gpu memory exhaustion rather than the required diagnostic-and-remedy pair for sagemaker model registry candidate approval. Use evidence: Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. and the matching correction: Register immutable model package versions with lineage and require explicit approval before promotion to production. Signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for sagemaker model registry candidate approval. Use evidence: Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. and the matching correction: Register immutable model package versions with lineage and require explicit approval before promotion to production. Signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This selection concerns clustering for unlabeled customer segments rather than the required diagnostic-and-remedy pair for sagemaker model registry candidate approval. Use evidence: Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. and the matching correction: Register immutable model package versions with lineage and require explicit approval before promotion to production. Signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 377
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. The data team must preserve event-time meaning and lineage. Which verification result BEST demonstrates that the issue is resolved?
- Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract.
- Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals.
- Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words.
- Replaying the same notification leaves exactly one corresponding logical training record and records deduplication.
Explanation
Correct Answer
A:Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This is the acceptance evidence for the described sagemaker feature store online offline consistency scenario. Online current state and offline historical records answer different temporal queries; blind latest-value joins cause leakage. The corrective implementation it validates is: Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. Reported signal: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. This could validate glue job bookmark state error, but it does not establish that sagemaker feature store online offline consistency is resolved for this workload. Confirm instead: Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. Observed problem: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. This could validate text tokenization mismatch in serving, but it does not establish that sagemaker feature store online offline consistency is resolved for this workload. Confirm instead: Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. Observed problem: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Replaying the same notification leaves exactly one corresponding logical training record and records deduplication. This could validate s3 object event at-least-once processing, but it does not establish that sagemaker feature store online offline consistency is resolved for this workload. Confirm instead: Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. Observed problem: A fraud endpoint fetches the latest online customer feature while offline training joins an earlier feature snapshot, creating training-serving skew. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 378
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. The team needs a defensible technical decision rather than an untracked workaround. Which engineering response resolves the actual issue without masking the symptoms?
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation.
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
- Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput.
Explanation
Correct Answer
D:Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This is the appropriate controlled remedy for data parallelism versus model parallelism. Data parallelism shards data across replicas; model parallelism is more relevant when the model itself cannot fit on one device. Verify the cause with: Profile model memory, throughput, communication overhead, and per-device utilization. Then confirm: Multiple workers reduce epoch time with acceptable convergence and measured communication overhead. Reported signal: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This addresses a different issue involving xgboost tabular classification baseline. It does not correct the stated data parallelism versus model parallelism mechanism. The targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Case evidence: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. This addresses a different issue involving training batch size causes gpu memory exhaustion. It does not correct the stated data parallelism versus model parallelism mechanism. The targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Case evidence: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This addresses a different issue involving regression versus classification problem formulation. It does not correct the stated data parallelism versus model parallelism mechanism. The targeted response is: Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. Case evidence: A deep model fits on one GPU but training takes too long over a very large dataset; the team suggests splitting individual layers across devices without evidence of model-memory pressure. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 379
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. The deployment must be reproducible without manual console-only fixes. Which measured outcome would confirm that the correction worked as intended?
- A simulated green regression returns traffic to the last healthy model without extended outage.
- Capacity responds to peak request load and p95 latency improves without continual scale oscillation.
- The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver.
- Both regions match their approved parameterized templates and subsequent deployments remain repeatable.
Explanation
Correct Answer
B:Capacity responds to peak request load and p95 latency improves without continual scale oscillation. This is the acceptance evidence for the described sagemaker endpoint auto scaling metric selection scenario. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. The corrective implementation it validates is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:A simulated green regression returns traffic to the last healthy model without extended outage. This could validate blue-green endpoint rollback after health failure, but it does not establish that sagemaker endpoint auto scaling metric selection is resolved for this workload. Confirm instead: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. Observed problem: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. This could validate model registry version promotion provenance, but it does not establish that sagemaker endpoint auto scaling metric selection is resolved for this workload. Confirm instead: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. Observed problem: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Both regions match their approved parameterized templates and subsequent deployments remain repeatable. This could validate cloudformation stack parameter drift, but it does not establish that sagemaker endpoint auto scaling metric selection is resolved for this workload. Confirm instead: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. Observed problem: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 380
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. The data team must preserve event-time meaning and lineage. Which observation most directly identifies the root cause of the reported behavior?
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
- Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
- Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position.
Explanation
Correct Answer
C:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This directly tests skewed numerical feature log transformation in the reported AWS ML workflow. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. It distinguishes the problem before choosing a change. The related targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This is a possible diagnostic for s3 object event at-least-once processing, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. This is a possible diagnostic for standardization of numerical features, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. This is a possible diagnostic for kinesis consumer retention gap, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.