Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 53
Question 520
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Engineers must avoid changing unrelated source partitions. Which verification result BEST demonstrates that the issue is resolved?
- Training converges more consistently, and the same raw request gives aligned standardized values online.
- Validated records preserve the expected label and field order while malformed inputs are reported separately.
- A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values.
- The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps.
Explanation
Correct Answer
A:Training converges more consistently, and the same raw request gives aligned standardized values online. This is the acceptance evidence for the described standardization of numerical features scenario. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. The corrective implementation it validates is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. This could validate median imputation fitted on training split, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. This could validate kinesis consumer retention gap, but it does not establish that standardization of numerical features is resolved for this workload. Confirm instead: Training converges more consistently, and the same raw request gives aligned standardized values online. Observed problem: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 521
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. The dataset contract must remain reproducible for a backfill. Which engineering response resolves the actual issue without masking the symptoms?
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
Explanation
Correct Answer
D:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This is the appropriate controlled remedy for chronological split for forecast evaluation. Random splits violate temporal causality when future observations influence features or train data. Verify the cause with: Inspect feature availability timestamps and whether each label time follows the last feature observation. Then confirm: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This addresses a different issue involving ground truth labeling agreement review. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This addresses a different issue involving point-in-time feature data leakage. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. This addresses a different issue involving s3 object event at-least-once processing. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 522
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. The team needs a defensible technical decision rather than an untracked workaround. What postchange observation provides the strongest acceptance evidence?
- A representative invoice set yields usable structured fields with measured extraction quality and minimal custom training.
- The evaluation report shows both typical error and extreme-error impact with a justified primary metric.
- Held-out messages receive the intended class predictions and macro-averaged quality is measurable.
- The production response remains on the primary while shadow metrics reveal candidate performance and resource needs.
Explanation
Correct Answer
B:The evaluation report shows both typical error and extreme-error impact with a justified primary metric. This is the acceptance evidence for the described rmse versus mae outlier sensitivity scenario. Squaring residuals gives large errors disproportionately high weight; MAE weights magnitudes linearly. The corrective implementation it validates is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Reported signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:A representative invoice set yields usable structured fields with measured extraction quality and minimal custom training. This could validate managed ai service versus custom ocr model, but it does not establish that rmse versus mae outlier sensitivity is resolved for this workload. Confirm instead: The evaluation report shows both typical error and extreme-error impact with a justified primary metric. Observed problem: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Held-out messages receive the intended class predictions and macro-averaged quality is measurable. This could validate sagemaker built-in blazingtext choice, but it does not establish that rmse versus mae outlier sensitivity is resolved for this workload. Confirm instead: The evaluation report shows both typical error and extreme-error impact with a justified primary metric. Observed problem: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:The production response remains on the primary while shadow metrics reveal candidate performance and resource needs. This could validate shadow deployment model evaluation without response change, but it does not establish that rmse versus mae outlier sensitivity is resolved for this workload. Confirm instead: The evaluation report shows both typical error and extreme-error impact with a justified primary metric. Observed problem: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 523
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. The team must demonstrate a repeatable monitoring or security control. Which measured outcome would confirm that the correction worked as intended?
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
- Training jobs reach the intended service privately while unauthorized external egress stays blocked.
- Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner.
- The pipeline deploys with the authorized role and cannot assign an unrelated privileged role.
Explanation
Correct Answer
B:Training jobs reach the intended service privately while unauthorized external egress stays blocked. This is the acceptance evidence for the described private vpc endpoint policy for sagemaker apis scenario. An IAM role permits API actions but network access and endpoint policies must also support the private path. The corrective implementation it validates is: Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access. Reported signal: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This could validate inference recommender benchmarking instance family, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner. This could validate model monitor violation alert calibration, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:The pipeline deploys with the authorized role and cannot assign an unrelated privileged role. This could validate iam passrole constraint for model deployment, but it does not establish that private vpc endpoint policy for sagemaker apis is resolved for this workload. Confirm instead: Training jobs reach the intended service privately while unauthorized external egress stays blocked. Observed problem: A regulated training process requires private network paths, but its isolated subnet cannot call the intended SageMaker API without going through public internet. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 524
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Engineers must avoid changing unrelated source partitions. Which corrective action most directly addresses this ML workflow problem?
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
Explanation
Correct Answer
D:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This is the appropriate controlled remedy for ground truth labeling agreement review. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. Verify the cause with: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. Then confirm: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This addresses a different issue involving model training data residency boundary. It does not correct the stated ground truth labeling agreement review mechanism. The targeted response is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Case evidence: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This addresses a different issue involving text tokenization mismatch in serving. It does not correct the stated ground truth labeling agreement review mechanism. The targeted response is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Case evidence: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This addresses a different issue involving glue data quality non-null contract. It does not correct the stated ground truth labeling agreement review mechanism. The targeted response is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Case evidence: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 525
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. The experiment must be compared fairly against its prior baseline. Which measured outcome would confirm that the correction worked as intended?
- Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy.
- The fine-tuned model improves task accuracy without collapsing pretrained representations.
- The model no longer relies on future-only flags and held-out results reflect features available at inference.
- Gradient norms stay within the chosen range and training loss remains finite under representative batches.
Explanation
Correct Answer
A:Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. This is the acceptance evidence for the described training batch size causes gpu memory exhaustion scenario. Per-step activation memory generally scales with batch size; safe accumulation can preserve an effective larger batch. The corrective implementation it validates is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Reported signal: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
B:The fine-tuned model improves task accuracy without collapsing pretrained representations. This could validate fine-tuning pretrained model learning-rate stability, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:The model no longer relies on future-only flags and held-out results reflect features available at inference. This could validate clarify feature attribution against target leakage, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Gradient norms stay within the chosen range and training loss remains finite under representative batches. This could validate model debugger exploding gradient diagnosis, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 526
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Engineers must avoid changing unrelated source partitions. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
- Inspect categorical cardinality, sparse matrix dimensions, feature contribution, and generalization to unseen identifiers.
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
Explanation
Correct Answers
A:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This directly tests class imbalance handled inside cross-validation in the reported AWS ML workflow. Oversampling before splitting contaminates evaluation and hides the real error rate on rare classes. It distinguishes the problem before choosing a change. The related targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This is the appropriate controlled remedy for class imbalance handled inside cross-validation. Oversampling before splitting contaminates evaluation and hides the real error rate on rare classes. Verify the cause with: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. Then confirm: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
C:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This selection concerns glue data quality non-null contract rather than the required diagnostic-and-remedy pair for class imbalance handled inside cross-validation. Use evidence: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. and the matching correction: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Inspect categorical cardinality, sparse matrix dimensions, feature contribution, and generalization to unseen identifiers. This selection concerns high-cardinality categorical encoding rather than the required diagnostic-and-remedy pair for class imbalance handled inside cross-validation. Use evidence: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. and the matching correction: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
E:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for class imbalance handled inside cross-validation. Use evidence: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. and the matching correction: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 527
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The experiment must be compared fairly against its prior baseline. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
Explanation
Correct Answers
A:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This directly tests sagemaker jumpstart template provenance in the reported AWS ML workflow. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. It distinguishes the problem before choosing a change. The related targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is the appropriate controlled remedy for sagemaker jumpstart template provenance. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. Verify the cause with: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. Then confirm: The chosen version meets task metrics and license conditions and its inference contract is reproducible. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
B:Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. This selection concerns sagemaker model registry candidate approval rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This selection concerns regression versus classification problem formulation rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 528
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. The team must demonstrate a repeatable monitoring or security control. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
- Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service.
- Use a consistent versioned feature definition and test offline/online values at the same observation cutoff.
Explanation
Correct Answers
B:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This directly tests secret rotation for inference container credentials in the reported AWS ML workflow. Container artifacts can leak hard-coded secrets; runtime retrieval and rotation keep sensitive values outside build outputs. It distinguishes the problem before choosing a change. The related targeted response is: Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. This is the appropriate controlled remedy for secret rotation for inference container credentials. Container artifacts can leak hard-coded secrets; runtime retrieval and rotation keep sensitive values outside build outputs. Verify the cause with: Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. Then confirm: The new container operates with rotated credentials and image scans find no active embedded password. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This selection concerns sagemaker execution role s3 least privilege rather than the required diagnostic-and-remedy pair for secret rotation for inference container credentials. Use evidence: Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. and the matching correction: Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. Signal: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This selection concerns aws budgets spend threshold for experimentation rather than the required diagnostic-and-remedy pair for secret rotation for inference container credentials. Use evidence: Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. and the matching correction: Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. Signal: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
E:Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. This selection concerns training-serving feature skew incident rather than the required diagnostic-and-remedy pair for secret rotation for inference container credentials. Use evidence: Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. and the matching correction: Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. Signal: An inference container embeds a database password in its image, and every rollout reuses the credential even after an incident. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 529
During a production MLOps reliability and security review, the following condition is observed: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. The owner needs an auditable resolution without broadening privileges. What targeted change should be implemented after verifying the stated cause?
- Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions.
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable.
- Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service.
Explanation
Correct Answer
C:Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. This is the appropriate controlled remedy for champion challenger a/b assignment consistency. Random assignment per request can mix treatments for one entity and bias longitudinal online experiments. Verify the cause with: Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. Then confirm: Repeated requests for one test user reach the same assigned variant and measured outcomes remain comparable. Reported signal: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This addresses a different issue involving target-label delay in production quality monitoring. It does not correct the stated champion challenger a/b assignment consistency mechanism. The targeted response is: Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. Case evidence: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
B:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This addresses a different issue involving cross-account s3 bucket exfiltration protection. It does not correct the stated champion challenger a/b assignment consistency mechanism. The targeted response is: Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. Case evidence: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
D:Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. This addresses a different issue involving secret rotation for inference container credentials. It does not correct the stated champion challenger a/b assignment consistency mechanism. The targeted response is: Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. Case evidence: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
Question 530
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Engineers must avoid changing unrelated source partitions. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines.
- Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training.
- Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
Explanation
Correct Answers
B:Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. This directly tests standardization of numerical features in the reported AWS ML workflow. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. It distinguishes the problem before choosing a change. The related targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This is the appropriate controlled remedy for standardization of numerical features. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. Verify the cause with: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. Then confirm: Training converges more consistently, and the same raw request gives aligned standardized values online. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines. This selection concerns glue data quality non-null contract rather than the required diagnostic-and-remedy pair for standardization of numerical features. Use evidence: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. and the matching correction: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. This selection concerns csv schema ambiguity during ingestion rather than the required diagnostic-and-remedy pair for standardization of numerical features. Use evidence: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. and the matching correction: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
E:Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This selection concerns text tokenization mismatch in serving rather than the required diagnostic-and-remedy pair for standardization of numerical features. Use evidence: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. and the matching correction: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.