Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 109
Question 1080
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. The data team must preserve event-time meaning and lineage. Which corrective action most directly addresses this ML workflow problem?
- Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema.
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
Explanation
Correct Answer
A:Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. This is the appropriate controlled remedy for columnar file compaction for small objects. Excessive small files create metadata and request overhead even with a columnar data format. Verify the cause with: Measure file-size distribution, object request count, Spark task scheduling overhead, and read throughput. Then confirm: Training read time and object operations decline while the resulting row count and checksums match. Reported signal: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This addresses a different issue involving high-cardinality categorical encoding. It does not correct the stated columnar file compaction for small objects mechanism. The targeted response is: Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. Case evidence: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This addresses a different issue involving streaming feature rolling window correctness. It does not correct the stated columnar file compaction for small objects mechanism. The targeted response is: Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. Case evidence: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This addresses a different issue involving rds extraction overload into ml. It does not correct the stated columnar file compaction for small objects mechanism. The targeted response is: Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. Case evidence: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1081
During a production MLOps reliability and security review, the following condition is observed: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. The owner needs an auditable resolution without broadening privileges. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Compare probability calibration plots, Brier score and event rates across recent labeled cohorts.
- Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions.
Explanation
Correct Answers
A:Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. This directly tests serving output confidence calibration drift in the reported AWS ML workflow. A good ranking metric does not guarantee calibrated probabilities; calibration must be verified against observed outcomes. It distinguishes the problem before choosing a change. The related targeted response is: Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: During a production MLOps reliability and security review.
B:Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. This is the appropriate controlled remedy for serving output confidence calibration drift. A good ranking metric does not guarantee calibrated probabilities; calibration must be verified against observed outcomes. Verify the cause with: Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. Then confirm: Predicted probability buckets align with observed frequencies on held-out recent labeled cohorts. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
C:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This selection concerns s3 sse-kms cross-account model artifact access rather than the required diagnostic-and-remedy pair for serving output confidence calibration drift. Use evidence: Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. and the matching correction: Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. Signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: During a production MLOps reliability and security review.
D:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This selection concerns iam passrole constraint for model deployment rather than the required diagnostic-and-remedy pair for serving output confidence calibration drift. Use evidence: Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. and the matching correction: Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. Signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: During a production MLOps reliability and security review.
E:Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This selection concerns target-label delay in production quality monitoring rather than the required diagnostic-and-remedy pair for serving output confidence calibration drift. Use evidence: Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. and the matching correction: Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. Signal: A binary risk model continues producing apparently confident scores after a market regime change, but realized outcomes show the scores no longer correspond to observed event frequency. Operational setting: During a production MLOps reliability and security review.
Question 1082
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Engineers must avoid changing unrelated source partitions. What targeted change should be implemented after verifying the stated cause?
- Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
Explanation
Correct Answer
C:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This is the appropriate controlled remedy for model training data residency boundary. Encrypting copied data does not automatically satisfy geographic residency constraints; placement and access must be controlled. Verify the cause with: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. Then confirm: A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. Reported signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This addresses a different issue involving group-leakage train and validation split. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This addresses a different issue involving rds extraction overload into ml. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This addresses a different issue involving text tokenization mismatch in serving. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 1083
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The team needs a defensible technical decision rather than an untracked workaround. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event.
- Read the configured SageMaker training channel path or environment variable and fail clearly on missing input.
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation.
Explanation
Correct Answers
B:Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This is the appropriate controlled remedy for sagemaker script-mode data channel mismatch. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. Verify the cause with: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. Then confirm: The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This directly tests sagemaker script-mode data channel mismatch in the reported AWS ML workflow. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. It distinguishes the problem before choosing a change. The related targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event. This selection concerns clarify feature attribution against target leakage rather than the required diagnostic-and-remedy pair for sagemaker script-mode data channel mismatch. Use evidence: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. and the matching correction: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This selection concerns xgboost tabular classification baseline rather than the required diagnostic-and-remedy pair for sagemaker script-mode data channel mismatch. Use evidence: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. and the matching correction: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. This selection concerns training batch size causes gpu memory exhaustion rather than the required diagnostic-and-remedy pair for sagemaker script-mode data channel mismatch. Use evidence: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. and the matching correction: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1084
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The release is blocked until the underlying model behavior is understood. What targeted change should be implemented after verifying the stated cause?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes.
- Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses.
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
Explanation
Correct Answer
D:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This is the appropriate controlled remedy for roc-auc versus pr-auc for rare events. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. Verify the cause with: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. Then confirm: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated roc-auc versus pr-auc for rare events mechanism. The targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Case evidence: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. This addresses a different issue involving regression versus classification problem formulation. It does not correct the stated roc-auc versus pr-auc for rare events mechanism. The targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Case evidence: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This addresses a different issue involving shadow deployment model evaluation without response change. It does not correct the stated roc-auc versus pr-auc for rare events mechanism. The targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Case evidence: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1085
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. The experiment must be compared fairly against its prior baseline. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.
- Read the configured SageMaker training channel path or environment variable and fail clearly on missing input.
Explanation
Correct Answers
A:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This is the appropriate controlled remedy for training image compatibility for byoc. Custom containers must implement the hosting or training contract; building a valid Docker image alone is insufficient. Verify the cause with: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. Then confirm: The managed training job starts the intended script and produces a usable model artifact in the output location. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This directly tests training image compatibility for byoc in the reported AWS ML workflow. Custom containers must implement the hosting or training contract; building a valid Docker image alone is insufficient. It distinguishes the problem before choosing a change. The related targeted response is: Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
B:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This selection concerns interpretability for high-stakes prediction rather than the required diagnostic-and-remedy pair for training image compatibility for byoc. Use evidence: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. and the matching correction: Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. Signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for training image compatibility for byoc. Use evidence: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. and the matching correction: Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. Signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This selection concerns sagemaker script-mode data channel mismatch rather than the required diagnostic-and-remedy pair for training image compatibility for byoc. Use evidence: Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. and the matching correction: Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. Signal: A custom SageMaker training image exits before fitting because its entrypoint does not understand the job's expected channel paths and arguments. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 1086
During an approved rollout of an AWS ML inference workload, the following condition is observed: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. The team must meet its documented availability and rollback constraints. Which engineering response resolves the actual issue without masking the symptoms?
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit.
Explanation
Correct Answer
D:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This is the appropriate controlled remedy for bring-your-own-inference-container contract. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. Verify the cause with: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. Then confirm: Endpoint health becomes Ready and inference returns the specified payload type for a known test request. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated bring-your-own-inference-container contract mechanism. The targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Case evidence: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1087
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. The dataset contract must remain reproducible for a backfill. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned.
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
Explanation
Correct Answer
C:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This directly tests skewed numerical feature log transformation in the reported AWS ML workflow. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. It distinguishes the problem before choosing a change. The related targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. This is a possible diagnostic for partition pruning in s3 parquet training input, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This is a possible diagnostic for text tokenization mismatch in serving, but it does not directly test the skewed numerical feature log transformation failure reported here. Prioritize: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. The relevant case is: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1088
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The experiment must be compared fairly against its prior baseline. Which measured outcome would confirm that the correction worked as intended?
- Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage.
- The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions.
- Trials record comparable objective values and a selected candidate meets an independent validation target within budget.
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
Explanation
Correct Answer
B:The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. This is the acceptance evidence for the described sagemaker script-mode data channel mismatch scenario. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. The corrective implementation it validates is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This could validate reproducible sagemaker experiments comparisons, but it does not establish that sagemaker script-mode data channel mismatch is resolved for this workload. Confirm instead: The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. Observed problem: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Trials record comparable objective values and a selected candidate meets an independent validation target within budget. This could validate hyperparameter bayesian tuning strategy, but it does not establish that sagemaker script-mode data channel mismatch is resolved for this workload. Confirm instead: The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. Observed problem: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that sagemaker script-mode data channel mismatch is resolved for this workload. Confirm instead: The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. Observed problem: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 1089
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?
- Training converges more consistently, and the same raw request gives aligned standardized values online.
- Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering.
- Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals.
- Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings.
Explanation
Correct Answer
B:Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. This is the acceptance evidence for the described chronological split for forecast evaluation scenario. Random splits violate temporal causality when future observations influence features or train data. The corrective implementation it validates is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Training converges more consistently, and the same raw request gives aligned standardized values online. This could validate standardization of numerical features, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. This could validate glue job bookmark state error, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. This could validate pii masking before model labeling, but it does not establish that chronological split for forecast evaluation is resolved for this workload. Confirm instead: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Observed problem: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 1090
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. The team needs a defensible technical decision rather than an untracked workaround. What targeted change should be implemented after verifying the stated cause?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
Explanation
Correct Answer
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This is the appropriate controlled remedy for fine-tuning pretrained model learning-rate stability. Large updates on small data can overwrite pretrained features; careful transfer learning limits destructive forgetting. Verify the cause with: Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. Then confirm: The fine-tuned model improves task accuracy without collapsing pretrained representations. Reported signal: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This addresses a different issue involving xgboost tabular classification baseline. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. This addresses a different issue involving model debugger exploding gradient diagnosis. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This addresses a different issue involving training image compatibility for byoc. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: At the model-governance gate before promotion of a new ML artifact.