Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 91
Question 900
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Change control requires measurable endpoint or pipeline acceptance evidence. Which engineering response resolves the actual issue without masking the symptoms?
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
- Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift.
- Reference an approved immutable image digest or controlled version tag and retain a reproducible build record.
- Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
Explanation
Correct Answer
B:Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. This is the appropriate controlled remedy for cloudformation stack parameter drift. Infrastructure as code only controls actual state when out-of-band changes are detected and reconciled. Verify the cause with: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. Then confirm: Both regions match their approved parameterized templates and subsequent deployments remain repeatable. Reported signal: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This addresses a different issue involving model registry version promotion provenance. It does not correct the stated cloudformation stack parameter drift mechanism. The targeted response is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Case evidence: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. This addresses a different issue involving ecr immutable image digest for inference. It does not correct the stated cloudformation stack parameter drift mechanism. The targeted response is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Case evidence: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This addresses a different issue involving multi-container inference pipeline responsibilities. It does not correct the stated cloudformation stack parameter drift mechanism. The targeted response is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Case evidence: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 901
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. The dataset contract must remain reproducible for a backfill. Which engineering response resolves the actual issue without masking the symptoms?
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
Explanation
Correct Answer
B:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This is the appropriate controlled remedy for model training data residency boundary. Encrypting copied data does not automatically satisfy geographic residency constraints; placement and access must be controlled. Verify the cause with: Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. Then confirm: A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. Reported signal: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This addresses a different issue involving standardization of numerical features. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This addresses a different issue involving rds extraction overload into ml. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This addresses a different issue involving clarify label imbalance measurement. It does not correct the stated model training data residency boundary mechanism. The targeted response is: Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. Case evidence: A regulated ML pipeline copies EU-only customer records into an unapproved cross-region training bucket for convenience. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 902
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. The dataset contract must remain reproducible for a backfill. What targeted change should be implemented after verifying the stated cause?
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
Explanation
Correct Answer
C:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This is the appropriate controlled remedy for standardization of numerical features. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. Verify the cause with: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. Then confirm: Training converges more consistently, and the same raw request gives aligned standardized values online. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This addresses a different issue involving glue data quality non-null contract. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This addresses a different issue involving chronological split for forecast evaluation. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 903
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. The deployment must be reproducible without manual console-only fixes. What targeted change should be implemented after verifying the stated cause?
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
Explanation
Correct Answer
D:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This is the appropriate controlled remedy for sagemaker neo edge compiler compatibility. Edge optimization depends on target hardware and supported operations, not merely copying a cloud training artifact. Verify the cause with: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. Then confirm: The compiled artifact runs on the target device with validated outputs and acceptable memory and latency. Reported signal: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This addresses a different issue involving bring-your-own-inference-container contract. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 904
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. The team must demonstrate a repeatable monitoring or security control. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Pin an immutable approved artifact version or content digest and verify integrity before deployment.
- Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest.
- Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting.
- Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
- Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention.
Explanation
Correct Answers
A:Pin an immutable approved artifact version or content digest and verify integrity before deployment. This is the appropriate controlled remedy for model artifact supply-chain integrity. Object names alone do not guarantee model provenance; supply-chain checks bind deployment to reviewed bytes. Verify the cause with: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. Then confirm: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. This directly tests model artifact supply-chain integrity in the reported AWS ML workflow. Object names alone do not guarantee model provenance; supply-chain checks bind deployment to reviewed bytes. It distinguishes the problem before choosing a change. The related targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
C:Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. This selection concerns tag-based ml training cost attribution rather than the required diagnostic-and-remedy pair for model artifact supply-chain integrity. Use evidence: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. and the matching correction: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This selection concerns spot training cost versus interruption recovery rather than the required diagnostic-and-remedy pair for model artifact supply-chain integrity. Use evidence: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. and the matching correction: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
E:Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. This selection concerns cloudtrail training data access audit coverage rather than the required diagnostic-and-remedy pair for model artifact supply-chain integrity. Use evidence: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. and the matching correction: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 905
During a production MLOps reliability and security review, the following condition is observed: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. The owner needs an auditable resolution without broadening privileges. Which engineering response resolves the actual issue without masking the symptoms?
- Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention.
- Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed.
- Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access.
- Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy.
Explanation
Correct Answer
A:Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. This is the appropriate controlled remedy for cloudtrail training data access audit coverage. CloudTrail management events do not by default include every S3 object read; data-event selection provides that visibility. Verify the cause with: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. Then confirm: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Reported signal: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
B:Monitor calibration against delayed truth and retrain or recalibrate on representative permitted data when drift is confirmed. This addresses a different issue involving serving output confidence calibration drift. It does not correct the stated cloudtrail training data access audit coverage mechanism. The targeted response is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Case evidence: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: During a production MLOps reliability and security review.
C:Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access. This addresses a different issue involving private vpc endpoint policy for sagemaker apis. It does not correct the stated cloudtrail training data access audit coverage mechanism. The targeted response is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Case evidence: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: During a production MLOps reliability and security review.
D:Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This addresses a different issue involving aws budgets spend threshold for experimentation. It does not correct the stated cloudtrail training data access audit coverage mechanism. The targeted response is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Case evidence: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: During a production MLOps reliability and security review.
Question 906
During an approved rollout of an AWS ML inference workload, the following condition is observed: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. The team must meet its documented availability and rollback constraints. Which corrective action most directly addresses this ML workflow problem?
- Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
Explanation
Correct Answer
B:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This is the appropriate controlled remedy for sagemaker neo edge compiler compatibility. Edge optimization depends on target hardware and supported operations, not merely copying a cloud training artifact. Verify the cause with: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. Then confirm: The compiled artifact runs on the target device with validated outputs and acceptable memory and latency. Reported signal: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This addresses a different issue involving canary variant rollout for model changes. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This addresses a different issue involving eventbridge conditional retraining trigger. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This addresses a different issue involving codepipeline approval gate on model metrics. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 907
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. The team needs a defensible technical decision rather than an untracked workaround. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
- Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints.
- Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
Explanation
Correct Answers
A:Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This is the appropriate controlled remedy for hyperparameter bayesian tuning strategy. Hyperparameter optimization needs a defined objective and controlled comparable trials, not arbitrary parameter changes. Verify the cause with: Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. Then confirm: Trials record comparable objective values and a selected candidate meets an independent validation target within budget. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. This directly tests hyperparameter bayesian tuning strategy in the reported AWS ML workflow. Hyperparameter optimization needs a defined objective and controlled comparable trials, not arbitrary parameter changes. It distinguishes the problem before choosing a change. The related targeted response is: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This selection concerns roc-auc versus pr-auc for rare events rather than the required diagnostic-and-remedy pair for hyperparameter bayesian tuning strategy. Use evidence: Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. and the matching correction: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Prefer data parallel training with synchronized gradients when the model fits per device and the bottleneck is dataset throughput. This selection concerns data parallelism versus model parallelism rather than the required diagnostic-and-remedy pair for hyperparameter bayesian tuning strategy. Use evidence: Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. and the matching correction: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for hyperparameter bayesian tuning strategy. Use evidence: Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. and the matching correction: Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. Signal: An ML engineer manually tests hundreds of random combinations for an expensive model without recording objectives or resource budgets. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 908
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. The experiment must be compared fairly against its prior baseline. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs.
- Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
- Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts.
Explanation
Correct Answer
B:Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. This directly tests interpretability for high-stakes prediction in the reported AWS ML workflow. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. It distinguishes the problem before choosing a change. The related targeted response is: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Inspect accelerator memory use, tensor shapes, batch size, gradient accumulation, and failed training logs. This is a possible diagnostic for training batch size causes gpu memory exhaustion, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This is a possible diagnostic for clustering for unlabeled customer segments, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Inspect interruption events, checkpoint directory mapping, restoration logic, and persistent S3 checkpoint artifacts. This is a possible diagnostic for managed spot training checkpoint recovery, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 909
During a production MLOps reliability and security review, the following condition is observed: An asynchronous inference queue's oldest pending request age keeps increasing, yet GPU utilization alerts remain normal because requests are waiting before execution. The owner needs an auditable resolution without broadening privileges. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics.
- Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
Explanation
Correct Answer
C:Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. This directly tests asynchronous inference queue backlog alert in the reported AWS ML workflow. Queued work can miss response deadlines without saturating compute; queue age is its own performance signal. It distinguishes the problem before choosing a change. The related targeted response is: Scale compatible asynchronous inference capacity or tune workload and queue alarms for pending-request age. Reported signal: An asynchronous inference queue's oldest pending request age keeps increasing, yet GPU utilization alerts remain normal because requests are waiting before execution. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This is a possible diagnostic for aws budgets spend threshold for experimentation, but it does not directly test the asynchronous inference queue backlog alert failure reported here. Prioritize: Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. The relevant case is: An asynchronous inference queue's oldest pending request age keeps increasing, yet GPU utilization alerts remain normal because requests are waiting before execution. Operational setting: During a production MLOps reliability and security review.
B:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This is a possible diagnostic for s3 sse-kms cross-account model artifact access, but it does not directly test the asynchronous inference queue backlog alert failure reported here. Prioritize: Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. The relevant case is: An asynchronous inference queue's oldest pending request age keeps increasing, yet GPU utilization alerts remain normal because requests are waiting before execution. Operational setting: During a production MLOps reliability and security review.
D:Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This is a possible diagnostic for training-serving feature skew incident, but it does not directly test the asynchronous inference queue backlog alert failure reported here. Prioritize: Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. The relevant case is: An asynchronous inference queue's oldest pending request age keeps increasing, yet GPU utilization alerts remain normal because requests are waiting before execution. Operational setting: During a production MLOps reliability and security review.
Question 910
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. The data team must preserve event-time meaning and lineage. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
- Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
Explanation
Correct Answers
A:Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This directly tests rds extraction overload into ml in the reported AWS ML workflow. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. It distinguishes the problem before choosing a change. The related targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This is the appropriate controlled remedy for rds extraction overload into ml. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. Verify the cause with: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. Then confirm: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This selection concerns group-leakage train and validation split rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This selection concerns median imputation fitted on training split rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This selection concerns glue job bookmark state error rather than the required diagnostic-and-remedy pair for rds extraction overload into ml. Use evidence: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. and the matching correction: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.