Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 114
Question 1130
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. The data team must preserve event-time meaning and lineage. Which measured outcome would confirm that the correction worked as intended?
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals.
- Write throttles and iterator age fall under burst load without losing required ordering for related records.
- A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values.
Explanation
Correct Answer
B:Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. This is the acceptance evidence for the described glue job bookmark state error scenario. Glue job bookmarks track supported processed state and must be managed deliberately during job changes. The corrective implementation it validates is: Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. Reported signal: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Write throttles and iterator age fall under burst load without losing required ordering for related records. This could validate kinesis data streams shard hot key, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. This could validate median imputation fitted on training split, but it does not establish that glue job bookmark state error is resolved for this workload. Confirm instead: Two ordinary runs ingest only newly eligible objects while a separately invoked backfill handles prior intervals. Observed problem: A daily AWS Glue ingestion job reprocesses a month of files after a deployment because its job bookmark state was reset or the job identity changed. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1131
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. The deployment must be reproducible without manual console-only fixes. Which corrective action most directly addresses this ML workflow problem?
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
Explanation
Correct Answer
A:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This is the appropriate controlled remedy for eventbridge conditional retraining trigger. Event-driven automation needs selective event patterns and readiness checks; every object-write event is not a retraining signal. Verify the cause with: Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories. Then confirm: Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. Reported signal: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
B:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated eventbridge conditional retraining trigger mechanism. The targeted response is: Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. Case evidence: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This addresses a different issue involving bring-your-own-inference-container contract. It does not correct the stated eventbridge conditional retraining trigger mechanism. The targeted response is: Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. Case evidence: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated eventbridge conditional retraining trigger mechanism. The targeted response is: Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. Case evidence: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 1132
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Engineers must avoid changing unrelated source partitions. Which corrective action most directly addresses this ML workflow problem?
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
Explanation
Correct Answer
C:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This is the appropriate controlled remedy for standardization of numerical features. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. Verify the cause with: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. Then confirm: Training converges more consistently, and the same raw request gives aligned standardized values online. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This addresses a different issue involving class imbalance handled inside cross-validation. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This addresses a different issue involving glue data quality non-null contract. It does not correct the stated standardization of numerical features mechanism. The targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Case evidence: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 1133
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The team must demonstrate a repeatable monitoring or security control. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect captured request IDs, ground-truth keys, and the quality monitor dataset schema.
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
- Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
Explanation
Correct Answer
B:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This directly tests iam passrole constraint for model deployment in the reported AWS ML workflow. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. It distinguishes the problem before choosing a change. The related targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Inspect captured request IDs, ground-truth keys, and the quality monitor dataset schema. This is a possible diagnostic for model monitor ground truth association, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This is a possible diagnostic for training-serving feature skew incident, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This is a possible diagnostic for cloudtrail training data access audit coverage, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 1134
During an approved rollout of an AWS ML inference workload, the following condition is observed: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. The team must meet its documented availability and rollback constraints. Which verification result BEST demonstrates that the issue is resolved?
- Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced.
- A deliberately poor candidate halts before production while a passing approved candidate can proceed.
- Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not.
- The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure.
Explanation
Correct Answer
A:Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced. This is the acceptance evidence for the described serverless inference for intermittent requests scenario. Serverless capacity trades some cold-start behavior and resource limits for reduced idle endpoint commitment. The corrective implementation it validates is: Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. Reported signal: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:A deliberately poor candidate halts before production while a passing approved candidate can proceed. This could validate codepipeline approval gate on model metrics, but it does not establish that serverless inference for intermittent requests is resolved for this workload. Confirm instead: Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced. Observed problem: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. This could validate eventbridge conditional retraining trigger, but it does not establish that serverless inference for intermittent requests is resolved for this workload. Confirm instead: Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced. Observed problem: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
D:The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure. This could validate gpu versus cpu inference fit, but it does not establish that serverless inference for intermittent requests is resolved for this workload. Confirm instead: Low-frequency requests succeed within agreed latency while unused provisioned compute spend is reduced. Observed problem: A small CPU inference model receives only occasional requests, but a permanently provisioned endpoint stays idle for most hours. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1135
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. The dataset contract must remain reproducible for a backfill. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
- Inspect prediction errors around midnight and feature representations for the periodic hour variable.
- Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
Explanation
Correct Answer
C:Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. This directly tests standardization of numerical features in the reported AWS ML workflow. Gradient-based training is sensitive to disparate feature scales; training-serving transformation parity is required. It distinguishes the problem before choosing a change. The related targeted response is: Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. Reported signal: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect feature availability timestamps and whether each label time follows the last feature observation. This is a possible diagnostic for chronological split for forecast evaluation, but it does not directly test the standardization of numerical features failure reported here. Prioritize: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. The relevant case is: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Inspect prediction errors around midnight and feature representations for the periodic hour variable. This is a possible diagnostic for time-series cyclical calendar feature, but it does not directly test the standardization of numerical features failure reported here. Prioritize: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. The relevant case is: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This is a possible diagnostic for s3 versus efs training storage choice, but it does not directly test the standardization of numerical features failure reported here. Prioritize: Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. The relevant case is: A model trained on transaction amount and account age is unstable because one feature spans millions of units and the other spans years. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1136
During an approved rollout of an AWS ML inference workload, the following condition is observed: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. The team must meet its documented availability and rollback constraints. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
Explanation
Correct Answers
C:Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This is the appropriate controlled remedy for model registry version promotion provenance. Immutable package versions and approval metadata connect evaluation with deployment; mutable S3 nicknames do not. Verify the cause with: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. Then confirm: The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
E:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This directly tests model registry version promotion provenance in the reported AWS ML workflow. Immutable package versions and approval metadata connect evaluation with deployment; mutable S3 nicknames do not. It distinguishes the problem before choosing a change. The related targeted response is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This selection concerns codepipeline approval gate on model metrics rather than the required diagnostic-and-remedy pair for model registry version promotion provenance. Use evidence: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. and the matching correction: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This selection concerns endpoint scale-to-zero cold capacity planning rather than the required diagnostic-and-remedy pair for model registry version promotion provenance. Use evidence: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. and the matching correction: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This selection concerns asynchronous endpoint for large payloads rather than the required diagnostic-and-remedy pair for model registry version promotion provenance. Use evidence: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. and the matching correction: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1137
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Change control requires measurable endpoint or pipeline acceptance evidence. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
- Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs.
Explanation
Correct Answer
D:Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. This directly tests sagemaker vpc endpoint access for private artifacts in the reported AWS ML workflow. VPC isolation requires explicit supported network paths to AWS services; IAM permission alone does not create connectivity. It distinguishes the problem before choosing a change. The related targeted response is: Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. Reported signal: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect EventBridge rule patterns, source events, object prefixes, and pipeline execution histories. This is a possible diagnostic for eventbridge conditional retraining trigger, but it does not directly test the sagemaker vpc endpoint access for private artifacts failure reported here. Prioritize: Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. The relevant case is: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This is a possible diagnostic for endpoint scale-to-zero cold capacity planning, but it does not directly test the sagemaker vpc endpoint access for private artifacts failure reported here. Prioritize: Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. The relevant case is: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This is a possible diagnostic for model registry version promotion provenance, but it does not directly test the sagemaker vpc endpoint access for private artifacts failure reported here. Prioritize: Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. The relevant case is: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1138
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. The release is blocked until the underlying model behavior is understood. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
Explanation
Correct Answer
A:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This directly tests shadow deployment model evaluation without response change in the reported AWS ML workflow. Shadow evaluation measures candidates on live traffic while withholding their output from the customer response path. It distinguishes the problem before choosing a change. The related targeted response is: Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. Reported signal: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This is a possible diagnostic for sagemaker jumpstart template provenance, but it does not directly test the shadow deployment model evaluation without response change failure reported here. Prioritize: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. The relevant case is: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the shadow deployment model evaluation without response change failure reported here. Prioritize: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. The relevant case is: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This is a possible diagnostic for reproducible sagemaker experiments comparisons, but it does not directly test the shadow deployment model evaluation without response change failure reported here. Prioritize: Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. The relevant case is: A new model appears faster offline, but production owners require comparison using real requests without changing customer-visible predictions. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1139
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Change control requires measurable endpoint or pipeline acceptance evidence. Which engineering response resolves the actual issue without masking the symptoms?
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
Explanation
Correct Answer
D:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This is the appropriate controlled remedy for endpoint scale-to-zero cold capacity planning. Reactive scaling takes time and is bounded by quotas; zero spare capacity may not absorb an instantaneous burst. Verify the cause with: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. Then confirm: A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. Reported signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This addresses a different issue involving multi-model endpoint hosting tradeoff. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated endpoint scale-to-zero cold capacity planning mechanism. The targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Case evidence: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1140
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. The dataset contract must remain reproducible for a backfill. Which corrective action most directly addresses this ML workflow problem?
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
Explanation
Correct Answer
B:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This is the appropriate controlled remedy for class imbalance handled inside cross-validation. Oversampling before splitting contaminates evaluation and hides the real error rate on rare classes. Verify the cause with: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. Then confirm: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. Reported signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This addresses a different issue involving partition pruning in s3 parquet training input. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This addresses a different issue involving clarify label imbalance measurement. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This addresses a different issue involving high-cardinality categorical encoding. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.