Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 107
Question 1060
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. The deployment must be reproducible without manual console-only fixes. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
- Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
Explanation
Correct Answer
D:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This directly tests multi-container inference pipeline responsibilities in the reported AWS ML workflow. A managed inference pipeline chains preprocessing and prediction steps consistently, reducing client-side skew. It distinguishes the problem before choosing a change. The related targeted response is: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Reported signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This is a possible diagnostic for model registry version promotion provenance, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. This is a possible diagnostic for gpu versus cpu inference fit, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This is a possible diagnostic for endpoint scale-to-zero cold capacity planning, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 1061
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. The dataset contract must remain reproducible for a backfill. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
- Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks.
- Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering.
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag.
Explanation
Correct Answers
C:Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. This is the appropriate controlled remedy for kinesis data streams shard hot key. Kinesis shard throughput is bounded; a hot partition key can overload one shard despite spare total stream capacity. Verify the cause with: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. Then confirm: Write throttles and iterator age fall under burst load without losing required ordering for related records. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
E:Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. This directly tests kinesis data streams shard hot key in the reported AWS ML workflow. Kinesis shard throughput is bounded; a hot partition key can overload one shard despite spare total stream capacity. It distinguishes the problem before choosing a change. The related targeted response is: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This selection concerns class imbalance handled inside cross-validation rather than the required diagnostic-and-remedy pair for kinesis data streams shard hot key. Use evidence: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. and the matching correction: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. Signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. This selection concerns text tokenization mismatch in serving rather than the required diagnostic-and-remedy pair for kinesis data streams shard hot key. Use evidence: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. and the matching correction: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. Signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This selection concerns partition pruning in s3 parquet training input rather than the required diagnostic-and-remedy pair for kinesis data streams shard hot key. Use evidence: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. and the matching correction: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. Signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1062
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The data team must preserve event-time meaning and lineage. Which observation most directly identifies the root cause of the reported behavior?
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
Explanation
Correct Answer
C:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This directly tests clarify label imbalance measurement in the reported AWS ML workflow. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. It distinguishes the problem before choosing a change. The related targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the clarify label imbalance measurement failure reported here. Prioritize: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. The relevant case is: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. This is a possible diagnostic for partition pruning in s3 parquet training input, but it does not directly test the clarify label imbalance measurement failure reported here. Prioritize: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. The relevant case is: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This is a possible diagnostic for s3 object event at-least-once processing, but it does not directly test the clarify label imbalance measurement failure reported here. Prioritize: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. The relevant case is: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1063
During a production MLOps reliability and security review, the following condition is observed: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. The owner needs an auditable resolution without broadening privileges. Which observation most directly identifies the root cause of the reported behavior?
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
- Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation.
- Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
Explanation
Correct Answer
B:Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. This directly tests model monitor violation alert calibration in the reported AWS ML workflow. Monitoring must balance sensitivity and alert fatigue; treating every small statistical change as an incident is unreliable. It distinguishes the problem before choosing a change. The related targeted response is: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. Reported signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: During a production MLOps reliability and security review.
C:Inspect inference timestamps, eventual ground-truth arrival, join keys, and the provenance of displayed quality metrics. This is a possible diagnostic for target-label delay in production quality monitoring, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: During a production MLOps reliability and security review.
D:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This is a possible diagnostic for s3 sse-kms cross-account model artifact access, but it does not directly test the model monitor violation alert calibration failure reported here. Prioritize: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. The relevant case is: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: During a production MLOps reliability and security review.
Question 1064
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. The experiment must be compared fairly against its prior baseline. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds.
Explanation
Correct Answer
D:Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. This directly tests precision versus recall fraud threshold in the reported AWS ML workflow. Accuracy can conceal poor minority-class detection; threshold selection trades recall against precision. It distinguishes the problem before choosing a change. The related targeted response is: Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. Reported signal: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event. This is a possible diagnostic for clarify feature attribution against target leakage, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This is a possible diagnostic for sagemaker jumpstart template provenance, but it does not directly test the precision versus recall fraud threshold failure reported here. Prioritize: Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. The relevant case is: A fraud-screening model has high global accuracy because most purchases are legitimate, while expensive fraud cases are often missed. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 1065
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The data team must preserve event-time meaning and lineage. Which engineering response resolves the actual issue without masking the symptoms?
- Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving.
- Split by stable patient identity before training and reserve a disjoint held-out group for evaluation.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training.
Explanation
Correct Answer
C:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is the appropriate controlled remedy for clarify label imbalance measurement. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. Verify the cause with: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. Then confirm: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. This addresses a different issue involving skewed numerical feature log transformation. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. This addresses a different issue involving group-leakage train and validation split. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. This addresses a different issue involving csv schema ambiguity during ingestion. It does not correct the stated clarify label imbalance measurement mechanism. The targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Case evidence: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1066
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Change control requires measurable endpoint or pipeline acceptance evidence. Which observation most directly identifies the root cause of the reported behavior?
- Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect versioned request schema, unit-test coverage, container
/invocations behavior, and pipeline gate logs. - Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
Explanation
Correct Answer
A:Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. This directly tests ecr immutable image digest for inference in the reported AWS ML workflow. Mutable container tags can point to different images; reproducible ML deployment needs immutable artifact references. It distinguishes the problem before choosing a change. The related targeted response is: Reference an approved immutable image digest or controlled version tag and retain a reproducible build record. Reported signal: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the ecr immutable image digest for inference failure reported here. Prioritize: Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. The relevant case is: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. This is a possible diagnostic for continuous integration unit and endpoint contract tests, but it does not directly test the ecr immutable image digest for inference failure reported here. Prioritize: Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. The relevant case is: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This is a possible diagnostic for cloudformation stack parameter drift, but it does not directly test the ecr immutable image digest for inference failure reported here. Prioritize: Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. The relevant case is: A model endpoint repeatedly deploys an image tagged latest, causing unexpectedly different runtime libraries after each redeploy. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1067
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. The data team must preserve event-time meaning and lineage. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
- Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results.
- Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position.
- Measure file-size distribution, object request count, Spark task scheduling overhead, and read throughput.
Explanation
Correct Answer
C:Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. This directly tests kinesis consumer retention gap in the reported AWS ML workflow. Streaming retention is finite; an expired record cannot be recovered merely by restarting a consumer. It distinguishes the problem before choosing a change. The related targeted response is: Increase appropriate retention before long maintenance and persist a durable downstream historical copy for replay beyond retention. Reported signal: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This is a possible diagnostic for streaming feature rolling window correctness, but it does not directly test the kinesis consumer retention gap failure reported here. Prioritize: Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. The relevant case is: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect shared entity identifiers across partitions and compare patient-level versus image-level evaluation results. This is a possible diagnostic for group-leakage train and validation split, but it does not directly test the kinesis consumer retention gap failure reported here. Prioritize: Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. The relevant case is: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Measure file-size distribution, object request count, Spark task scheduling overhead, and read throughput. This is a possible diagnostic for columnar file compaction for small objects, but it does not directly test the kinesis consumer retention gap failure reported here. Prioritize: Inspect the stream retention setting, consumer checkpoint timestamps, and the oldest available sequence or time position. The relevant case is: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 1068
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Change control requires measurable endpoint or pipeline acceptance evidence. Which engineering response resolves the actual issue without masking the symptoms?
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
Explanation
Correct Answer
A:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This is the appropriate controlled remedy for codepipeline approval gate on model metrics. A CI/CD stage that records evaluation without enforcing its result is not a release control. Verify the cause with: Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. Then confirm: A deliberately poor candidate halts before production while a passing approved candidate can proceed. Reported signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This addresses a different issue involving real-time versus batch inference decision. It does not correct the stated codepipeline approval gate on model metrics mechanism. The targeted response is: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Case evidence: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This addresses a different issue involving sagemaker neo edge compiler compatibility. It does not correct the stated codepipeline approval gate on model metrics mechanism. The targeted response is: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Case evidence: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This addresses a different issue involving blue-green endpoint rollback after health failure. It does not correct the stated codepipeline approval gate on model metrics mechanism. The targeted response is: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Case evidence: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1069
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Change control requires measurable endpoint or pipeline acceptance evidence. Which observation most directly identifies the root cause of the reported behavior?
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
- Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies.
- Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory.
- Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure.
Explanation
Correct Answer
A:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This directly tests cloudformation stack parameter drift in the reported AWS ML workflow. Infrastructure as code only controls actual state when out-of-band changes are detected and reconciled. It distinguishes the problem before choosing a change. The related targeted response is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Reported signal: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. This is a possible diagnostic for codepipeline approval gate on model metrics, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect ECR image digest, tag history, pipeline manifests, and built-image package inventory. This is a possible diagnostic for ecr immutable image digest for inference, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Inspect production variant weights, guardrail metrics, rollback procedure, and representativeness of staged exposure. This is a possible diagnostic for canary variant rollout for model changes, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1070
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Engineers must avoid changing unrelated source partitions. Which observation most directly identifies the root cause of the reported behavior?
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
- Inspect prediction errors around midnight and feature representations for the periodic hour variable.
- Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint.
Explanation
Correct Answer
C:Inspect prediction errors around midnight and feature representations for the periodic hour variable. This directly tests time-series cyclical calendar feature in the reported AWS ML workflow. Time-of-day has periodic topology; raw integer distance does not represent wraparound. It distinguishes the problem before choosing a change. The related targeted response is: Encode hour with sine and cosine cyclic features and validate with a time-aware split. Reported signal: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This is a possible diagnostic for median imputation fitted on training split, but it does not directly test the time-series cyclical calendar feature failure reported here. Prioritize: Inspect prediction errors around midnight and feature representations for the periodic hour variable. The relevant case is: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This is a possible diagnostic for s3 object event at-least-once processing, but it does not directly test the time-series cyclical calendar feature failure reported here. Prioritize: Inspect prediction errors around midnight and feature representations for the periodic hour variable. The relevant case is: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. This is a possible diagnostic for glue job bookmark state error, but it does not directly test the time-series cyclical calendar feature failure reported here. Prioritize: Inspect prediction errors around midnight and feature representations for the periodic hour variable. The relevant case is: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.