Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 89
Question 880
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. The data team must preserve event-time meaning and lineage. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval.
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
Explanation
Correct Answers
A:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This directly tests streaming feature rolling window correctness in the reported AWS ML workflow. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. It distinguishes the problem before choosing a change. The related targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This is the appropriate controlled remedy for streaming feature rolling window correctness. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. Verify the cause with: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. Then confirm: A controlled out-of-order replay yields the expected window totals and bounded late-event treatment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This selection concerns clarify label imbalance measurement rather than the required diagnostic-and-remedy pair for streaming feature rolling window correctness. Use evidence: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. and the matching correction: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This selection concerns sagemaker feature store online offline consistency rather than the required diagnostic-and-remedy pair for streaming feature rolling window correctness. Use evidence: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. and the matching correction: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This selection concerns s3 object event at-least-once processing rather than the required diagnostic-and-remedy pair for streaming feature rolling window correctness. Use evidence: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. and the matching correction: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 881
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. The dataset contract must remain reproducible for a backfill. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics.
- Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag.
- Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows.
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
Explanation
Correct Answer
C:Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. This directly tests rds extraction overload into ml in the reported AWS ML workflow. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. It distinguishes the problem before choosing a change. The related targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect Spark stage durations, partition size distribution, join key frequencies, and executor spill metrics. This is a possible diagnostic for glue spark join skew on dominant identifier, but it does not directly test the rds extraction overload into ml failure reported here. Prioritize: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. The relevant case is: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. This is a possible diagnostic for kinesis data streams shard hot key, but it does not directly test the rds extraction overload into ml failure reported here. Prioritize: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. The relevant case is: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Inspect feature availability timestamps and whether each label time follows the last feature observation. This is a possible diagnostic for chronological split for forecast evaluation, but it does not directly test the rds extraction overload into ml failure reported here. Prioritize: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. The relevant case is: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 882
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Change control requires measurable endpoint or pipeline acceptance evidence. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy.
- Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
Explanation
Correct Answers
A:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This is the appropriate controlled remedy for sagemaker endpoint auto scaling metric selection. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. Verify the cause with: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. Then confirm: Capacity responds to peak request load and p95 latency improves without continual scale oscillation. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. This directly tests sagemaker endpoint auto scaling metric selection in the reported AWS ML workflow. CPU percentage can be poorly correlated with accelerator-bound inference demand; scale on a meaningful signal. It distinguishes the problem before choosing a change. The related targeted response is: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
C:Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. This selection concerns gpu versus cpu inference fit rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This selection concerns bring-your-own-inference-container contract rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This selection concerns serverless inference for intermittent requests rather than the required diagnostic-and-remedy pair for sagemaker endpoint auto scaling metric selection. Use evidence: Compare invocation count per instance, model latency, GPU utilization, and the behavior of current scaling policy. and the matching correction: Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. Signal: An online classifier faces bursty demand and latency spikes because auto scaling tracks host CPU while requests spend most time waiting for accelerated inference. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 883
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. The team needs a defensible technical decision rather than an untracked workaround. What targeted change should be implemented after verifying the stated cause?
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
Explanation
Correct Answer
C:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This is the appropriate controlled remedy for overfitting reduced with l2 regularization. L2 penalizes large weights and can reduce variance but excessive regularization also causes underfitting. Verify the cause with: Compare training and validation curves, coefficient magnitudes, and error by split. Then confirm: The train-validation gap narrows without losing acceptable validation performance. Reported signal: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This addresses a different issue involving feature selection to reduce overparameterization. It does not correct the stated overfitting reduced with l2 regularization mechanism. The targeted response is: Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. Case evidence: A model reaches near-perfect training accuracy but substantially worse holdout performance as feature coefficients grow unusually large. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 884
During an approved rollout of an AWS ML inference workload, the following condition is observed: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. The team must meet its documented availability and rollback constraints. What targeted change should be implemented after verifying the stated cause?
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
- Grant the build role only required object and key operations for its specific artifact prefix and encryption key.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
Explanation
Correct Answer
D:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This is the appropriate controlled remedy for multi-model endpoint hosting tradeoff. Multi-model hosting shares inference compute but can incur cache misses and is unsuitable when models require incompatible runtimes. Verify the cause with: Inspect model sizes, framework compatibility, per-model request rates, load latency, and isolation requirements. Then confirm: Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. Reported signal: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This addresses a different issue involving real-time versus batch inference decision. It does not correct the stated multi-model endpoint hosting tradeoff mechanism. The targeted response is: Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. Case evidence: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Grant the build role only required object and key operations for its specific artifact prefix and encryption key. This addresses a different issue involving codebuild iam least-privilege artifact upload. It does not correct the stated multi-model endpoint hosting tradeoff mechanism. The targeted response is: Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. Case evidence: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This addresses a different issue involving sagemaker endpoint provisioned concurrency tradeoff. It does not correct the stated multi-model endpoint hosting tradeoff mechanism. The targeted response is: Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. Case evidence: A platform maintains hundreds of low-traffic similar models and deploys each to a dedicated always-running instance, causing high idle cost. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 885
During an approved rollout of an AWS ML inference workload, the following condition is observed: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. The team must meet its documented availability and rollback constraints. Which measured outcome would confirm that the correction worked as intended?
- The endpoint applies the same preprocessor to every client request and produces the expected model input schema.
- A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag.
- Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs.
- A simulated green regression returns traffic to the last healthy model without extended outage.
Explanation
Correct Answer
D:A simulated green regression returns traffic to the last healthy model without extended outage. This is the acceptance evidence for the described blue-green endpoint rollback after health failure scenario. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. The corrective implementation it validates is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:The endpoint applies the same preprocessor to every client request and produces the expected model input schema. This could validate multi-container inference pipeline responsibilities, but it does not establish that blue-green endpoint rollback after health failure is resolved for this workload. Confirm instead: A simulated green regression returns traffic to the last healthy model without extended outage. Observed problem: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
B:A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. This could validate endpoint scale-to-zero cold capacity planning, but it does not establish that blue-green endpoint rollback after health failure is resolved for this workload. Confirm instead: A simulated green regression returns traffic to the last healthy model without extended outage. Observed problem: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs. This could validate sagemaker pipelines parameterized retraining, but it does not establish that blue-green endpoint rollback after health failure is resolved for this workload. Confirm instead: A simulated green regression returns traffic to the last healthy model without extended outage. Observed problem: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 886
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Engineers must avoid changing unrelated source partitions. Which verification result BEST demonstrates that the issue is resolved?
- A controlled out-of-order replay yields the expected window totals and bounded late-event treatment.
- Invalid batches are rejected with attributable rule failures and accepted training data meets the entity-key contract.
- No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.
- Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words.
Explanation
Correct Answer
C:No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This is the acceptance evidence for the described group-leakage train and validation split scenario. Correlated records from one entity across splits can inflate performance without improving true generalization. The corrective implementation it validates is: Split by stable patient identity before training and reserve a disjoint held-out group for evaluation. Reported signal: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:A controlled out-of-order replay yields the expected window totals and bounded late-event treatment. This could validate streaming feature rolling window correctness, but it does not establish that group-leakage train and validation split is resolved for this workload. Confirm instead: No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. Observed problem: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Invalid batches are rejected with attributable rule failures and accepted training data meets the entity-key contract. This could validate glue data quality non-null contract, but it does not establish that group-leakage train and validation split is resolved for this workload. Confirm instead: No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. Observed problem: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. This could validate text tokenization mismatch in serving, but it does not establish that group-leakage train and validation split is resolved for this workload. Confirm instead: No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. Observed problem: A medical-image classifier uses random row splitting so multiple scans from the same patient occur in training and validation. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 887
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A source feed silently begins emitting missing customer IDs, and the downstream pipeline trains on rows with null entity keys instead of failing. The data team must preserve event-time meaning and lineage. Which observation most directly identifies the root cause of the reported behavior?
- Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job.
- Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines.
- Inspect prediction errors around midnight and feature representations for the periodic hour variable.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
Explanation
Correct Answer
B:Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines. This directly tests glue data quality non-null contract in the reported AWS ML workflow. Schema existence alone cannot establish semantic completeness or identifier uniqueness in ML inputs. It distinguishes the problem before choosing a change. The related targeted response is: Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. Reported signal: A source feed silently begins emitting missing customer IDs, and the downstream pipeline trains on rows with null entity keys instead of failing. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect sample raw records, quoting rules, expected headers, and parsed column counts in the ingestion job. This is a possible diagnostic for csv schema ambiguity during ingestion, but it does not directly test the glue data quality non-null contract failure reported here. Prioritize: Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines. The relevant case is: A source feed silently begins emitting missing customer IDs, and the downstream pipeline trains on rows with null entity keys instead of failing. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect prediction errors around midnight and feature representations for the periodic hour variable. This is a possible diagnostic for time-series cyclical calendar feature, but it does not directly test the glue data quality non-null contract failure reported here. Prioritize: Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines. The relevant case is: A source feed silently begins emitting missing customer IDs, and the downstream pipeline trains on rows with null entity keys instead of failing. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This is a possible diagnostic for class imbalance handled inside cross-validation, but it does not directly test the glue data quality non-null contract failure reported here. Prioritize: Inspect AWS Glue Data Quality rule evaluations, missing-key rates, source partitions, and prior accepted baselines. The relevant case is: A source feed silently begins emitting missing customer IDs, and the downstream pipeline trains on rows with null entity keys instead of failing. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 888
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Engineers must avoid changing unrelated source partitions. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field.
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
- Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features.
- Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving.
- Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes.
Explanation
Correct Answers
A:Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field. This directly tests glue schema evolution with mixed input types in the reported AWS ML workflow. A catalog entry does not automatically reconcile incompatible field types across all source partitions. It distinguishes the problem before choosing a change. The related targeted response is: Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This is the appropriate controlled remedy for glue schema evolution with mixed input types. A catalog entry does not automatically reconcile incompatible field types across all source partitions. Verify the cause with: Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field. Then confirm: Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This selection concerns text tokenization mismatch in serving rather than the required diagnostic-and-remedy pair for glue schema evolution with mixed input types. Use evidence: Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field. and the matching correction: Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. Signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. This selection concerns skewed numerical feature log transformation rather than the required diagnostic-and-remedy pair for glue schema evolution with mixed input types. Use evidence: Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field. and the matching correction: Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. Signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
E:Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. This selection concerns s3 object event at-least-once processing rather than the required diagnostic-and-remedy pair for glue schema evolution with mixed input types. Use evidence: Compare source schemas by partition, Glue Data Catalog types, and failed cast rows for the evolving field. and the matching correction: Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. Signal: New event producers change a numerical source field to strings while legacy objects remain numeric, causing the shared Glue transformation to fail. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 889
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. The team needs a defensible technical decision rather than an untracked workaround. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
- Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests.
- Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.
Explanation
Correct Answer
B:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This directly tests regression versus classification problem formulation in the reported AWS ML workflow. A categorical decision boundary is not an appropriate direct estimator of an unconstrained continuous value. It distinguishes the problem before choosing a change. The related targeted response is: Select a regression approach with suitable loss and evaluation metrics instead of forcing continuous amounts into unrelated classes. Reported signal: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This is a possible diagnostic for roc-auc versus pr-auc for rare events, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. This is a possible diagnostic for interpretability for high-stakes prediction, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This is a possible diagnostic for early stopping on validation plateau, but it does not directly test the regression versus classification problem formulation failure reported here. Prioritize: Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. The relevant case is: A revenue-prediction team tries a binary classifier to predict the exact future dollar value of each customer's next purchase. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 890
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Change control requires measurable endpoint or pipeline acceptance evidence. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies.
- Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete.
Explanation
Correct Answers
A:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This is the appropriate controlled remedy for codepipeline approval gate on model metrics. A CI/CD stage that records evaluation without enforcing its result is not a release control. Verify the cause with: Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. Then confirm: A deliberately poor candidate halts before production while a passing approved candidate can proceed. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. This directly tests codepipeline approval gate on model metrics in the reported AWS ML workflow. A CI/CD stage that records evaluation without enforcing its result is not a release control. It distinguishes the problem before choosing a change. The related targeted response is: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This selection concerns sagemaker endpoint auto scaling metric selection rather than the required diagnostic-and-remedy pair for codepipeline approval gate on model metrics. Use evidence: Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. and the matching correction: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This selection concerns sagemaker neo edge compiler compatibility rather than the required diagnostic-and-remedy pair for codepipeline approval gate on model metrics. Use evidence: Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. and the matching correction: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. This selection concerns eventbridge conditional retraining trigger rather than the required diagnostic-and-remedy pair for codepipeline approval gate on model metrics. Use evidence: Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. and the matching correction: Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. Signal: A pipeline pushes a newly trained model directly to production even though its evaluated recall has fallen below the business threshold. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.