Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 43
Question 420
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Change control requires measurable endpoint or pipeline acceptance evidence. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies.
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
Explanation
Correct Answer
D:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This directly tests multi-container inference pipeline responsibilities in the reported AWS ML workflow. A managed inference pipeline chains preprocessing and prediction steps consistently, reducing client-side skew. It distinguishes the problem before choosing a change. The related targeted response is: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Reported signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect pipeline stages, evaluation artifacts, test result propagation, registry approval state, and deployment dependencies. This is a possible diagnostic for codepipeline approval gate on model metrics, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This is a possible diagnostic for cloudformation stack parameter drift, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 421
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. The team needs a defensible technical decision rather than an untracked workaround. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests.
- Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.
- Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
Explanation
Correct Answer
A:Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. This directly tests interpretability for high-stakes prediction in the reported AWS ML workflow. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. It distinguishes the problem before choosing a change. The related targeted response is: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This is a possible diagnostic for early stopping on validation plateau, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect Clarify attribution results, feature timestamp semantics, and whether the flag is created after the target event. This is a possible diagnostic for clarify feature attribution against target leakage, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the interpretability for high-stakes prediction failure reported here. Prioritize: Inspect documented explanation requirements, candidate feature contributions, and available post-hoc interpretation tests. The relevant case is: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 422
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. The experiment must be compared fairly against its prior baseline. Which verification result BEST demonstrates that the issue is resolved?
- Holdout quality stays acceptable while model size and run-to-run instability decrease.
- A forced interruption resumes near the last saved epoch and restores optimizer and model state.
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
- The tested alert rate and precision match the production workload rather than an optimistic single ROC figure.
Explanation
Correct Answer
B:A forced interruption resumes near the last saved epoch and restores optimizer and model state. This is the acceptance evidence for the described managed spot training checkpoint recovery scenario. Spot capacity can be interrupted; durable checkpoints prevent full retraining when restoration is correctly implemented. The corrective implementation it validates is: Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. Reported signal: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Holdout quality stays acceptable while model size and run-to-run instability decrease. This could validate feature selection to reduce overparameterization, but it does not establish that managed spot training checkpoint recovery is resolved for this workload. Confirm instead: A forced interruption resumes near the last saved epoch and restores optimizer and model state. Observed problem: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that managed spot training checkpoint recovery is resolved for this workload. Confirm instead: A forced interruption resumes near the last saved epoch and restores optimizer and model state. Observed problem: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This could validate roc-auc versus pr-auc for rare events, but it does not establish that managed spot training checkpoint recovery is resolved for this workload. Confirm instead: A forced interruption resumes near the last saved epoch and restores optimizer and model state. Observed problem: An expensive long-running training job on managed Spot Instances restarts from epoch zero after an interruption because it writes checkpoints only to ephemeral local files. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 423
During a production MLOps reliability and security review, the following condition is observed: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. The owner needs an auditable resolution without broadening privileges. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
- Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations.
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
Explanation
Correct Answer
A:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This directly tests iam passrole constraint for model deployment in the reported AWS ML workflow. PassRole authorizes delegation of role credentials to a service; wide permissions can enable privilege escalation. It distinguishes the problem before choosing a change. The related targeted response is: Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. Reported signal: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
B:Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. This is a possible diagnostic for inference recommender benchmarking instance family, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: During a production MLOps reliability and security review.
C:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This is a possible diagnostic for tag-based ml training cost attribution, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: During a production MLOps reliability and security review.
D:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the iam passrole constraint for model deployment failure reported here. Prioritize: Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. The relevant case is: A deployment pipeline is denied iam:PassRole for its approved SageMaker execution role, but the proposed fix allows passing every role in the account. Operational setting: During a production MLOps reliability and security review.
Question 424
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. The dataset contract must remain reproducible for a backfill. Which corrective action most directly addresses this ML workflow problem?
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
Explanation
Correct Answer
D:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This is the appropriate controlled remedy for median imputation fitted on training split. Preprocessing parameters learned from held-out records leak information into model selection. Verify the cause with: Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. Then confirm: A held-out split uses the training-fitted median and independent evaluation no longer incorporates held-out distribution values. Reported signal: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This addresses a different issue involving class imbalance handled inside cross-validation. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. This addresses a different issue involving pii masking before model labeling. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This addresses a different issue involving glue spark join skew on dominant identifier. It does not correct the stated median imputation fitted on training split mechanism. The targeted response is: Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. Case evidence: A missing-value imputer calculates its median on the complete labeled dataset before train/test splitting, inflating apparent validation performance. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 425
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. The deployment must be reproducible without manual console-only fixes. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
- Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost.
Explanation
Correct Answers
A:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This is the appropriate controlled remedy for sagemaker endpoint provisioned concurrency tradeoff. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. Verify the cause with: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. Then confirm: Cold-start p95 improves during planned demand windows while capacity cost remains measured. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. This directly tests sagemaker endpoint provisioned concurrency tradeoff in the reported AWS ML workflow. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. It distinguishes the problem before choosing a change. The related targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
B:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This selection concerns sagemaker vpc endpoint access for private artifacts rather than the required diagnostic-and-remedy pair for sagemaker endpoint provisioned concurrency tradeoff. Use evidence: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. and the matching correction: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This selection concerns multi-container inference pipeline responsibilities rather than the required diagnostic-and-remedy pair for sagemaker endpoint provisioned concurrency tradeoff. Use evidence: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. and the matching correction: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This selection concerns real-time versus batch inference decision rather than the required diagnostic-and-remedy pair for sagemaker endpoint provisioned concurrency tradeoff. Use evidence: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. and the matching correction: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 426
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Engineers must avoid changing unrelated source partitions. Which engineering response resolves the actual issue without masking the symptoms?
- Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls.
- Define event-time windows with appropriate lateness handling and a documented revision policy for late records.
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
Explanation
Correct Answer
B:Define event-time windows with appropriate lateness handling and a documented revision policy for late records. This is the appropriate controlled remedy for streaming feature rolling window correctness. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. Verify the cause with: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. Then confirm: A controlled out-of-order replay yields the expected window totals and bounded late-event treatment. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. This addresses a different issue involving pii masking before model labeling. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This addresses a different issue involving partition pruning in s3 parquet training input. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This addresses a different issue involving ground truth labeling agreement review. It does not correct the stated streaming feature rolling window correctness mechanism. The targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Case evidence: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 427
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. The data team must preserve event-time meaning and lineage. Which measured outcome would confirm that the correction worked as intended?
- The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps.
- Write throttles and iterator age fall under burst load without losing required ordering for related records.
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract.
Explanation
Correct Answer
B:Write throttles and iterator age fall under burst load without losing required ordering for related records. This is the acceptance evidence for the described kinesis data streams shard hot key scenario. Kinesis shard throughput is bounded; a hot partition key can overload one shard despite spare total stream capacity. The corrective implementation it validates is: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. Reported signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. This could validate kinesis consumer retention gap, but it does not establish that kinesis data streams shard hot key is resolved for this workload. Confirm instead: Write throttles and iterator age fall under burst load without losing required ordering for related records. Observed problem: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that kinesis data streams shard hot key is resolved for this workload. Confirm instead: Write throttles and iterator age fall under burst load without losing required ordering for related records. Observed problem: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This could validate sagemaker feature store online offline consistency, but it does not establish that kinesis data streams shard hot key is resolved for this workload. Confirm instead: Write throttles and iterator age fall under burst load without losing required ordering for related records. Observed problem: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 428
During an approved rollout of an AWS ML inference workload, the following condition is observed: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. The team must meet its documented availability and rollback constraints. What targeted change should be implemented after verifying the stated cause?
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
Explanation
Correct Answer
D:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This is the appropriate controlled remedy for sagemaker endpoint provisioned concurrency tradeoff. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. Verify the cause with: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. Then confirm: Cold-start p95 improves during planned demand windows while capacity cost remains measured. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 429
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Engineers must avoid changing unrelated source partitions. Which corrective action most directly addresses this ML workflow problem?
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features.
- Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema.
- Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving.
Explanation
Correct Answer
D:Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. This is the appropriate controlled remedy for skewed numerical feature log transformation. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. Verify the cause with: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. Then confirm: The transformed distribution is less skewed and inference uses identical guarded transformations. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated skewed numerical feature log transformation mechanism. The targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Case evidence: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This addresses a different issue involving glue schema evolution with mixed input types. It does not correct the stated skewed numerical feature log transformation mechanism. The targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Case evidence: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. This addresses a different issue involving columnar file compaction for small objects. It does not correct the stated skewed numerical feature log transformation mechanism. The targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Case evidence: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 430
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The team needs a defensible technical decision rather than an untracked workaround. Which engineering response resolves the actual issue without masking the symptoms?
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
- Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses.
Explanation
Correct Answer
B:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is the appropriate controlled remedy for xgboost tabular classification baseline. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. Verify the cause with: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. Then confirm: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This addresses a different issue involving clustering for unlabeled customer segments. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This addresses a different issue involving rmse versus mae outlier sensitivity. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.