Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 58
Question 570
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. The team needs a defensible technical decision rather than an untracked workaround. Which corrective action most directly addresses this ML workflow problem?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Register immutable model package versions with lineage and require explicit approval before promotion to production.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
- Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability.
Explanation
Correct Answer
B:Register immutable model package versions with lineage and require explicit approval before promotion to production. This is the appropriate controlled remedy for sagemaker model registry candidate approval. A human-readable model nickname is not a reproducible deployment identifier; versioned registry artifacts support controlled promotion. Verify the cause with: Inspect model package version, artifact URI, training metadata, data snapshot, and registry approval state. Then confirm: A production endpoint resolves to one approved model package version with traceable training lineage. Reported signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated sagemaker model registry candidate approval mechanism. The targeted response is: Register immutable model package versions with lineage and require explicit approval before promotion to production. Case evidence: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This addresses a different issue involving managed ai service versus custom ocr model. It does not correct the stated sagemaker model registry candidate approval mechanism. The targeted response is: Register immutable model package versions with lineage and require explicit approval before promotion to production. Case evidence: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. This addresses a different issue involving model debugger exploding gradient diagnosis. It does not correct the stated sagemaker model registry candidate approval mechanism. The targeted response is: Register immutable model package versions with lineage and require explicit approval before promotion to production. Case evidence: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 571
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. The dataset contract must remain reproducible for a backfill. Which engineering response resolves the actual issue without masking the symptoms?
- Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
- Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory.
Explanation
Correct Answer
A:Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. This is the appropriate controlled remedy for pii masking before model labeling. Data minimization applies before external labeling; encryption in transit does not remove unnecessary sensitive content from the task. Verify the cause with: Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. Then confirm: Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. Reported signal: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This addresses a different issue involving standardization of numerical features. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This addresses a different issue involving chronological split for forecast evaluation. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Repartition or salt the skewed join appropriately, or use a justified broadcast join when the small side fits memory. This addresses a different issue involving glue spark join skew on dominant identifier. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 572
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. The experiment must be compared fairly against its prior baseline. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Inspect feature importance stability, variance across folds, regularization and model dimensionality.
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
- Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
- Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons.
Explanation
Correct Answers
A:Inspect feature importance stability, variance across folds, regularization and model dimensionality. This directly tests feature selection to reduce overparameterization in the reported AWS ML workflow. Unnecessary high-dimensional inputs can increase variance and compute cost; selection itself must avoid evaluation leakage. It distinguishes the problem before choosing a change. The related targeted response is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This is the appropriate controlled remedy for feature selection to reduce overparameterization. Unnecessary high-dimensional inputs can increase variance and compute cost; selection itself must avoid evaluation leakage. Verify the cause with: Inspect feature importance stability, variance across folds, regularization and model dimensionality. Then confirm: Holdout quality stays acceptable while model size and run-to-run instability decrease. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
C:Configure SageMaker Automatic Model Tuning with a bounded search space, objective metric, budget, and justified Bayesian or random strategy. This selection concerns hyperparameter bayesian tuning strategy rather than the required diagnostic-and-remedy pair for feature selection to reduce overparameterization. Use evidence: Inspect feature importance stability, variance across folds, regularization and model dimensionality. and the matching correction: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This selection concerns clustering for unlabeled customer segments rather than the required diagnostic-and-remedy pair for feature selection to reduce overparameterization. Use evidence: Inspect feature importance stability, variance across folds, regularization and model dimensionality. and the matching correction: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. This selection concerns time-series forecast horizon and seasonality rather than the required diagnostic-and-remedy pair for feature selection to reduce overparameterization. Use evidence: Inspect feature importance stability, variance across folds, regularization and model dimensionality. and the matching correction: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 573
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Change control requires measurable endpoint or pipeline acceptance evidence. Which engineering response resolves the actual issue without masking the symptoms?
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
- Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
Explanation
Correct Answer
B:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This is the appropriate controlled remedy for sagemaker neo edge compiler compatibility. Edge optimization depends on target hardware and supported operations, not merely copying a cloud training artifact. Verify the cause with: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. Then confirm: The compiled artifact runs on the target device with validated outputs and acceptable memory and latency. Reported signal: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This addresses a different issue involving canary variant rollout for model changes. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This addresses a different issue involving codepipeline approval gate on model metrics. It does not correct the stated sagemaker neo edge compiler compatibility mechanism. The targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Case evidence: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 574
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The team needs a defensible technical decision rather than an untracked workaround. Which corrective action most directly addresses this ML workflow problem?
- Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability.
- Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons.
Explanation
Correct Answer
C:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is the appropriate controlled remedy for sagemaker jumpstart template provenance. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. Verify the cause with: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. Then confirm: The chosen version meets task metrics and license conditions and its inference contract is reproducible. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Use appropriate SageMaker Debugger or framework instrumentation; adjust learning rate or gradient clipping after confirming instability. This addresses a different issue involving model debugger exploding gradient diagnosis. It does not correct the stated sagemaker jumpstart template provenance mechanism. The targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Case evidence: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Remove label-derived or post-outcome features, rebuild a point-in-time split, and recompute explanations and holdout metrics. This addresses a different issue involving clarify feature attribution against target leakage. It does not correct the stated sagemaker jumpstart template provenance mechanism. The targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Case evidence: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. This addresses a different issue involving time-series forecast horizon and seasonality. It does not correct the stated sagemaker jumpstart template provenance mechanism. The targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Case evidence: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 575
During a production MLOps reliability and security review, the following condition is observed: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. The owner needs an auditable resolution without broadening privileges. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
- Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations.
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time.
- Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service.
Explanation
Correct Answers
A:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This is the appropriate controlled remedy for inference recommender benchmarking instance family. Rightsizing depends on workload measurements rather than the training machine or instance size alone. Verify the cause with: Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. Then confirm: A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
B:Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. This directly tests inference recommender benchmarking instance family in the reported AWS ML workflow. Rightsizing depends on workload measurements rather than the training machine or instance size alone. It distinguishes the problem before choosing a change. The related targeted response is: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
C:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This selection concerns cloudtrail training data access audit coverage rather than the required diagnostic-and-remedy pair for inference recommender benchmarking instance family. Use evidence: Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. and the matching correction: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
D:Use structured logging and scoped CloudWatch Logs Insights queries to aggregate failures by training job and time. This selection concerns cloudwatch logs insights error correlation rather than the required diagnostic-and-remedy pair for inference recommender benchmarking instance family. Use evidence: Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. and the matching correction: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
E:Remove embedded credentials, rotate the exposed secret, and retrieve current credentials through an approved managed secret service. This selection concerns secret rotation for inference container credentials rather than the required diagnostic-and-remedy pair for inference recommender benchmarking instance family. Use evidence: Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. and the matching correction: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: During a production MLOps reliability and security review.
Question 576
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. The deployment must be reproducible without manual console-only fixes. Which engineering response resolves the actual issue without masking the symptoms?
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
Explanation
Correct Answer
D:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This is the appropriate controlled remedy for real-time versus batch inference decision. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. Verify the cause with: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. Then confirm: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated real-time versus batch inference decision mechanism. The targeted response is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Case evidence: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This addresses a different issue involving multi-model endpoint hosting tradeoff. It does not correct the stated real-time versus batch inference decision mechanism. The targeted response is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Case evidence: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This addresses a different issue involving endpoint scale-to-zero cold capacity planning. It does not correct the stated real-time versus batch inference decision mechanism. The targeted response is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Case evidence: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 577
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Engineers must avoid changing unrelated source partitions. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Encode hour with sine and cosine cyclic features and validate with a time-aware split.
- Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale.
- Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving.
Explanation
Correct Answers
D:Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. This directly tests skewed numerical feature log transformation in the reported AWS ML workflow. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. It distinguishes the problem before choosing a change. The related targeted response is: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
E:Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. This is the appropriate controlled remedy for skewed numerical feature log transformation. A monotonic log transform can reduce heavy-tail influence, but invalid domains and train-serving parity must be handled. Verify the cause with: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. Then confirm: The transformed distribution is less skewed and inference uses identical guarded transformations. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for skewed numerical feature log transformation. Use evidence: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. and the matching correction: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This selection concerns class imbalance handled inside cross-validation rather than the required diagnostic-and-remedy pair for skewed numerical feature log transformation. Use evidence: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. and the matching correction: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Encode hour with sine and cosine cyclic features and validate with a time-aware split. This selection concerns time-series cyclical calendar feature rather than the required diagnostic-and-remedy pair for skewed numerical feature log transformation. Use evidence: Inspect quantiles, heavy-tail plots, outliers, and the target model's response to feature scale. and the matching correction: Apply a justified log1p transformation with documented treatment of invalid negatives and package it for serving. Signal: A training job is dominated by extreme transaction-amount magnitudes, although most records have modest nonnegative amounts. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 578
During a production MLOps reliability and security review, the following condition is observed: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. The owner needs an auditable resolution without broadening privileges. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
- Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes.
- Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations.
- Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks.
Explanation
Correct Answers
B:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This directly tests sagemaker model monitor feature drift baseline in the reported AWS ML workflow. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. It distinguishes the problem before choosing a change. The related targeted response is: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: During a production MLOps reliability and security review.
E:Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This is the appropriate controlled remedy for sagemaker model monitor feature drift baseline. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. Verify the cause with: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. Then confirm: Changed feature distributions produce attributable violations even while endpoint availability remains healthy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. This selection concerns aws budgets spend threshold for experimentation rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: During a production MLOps reliability and security review.
C:Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. This selection concerns clarify postdeployment group bias monitoring rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: During a production MLOps reliability and security review.
D:Measure memory, throughput, p95 latency and cost across supported candidate endpoint configurations. This selection concerns inference recommender benchmarking instance family rather than the required diagnostic-and-remedy pair for sagemaker model monitor feature drift baseline. Use evidence: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. and the matching correction: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: During a production MLOps reliability and security review.
Question 579
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. The data team must preserve event-time meaning and lineage. What targeted change should be implemented after verifying the stated cause?
- Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling.
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
Explanation
Correct Answer
C:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This is the appropriate controlled remedy for rds extraction overload into ml. Extract jobs contend with transactional queries; moving or bounding reads can isolate production workloads. Verify the cause with: Correlate export query plans, RDS CPU and IOPS, replication lag, and business traffic windows. Then confirm: Application p95 latency returns to target while exported records meet a measured completeness and staleness objective. Reported signal: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Drop leakage-prone IDs or adopt controlled hashing or suitable learned encodings with stable unknown-category handling. This addresses a different issue involving high-cardinality categorical encoding. It does not correct the stated rds extraction overload into ml mechanism. The targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Case evidence: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This addresses a different issue involving ground truth labeling agreement review. It does not correct the stated rds extraction overload into ml mechanism. The targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Case evidence: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This addresses a different issue involving glue job bookmark state error. It does not correct the stated rds extraction overload into ml mechanism. The targeted response is: Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. Case evidence: An overnight ML export runs expensive full-table queries on a production RDS database and causes application transaction latency spikes. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 580
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The release is blocked until the underlying model behavior is understood. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Profile model memory, throughput, communication overhead, and per-device utilization.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
Explanation
Correct Answers
C:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This directly tests sagemaker jumpstart template provenance in the reported AWS ML workflow. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. It distinguishes the problem before choosing a change. The related targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is the appropriate controlled remedy for sagemaker jumpstart template provenance. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. Verify the cause with: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. Then confirm: The chosen version meets task metrics and license conditions and its inference contract is reproducible. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Profile model memory, throughput, communication overhead, and per-device utilization. This selection concerns data parallelism versus model parallelism rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This selection concerns interpretability for high-stakes prediction rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This selection concerns roc-auc versus pr-auc for rare events rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: During production evaluation of a SageMaker AI model candidate.