Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 32
Question 310
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Change control requires measurable endpoint or pipeline acceptance evidence. Which corrective action most directly addresses this ML workflow problem?
- Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost.
- Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.
Explanation
Correct Answer
D:Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This is the appropriate controlled remedy for sagemaker pipelines parameterized retraining. Pipelines make dependencies explicit; manually ordered notebook operations are difficult to repeat or audit. Verify the cause with: Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. Then confirm: Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs. Reported signal: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Benchmark supported accelerated inference instances and choose GPU capacity only if latency and throughput gains justify cost. This addresses a different issue involving gpu versus cpu inference fit. It does not correct the stated sagemaker pipelines parameterized retraining mechanism. The targeted response is: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Case evidence: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings. This addresses a different issue involving asynchronous endpoint for large payloads. It does not correct the stated sagemaker pipelines parameterized retraining mechanism. The targeted response is: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Case evidence: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated sagemaker pipelines parameterized retraining mechanism. The targeted response is: Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. Case evidence: A retraining workflow copies notebook cells into a scheduled script without tracking data snapshots or processing dependencies, leading to inconsistent model artifacts. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 311
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. The team must demonstrate a repeatable monitoring or security control. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies.
- Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.
Explanation
Correct Answer
C:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This directly tests s3 sse-kms cross-account model artifact access in the reported AWS ML workflow. S3 object permission does not imply access to the KMS encryption key used on the object. It distinguishes the problem before choosing a change. The related targeted response is: Authorize the specific serving role to decrypt with the relevant KMS key under a restricted key policy and S3 access. Reported signal: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies. This is a possible diagnostic for private vpc endpoint policy for sagemaker apis, but it does not directly test the s3 sse-kms cross-account model artifact access failure reported here. Prioritize: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. The relevant case is: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This is a possible diagnostic for training-serving feature skew incident, but it does not directly test the s3 sse-kms cross-account model artifact access failure reported here. Prioritize: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. The relevant case is: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This is a possible diagnostic for clarify postdeployment group bias monitoring, but it does not directly test the s3 sse-kms cross-account model artifact access failure reported here. Prioritize: Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. The relevant case is: A SageMaker endpoint role has s3:GetObject for a model artifact, but download fails because the artifact is encrypted under a KMS key in a different account. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 312
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Change control requires measurable endpoint or pipeline acceptance evidence. Which corrective action most directly addresses this ML workflow problem?
- Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified.
- Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings.
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
Explanation
Correct Answer
A:Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. This is the appropriate controlled remedy for sagemaker endpoint provisioned concurrency tradeoff. Provisioned concurrency can reduce cold-start effects but adds reserved cost and must match supported endpoint mode. Verify the cause with: Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. Then confirm: Cold-start p95 improves during planned demand windows while capacity cost remains measured. Reported signal: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings. This addresses a different issue involving asynchronous endpoint for large payloads. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This addresses a different issue involving sagemaker endpoint auto scaling metric selection. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This addresses a different issue involving serverless inference for intermittent requests. It does not correct the stated sagemaker endpoint provisioned concurrency tradeoff mechanism. The targeted response is: Configure supported provisioned concurrency for the latency-critical interval or switch to provisioned real-time hosting if justified. Case evidence: A spiky serverless ML endpoint exceeds customer latency targets on cold starts even though average compute utilization is low. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 313
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Change control requires measurable endpoint or pipeline acceptance evidence. Which corrective action most directly addresses this ML workflow problem?
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds.
- Grant the build role only required object and key operations for its specific artifact prefix and encryption key.
- Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions.
Explanation
Correct Answer
C:Grant the build role only required object and key operations for its specific artifact prefix and encryption key. This is the appropriate controlled remedy for codebuild iam least-privilege artifact upload. Artifact publishing often requires S3 and KMS permissions, but broad administrative permissions are unnecessary and unsafe. Verify the cause with: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. Then confirm: The build uploads signed artifacts successfully while unauthorized buckets and prefixes remain denied. Reported signal: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This addresses a different issue involving bring-your-own-inference-container contract. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Require model evaluation and explicit approval gates before production deployment, blocking failed metric thresholds. This addresses a different issue involving codepipeline approval gate on model metrics. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use a measured canary or linear traffic-shift deployment with alarms and immediate rollback conditions. This addresses a different issue involving canary variant rollout for model changes. It does not correct the stated codebuild iam least-privilege artifact upload mechanism. The targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Case evidence: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 314
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?
- A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts.
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps.
- Validated records preserve the expected label and field order while malformed inputs are reported separately.
Explanation
Correct Answer
C:The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. This is the acceptance evidence for the described kinesis consumer retention gap scenario. Streaming retention is finite; an expired record cannot be recovered merely by restarting a consumer. The corrective implementation it validates is: Increase appropriate retention before long maintenance and persist a durable downstream historical copy for replay beyond retention. Reported signal: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This could validate model training data residency boundary, but it does not establish that kinesis consumer retention gap is resolved for this workload. Confirm instead: The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. Observed problem: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that kinesis consumer retention gap is resolved for this workload. Confirm instead: The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. Observed problem: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Validated records preserve the expected label and field order while malformed inputs are reported separately. This could validate csv schema ambiguity during ingestion, but it does not establish that kinesis consumer retention gap is resolved for this workload. Confirm instead: The recovery run reads a complete expected interval from retained stream records or durable archive without silent gaps. Observed problem: An ML consumer is offline longer than the stream retention period and assumes it can replay every historical sample from its expired iterator. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 315
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. The deployment must be reproducible without manual console-only fixes. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs.
- Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests.
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
Explanation
Correct Answer
D:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This directly tests model registry version promotion provenance in the reported AWS ML workflow. Immutable package versions and approval metadata connect evaluation with deployment; mutable S3 nicknames do not. It distinguishes the problem before choosing a change. The related targeted response is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Reported signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. This is a possible diagnostic for sagemaker vpc endpoint access for private artifacts, but it does not directly test the model registry version promotion provenance failure reported here. Prioritize: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. The relevant case is: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. This is a possible diagnostic for blue-green endpoint rollback after health failure, but it does not directly test the model registry version promotion provenance failure reported here. Prioritize: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. The relevant case is: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This is a possible diagnostic for sagemaker neo edge compiler compatibility, but it does not directly test the model registry version promotion provenance failure reported here. Prioritize: Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. The relevant case is: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 316
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. The proposed change must preserve logging and least privilege. What postchange observation provides the strongest acceptance evidence?
- Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms.
- A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
- The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics.
- The job reads authorized training data while attempts to access unrelated buckets remain denied.
Explanation
Correct Answer
D:The job reads authorized training data while attempts to access unrelated buckets remain denied. This is the acceptance evidence for the described sagemaker execution role s3 least privilege scenario. Least-privilege IAM and resource policy alignment are preferable to broad global data permissions. The corrective implementation it validates is: Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. Reported signal: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms. This could validate cloudwatch 5xxerrors endpoint saturation, but it does not establish that sagemaker execution role s3 least privilege is resolved for this workload. Confirm instead: The job reads authorized training data while attempts to access unrelated buckets remain denied. Observed problem: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This could validate cross-account s3 bucket exfiltration protection, but it does not establish that sagemaker execution role s3 least privilege is resolved for this workload. Confirm instead: The job reads authorized training data while attempts to access unrelated buckets remain denied. Observed problem: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics. This could validate model monitor ground truth association, but it does not establish that sagemaker execution role s3 least privilege is resolved for this workload. Confirm instead: The job reads authorized training data while attempts to access unrelated buckets remain denied. Observed problem: A managed training job cannot read its approved dataset prefix and an engineer proposes granting its execution role full access to every S3 bucket. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 317
During a production MLOps reliability and security review, the following condition is observed: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. The owner needs an auditable resolution without broadening privileges. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
- Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.
- Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
Explanation
Correct Answer
D:Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This directly tests champion challenger a/b assignment consistency in the reported AWS ML workflow. Random assignment per request can mix treatments for one entity and bias longitudinal online experiments. It distinguishes the problem before choosing a change. The related targeted response is: Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. Reported signal: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This is a possible diagnostic for tag-based ml training cost attribution, but it does not directly test the champion challenger a/b assignment consistency failure reported here. Prioritize: Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. The relevant case is: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
B:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This is a possible diagnostic for iam passrole constraint for model deployment, but it does not directly test the champion challenger a/b assignment consistency failure reported here. Prioritize: Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. The relevant case is: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
C:Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This is a possible diagnostic for clarify postdeployment group bias monitoring, but it does not directly test the champion challenger a/b assignment consistency failure reported here. Prioritize: Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. The relevant case is: An A/B model test routes consecutive requests from the same user to different variants, contaminating the comparison with unstable user experience. Operational setting: During a production MLOps reliability and security review.
Question 318
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. The team needs a defensible technical decision rather than an untracked workaround. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Inspect feature importance stability, variance across folds, regularization and model dimensionality.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
- Inspect the supervised labels, text representation, model-input format, and the desired classification output.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
Explanation
Correct Answers
C:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This is the appropriate controlled remedy for sagemaker built-in blazingtext choice. Supervised text classification requires labels and task-specific evaluation rather than unlabeled similarity clusters. Verify the cause with: Inspect the supervised labels, text representation, model-input format, and the desired classification output. Then confirm: Held-out messages receive the intended class predictions and macro-averaged quality is measurable. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect the supervised labels, text representation, model-input format, and the desired classification output. This directly tests sagemaker built-in blazingtext choice in the reported AWS ML workflow. Supervised text classification requires labels and task-specific evaluation rather than unlabeled similarity clusters. It distinguishes the problem before choosing a change. The related targeted response is: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect feature importance stability, variance across folds, regularization and model dimensionality. This selection concerns feature selection to reduce overparameterization rather than the required diagnostic-and-remedy pair for sagemaker built-in blazingtext choice. Use evidence: Inspect the supervised labels, text representation, model-input format, and the desired classification output. and the matching correction: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. Signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This selection concerns precision versus recall fraud threshold rather than the required diagnostic-and-remedy pair for sagemaker built-in blazingtext choice. Use evidence: Inspect the supervised labels, text representation, model-input format, and the desired classification output. and the matching correction: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. Signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This selection concerns interpretability for high-stakes prediction rather than the required diagnostic-and-remedy pair for sagemaker built-in blazingtext choice. Use evidence: Inspect the supervised labels, text representation, model-input format, and the desired classification output. and the matching correction: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. Signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 319
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. The experiment must be compared fairly against its prior baseline. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery.
- Enable patience-based early stopping and restore the checkpoint with the best validation metric.
- Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
Explanation
Correct Answers
B:Enable patience-based early stopping and restore the checkpoint with the best validation metric. This is the appropriate controlled remedy for early stopping on validation plateau. More epochs are not always better; validation loss can worsen while training loss continues to decrease. Verify the cause with: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. Then confirm: Training stops before extended overfitting and the retained model corresponds to the best validated epoch. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. This directly tests early stopping on validation plateau in the reported AWS ML workflow. More epochs are not always better; validation loss can worsen while training loss continues to decrease. It distinguishes the problem before choosing a change. The related targeted response is: Enable patience-based early stopping and restore the checkpoint with the best validation metric. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Configure a supported SageMaker checkpoint location and resume training state on managed Spot interruption recovery. This selection concerns managed spot training checkpoint recovery rather than the required diagnostic-and-remedy pair for early stopping on validation plateau. Use evidence: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. and the matching correction: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This selection concerns time-series forecast horizon and seasonality rather than the required diagnostic-and-remedy pair for early stopping on validation plateau. Use evidence: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. and the matching correction: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This selection concerns xgboost tabular classification baseline rather than the required diagnostic-and-remedy pair for early stopping on validation plateau. Use evidence: Inspect epoch-level training and validation curves, stopping criteria, and the best checkpoint location. and the matching correction: Enable patience-based early stopping and restore the checkpoint with the best validation metric. Signal: A neural network continues training for many epochs after validation loss begins increasing while training loss keeps falling. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 320
During an approved rollout of an AWS ML inference workload, the following condition is observed: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. The team must meet its documented availability and rollback constraints. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
Explanation
Correct Answer
D:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This directly tests codebuild iam least-privilege artifact upload in the reported AWS ML workflow. Artifact publishing often requires S3 and KMS permissions, but broad administrative permissions are unnecessary and unsafe. It distinguishes the problem before choosing a change. The related targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Reported signal: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This is a possible diagnostic for model registry version promotion provenance, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This is a possible diagnostic for sagemaker neo edge compiler compatibility, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.