Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 77
Question 760
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. The experiment must be compared fairly against its prior baseline. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
- Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks.
- Inspect the supervised labels, text representation, model-input format, and the desired classification output.
Explanation
Correct Answer
D:Inspect the supervised labels, text representation, model-input format, and the desired classification output. This directly tests sagemaker built-in blazingtext choice in the reported AWS ML workflow. Supervised text classification requires labels and task-specific evaluation rather than unlabeled similarity clusters. It distinguishes the problem before choosing a change. The related targeted response is: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. Reported signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the sagemaker built-in blazingtext choice failure reported here. Prioritize: Inspect the supervised labels, text representation, model-input format, and the desired classification output. The relevant case is: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This is a possible diagnostic for regression versus classification problem formulation, but it does not directly test the sagemaker built-in blazingtext choice failure reported here. Prioritize: Inspect the supervised labels, text representation, model-input format, and the desired classification output. The relevant case is: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Inspect tensor summaries, gradient magnitudes, learning-rate schedule, and training loss anomalies with supported debugging hooks. This is a possible diagnostic for model debugger exploding gradient diagnosis, but it does not directly test the sagemaker built-in blazingtext choice failure reported here. Prioritize: Inspect the supervised labels, text representation, model-input format, and the desired classification output. The relevant case is: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 761
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. The team must demonstrate a repeatable monitoring or security control. Which engineering response resolves the actual issue without masking the symptoms?
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting.
- Pin an immutable approved artifact version or content digest and verify integrity before deployment.
- Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window.
Explanation
Correct Answer
C:Pin an immutable approved artifact version or content digest and verify integrity before deployment. This is the appropriate controlled remedy for model artifact supply-chain integrity. Object names alone do not guarantee model provenance; supply-chain checks bind deployment to reviewed bytes. Verify the cause with: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. Then confirm: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. Reported signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This addresses a different issue involving cross-account s3 bucket exfiltration protection. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. This addresses a different issue involving tag-based ml training cost attribution. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. This addresses a different issue involving cloudwatch 5xxerrors endpoint saturation. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 762
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. The release is blocked until the underlying model behavior is understood. Which verification result BEST demonstrates that the issue is resolved?
- Trials record comparable objective values and a selected candidate meets an independent validation target within budget.
- Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage.
- Holdout quality stays acceptable while model size and run-to-run instability decrease.
- The model no longer relies on future-only flags and held-out results reflect features available at inference.
Explanation
Correct Answer
C:Holdout quality stays acceptable while model size and run-to-run instability decrease. This is the acceptance evidence for the described feature selection to reduce overparameterization scenario. Unnecessary high-dimensional inputs can increase variance and compute cost; selection itself must avoid evaluation leakage. The corrective implementation it validates is: Use justified feature selection or sparsity constraints fitted on training folds before retraining. Reported signal: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Trials record comparable objective values and a selected candidate meets an independent validation target within budget. This could validate hyperparameter bayesian tuning strategy, but it does not establish that feature selection to reduce overparameterization is resolved for this workload. Confirm instead: Holdout quality stays acceptable while model size and run-to-run instability decrease. Observed problem: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Candidate comparisons reference equivalent datasets and metrics and can be rerun from stored lineage. This could validate reproducible sagemaker experiments comparisons, but it does not establish that feature selection to reduce overparameterization is resolved for this workload. Confirm instead: Holdout quality stays acceptable while model size and run-to-run instability decrease. Observed problem: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:The model no longer relies on future-only flags and held-out results reflect features available at inference. This could validate clarify feature attribution against target leakage, but it does not establish that feature selection to reduce overparameterization is resolved for this workload. Confirm instead: Holdout quality stays acceptable while model size and run-to-run instability decrease. Observed problem: A text classifier includes thousands of weak correlated features and becomes unstable across repeated training runs. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 763
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The release is blocked until the underlying model behavior is understood. Which corrective action most directly addresses this ML workflow problem?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
Explanation
Correct Answer
C:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is the appropriate controlled remedy for xgboost tabular classification baseline. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. Verify the cause with: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. Then confirm: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This addresses a different issue involving sagemaker jumpstart template provenance. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated xgboost tabular classification baseline mechanism. The targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Case evidence: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 764
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. The data team must preserve event-time meaning and lineage. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
Explanation
Correct Answers
C:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This directly tests s3 versus efs training storage choice in the reported AWS ML workflow. S3 object semantics differ from mounted shared filesystems; choose storage for workload access behavior. It distinguishes the problem before choosing a change. The related targeted response is: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This is the appropriate controlled remedy for s3 versus efs training storage choice. S3 object semantics differ from mounted shared filesystems; choose storage for workload access behavior. Verify the cause with: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. Then confirm: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Define point-in-time offline joins, freshness SLAs, and aligned feature version logic for online retrieval. This selection concerns sagemaker feature store online offline consistency rather than the required diagnostic-and-remedy pair for s3 versus efs training storage choice. Use evidence: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. and the matching correction: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This selection concerns class imbalance handled inside cross-validation rather than the required diagnostic-and-remedy pair for s3 versus efs training storage choice. Use evidence: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. and the matching correction: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This selection concerns glue job bookmark state error rather than the required diagnostic-and-remedy pair for s3 versus efs training storage choice. Use evidence: Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. and the matching correction: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 765
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The experiment must be compared fairly against its prior baseline. Which observation most directly identifies the root cause of the reported behavior?
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical.
- Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract.
Explanation
Correct Answer
A:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This directly tests sagemaker script-mode data channel mismatch in the reported AWS ML workflow. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. It distinguishes the problem before choosing a change. The related targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
B:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:Inspect target types, business loss function, sample labels, and whether the required output is continuous or categorical. This is a possible diagnostic for regression versus classification problem formulation, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Inspect Docker entrypoint, training logs, image architecture, input mount points, and required container contract. This is a possible diagnostic for training image compatibility for byoc, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 766
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. The deployment must be reproducible without manual console-only fixes. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
- Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage.
- Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost.
- Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
Explanation
Correct Answer
D:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This directly tests bring-your-own-inference-container contract in the reported AWS ML workflow. A Docker image is not automatically a SageMaker-compatible inference server without the runtime HTTP contract. It distinguishes the problem before choosing a change. The related targeted response is: Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. Reported signal: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This is a possible diagnostic for multi-container inference pipeline responsibilities, but it does not directly test the bring-your-own-inference-container contract failure reported here. Prioritize: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. The relevant case is: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect the DAG of processing, training, evaluation and registration steps, along with parameter and artifact lineage. This is a possible diagnostic for sagemaker pipelines parameterized retraining, but it does not directly test the bring-your-own-inference-container contract failure reported here. Prioritize: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. The relevant case is: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect serverless invocation frequency, cold-start latency, supported provisioned concurrency settings, and cost. This is a possible diagnostic for sagemaker endpoint provisioned concurrency tradeoff, but it does not directly test the bring-your-own-inference-container contract failure reported here. Prioritize: Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. The relevant case is: A custom image works when run locally but SageMaker cannot invoke it because the container lacks an expected health route and invocation handler. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 767
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. The dataset contract must remain reproducible for a backfill. Which verification result BEST demonstrates that the issue is resolved?
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts.
- Neighboring times across midnight map close in cyclic feature space and validation improves without leakage.
- Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract.
Explanation
Correct Answer
A:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This is the acceptance evidence for the described class imbalance handled inside cross-validation scenario. Oversampling before splitting contaminates evaluation and hides the real error rate on rare classes. The corrective implementation it validates is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Reported signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This could validate model training data residency boundary, but it does not establish that class imbalance handled inside cross-validation is resolved for this workload. Confirm instead: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. Observed problem: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. This could validate time-series cyclical calendar feature, but it does not establish that class imbalance handled inside cross-validation is resolved for this workload. Confirm instead: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. Observed problem: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Historical evaluation reproduces features available at prediction time, and production freshness is monitored against the same contract. This could validate sagemaker feature store online offline consistency, but it does not establish that class imbalance handled inside cross-validation is resolved for this workload. Confirm instead: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. Observed problem: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 768
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. The deployment must be reproducible without manual console-only fixes. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift.
- Inspect versioned request schema, unit-test coverage, container
/invocations behavior, and pipeline gate logs. - Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp.
- Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings.
Explanation
Correct Answers
C:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This directly tests endpoint scale-to-zero cold capacity planning in the reported AWS ML workflow. Reactive scaling takes time and is bounded by quotas; zero spare capacity may not absorb an instantaneous burst. It distinguishes the problem before choosing a change. The related targeted response is: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. This is the appropriate controlled remedy for endpoint scale-to-zero cold capacity planning. Reactive scaling takes time and is bounded by quotas; zero spare capacity may not absorb an instantaneous burst. Verify the cause with: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. Then confirm: A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. This selection concerns cloudformation stack parameter drift rather than the required diagnostic-and-remedy pair for endpoint scale-to-zero cold capacity planning. Use evidence: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. and the matching correction: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Inspect versioned request schema, unit-test coverage, container /invocations behavior, and pipeline gate logs. This selection concerns continuous integration unit and endpoint contract tests rather than the required diagnostic-and-remedy pair for endpoint scale-to-zero cold capacity planning. Use evidence: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. and the matching correction: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
E:Use SageMaker asynchronous inference with S3 input/output and suitable queue and notification settings. This selection concerns asynchronous endpoint for large payloads rather than the required diagnostic-and-remedy pair for endpoint scale-to-zero cold capacity planning. Use evidence: Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. and the matching correction: Set adequate minimum capacity, scaling limits, alarms, and request backpressure for the expected traffic ramp. Signal: A real-time ML service is configured for very low baseline capacity but traffic can surge tenfold within seconds, exhausting available instance capacity. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 769
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. The team must demonstrate a repeatable monitoring or security control. Which measured outcome would confirm that the correction worked as intended?
- The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics.
- Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals.
- Training jobs reach the intended service privately while unauthorized external egress stays blocked.
- The job reads authorized training data while attempts to access unrelated buckets remain denied.
Explanation
Correct Answer
B:Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals. This is the acceptance evidence for the described clarify postdeployment group bias monitoring scenario. Aggregate performance can mask group-specific shifts; fairness monitoring must examine appropriate group metrics. The corrective implementation it validates is: Use appropriate SageMaker Clarify model-bias monitoring and investigate supported group differences before deployment changes. Reported signal: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:The monitor joins each known labeled request to the corresponding earlier prediction and computes expected metrics. This could validate model monitor ground truth association, but it does not establish that clarify postdeployment group bias monitoring is resolved for this workload. Confirm instead: Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals. Observed problem: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Training jobs reach the intended service privately while unauthorized external egress stays blocked. This could validate private vpc endpoint policy for sagemaker apis, but it does not establish that clarify postdeployment group bias monitoring is resolved for this workload. Confirm instead: Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals. Observed problem: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:The job reads authorized training data while attempts to access unrelated buckets remain denied. This could validate sagemaker execution role s3 least privilege, but it does not establish that clarify postdeployment group bias monitoring is resolved for this workload. Confirm instead: Auditors see reproducible subgroup statistics and alarms for material disparities rather than only global totals. Observed problem: A model's overall approval rate remains stable while approval differences between customer groups increase after a data-source migration. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 770
During a production MLOps reliability and security review, the following condition is observed: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. The owner needs an auditable resolution without broadening privileges. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Compare probability calibration plots, Brier score and event rates across recent labeled cohorts.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
- Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings.
- Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes.
Explanation
Correct Answer
C:Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. This directly tests aws budgets spend threshold for experimentation in the reported AWS ML workflow. Budgets detect or warn about costs but do not automatically limit every ML training request; job limits are also needed. It distinguishes the problem before choosing a change. The related targeted response is: Set budget alerts and bounded tuning job quotas before launching experiments, and enforce an owner-approved stopping policy. Reported signal: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. This is a possible diagnostic for serving output confidence calibration drift, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
B:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This is a possible diagnostic for cloudwatch 5xxerrors endpoint saturation, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.
D:Inspect caller identity, pass-role resource ARN, service constraint, and denied event attributes. This is a possible diagnostic for iam passrole constraint for model deployment, but it does not directly test the aws budgets spend threshold for experimentation failure reported here. Prioritize: Inspect tuning max jobs and parallel jobs, usage forecasts, AWS Budgets thresholds, and quota settings. The relevant case is: An unconstrained SageMaker tuning experiment launches hundreds of expensive GPU jobs, but the team notices the bill only at month end. Operational setting: During a production MLOps reliability and security review.