Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 80
Question 790
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The team needs a defensible technical decision rather than an untracked workaround. Which observation most directly identifies the root cause of the reported behavior?
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements.
- Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions.
- Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds.
Explanation
Correct Answer
B:Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. This directly tests xgboost tabular classification baseline in the reported AWS ML workflow. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. It distinguishes the problem before choosing a change. The related targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This is a possible diagnostic for reproducible sagemaker experiments comparisons, but it does not directly test the xgboost tabular classification baseline failure reported here. Prioritize: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. The relevant case is: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect forecast horizon, frequency, calendar patterns, historical covariates, and temporal train/test partitions. This is a possible diagnostic for time-series forecast horizon and seasonality, but it does not directly test the xgboost tabular classification baseline failure reported here. Prioritize: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. The relevant case is: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect confusion matrix, class prevalence, false-negative cost, and precision-recall curves across thresholds. This is a possible diagnostic for precision versus recall fraud threshold, but it does not directly test the xgboost tabular classification baseline failure reported here. Prioritize: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. The relevant case is: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 791
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. The release is blocked until the underlying model behavior is understood. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility.
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
- Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample.
Explanation
Correct Answers
D:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This is the appropriate controlled remedy for clustering for unlabeled customer segments. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. Verify the cause with: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. Then confirm: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
E:Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. This directly tests clustering for unlabeled customer segments in the reported AWS ML workflow. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. It distinguishes the problem before choosing a change. The related targeted response is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This selection concerns sagemaker built-in blazingtext choice rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect routing mode, shadow traffic duplication, inference latency, output divergence, and payload compatibility. This selection concerns shadow deployment model evaluation without response change rather than the required diagnostic-and-remedy pair for clustering for unlabeled customer segments. Use evidence: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. and the matching correction: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 792
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Engineers must avoid changing unrelated source partitions. What targeted change should be implemented after verifying the stated cause?
- Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features.
- Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target.
- Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
Explanation
Correct Answer
C:Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. This is the appropriate controlled remedy for chronological split for forecast evaluation. Random splits violate temporal causality when future observations influence features or train data. Verify the cause with: Inspect feature availability timestamps and whether each label time follows the last feature observation. Then confirm: Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Define explicit compatible conversions and schema contracts, isolate incompatible versions, and validate before publishing features. This addresses a different issue involving glue schema evolution with mixed input types. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Use controlled incremental extraction or a suitable read replica and throttle export jobs within the approved data freshness target. This addresses a different issue involving rds extraction overload into ml. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This addresses a different issue involving model training data residency boundary. It does not correct the stated chronological split for forecast evaluation mechanism. The targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Case evidence: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 793
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. The team needs a defensible technical decision rather than an untracked workaround. What targeted change should be implemented after verifying the stated cause?
- Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses.
- Read the configured SageMaker training channel path or environment variable and fail clearly on missing input.
- Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses.
- Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process.
Explanation
Correct Answer
A:Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. This is the appropriate controlled remedy for rmse versus mae outlier sensitivity. Squaring residuals gives large errors disproportionately high weight; MAE weights magnitudes linearly. Verify the cause with: Inspect squared versus absolute residual contributions, target distribution, and large-error business costs. Then confirm: The evaluation report shows both typical error and extreme-error impact with a justified primary metric. Reported signal: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. This addresses a different issue involving sagemaker script-mode data channel mismatch. It does not correct the stated rmse versus mae outlier sensitivity mechanism. The targeted response is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Case evidence: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Deploy a SageMaker shadow variant for observational comparison before promoting the new model to served responses. This addresses a different issue involving shadow deployment model evaluation without response change. It does not correct the stated rmse versus mae outlier sensitivity mechanism. The targeted response is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Case evidence: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. This addresses a different issue involving interpretability for high-stakes prediction. It does not correct the stated rmse versus mae outlier sensitivity mechanism. The targeted response is: Compare RMSE with MAE or robust error summaries and choose the metric matching the application's penalty for large misses. Case evidence: A house-price model's RMSE increases sharply after a few exceptionally expensive properties enter the validation set, although typical absolute errors remain stable. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 794
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. The release is blocked until the underlying model behavior is understood. What targeted change should be implemented after verifying the stated cause?
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
- Use justified feature selection or sparsity constraints fitted on training folds before retraining.
- Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
Explanation
Correct Answer
C:Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. This is the appropriate controlled remedy for clustering for unlabeled customer segments. Unsupervised grouping does not require labeled segment classes and should not be judged by an unavailable label accuracy metric. Verify the cause with: Check whether trustworthy target labels exist and compare feature distance scaling and cluster stability on a sample. Then confirm: Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. Reported signal: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated clustering for unlabeled customer segments mechanism. The targeted response is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Case evidence: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Use justified feature selection or sparsity constraints fitted on training folds before retraining. This addresses a different issue involving feature selection to reduce overparameterization. It does not correct the stated clustering for unlabeled customer segments mechanism. The targeted response is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Case evidence: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This addresses a different issue involving sagemaker built-in blazingtext choice. It does not correct the stated clustering for unlabeled customer segments mechanism. The targeted response is: Use an unsupervised clustering approach such as k-means after appropriate feature preparation and assess whether groups are meaningful. Case evidence: A retail analytics group needs to discover coherent groups of customers but has no verified segment labels for supervised classification. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 795
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. The team must demonstrate a repeatable monitoring or security control. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence.
- Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation.
- Inspect routing hashes, experiment assignments, variant weights, and request identity consistency.
Explanation
Correct Answer
A:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This directly tests cloudtrail training data access audit coverage in the reported AWS ML workflow. CloudTrail management events do not by default include every S3 object read; data-event selection provides that visibility. It distinguishes the problem before choosing a change. The related targeted response is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Reported signal: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
B:Inspect the assumed SageMaker execution role, bucket/KMS policies, object path, and access-denied CloudTrail evidence. This is a possible diagnostic for sagemaker execution role s3 least privilege, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
C:Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. This is a possible diagnostic for model monitor violation alert calibration, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Inspect routing hashes, experiment assignments, variant weights, and request identity consistency. This is a possible diagnostic for champion challenger a/b assignment consistency, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 796
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. The dataset contract must remain reproducible for a backfill. Which observation most directly identifies the root cause of the reported behavior?
- Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set.
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
- Inspect feature availability timestamps and whether each label time follows the last feature observation.
Explanation
Correct Answer
D:Inspect feature availability timestamps and whether each label time follows the last feature observation. This directly tests chronological split for forecast evaluation in the reported AWS ML workflow. Random splits violate temporal causality when future observations influence features or train data. It distinguishes the problem before choosing a change. The related targeted response is: Use rolling-origin or chronological validation with strictly past-derived features and appropriate forecast horizons. Reported signal: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. This is a possible diagnostic for ground truth labeling agreement review, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This is a possible diagnostic for text tokenization mismatch in serving, but it does not directly test the chronological split for forecast evaluation failure reported here. Prioritize: Inspect feature availability timestamps and whether each label time follows the last feature observation. The relevant case is: A demand forecast model is evaluated on randomly sampled days while features contain recent historical moving averages, creating unrealistic future information. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 797
During a production MLOps reliability and security review, the following condition is observed: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. The owner needs an auditable resolution without broadening privileges. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies.
- Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
- Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting.
Explanation
Correct Answers
C:Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. This is the appropriate controlled remedy for cloudwatch 5xxerrors endpoint saturation. Daily averages can conceal short capacity failures; monitoring must use an incident-relevant interval. Verify the cause with: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. Then confirm: Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
D:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This directly tests cloudwatch 5xxerrors endpoint saturation in the reported AWS ML workflow. Daily averages can conceal short capacity failures; monitoring must use an incident-relevant interval. It distinguishes the problem before choosing a change. The related targeted response is: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This selection concerns iam passrole constraint for model deployment rather than the required diagnostic-and-remedy pair for cloudwatch 5xxerrors endpoint saturation. Use evidence: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. and the matching correction: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. Signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
B:Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies. This selection concerns private vpc endpoint policy for sagemaker apis rather than the required diagnostic-and-remedy pair for cloudwatch 5xxerrors endpoint saturation. Use evidence: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. and the matching correction: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. Signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
E:Apply consistent approved cost allocation tags to ML jobs and supported linked resources and activate relevant reporting. This selection concerns tag-based ml training cost attribution rather than the required diagnostic-and-remedy pair for cloudwatch 5xxerrors endpoint saturation. Use evidence: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. and the matching correction: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. Signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
Question 798
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. The dataset contract must remain reproducible for a backfill. Which measured outcome would confirm that the correction worked as intended?
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path.
- Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable.
- Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings.
Explanation
Correct Answer
C:Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. This is the acceptance evidence for the described s3 versus efs training storage choice scenario. S3 object semantics differ from mounted shared filesystems; choose storage for workload access behavior. The corrective implementation it validates is: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Reported signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. This could validate glue schema evolution with mixed input types, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. This could validate pii masking before model labeling, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 799
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?
- Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words.
- Training read time and object operations decline while the resulting row count and checksums match.
- Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings.
- Neighboring times across midnight map close in cyclic feature space and validation improves without leakage.
Explanation
Correct Answer
A:Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. This is the acceptance evidence for the described text tokenization mismatch in serving scenario. Model embeddings depend on stable token-ID semantics; swapping tokenizers changes the feature representation. The corrective implementation it validates is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Reported signal: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Training read time and object operations decline while the resulting row count and checksums match. This could validate columnar file compaction for small objects, but it does not establish that text tokenization mismatch in serving is resolved for this workload. Confirm instead: Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. Observed problem: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. This could validate pii masking before model labeling, but it does not establish that text tokenization mismatch in serving is resolved for this workload. Confirm instead: Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. Observed problem: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. This could validate time-series cyclical calendar feature, but it does not establish that text tokenization mismatch in serving is resolved for this workload. Confirm instead: Identical inputs create identical token IDs in train and serving paths, including punctuation and unknown words. Observed problem: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 800
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. The team needs a defensible technical decision rather than an untracked workaround. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
- Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed.
Explanation
Correct Answers
A:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This is the appropriate controlled remedy for managed ai service versus custom ocr model. Managed document extraction can solve standard OCR and key-value needs without owning an entire model-training pipeline. Verify the cause with: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. Then confirm: A representative invoice set yields usable structured fields with measured extraction quality and minimal custom training. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. This directly tests managed ai service versus custom ocr model in the reported AWS ML workflow. Managed document extraction can solve standard OCR and key-value needs without owning an entire model-training pipeline. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This selection concerns xgboost tabular classification baseline rather than the required diagnostic-and-remedy pair for managed ai service versus custom ocr model. Use evidence: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. and the matching correction: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This selection concerns training image compatibility for byoc rather than the required diagnostic-and-remedy pair for managed ai service versus custom ocr model. Use evidence: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. and the matching correction: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This selection concerns sagemaker script-mode data channel mismatch rather than the required diagnostic-and-remedy pair for managed ai service versus custom ocr model. Use evidence: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. and the matching correction: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.