Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 70
Question 690
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. The data team must preserve event-time meaning and lineage. Which corrective action most directly addresses this ML workflow problem?
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training.
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Fit an appropriate scaler on training data and package the same transformation with inference preprocessing.
Explanation
Correct Answer
C:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This is the appropriate controlled remedy for partition pruning in s3 parquet training input. Partition-aware columnar scans reduce irrelevant I/O; naming a date column without partition metadata does not create pruning. Verify the cause with: Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. Then confirm: An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. Reported signal: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated partition pruning in s3 parquet training input mechanism. The targeted response is: Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. Case evidence: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Use a CSV parser with explicit quoting and schema validation; quarantine malformed records before training. This addresses a different issue involving csv schema ambiguity during ingestion. It does not correct the stated partition pruning in s3 parquet training input mechanism. The targeted response is: Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. Case evidence: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Fit an appropriate scaler on training data and package the same transformation with inference preprocessing. This addresses a different issue involving standardization of numerical features. It does not correct the stated partition pruning in s3 parquet training input mechanism. The targeted response is: Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. Case evidence: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 691
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Engineers must avoid changing unrelated source partitions. Which engineering response resolves the actual issue without masking the symptoms?
- Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
Explanation
Correct Answer
D:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This is the appropriate controlled remedy for class imbalance handled inside cross-validation. Oversampling before splitting contaminates evaluation and hides the real error rate on rare classes. Verify the cause with: Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. Then confirm: No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. Reported signal: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. This addresses a different issue involving partition pruning in s3 parquet training input. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This addresses a different issue involving median imputation fitted on training split. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Perform point-in-time correct joins using the most recent eligible pre-prediction feature record, not the globally latest value. This addresses a different issue involving point-in-time feature data leakage. It does not correct the stated class imbalance handled inside cross-validation mechanism. The targeted response is: Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. Case evidence: A rare-defect classifier oversamples minority instances before creating cross-validation folds, causing near copies in both training and holdout. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 692
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. The release is blocked until the underlying model behavior is understood. Which engineering response resolves the actual issue without masking the symptoms?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Enable patience-based early stopping and restore the checkpoint with the best validation metric.
- Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
Explanation
Correct Answer
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This is the appropriate controlled remedy for fine-tuning pretrained model learning-rate stability. Large updates on small data can overwrite pretrained features; careful transfer learning limits destructive forgetting. Verify the cause with: Compare pretrained validation metrics, fine-tuning learning curves, and layer-wise parameter updates. Then confirm: The fine-tuned model improves task accuracy without collapsing pretrained representations. Reported signal: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
B:Enable patience-based early stopping and restore the checkpoint with the best validation metric. This addresses a different issue involving early stopping on validation plateau. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. This addresses a different issue involving sagemaker built-in blazingtext choice. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This addresses a different issue involving precision versus recall fraud threshold. It does not correct the stated fine-tuning pretrained model learning-rate stability mechanism. The targeted response is: Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. Case evidence: A pretrained image encoder loses useful general features after fine-tuning on a small labeled dataset using an excessively high learning rate. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 693
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Engineers must avoid changing unrelated source partitions. What targeted change should be implemented after verifying the stated cause?
- Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema.
- Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls.
- Encode hour with sine and cosine cyclic features and validate with a time-aware split.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
Explanation
Correct Answer
B:Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. This is the appropriate controlled remedy for pii masking before model labeling. Data minimization applies before external labeling; encryption in transit does not remove unnecessary sensitive content from the task. Verify the cause with: Inspect source fields, sensitivity classification, Ground Truth task input, and downstream annotation permissions. Then confirm: Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. Reported signal: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. This addresses a different issue involving columnar file compaction for small objects. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Encode hour with sine and cosine cyclic features and validate with a time-aware split. This addresses a different issue involving time-series cyclical calendar feature. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This addresses a different issue involving model training data residency boundary. It does not correct the stated pii masking before model labeling mechanism. The targeted response is: Remove or pseudonymize unnecessary PII before annotation and restrict access to the token mapping under separate controls. Case evidence: A customer-support labeling dataset includes raw email addresses and account identifiers that external annotators do not need. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 694
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. The proposed change must preserve logging and least privilege. Which engineering response resolves the actual issue without masking the symptoms?
- Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions.
- Identify the component contributing to total request time and optimize network or overhead separately from actual model inference.
- Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust.
- Use a consistent versioned feature definition and test offline/online values at the same observation cutoff.
Explanation
Correct Answer
D:Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. This is the appropriate controlled remedy for training-serving feature skew incident. Mismatched feature windows and update cadence can degrade production predictions even if training accuracy is stable. Verify the cause with: Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. Then confirm: Parity checks match transformations within documented freshness tolerances for test entities. Reported signal: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Separate prompt input-distribution monitoring from delayed model-quality evaluation and join only observed labels to predictions. This addresses a different issue involving target-label delay in production quality monitoring. It does not correct the stated training-serving feature skew incident mechanism. The targeted response is: Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. Case evidence: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Identify the component contributing to total request time and optimize network or overhead separately from actual model inference. This addresses a different issue involving cloudwatch invocations and modellatency distinction. It does not correct the stated training-serving feature skew incident mechanism. The targeted response is: Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. Case evidence: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Grant only the needed S3 and KMS actions for the approved data prefix and ensure appropriate role trust. This addresses a different issue involving sagemaker execution role s3 least privilege. It does not correct the stated training-serving feature skew incident mechanism. The targeted response is: Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. Case evidence: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 695
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. The team needs a defensible technical decision rather than an untracked workaround. What postchange observation provides the strongest acceptance evidence?
- Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy.
- Reviewers can identify stable feature drivers for representative decisions without misleading causal claims.
- A rolling-origin backtest improves multi-step forecast error and respects temporal order.
- The managed training job starts the intended script and produces a usable model artifact in the output location.
Explanation
Correct Answer
B:Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. This is the acceptance evidence for the described interpretability for high-stakes prediction scenario. Feature attribution can support explanation, but model choice must reflect transparency requirements and attribution is not causality. The corrective implementation it validates is: Compare a more interpretable model or add tested SageMaker Clarify explainability to the decision process. Reported signal: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. This could validate training batch size causes gpu memory exhaustion, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:A rolling-origin backtest improves multi-step forecast error and respects temporal order. This could validate time-series forecast horizon and seasonality, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:The managed training job starts the intended script and produces a usable model artifact in the output location. This could validate training image compatibility for byoc, but it does not establish that interpretability for high-stakes prediction is resolved for this workload. Confirm instead: Reviewers can identify stable feature drivers for representative decisions without misleading causal claims. Observed problem: A credit-risk pilot selects a high-performing opaque model even though reviewers must justify material prediction features to an auditor. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 696
During a production MLOps reliability and security review, the following condition is observed: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. The owner needs an auditable resolution without broadening privileges. What targeted change should be implemented after verifying the stated cause?
- Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate.
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Scale compatible asynchronous inference capacity or tune workload and queue alarms for pending-request age.
- Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family.
Explanation
Correct Answer
B:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This is the appropriate controlled remedy for cross-account s3 bucket exfiltration protection. Least privilege must constrain the destination resource; an unrestricted object-write policy can enable data exfiltration. Verify the cause with: Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. Then confirm: A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. Reported signal: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Permit iam:PassRole only for the named execution role, constrained to the intended SageMaker service as appropriate. This addresses a different issue involving iam passrole constraint for model deployment. It does not correct the stated cross-account s3 bucket exfiltration protection mechanism. The targeted response is: Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. Case evidence: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: During a production MLOps reliability and security review.
C:Scale compatible asynchronous inference capacity or tune workload and queue alarms for pending-request age. This addresses a different issue involving asynchronous inference queue backlog alert. It does not correct the stated cross-account s3 bucket exfiltration protection mechanism. The targeted response is: Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. Case evidence: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: During a production MLOps reliability and security review.
D:Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. This addresses a different issue involving inference recommender benchmarking instance family. It does not correct the stated cross-account s3 bucket exfiltration protection mechanism. The targeted response is: Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. Case evidence: An ML pipeline in one account is allowed to write model predictions to an unapproved external bucket because its role has overly broad s3:PutObject access. Operational setting: During a production MLOps reliability and security review.
Question 697
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The dataset contract must remain reproducible for a backfill. What postchange observation provides the strongest acceptance evidence?
- The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions.
- Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering.
- Training converges more consistently, and the same raw request gives aligned standardized values online.
- An equivalent recent-date query reads only its selected partitions while returning the same labeled rows.
Explanation
Correct Answer
A:The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. This is the acceptance evidence for the described clarify label imbalance measurement scenario. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. The corrective implementation it validates is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
B:Every held-out forecast uses only data that existed at prediction time and its backtest follows real ordering. This could validate chronological split for forecast evaluation, but it does not establish that clarify label imbalance measurement is resolved for this workload. Confirm instead: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. Observed problem: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:Training converges more consistently, and the same raw request gives aligned standardized values online. This could validate standardization of numerical features, but it does not establish that clarify label imbalance measurement is resolved for this workload. Confirm instead: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. Observed problem: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:An equivalent recent-date query reads only its selected partitions while returning the same labeled rows. This could validate partition pruning in s3 parquet training input, but it does not establish that clarify label imbalance measurement is resolved for this workload. Confirm instead: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. Observed problem: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 698
During an approved rollout of an AWS ML inference workload, the following condition is observed: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. The team must meet its documented availability and rollback constraints. Which verification result BEST demonstrates that the issue is resolved?
- Both regions match their approved parameterized templates and subsequent deployments remain repeatable.
- Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost.
- Cold-start p95 improves during planned demand windows while capacity cost remains measured.
- The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure.
Explanation
Correct Answer
A:Both regions match their approved parameterized templates and subsequent deployments remain repeatable. This is the acceptance evidence for the described cloudformation stack parameter drift scenario. Infrastructure as code only controls actual state when out-of-band changes are detected and reconciled. The corrective implementation it validates is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Reported signal: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. This could validate multi-model endpoint hosting tradeoff, but it does not establish that cloudformation stack parameter drift is resolved for this workload. Confirm instead: Both regions match their approved parameterized templates and subsequent deployments remain repeatable. Observed problem: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Cold-start p95 improves during planned demand windows while capacity cost remains measured. This could validate sagemaker endpoint provisioned concurrency tradeoff, but it does not establish that cloudformation stack parameter drift is resolved for this workload. Confirm instead: Both regions match their approved parameterized templates and subsequent deployments remain repeatable. Observed problem: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
D:The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure. This could validate gpu versus cpu inference fit, but it does not establish that cloudformation stack parameter drift is resolved for this workload. Confirm instead: Both regions match their approved parameterized templates and subsequent deployments remain repeatable. Observed problem: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 699
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. The proposed change must preserve logging and least privilege. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Use a consistent versioned feature definition and test offline/online values at the same observation cutoff.
- Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access.
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation.
- Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks.
Explanation
Correct Answers
D:Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. This directly tests model monitor violation alert calibration in the reported AWS ML workflow. Monitoring must balance sensitivity and alert fatigue; treating every small statistical change as an incident is unreliable. It distinguishes the problem before choosing a change. The related targeted response is: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
E:Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. This is the appropriate controlled remedy for model monitor violation alert calibration. Monitoring must balance sensitivity and alert fatigue; treating every small statistical change as an incident is unreliable. Verify the cause with: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. Then confirm: Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. This selection concerns training-serving feature skew incident rather than the required diagnostic-and-remedy pair for model monitor violation alert calibration. Use evidence: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. and the matching correction: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. Signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Use approved SageMaker interface endpoints and relevant private DNS and policy settings for required API access. This selection concerns private vpc endpoint policy for sagemaker apis rather than the required diagnostic-and-remedy pair for model monitor violation alert calibration. Use evidence: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. and the matching correction: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. Signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This selection concerns tag-based ml training cost attribution rather than the required diagnostic-and-remedy pair for model monitor violation alert calibration. Use evidence: Inspect constraint threshold selection, false-positive incidents, feature importance and baseline seasonal variation. and the matching correction: Tune justified thresholds and group actionable monitor violations by severity without suppressing critical data-integrity checks. Signal: A monitor issues thousands of alerts after a small harmless shift in an optional numeric feature and on-call engineers begin ignoring all violations. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 700
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The team needs a defensible technical decision rather than an untracked workaround. Which verification result BEST demonstrates that the issue is resolved?
- A rolling-origin backtest improves multi-step forecast error and respects temporal order.
- The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions.
- Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy.
- The chosen version meets task metrics and license conditions and its inference contract is reproducible.
Explanation
Correct Answer
D:The chosen version meets task metrics and license conditions and its inference contract is reproducible. This is the acceptance evidence for the described sagemaker jumpstart template provenance scenario. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. The corrective implementation it validates is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:A rolling-origin backtest improves multi-step forecast error and respects temporal order. This could validate time-series forecast horizon and seasonality, but it does not establish that sagemaker jumpstart template provenance is resolved for this workload. Confirm instead: The chosen version meets task metrics and license conditions and its inference contract is reproducible. Observed problem: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:The same container runs under managed training and reads the intended channel without hard-coded notebook filesystem assumptions. This could validate sagemaker script-mode data channel mismatch, but it does not establish that sagemaker jumpstart template provenance is resolved for this workload. Confirm instead: The chosen version meets task metrics and license conditions and its inference contract is reproducible. Observed problem: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. This could validate training batch size causes gpu memory exhaustion, but it does not establish that sagemaker jumpstart template provenance is resolved for this workload. Confirm instead: The chosen version meets task metrics and license conditions and its inference contract is reproducible. Observed problem: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.