Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 106
Question 1050
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. The experiment must be compared fairly against its prior baseline. Which measured outcome would confirm that the correction worked as intended?
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
- A production endpoint resolves to one approved model package version with traceable training lineage.
- A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records.
- The managed training job starts the intended script and produces a usable model artifact in the output location.
Explanation
Correct Answer
B:A production endpoint resolves to one approved model package version with traceable training lineage. This is the acceptance evidence for the described sagemaker model registry candidate approval scenario. A human-readable model nickname is not a reproducible deployment identifier; versioned registry artifacts support controlled promotion. The corrective implementation it validates is: Register immutable model package versions with lineage and require explicit approval before promotion to production. Reported signal: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that sagemaker model registry candidate approval is resolved for this workload. Confirm instead: A production endpoint resolves to one approved model package version with traceable training lineage. Observed problem: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
C:A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. This could validate regression versus classification problem formulation, but it does not establish that sagemaker model registry candidate approval is resolved for this workload. Confirm instead: A production endpoint resolves to one approved model package version with traceable training lineage. Observed problem: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:The managed training job starts the intended script and produces a usable model artifact in the output location. This could validate training image compatibility for byoc, but it does not establish that sagemaker model registry candidate approval is resolved for this workload. Confirm instead: A production endpoint resolves to one approved model package version with traceable training lineage. Observed problem: Two notebooks deploy different model artifacts under the same informal name, so the team cannot reproduce which code and data generated production predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 1051
During an approved rollout of an AWS ML inference workload, the following condition is observed: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. The team must meet its documented availability and rollback constraints. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Compare template parameters, stack drift results, change sets, and deployed endpoint settings.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
- Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests.
- Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs.
Explanation
Correct Answer
A:Compare template parameters, stack drift results, change sets, and deployed endpoint settings. This directly tests cloudformation stack parameter drift in the reported AWS ML workflow. Infrastructure as code only controls actual state when out-of-band changes are detected and reconciled. It distinguishes the problem before choosing a change. The related targeted response is: Define the endpoint resources and parameters in versioned CloudFormation or CDK code, review a change set, and reconcile drift. Reported signal: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
B:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This is a possible diagnostic for codebuild iam least-privilege artifact upload, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. This is a possible diagnostic for blue-green endpoint rollback after health failure, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. This is a possible diagnostic for sagemaker vpc endpoint access for private artifacts, but it does not directly test the cloudformation stack parameter drift failure reported here. Prioritize: Compare template parameters, stack drift results, change sets, and deployed endpoint settings. The relevant case is: Two production regions deploy different endpoint instance sizes because engineers manually alter console settings after the shared CloudFormation stack is created. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1052
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Change control requires measurable endpoint or pipeline acceptance evidence. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
- Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs.
- Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not.
Explanation
Correct Answers
A:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This directly tests multi-container inference pipeline responsibilities in the reported AWS ML workflow. A managed inference pipeline chains preprocessing and prediction steps consistently, reducing client-side skew. It distinguishes the problem before choosing a change. The related targeted response is: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This is the appropriate controlled remedy for multi-container inference pipeline responsibilities. A managed inference pipeline chains preprocessing and prediction steps consistently, reducing client-side skew. Verify the cause with: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. Then confirm: The endpoint applies the same preprocessor to every client request and produces the expected model input schema. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. This selection concerns sagemaker vpc endpoint access for private artifacts rather than the required diagnostic-and-remedy pair for multi-container inference pipeline responsibilities. Use evidence: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. and the matching correction: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This selection concerns blue-green endpoint rollback after health failure rather than the required diagnostic-and-remedy pair for multi-container inference pipeline responsibilities. Use evidence: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. and the matching correction: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Use SageMaker Serverless Inference where the model and latency envelope fit, or justify provisioned capacity if it does not. This selection concerns serverless inference for intermittent requests rather than the required diagnostic-and-remedy pair for multi-container inference pipeline responsibilities. Use evidence: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. and the matching correction: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 1053
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. The team needs a defensible technical decision rather than an untracked workaround. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
- Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout.
Explanation
Correct Answers
A:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This directly tests sagemaker jumpstart template provenance in the reported AWS ML workflow. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. It distinguishes the problem before choosing a change. The related targeted response is: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This is the appropriate controlled remedy for sagemaker jumpstart template provenance. Pretrained model convenience does not remove licensing, fit-for-purpose evaluation, or operational constraints. Verify the cause with: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. Then confirm: The chosen version meets task metrics and license conditions and its inference contract is reproducible. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
B:Inspect training metrics per trial, search bounds, tuning-objective direction, and compute constraints. This selection concerns hyperparameter bayesian tuning strategy rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This selection concerns xgboost tabular classification baseline rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Select a decision threshold using recall or cost-aware precision/recall targets and measure on the untouched holdout. This selection concerns precision versus recall fraud threshold rather than the required diagnostic-and-remedy pair for sagemaker jumpstart template provenance. Use evidence: Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. and the matching correction: Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. Signal: A team chooses a SageMaker JumpStart model by popularity alone and overlooks its license, task fit, input contracts, and deployment costs. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1054
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. The deployment must be reproducible without manual console-only fixes. Which corrective action most directly addresses this ML workflow problem?
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route.
- Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms.
- Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts.
Explanation
Correct Answer
C:Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. This is the appropriate controlled remedy for blue-green endpoint rollback after health failure. Blue-green deployment provides safe rollback only while the previous serving path remains functional during validation. Verify the cause with: Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. Then confirm: A simulated green regression returns traffic to the last healthy model without extended outage. Reported signal: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This addresses a different issue involving sagemaker vpc endpoint access for private artifacts. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. This addresses a different issue involving sagemaker neo edge compiler compatibility. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Define a parameterized SageMaker Pipeline that orders steps and records source data, code and model artifacts. This addresses a different issue involving sagemaker pipelines parameterized retraining. It does not correct the stated blue-green endpoint rollback after health failure mechanism. The targeted response is: Keep the blue environment available until green health gates pass and automate traffic rollback on failed alarms. Case evidence: A green SageMaker endpoint variant receives a traffic shift but causes elevated errors; the deployment script removes the blue version before health is established. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 1055
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Engineers must avoid changing unrelated source partitions. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
Explanation
Correct Answer
A:Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. This directly tests text tokenization mismatch in serving in the reported AWS ML workflow. Model embeddings depend on stable token-ID semantics; swapping tokenizers changes the feature representation. It distinguishes the problem before choosing a change. The related targeted response is: Package the training tokenizer and normalization configuration with the model artifact and require serving compatibility checks. Reported signal: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This is a possible diagnostic for median imputation fitted on training split, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Inspect sampler placement, duplicate neighbor IDs, fold membership, and class-conditioned metric changes. This is a possible diagnostic for class imbalance handled inside cross-validation, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This is a possible diagnostic for clarify label imbalance measurement, but it does not directly test the text tokenization mismatch in serving failure reported here. Prioritize: Compare vocabulary hashes, normalization steps, token IDs for test strings, and serialized preprocessing versions. The relevant case is: A sentiment model trained with one tokenizer receives text encoded by a different tokenizer in production and generates incorrect input token IDs. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 1056
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. The team needs a defensible technical decision rather than an untracked workaround. Which engineering response resolves the actual issue without masking the symptoms?
- Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set.
- Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons.
- Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract.
- Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields.
Explanation
Correct Answer
D:Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. This is the appropriate controlled remedy for managed ai service versus custom ocr model. Managed document extraction can solve standard OCR and key-value needs without owning an entire model-training pipeline. Verify the cause with: Inspect requested outputs, standard extraction capability, exception rates, cost, and whether layout-specific custom learning is needed. Then confirm: A representative invoice set yields usable structured fields with measured extraction quality and minimal custom training. Reported signal: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Use a smaller learning rate, optionally freeze early layers, and assess staged unfreezing against a held-out set. This addresses a different issue involving fine-tuning pretrained model learning-rate stability. It does not correct the stated managed ai service versus custom ocr model mechanism. The targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Case evidence: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Use a time-series forecasting approach with past context and seasonal features, evaluating all intended future horizons. This addresses a different issue involving time-series forecast horizon and seasonality. It does not correct the stated managed ai service versus custom ocr model mechanism. The targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Case evidence: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This addresses a different issue involving reproducible sagemaker experiments comparisons. It does not correct the stated managed ai service versus custom ocr model mechanism. The targeted response is: Evaluate Amazon Textract form and table extraction first, adding custom processing only for unsupported fields. Case evidence: An invoice project needs typed text extracted from scanned forms but begins collecting millions of labels to train a custom generic vision encoder. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1057
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The release is blocked until the underlying model behavior is understood. What postchange observation provides the strongest acceptance evidence?
- The evaluation report shows both typical error and extreme-error impact with a justified primary metric.
- A production endpoint resolves to one approved model package version with traceable training lineage.
- Multiple workers reduce epoch time with acceptable convergence and measured communication overhead.
- The tested alert rate and precision match the production workload rather than an optimistic single ROC figure.
Explanation
Correct Answer
D:The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This is the acceptance evidence for the described roc-auc versus pr-auc for rare events scenario. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. The corrective implementation it validates is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:The evaluation report shows both typical error and extreme-error impact with a justified primary metric. This could validate rmse versus mae outlier sensitivity, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:A production endpoint resolves to one approved model package version with traceable training lineage. This could validate sagemaker model registry candidate approval, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Multiple workers reduce epoch time with acceptable convergence and measured communication overhead. This could validate data parallelism versus model parallelism, but it does not establish that roc-auc versus pr-auc for rare events is resolved for this workload. Confirm instead: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. Observed problem: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1058
During a production MLOps reliability and security review, the following condition is observed: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. The owner needs an auditable resolution without broadening privileges. Which corrective action most directly addresses this ML workflow problem?
- Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails.
- Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable.
- Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks.
- Pin an immutable approved artifact version or content digest and verify integrity before deployment.
Explanation
Correct Answer
D:Pin an immutable approved artifact version or content digest and verify integrity before deployment. This is the appropriate controlled remedy for model artifact supply-chain integrity. Object names alone do not guarantee model provenance; supply-chain checks bind deployment to reviewed bytes. Verify the cause with: Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. Then confirm: The deployed model bytes match the signed or approved manifest and a tampered artifact fails validation. Reported signal: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Restrict writes to approved bucket prefixes and apply appropriate resource and organizational guardrails. This addresses a different issue involving cross-account s3 bucket exfiltration protection. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: During a production MLOps reliability and security review.
B:Use stable user-cohort assignment or an appropriate experiment design while keeping exposed groups measurable. This addresses a different issue involving champion challenger a/b assignment consistency. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: During a production MLOps reliability and security review.
C:Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. This addresses a different issue involving sagemaker model monitor feature drift baseline. It does not correct the stated model artifact supply-chain integrity mechanism. The targeted response is: Pin an immutable approved artifact version or content digest and verify integrity before deployment. Case evidence: A release pipeline downloads an ML model artifact from a mutable object key and deploys it without checking whether its bytes changed since approval. Operational setting: During a production MLOps reliability and security review.
Question 1059
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. The dataset contract must remain reproducible for a backfill. Which observation most directly identifies the root cause of the reported behavior?
- Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries.
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
- Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned.
- Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query.
Explanation
Correct Answer
C:Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. This directly tests partition pruning in s3 parquet training input in the reported AWS ML workflow. Partition-aware columnar scans reduce irrelevant I/O; naming a date column without partition metadata does not create pruning. It distinguishes the problem before choosing a change. The related targeted response is: Write partitioned columnar Parquet data by event date, register accurate partitions in the catalog, and filter on partition keys. Reported signal: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. This is a possible diagnostic for s3 object event at-least-once processing, but it does not directly test the partition pruning in s3 parquet training input failure reported here. Prioritize: Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. The relevant case is: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This is a possible diagnostic for streaming feature rolling window correctness, but it does not directly test the partition pruning in s3 parquet training input failure reported here. Prioritize: Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. The relevant case is: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
D:Inspect feature event timestamps, target prediction cutoffs, and join predicates in the historical training query. This is a possible diagnostic for point-in-time feature data leakage, but it does not directly test the partition pruning in s3 parquet training input failure reported here. Prioritize: Compare the query predicates with S3 object prefixes, partition metadata, and query plans to confirm partitions are not being pruned. The relevant case is: A training preparation scan reads every month of event history even though the feature job requests one recent date, causing high bytes scanned and slow ingestion. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1060
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. The deployment must be reproducible without manual console-only fixes. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
- Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load.
- Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size.
- Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology.
Explanation
Correct Answer
D:Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. This directly tests multi-container inference pipeline responsibilities in the reported AWS ML workflow. A managed inference pipeline chains preprocessing and prediction steps consistently, reducing client-side skew. It distinguishes the problem before choosing a change. The related targeted response is: Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. Reported signal: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
A:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This is a possible diagnostic for model registry version promotion provenance, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
B:Profile model operations, memory footprint, CPU saturation, request latency, and GPU throughput under representative load. This is a possible diagnostic for gpu versus cpu inference fit, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:Inspect service quotas, minimum and maximum endpoint capacity, scaling cooldowns, startup time, and burst size. This is a possible diagnostic for endpoint scale-to-zero cold capacity planning, but it does not directly test the multi-container inference pipeline responsibilities failure reported here. Prioritize: Inspect preprocessing version drift, input/output contracts, and the selected hosting container topology. The relevant case is: An inference service needs a separate preprocessing transform before a predictor, but the team inserts inconsistent transformation code into many client applications. Operational setting: While testing a second region for recoverable deployment of the same ML service.