Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 34
Question 330
During a production MLOps reliability and security review, the following condition is observed: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. The owner needs an auditable resolution without broadening privileges. Which observation most directly identifies the root cause of the reported behavior?
- Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs.
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
Explanation
Correct Answer
D:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This directly tests cloudwatch 5xxerrors endpoint saturation in the reported AWS ML workflow. Daily averages can conceal short capacity failures; monitoring must use an incident-relevant interval. It distinguishes the problem before choosing a change. The related targeted response is: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. Reported signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. This is a possible diagnostic for cloudwatch logs insights error correlation, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
B:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This is a possible diagnostic for cloudtrail training data access audit coverage, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
C:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This is a possible diagnostic for s3 sse-kms cross-account model artifact access, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
Question 331
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. The release is blocked until the underlying model behavior is understood. What postchange observation provides the strongest acceptance evidence?
- The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset.
- Trials record comparable objective values and a selected candidate meets an independent validation target within budget.
- Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy.
- A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records.
Explanation
Correct Answer
C:Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. This is the acceptance evidence for the described training batch size causes gpu memory exhaustion scenario. Per-step activation memory generally scales with batch size; safe accumulation can preserve an effective larger batch. The corrective implementation it validates is: Reduce per-device batch size or use appropriate gradient accumulation or mixed precision after compatibility validation. Reported signal: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. This could validate xgboost tabular classification baseline, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Trials record comparable objective values and a selected candidate meets an independent validation target within budget. This could validate hyperparameter bayesian tuning strategy, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:A model returns calibrated numerical amounts and is evaluated against continuous target error on held-out records. This could validate regression versus classification problem formulation, but it does not establish that training batch size causes gpu memory exhaustion is resolved for this workload. Confirm instead: Training completes within GPU memory limits and reaches comparable optimizer behavior and accuracy. Observed problem: A SageMaker PyTorch training container repeatedly runs out of CUDA memory after batch size rises, although the model previously trained. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 332
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. The data team must preserve event-time meaning and lineage. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training.
- Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
- Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
Explanation
Correct Answers
A:Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is the appropriate controlled remedy for clarify label imbalance measurement. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. Verify the cause with: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. Then confirm: The report quantifies class or group imbalance with reproducible group counts and documents remediation assumptions. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This directly tests clarify label imbalance measurement in the reported AWS ML workflow. Aggregate accuracy can conceal unequal source-label distributions, which pretraining metrics assess before model fitting. It distinguishes the problem before choosing a change. The related targeted response is: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
B:Inspect preprocessing fit order, imputation statistics, dataset split boundaries, and pipeline serialization. This selection concerns median imputation fitted on training split rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Preserve the intended bookmark state across deployments and run an explicit controlled backfill only when required. This selection concerns glue job bookmark state error rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This selection concerns model training data residency boundary rather than the required diagnostic-and-remedy pair for clarify label imbalance measurement. Use evidence: Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. and the matching correction: Measure label distribution differences with an appropriate pretraining bias metric and improve data representation before training. Signal: A hiring-model dataset has very different positive-label rates across sensitive groups, but the team compares only global accuracy. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 333
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. The proposed change must preserve logging and least privilege. Which measured outcome would confirm that the correction worked as intended?
- The new container operates with rotated credentials and image scans find no active embedded password.
- Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner.
- Parity checks match transformations within documented freshness tolerances for test entities.
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
Explanation
Correct Answer
C:Parity checks match transformations within documented freshness tolerances for test entities. This is the acceptance evidence for the described training-serving feature skew incident scenario. Mismatched feature windows and update cadence can degrade production predictions even if training accuracy is stable. The corrective implementation it validates is: Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. Reported signal: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:The new container operates with rotated credentials and image scans find no active embedded password. This could validate secret rotation for inference container credentials, but it does not establish that training-serving feature skew incident is resolved for this workload. Confirm instead: Parity checks match transformations within documented freshness tolerances for test entities. Observed problem: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Representative benign fluctuations stay quiet while a known severe schema or distribution break pages the owner. This could validate model monitor violation alert calibration, but it does not establish that training-serving feature skew incident is resolved for this workload. Confirm instead: Parity checks match transformations within documented freshness tolerances for test entities. Observed problem: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This could validate inference recommender benchmarking instance family, but it does not establish that training-serving feature skew incident is resolved for this workload. Confirm instead: Parity checks match transformations within documented freshness tolerances for test entities. Observed problem: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 334
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Change control requires measurable endpoint or pipeline acceptance evidence. What targeted change should be implemented after verifying the stated cause?
- Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress.
- Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline.
- Implement the SageMaker inference container
/ping and /invocations expectations or use a supported serving toolkit. - Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior.
Explanation
Correct Answer
A:Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. This is the appropriate controlled remedy for sagemaker vpc endpoint access for private artifacts. VPC isolation requires explicit supported network paths to AWS services; IAM permission alone does not create connectivity. Verify the cause with: Inspect route tables, S3 VPC endpoint association, security policies, endpoint policies, and S3 access logs. Then confirm: The deployment loads artifacts privately and blocked public routes remain unused. Reported signal: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. This addresses a different issue involving continuous integration unit and endpoint contract tests. It does not correct the stated sagemaker vpc endpoint access for private artifacts mechanism. The targeted response is: Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. Case evidence: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Implement the SageMaker inference container /ping and /invocations expectations or use a supported serving toolkit. This addresses a different issue involving bring-your-own-inference-container contract. It does not correct the stated sagemaker vpc endpoint access for private artifacts mechanism. The targeted response is: Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. Case evidence: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use a compatible SageMaker multi-model endpoint with managed model loading and monitor cache/eviction behavior. This addresses a different issue involving multi-model endpoint hosting tradeoff. It does not correct the stated sagemaker vpc endpoint access for private artifacts mechanism. The targeted response is: Provide an approved S3 gateway or interface endpoint path and least-privilege bucket/role permissions without unnecessarily opening internet egress. Case evidence: A private-subnet inference deployment cannot retrieve its S3 model artifact because the network has no authorized path to the bucket. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 335
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Engineers must avoid changing unrelated source partitions. Which engineering response resolves the actual issue without masking the symptoms?
- Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication.
- Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3.
- Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports.
- Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes.
Explanation
Correct Answer
D:Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. This is the appropriate controlled remedy for s3 object event at-least-once processing. Event notifications can be delivered more than once; consuming an event is not proof of exactly-once effects. Verify the cause with: Inspect event identifiers, object versions or ETags, processing ledger, and downstream record keys for duplicate deliveries. Then confirm: Replaying the same notification leaves exactly one corresponding logical training record and records deduplication. Reported signal: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Enforce a required non-null or uniqueness contract with thresholds; quarantine violating partitions before feature publication. This addresses a different issue involving glue data quality non-null contract. It does not correct the stated s3 object event at-least-once processing mechanism. The targeted response is: Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. Case evidence: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. This addresses a different issue involving s3 versus efs training storage choice. It does not correct the stated s3 object event at-least-once processing mechanism. The targeted response is: Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. Case evidence: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Keep restricted records and dependent training artifacts in approved regions and deny unauthorized replication or cross-region exports. This addresses a different issue involving model training data residency boundary. It does not correct the stated s3 object event at-least-once processing mechanism. The targeted response is: Make the ingestion handler idempotent using a stable object/version key and conditional ledger writes. Case evidence: An S3 event-triggered feature ingestion function processes the same uploaded object twice, creating duplicate labeled samples. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 336
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?
- Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable.
- Write throttles and iterator age fall under burst load without losing required ordering for related records.
- The transformed distribution is less skewed and inference uses identical guarded transformations.
- No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.
Explanation
Correct Answer
A:Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. This is the acceptance evidence for the described s3 versus efs training storage choice scenario. S3 object semantics differ from mounted shared filesystems; choose storage for workload access behavior. The corrective implementation it validates is: Place shared POSIX-style working files on suitable EFS or FSx storage and keep immutable large artifacts in S3. Reported signal: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Write throttles and iterator age fall under burst load without losing required ordering for related records. This could validate kinesis data streams shard hot key, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:The transformed distribution is less skewed and inference uses identical guarded transformations. This could validate skewed numerical feature log transformation, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This could validate group-leakage train and validation split, but it does not establish that s3 versus efs training storage choice is resolved for this workload. Confirm instead: Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. Observed problem: Several distributed workers repeatedly read small shared checkpoints with POSIX file semantics, but the pipeline treats object-storage paths as a mutable shared filesystem. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 337
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Change control requires measurable endpoint or pipeline acceptance evidence. Which measured outcome would confirm that the correction worked as intended?
- The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver.
- Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not.
- Large inputs complete without client request timeout and clients receive tracked result locations or failure notifications.
- The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure.
Explanation
Correct Answer
A:The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. This is the acceptance evidence for the described model registry version promotion provenance scenario. Immutable package versions and approval metadata connect evaluation with deployment; mutable S3 nicknames do not. The corrective implementation it validates is: Promote an explicitly approved SageMaker Model Registry package version through repeatable pipeline stages. Reported signal: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
B:Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. This could validate eventbridge conditional retraining trigger, but it does not establish that model registry version promotion provenance is resolved for this workload. Confirm instead: The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. Observed problem: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Large inputs complete without client request timeout and clients receive tracked result locations or failure notifications. This could validate asynchronous endpoint for large payloads, but it does not establish that model registry version promotion provenance is resolved for this workload. Confirm instead: The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. Observed problem: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:The selected hardware meets p95 latency and cost-per-request requirements under load without memory pressure. This could validate gpu versus cpu inference fit, but it does not establish that model registry version promotion provenance is resolved for this workload. Confirm instead: The production endpoint matches the reviewed model package and auditor can trace its evaluation and approver. Observed problem: A pipeline deploys a model directly from an unversioned notebook S3 path and cannot prove which evaluated candidate was approved. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 338
During a production MLOps reliability and security review, the following condition is observed: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. The owner needs an auditable resolution without broadening privileges. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs.
- Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values.
- Compare probability calibration plots, Brier score and event rates across recent labeled cohorts.
- Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence.
Explanation
Correct Answer
B:Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. This directly tests training-serving feature skew incident in the reported AWS ML workflow. Mismatched feature windows and update cadence can degrade production predictions even if training accuracy is stable. It distinguishes the problem before choosing a change. The related targeted response is: Use a consistent versioned feature definition and test offline/online values at the same observation cutoff. Reported signal: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect image layers, environment configuration, secret source, runtime role permissions, and rotation logs. This is a possible diagnostic for secret rotation for inference container credentials, but it does not directly test the training-serving feature skew incident failure reported here. Prioritize: Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. The relevant case is: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: During a production MLOps reliability and security review.
C:Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. This is a possible diagnostic for serving output confidence calibration drift, but it does not directly test the training-serving feature skew incident failure reported here. Prioritize: Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. The relevant case is: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: During a production MLOps reliability and security review.
D:Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. This is a possible diagnostic for cross-account s3 bucket exfiltration protection, but it does not directly test the training-serving feature skew incident failure reported here. Prioritize: Inspect online versus offline feature computation code, event-time cutoffs, freshness, and sampled entity values. The relevant case is: A real-time recommender fetches cached customer history updated hourly while offline training used a daily snapshot with different aggregation boundaries. Operational setting: During a production MLOps reliability and security review.
Question 339
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. The data team must preserve event-time meaning and lineage. Select TWO: the appropriate diagnostic check and the targeted implementation change.
- Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics.
- Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns.
- Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data.
- Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class.
- Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set.
Explanation
Correct Answers
D:Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This is the appropriate controlled remedy for ground truth labeling agreement review. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. Verify the cause with: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. Then confirm: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
E:Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. This directly tests ground truth labeling agreement review in the reported AWS ML workflow. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. It distinguishes the problem before choosing a change. The related targeted response is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Apply resampling only inside each training fold and evaluate untouched validation folds using precision and recall metrics. This selection concerns class imbalance handled inside cross-validation rather than the required diagnostic-and-remedy pair for ground truth labeling agreement review. Use evidence: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. and the matching correction: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect workload read/write semantics, shared access requirements, filesystem operations, and object-store request patterns. This selection concerns s3 versus efs training storage choice rather than the required diagnostic-and-remedy pair for ground truth labeling agreement review. Use evidence: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. and the matching correction: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Split first; fit the imputer only on the training partition and apply those learned statistics to validation and test data. This selection concerns median imputation fitted on training split rather than the required diagnostic-and-remedy pair for ground truth labeling agreement review. Use evidence: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. and the matching correction: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 340
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The experiment must be compared fairly against its prior baseline. Which TWO steps best establish the evidence and correct the identified root cause? Select TWO.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment.
- Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements.
- Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout.
- Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates.
Explanation
Correct Answers
C:Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. This directly tests xgboost tabular classification baseline in the reported AWS ML workflow. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. It distinguishes the problem before choosing a change. The related targeted response is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
E:Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. This is the appropriate controlled remedy for xgboost tabular classification baseline. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. Verify the cause with: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. Then confirm: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This selection concerns reproducible sagemaker experiments comparisons rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Select a licensed, task-appropriate model and validate its performance and resource needs before a controlled deployment. This selection concerns sagemaker jumpstart template provenance rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:Adapt the custom training container to SageMaker training job conventions and verify locally against a representative channel layout. This selection concerns training image compatibility for byoc rather than the required diagnostic-and-remedy pair for xgboost tabular classification baseline. Use evidence: Assess tabular feature structure, sample size, baseline metrics, inference constraints, and model interpretability requirements. and the matching correction: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: While reproducing a training incident in an independent SageMaker experiment.