Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 33
Question 320
During an approved rollout of an AWS ML inference workload, the following condition is observed: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. The team must meet its documented availability and rollback constraints. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs.
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
Explanation
Correct Answer
D:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This directly tests codebuild iam least-privilege artifact upload in the reported AWS ML workflow. Artifact publishing often requires S3 and KMS permissions, but broad administrative permissions are unnecessary and unsafe. It distinguishes the problem before choosing a change. The related targeted response is: Grant the build role only required object and key operations for its specific artifact prefix and encryption key. Reported signal: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:Inspect model registry package versions, approval metadata, artifact hashes, and pipeline deployment inputs. This is a possible diagnostic for model registry version promotion provenance, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
B:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This is a possible diagnostic for sagemaker neo edge compiler compatibility, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
C:Inspect payload sizes, model processing duration, caller timeout limits, and request concurrency. This is a possible diagnostic for asynchronous endpoint for large payloads, but it does not directly test the codebuild iam least-privilege artifact upload failure reported here. Prioritize: Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. The relevant case is: A model package build fails to upload to the designated S3 artifact bucket, and engineers propose granting AdministratorAccess to the build role. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 321
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. The data team must preserve event-time meaning and lineage. Which measured outcome would confirm that the correction worked as intended?
- Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings.
- No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases.
- Agreement on a held-out gold set rises without silently discarding rare legitimate classes.
- Neighboring times across midnight map close in cyclic feature space and validation improves without leakage.
Explanation
Correct Answer
C:Agreement on a held-out gold set rises without silently discarding rare legitimate classes. This is the acceptance evidence for the described ground truth labeling agreement review scenario. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. The corrective implementation it validates is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Annotation workers can label required content without viewing direct identifiers and authorized audits can trace approved mappings. This could validate pii masking before model labeling, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:No synthetic or duplicated minority instance leaks into held-out folds, and minority-class recall reflects genuine unseen cases. This could validate class imbalance handled inside cross-validation, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
D:Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. This could validate time-series cyclical calendar feature, but it does not establish that ground truth labeling agreement review is resolved for this workload. Confirm instead: Agreement on a held-out gold set rises without silently discarding rare legitimate classes. Observed problem: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Question 322
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. The proposed change must preserve logging and least privilege. Which verification result BEST demonstrates that the issue is resolved?
- Parity checks match transformations within documented freshness tolerances for test entities.
- Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms.
- An authorized training read emits attributable S3 object-access events while alerting detects unexpected access.
- A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied.
Explanation
Correct Answer
C:An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. This is the acceptance evidence for the described cloudtrail training data access audit coverage scenario. CloudTrail management events do not by default include every S3 object read; data-event selection provides that visibility. The corrective implementation it validates is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Reported signal: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
A:Parity checks match transformations within documented freshness tolerances for test entities. This could validate training-serving feature skew incident, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
B:Peak-window 5xx rate and p95 latency fall below service objectives with verified alarms. This could validate cloudwatch 5xxerrors endpoint saturation, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:A test write to an approved prefix succeeds, while writes to unapproved external destinations are denied. This could validate cross-account s3 bucket exfiltration protection, but it does not establish that cloudtrail training data access audit coverage is resolved for this workload. Confirm instead: An authorized training read emits attributable S3 object-access events while alerting detects unexpected access. Observed problem: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 323
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. The team must demonstrate a repeatable monitoring or security control. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics.
- Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies.
- Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts.
- Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest.
Explanation
Correct Answer
C:Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. This directly tests sagemaker model monitor feature drift baseline in the reported AWS ML workflow. Endpoint uptime does not demonstrate feature-distribution stability; monitoring compares current inputs with expected statistics. It distinguishes the problem before choosing a change. The related targeted response is: Configure data capture and an appropriate Model Monitor baseline with scheduled data-quality checks. Reported signal: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Inspect group-level prediction and label distributions, subgroup sample sizes, and configured bias metrics. This is a possible diagnostic for clarify postdeployment group bias monitoring, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:Inspect subnet routes, VPC interface endpoints, private DNS settings, endpoint security groups, and endpoint policies. This is a possible diagnostic for private vpc endpoint policy for sagemaker apis, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. This is a possible diagnostic for model artifact supply-chain integrity, but it does not directly test the sagemaker model monitor feature drift baseline failure reported here. Prioritize: Compare incoming captured feature statistics against a stored training baseline and review SageMaker Model Monitor drift alerts. The relevant case is: A deployed credit-risk model begins receiving applicants with income distributions unlike training data, but dashboard operators only track endpoint HTTP 200 rates. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 324
While reproducing a training incident in an independent SageMaker experiment, the following condition is observed: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. The experiment must be compared fairly against its prior baseline. What postchange observation provides the strongest acceptance evidence?
- Holdout quality stays acceptable while model size and run-to-run instability decrease.
- Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy.
- Held-out messages receive the intended class predictions and macro-averaged quality is measurable.
- The fine-tuned model improves task accuracy without collapsing pretrained representations.
Explanation
Correct Answer
C:Held-out messages receive the intended class predictions and macro-averaged quality is measurable. This is the acceptance evidence for the described sagemaker built-in blazingtext choice scenario. Supervised text classification requires labels and task-specific evaluation rather than unlabeled similarity clusters. The corrective implementation it validates is: Use an appropriate text classification model or supported SageMaker BlazingText supervised approach with validated labels. Reported signal: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Incorrect Answers
A:Holdout quality stays acceptable while model size and run-to-run instability decrease. This could validate feature selection to reduce overparameterization, but it does not establish that sagemaker built-in blazingtext choice is resolved for this workload. Confirm instead: Held-out messages receive the intended class predictions and macro-averaged quality is measurable. Observed problem: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
B:Stable clusters exhibit interpretable differences in held-out descriptors without claiming supervised classification accuracy. This could validate clustering for unlabeled customer segments, but it does not establish that sagemaker built-in blazingtext choice is resolved for this workload. Confirm instead: Held-out messages receive the intended class predictions and macro-averaged quality is measurable. Observed problem: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
D:The fine-tuned model improves task accuracy without collapsing pretrained representations. This could validate fine-tuning pretrained model learning-rate stability, but it does not establish that sagemaker built-in blazingtext choice is resolved for this workload. Confirm instead: Held-out messages receive the intended class predictions and macro-averaged quality is measurable. Observed problem: A support team needs text classification using labeled messages, but engineers choose a clustering algorithm that produces no class-specific predictions. Operational setting: While reproducing a training incident in an independent SageMaker experiment.
Question 325
During a production MLOps reliability and security review, the following condition is observed: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. The owner needs an auditable resolution without broadening privileges. Which observation most directly identifies the root cause of the reported behavior?
- Compare probability calibration plots, Brier score and event rates across recent labeled cohorts.
- Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types.
- Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements.
- Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence.
Explanation
Correct Answer
C:Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. This directly tests spot training cost versus interruption recovery in the reported AWS ML workflow. Spot savings depend on interruption handling; a lower hourly rate is not a guarantee of lower total job cost. It distinguishes the problem before choosing a change. The related targeted response is: Use supported managed Spot Training with durable checkpoints for interruptible phases and retain On-Demand capacity when deadlines demand it. Reported signal: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Compare probability calibration plots, Brier score and event rates across recent labeled cohorts. This is a possible diagnostic for serving output confidence calibration drift, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: During a production MLOps reliability and security review.
B:Inspect resource tags, cost allocation tag activation, Cost Explorer grouping, and unallocated resource types. This is a possible diagnostic for tag-based ml training cost attribution, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: During a production MLOps reliability and security review.
D:Inspect identity and destination bucket policies, resource ARNs, organization restrictions, and CloudTrail data-event evidence. This is a possible diagnostic for cross-account s3 bucket exfiltration protection, but it does not directly test the spot training cost versus interruption recovery failure reported here. Prioritize: Inspect training interruption tolerance, persistent checkpoints, allowed instance families, and deadline requirements. The relevant case is: A long training workflow uses only On-Demand capacity even though checkpoints and flexible completion time permit interruptions, and its compute cost breaches target. Operational setting: During a production MLOps reliability and security review.
Question 326
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Change control requires measurable endpoint or pipeline acceptance evidence. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance.
- Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost.
- Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events.
- Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow.
- Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing.
Explanation
Correct Answers
B:Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. This directly tests real-time versus batch inference decision in the reported AWS ML workflow. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. It distinguishes the problem before choosing a change. The related targeted response is: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. This is the appropriate controlled remedy for real-time versus batch inference decision. Batch inference suits asynchronous bulk datasets without an interactive low-latency response requirement. Verify the cause with: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. Then confirm: The overnight batch completes within its service window while there is no idle always-on inference endpoint charge. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Configure a justified endpoint variant auto scaling policy using a workload-relevant supported metric such as invocations per instance. This selection concerns sagemaker endpoint auto scaling metric selection rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
C:Inspect CodeBuild execution-role policy, bucket policy, KMS permissions, and denied CloudTrail events. This selection concerns codebuild iam least-privilege artifact upload rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
E:Use a compatible SageMaker inference pipeline with ordered containers or a single packaged equivalent for shared preprocessing. This selection concerns multi-container inference pipeline responsibilities rather than the required diagnostic-and-remedy pair for real-time versus batch inference decision. Use evidence: Inspect invocation cadence, acceptable completion window, per-record latency requirement, and idle endpoint cost. and the matching correction: Use a SageMaker Batch Transform or batch inference job for the scheduled bulk scoring workflow. Signal: A customer scoring workload runs only once nightly over millions of S3 records, but a team provisions a permanently running low-latency endpoint for it. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 327
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Engineers must avoid changing unrelated source partitions. Which observation most directly identifies the root cause of the reported behavior?
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report.
- Inspect categorical cardinality, sparse matrix dimensions, feature contribution, and generalization to unseen identifiers.
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
Explanation
Correct Answer
D:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This directly tests streaming feature rolling window correctness in the reported AWS ML workflow. Processing-time windows depend on arrival timing; event-time windows need explicit watermarks and late-event policy. It distinguishes the problem before choosing a change. The related targeted response is: Define event-time windows with appropriate lateness handling and a documented revision policy for late records. Reported signal: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the streaming feature rolling window correctness failure reported here. Prioritize: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. The relevant case is: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:Inspect group sample sizes, label-positive fractions, and the appropriate SageMaker Clarify pretraining bias report. This is a possible diagnostic for clarify label imbalance measurement, but it does not directly test the streaming feature rolling window correctness failure reported here. Prioritize: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. The relevant case is: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Inspect categorical cardinality, sparse matrix dimensions, feature contribution, and generalization to unseen identifiers. This is a possible diagnostic for high-cardinality categorical encoding, but it does not directly test the streaming feature rolling window correctness failure reported here. Prioritize: Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. The relevant case is: A near-real-time account feature sums transactions using processing time, so late-arriving events land in the wrong window and produce inconsistent scores. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 328
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Engineers must avoid changing unrelated source partitions. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set.
- Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls.
- Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag.
- Inspect prediction errors around midnight and feature representations for the periodic hour variable.
Explanation
Correct Answer
A:Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. This directly tests ground truth labeling agreement review in the reported AWS ML workflow. Majority vote does not guarantee semantic correctness when instructions are ambiguous or a class is rare. It distinguishes the problem before choosing a change. The related targeted response is: Revise instructions, route ambiguous samples for expert adjudication, and monitor label quality per class. Reported signal: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
B:Inspect S3 replication rules, region-specific bucket policies, Glue job destinations, KMS keys, and applicable residency controls. This is a possible diagnostic for model training data residency boundary, but it does not directly test the ground truth labeling agreement review failure reported here. Prioritize: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. The relevant case is: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
C:Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. This is a possible diagnostic for kinesis data streams shard hot key, but it does not directly test the ground truth labeling agreement review failure reported here. Prioritize: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. The relevant case is: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Inspect prediction errors around midnight and feature representations for the periodic hour variable. This is a possible diagnostic for time-series cyclical calendar feature, but it does not directly test the ground truth labeling agreement review failure reported here. Prioritize: Inspect per-class confusion, worker agreement, label instructions, and disagreements on an adjudicated reference set. The relevant case is: Three SageMaker Ground Truth annotators assign conflicting labels to borderline product photos, but a training job assumes all majority votes are gold. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 329
During an operational load and release rehearsal for SageMaker-hosted inference, the following condition is observed: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Change control requires measurable endpoint or pipeline acceptance evidence. Which observation most directly identifies the root cause of the reported behavior?
- Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests.
- Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits.
- Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format.
- Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract.
Explanation
Correct Answer
C:Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. This directly tests sagemaker neo edge compiler compatibility in the reported AWS ML workflow. Edge optimization depends on target hardware and supported operations, not merely copying a cloud training artifact. It distinguishes the problem before choosing a change. The related targeted response is: Compile the supported model for the specific edge target using SageMaker Neo or choose a compatible conversion route. Reported signal: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Incorrect Answers
A:Inspect deployment guardrail alarms, variant routing, old configuration retention, and rollback tests. This is a possible diagnostic for blue-green endpoint rollback after health failure, but it does not directly test the sagemaker neo edge compiler compatibility failure reported here. Prioritize: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. The relevant case is: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
B:Profile request arrival intervals, cold-start tolerance, memory needs, and compatible serverless inference limits. This is a possible diagnostic for serverless inference for intermittent requests, but it does not directly test the sagemaker neo edge compiler compatibility failure reported here. Prioritize: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. The relevant case is: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
D:Inspect container startup logs, listening port, health endpoint, MIME types, and inference response contract. This is a possible diagnostic for bring-your-own-inference-container contract, but it does not directly test the sagemaker neo edge compiler compatibility failure reported here. Prioritize: Inspect target processor, supported Neo compiler configurations, operator compatibility, and deployment artifact format. The relevant case is: An edge vision model is deployed to a constrained device with a framework binary and operators assume any model artifact runs on its target accelerator. Operational setting: During an operational load and release rehearsal for SageMaker-hosted inference.
Question 330
During a production MLOps reliability and security review, the following condition is observed: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. The owner needs an auditable resolution without broadening privileges. Which observation most directly identifies the root cause of the reported behavior?
- Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs.
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
Explanation
Correct Answer
D:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This directly tests cloudwatch 5xxerrors endpoint saturation in the reported AWS ML workflow. Daily averages can conceal short capacity failures; monitoring must use an incident-relevant interval. It distinguishes the problem before choosing a change. The related targeted response is: Configure actionable alarms, capacity, and supported scaling or backpressure based on the burst window. Reported signal: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
Incorrect Answers
A:Inspect consistent log group names, job identifiers, timestamps, and failure codes in CloudWatch Logs. This is a possible diagnostic for cloudwatch logs insights error correlation, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
B:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This is a possible diagnostic for cloudtrail training data access audit coverage, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.
C:Inspect S3 object encryption, key policy, grant permissions, IAM role, and denied KMS decrypt events. This is a possible diagnostic for s3 sse-kms cross-account model artifact access, but it does not directly test the cloudwatch 5xxerrors endpoint saturation failure reported here. Prioritize: Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. The relevant case is: A recommendation endpoint drops peak requests with HTTP 5xx as invocations per instance rise, while the dashboard averages latency across an entire day. Operational setting: During a production MLOps reliability and security review.