Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 116
Question 1150
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The team needs a defensible technical decision rather than an untracked workaround. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Inspect the supervised labels, text representation, model-input format, and the desired classification output.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
Explanation
Correct Answer
D:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This directly tests sagemaker script-mode data channel mismatch in the reported AWS ML workflow. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. It distinguishes the problem before choosing a change. The related targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
A:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Inspect the supervised labels, text representation, model-input format, and the desired classification output. This is a possible diagnostic for sagemaker built-in blazingtext choice, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
C:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This is a possible diagnostic for reproducible sagemaker experiments comparisons, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1151
As a regulated ML workload prepares for an automated regional rollout, the following condition is observed: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. The team must demonstrate a repeatable monitoring or security control. Which verification result BEST demonstrates that the issue is resolved?
- Changed feature distributions produce attributable violations even while endpoint availability remains healthy.
- A query isolates the failing job versions and recurring error class within the incident interval.
- A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions.
- Parity checks match transformations within documented freshness tolerances for test entities.
Explanation
Correct Answer
C:A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. This is the acceptance evidence for the described inference recommender benchmarking instance family scenario. Rightsizing depends on workload measurements rather than the training machine or instance size alone. The corrective implementation it validates is: Use SageMaker Inference Recommender or equivalent controlled load tests to rightsize the serving instance family. Reported signal: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Incorrect Answers
A:Changed feature distributions produce attributable violations even while endpoint availability remains healthy. This could validate sagemaker model monitor feature drift baseline, but it does not establish that inference recommender benchmarking instance family is resolved for this workload. Confirm instead: A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. Observed problem: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
B:A query isolates the failing job versions and recurring error class within the incident interval. This could validate cloudwatch logs insights error correlation, but it does not establish that inference recommender benchmarking instance family is resolved for this workload. Confirm instead: A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. Observed problem: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
D:Parity checks match transformations within documented freshness tolerances for test entities. This could validate training-serving feature skew incident, but it does not establish that inference recommender benchmarking instance family is resolved for this workload. Confirm instead: A chosen instance meets throughput and latency targets at lower measured cost per thousand predictions. Observed problem: A model is deployed to a large general-purpose instance based only on notebook habits, with no comparison of lower-cost inference-optimized choices. Operational setting: As a regulated ML workload prepares for an automated regional rollout.
Question 1152
During an approved rollout of an AWS ML inference workload, the following condition is observed: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. The team must meet its documented availability and rollback constraints. Which measured outcome would confirm that the correction worked as intended?
- The endpoint applies the same preprocessor to every client request and produces the expected model input schema.
- Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not.
- The build uploads signed artifacts successfully while unauthorized buckets and prefixes remain denied.
- Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost.
Explanation
Correct Answer
B:Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. This is the acceptance evidence for the described eventbridge conditional retraining trigger scenario. Event-driven automation needs selective event patterns and readiness checks; every object-write event is not a retraining signal. The corrective implementation it validates is: Filter appropriate validated data-ready events and trigger retraining only after the required dataset manifest is complete. Reported signal: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: During an approved rollout of an AWS ML inference workload.
Incorrect Answers
A:The endpoint applies the same preprocessor to every client request and produces the expected model input schema. This could validate multi-container inference pipeline responsibilities, but it does not establish that eventbridge conditional retraining trigger is resolved for this workload. Confirm instead: Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. Observed problem: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: During an approved rollout of an AWS ML inference workload.
C:The build uploads signed artifacts successfully while unauthorized buckets and prefixes remain denied. This could validate codebuild iam least-privilege artifact upload, but it does not establish that eventbridge conditional retraining trigger is resolved for this workload. Confirm instead: Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. Observed problem: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: During an approved rollout of an AWS ML inference workload.
D:Distinct requested model IDs return correct predictions with acceptable cold load latency and lower aggregate idle cost. This could validate multi-model endpoint hosting tradeoff, but it does not establish that eventbridge conditional retraining trigger is resolved for this workload. Confirm instead: Only the intended completed data batch launches one controlled training workflow, while unrelated objects do not. Observed problem: An ML system retrains on every S3 object event even when the object is a debug file, wasting resources and changing model versions unexpectedly. Operational setting: During an approved rollout of an AWS ML inference workload.
Question 1153
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. The release is blocked until the underlying model behavior is understood. What should the ML engineer inspect FIRST to distinguish this failure from unrelated issues?
- Compare training and validation curves, coefficient magnitudes, and error by split.
- Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint.
- Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions.
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
Explanation
Correct Answer
D:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This directly tests sagemaker script-mode data channel mismatch in the reported AWS ML workflow. Managed training channels have explicit mounted locations; notebook-local paths are not portable contracts. It distinguishes the problem before choosing a change. The related targeted response is: Read the configured SageMaker training channel path or environment variable and fail clearly on missing input. Reported signal: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:Compare training and validation curves, coefficient magnitudes, and error by split. This is a possible diagnostic for overfitting reduced with l2 regularization, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
B:Review model card, supported task, license terms, sample inference, evaluation evidence, and required compute footprint. This is a possible diagnostic for sagemaker jumpstart template provenance, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Inspect experiment run lineage, dataset/version hashes, code revisions, random seeds, and metric definitions. This is a possible diagnostic for reproducible sagemaker experiments comparisons, but it does not directly test the sagemaker script-mode data channel mismatch failure reported here. Prioritize: Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. The relevant case is: A custom training script searches for local ./data/train.csv although SageMaker mounted the training channel at a different container path. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1154
During a controlled replay of the data-preparation workflow in a separate ML staging account, the following condition is observed: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. The dataset contract must remain reproducible for a backfill. Which verification result BEST demonstrates that the issue is resolved?
- Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable.
- Memory use stays within limits and previously unseen categories are processed without dimension mismatch.
- A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts.
- Neighboring times across midnight map close in cyclic feature space and validation improves without leakage.
Explanation
Correct Answer
D:Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. This is the acceptance evidence for the described time-series cyclical calendar feature scenario. Time-of-day has periodic topology; raw integer distance does not represent wraparound. The corrective implementation it validates is: Encode hour with sine and cosine cyclic features and validate with a time-aware split. Reported signal: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Incorrect Answers
A:Concurrent workers observe consistent supported shared-file operations and training artifact delivery remains durable. This could validate s3 versus efs training storage choice, but it does not establish that time-series cyclical calendar feature is resolved for this workload. Confirm instead: Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. Observed problem: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
B:Memory use stays within limits and previously unseen categories are processed without dimension mismatch. This could validate high-cardinality categorical encoding, but it does not establish that time-series cyclical calendar feature is resolved for this workload. Confirm instead: Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. Observed problem: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
C:A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This could validate model training data residency boundary, but it does not establish that time-series cyclical calendar feature is resolved for this workload. Confirm instead: Neighboring times across midnight map close in cyclic feature space and validation improves without leakage. Observed problem: A demand model treats hour 23 and hour 0 as far apart when integer hour is used as a linear continuous feature. Operational setting: During a controlled replay of the data-preparation workflow in a separate ML staging account.
Question 1155
While reproducing the alert in an isolated AWS ML integration account, the following condition is observed: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. The proposed change must preserve logging and least privilege. Which investigation provides the most decisive FIRST evidence for the underlying problem?
- Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls.
- Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest.
- Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution.
- Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics.
Explanation
Correct Answer
A:Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. This directly tests cloudtrail training data access audit coverage in the reported AWS ML workflow. CloudTrail management events do not by default include every S3 object read; data-event selection provides that visibility. It distinguishes the problem before choosing a change. The related targeted response is: Enable appropriate CloudTrail S3 data events for the sensitive dataset with protected storage and retention. Reported signal: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Incorrect Answers
B:Compare evaluated artifact hash, S3 object version, package provenance, and deployment manifest. This is a possible diagnostic for model artifact supply-chain integrity, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
C:Inspect endpoint 5XXErrors, InvocationsPerInstance, instance availability, and per-minute latency distribution. This is a possible diagnostic for cloudwatch 5xxerrors endpoint saturation, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
D:Inspect async inference backlog size, age of oldest request, worker capacity and completion/error metrics. This is a possible diagnostic for asynchronous inference queue backlog alert, but it does not directly test the cloudtrail training data access audit coverage failure reported here. Prioritize: Inspect CloudTrail management events, data event selectors, S3 bucket coverage, and log retention controls. The relevant case is: A compliance reviewer can see SageMaker CreateTrainingJob API calls but not object-level reads from the sensitive S3 training dataset. Operational setting: While reproducing the alert in an isolated AWS ML integration account.
Question 1156
At a production AWS ML data lake supporting customer-facing predictions, the following condition is observed: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Engineers must avoid changing unrelated source partitions. What postchange observation provides the strongest acceptance evidence?
- A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts.
- No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients.
- Training read time and object operations decline while the resulting row count and checksums match.
- Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path.
Explanation
Correct Answer
C:Training read time and object operations decline while the resulting row count and checksums match. This is the acceptance evidence for the described columnar file compaction for small objects scenario. Excessive small files create metadata and request overhead even with a columnar data format. The corrective implementation it validates is: Compact the partitioned dataset into appropriately sized Parquet objects without changing the record keys or schema. Reported signal: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Incorrect Answers
A:A test batch remains in the approved region with enforceable policy and audit evidence for all derived artifacts. This could validate model training data residency boundary, but it does not establish that columnar file compaction for small objects is resolved for this workload. Confirm instead: Training read time and object operations decline while the resulting row count and checksums match. Observed problem: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
B:No patient identifier crosses split boundaries and evaluation reflects generalization to unseen patients. This could validate group-leakage train and validation split, but it does not establish that columnar file compaction for small objects is resolved for this workload. Confirm instead: Training read time and object operations decline while the resulting row count and checksums match. Observed problem: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
D:Both supported source versions produce the agreed typed feature, and invalid values enter an auditable reject path. This could validate glue schema evolution with mixed input types, but it does not establish that columnar file compaction for small objects is resolved for this workload. Confirm instead: Training read time and object operations decline while the resulting row count and checksums match. Observed problem: A daily S3 dataset consists of millions of tiny Parquet files, and training startup spends more time opening objects than scanning data. Operational setting: At a production AWS ML data lake supporting customer-facing predictions.
Question 1157
During production evaluation of a SageMaker AI model candidate, the following condition is observed: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. The release is blocked until the underlying model behavior is understood. Which verification result BEST demonstrates that the issue is resolved?
- A rolling-origin backtest improves multi-step forecast error and respects temporal order.
- The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset.
- Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs.
- Gradient norms stay within the chosen range and training loss remains finite under representative batches.
Explanation
Correct Answer
B:The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. This is the acceptance evidence for the described xgboost tabular classification baseline scenario. Gradient-boosted trees are a practical strong baseline for structured tabular features without needing an image model architecture. The corrective implementation it validates is: Train a gradient-boosted tree baseline such as SageMaker XGBoost and compare it against more complex candidates. Reported signal: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Incorrect Answers
A:A rolling-origin backtest improves multi-step forecast error and respects temporal order. This could validate time-series forecast horizon and seasonality, but it does not establish that xgboost tabular classification baseline is resolved for this workload. Confirm instead: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. Observed problem: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
C:Fraud recall meets the agreed target with documented review-volume and false-positive tradeoffs. This could validate precision versus recall fraud threshold, but it does not establish that xgboost tabular classification baseline is resolved for this workload. Confirm instead: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. Observed problem: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
D:Gradient norms stay within the chosen range and training loss remains finite under representative batches. This could validate model debugger exploding gradient diagnosis, but it does not establish that xgboost tabular classification baseline is resolved for this workload. Confirm instead: The tabular baseline meets recall, cost, and latency constraints on a representative held-out dataset. Observed problem: A fraud model has structured transaction attributes and labeled outcomes, but engineers start with a large image neural network despite limited compute and few features. Operational setting: During production evaluation of a SageMaker AI model candidate.
Question 1158
While testing a second region for recoverable deployment of the same ML service, the following condition is observed: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. The deployment must be reproducible without manual console-only fixes. Which measured outcome would confirm that the correction worked as intended?
- A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end.
- Both regions match their approved parameterized templates and subsequent deployments remain repeatable.
- A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag.
- Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs.
Explanation
Correct Answer
A:A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. This is the acceptance evidence for the described continuous integration unit and endpoint contract tests scenario. A successful training job does not prove the deployed inference API still satisfies consumer contracts. The corrective implementation it validates is: Add schema, integration and sample endpoint inference tests to the ML build and deployment pipeline. Reported signal: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Incorrect Answers
B:Both regions match their approved parameterized templates and subsequent deployments remain repeatable. This could validate cloudformation stack parameter drift, but it does not establish that continuous integration unit and endpoint contract tests is resolved for this workload. Confirm instead: A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. Observed problem: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
C:A synthetic load surge meets error and latency SLOs without rejected provisioning due to quota or startup lag. This could validate endpoint scale-to-zero cold capacity planning, but it does not establish that continuous integration unit and endpoint contract tests is resolved for this workload. Confirm instead: A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. Observed problem: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
D:Repeated runs with the same inputs reproduce the ordered processing and generate auditable versioned outputs. This could validate sagemaker pipelines parameterized retraining, but it does not establish that continuous integration unit and endpoint contract tests is resolved for this workload. Confirm instead: A deliberately incompatible payload causes CI to block promotion and a compatible fixture passes end to end. Observed problem: A data-science team tests only that a training script executes, but deployment repeatedly breaks because client JSON fields changed. Operational setting: While testing a second region for recoverable deployment of the same ML service.
Question 1159
At the model-governance gate before promotion of a new ML artifact, the following condition is observed: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. The team needs a defensible technical decision rather than an untracked workaround. Which TWO complementary choices provide the decisive diagnosis AND corrective response? Select TWO.
- Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence.
- Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold.
- Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract.
- Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout.
- Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths.
Explanation
Correct Answers
A:Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This is the appropriate controlled remedy for roc-auc versus pr-auc for rare events. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. Verify the cause with: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. Then confirm: The tested alert rate and precision match the production workload rather than an optimistic single ROC figure. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
B:Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. This directly tests roc-auc versus pr-auc for rare events in the reported AWS ML workflow. With rare positive classes, precision and operational false-alert counts can be more revealing than ROC-AUC alone. It distinguishes the problem before choosing a change. The related targeted response is: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. This is one part of a select-two decision; the matching evidence and corrective action are both required. Reported signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Incorrect Answers
C:Use tracked SageMaker Experiments runs with fixed comparable evaluation splits and a documented metric contract. This selection concerns reproducible sagemaker experiments comparisons rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
D:Increase justified L2 regularization or reduce model capacity and revalidate with an untouched holdout. This selection concerns overfitting reduced with l2 regularization rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
E:Inspect training job InputDataConfig, environment variables such as SM_CHANNEL_TRAINING, and container paths. This selection concerns sagemaker script-mode data channel mismatch rather than the required diagnostic-and-remedy pair for roc-auc versus pr-auc for rare events. Use evidence: Measure class prevalence, precision-recall curve, ROC curve, and alert volume at the intended operating threshold. and the matching correction: Evaluate PR-AUC and precision at required recall alongside ROC-AUC, and select a deployment threshold for actual prevalence. Signal: A rare equipment-failure classifier reports a high ROC-AUC but its operational queue contains mostly false alarms. Operational setting: At the model-governance gate before promotion of a new ML artifact.
Question 1160
As a regional data-pipeline rollout is validated against approved AWS storage and streams, the following condition is observed: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. The data team must preserve event-time meaning and lineage. Which observation most directly identifies the root cause of the reported behavior?
- Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records.
- Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training.
- Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint.
- Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag.
Explanation
Correct Answer
D:Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. This directly tests kinesis data streams shard hot key in the reported AWS ML workflow. Kinesis shard throughput is bounded; a hot partition key can overload one shard despite spare total stream capacity. It distinguishes the problem before choosing a change. The related targeted response is: Choose partition keys with enough cardinality or reshard the stream for the intended throughput, while preserving required per-key ordering. Reported signal: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
Incorrect Answers
A:Inspect event timestamps, ingest timestamps, watermark configuration, and window outputs for delayed sample records. This is a possible diagnostic for streaming feature rolling window correctness, but it does not directly test the kinesis data streams shard hot key failure reported here. Prioritize: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. The relevant case is: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
B:Inspect feature scale distributions, model sensitivity, and whether fitted scaler statistics are shared across serving and training. This is a possible diagnostic for standardization of numerical features, but it does not directly test the kinesis data streams shard hot key failure reported here. Prioritize: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. The relevant case is: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.
C:Check job names, bookmark settings, run history, source object timestamps, and the previously committed checkpoint. This is a possible diagnostic for glue job bookmark state error, but it does not directly test the kinesis data streams shard hot key failure reported here. Prioritize: Compare per-shard incoming records, write throttles, partition-key cardinality, and enhanced fan-out consumer lag. The relevant case is: A real-time feature consumer lags only for one tenant because producers use the same partition key for most high-volume events. Operational setting: As a regional data-pipeline rollout is validated against approved AWS storage and streams.