Amazon AWS Certified AI Practitioner AIF-C01 Practice Test 10
Question 90
A clinic screening model rarely misses positive cases but often flags healthy patients; the team must explain recall versus precision. A colleague suggests: Quote only overall accuracy from an imbalanced screening dataset. Which finding BEST explains why the suggestion should be rejected?
- Accuracy can conceal poor performance on an important minority class
- The hosting choice changes infrastructure and maintenance responsibility
- The shortcut is safe because its terminology is familiar to the team
- Predictive accuracy does not quantify operating cost or business outcomes
Explanation
Correct Answer
A:Accuracy can conceal poor performance on an important minority class. This is the direct defect in the proposed action: Quote only overall accuracy from an imbalanced screening dataset.
Incorrect Answers
B:This concern belongs to another situation: An IT team compares consuming managed inference from an API with hosting its own model-serving runtime.
C:Familiar wording is not proof that an action is appropriate. The actual defect is: Accuracy can conceal poor performance on an important minority class.
D:This finding is associated with a different problem: A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy.
Question 91
A clinic screening model rarely misses positive cases but often flags healthy patients; the team must explain recall versus precision. After implementing Report both recall and precision with the false-positive tradeoff, which observation BEST verifies the intended result?
- The team schedules a future test of whether a confusion matrix supports separately calculated precision and recall, but has no result
- A controlled pilot reports manual-review time and cost savings alongside model metrics
- A confusion matrix supports separately calculated precision and recall
- The team approves Report both recall and precision with the false-positive tradeoff but does not run an operational test
Explanation
Correct Answer
C:The observed result, A confusion matrix supports separately calculated precision and recall, provides direct evidence. Recall measures detected positives while precision measures how often flagged positives are true.
Incorrect Answers
A:An unperformed future check is not evidence. Verify the actual outcome: A confusion matrix supports separately calculated precision and recall.
B:This observation would be evidence for another case: A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy, not the current scenario.
D:The required observable condition is: A confusion matrix supports separately calculated precision and recall.
Question 92
The initial scenario was: A clinic screening model rarely misses positive cases but often flags healthy patients; the team must explain recall versus precision. The original control is already in place. Now leadership next needs one combined summary of the two rates. Which ADDITIONAL action BEST addresses the new condition?
- A confusion matrix supports separately calculated precision and recall
- Quote only overall accuracy from an imbalanced screening dataset
- Calculate the F1 score as their harmonic mean
- Report both recall and precision with the false-positive tradeoff
Explanation
Correct Answer
C:Leadership next needs one combined summary of the two rates. The appropriate added action is: Calculate the F1 score as their harmonic mean.
Incorrect Answers
A:This describes evidence for the original approach, not a new action: A confusion matrix supports separately calculated precision and recall.
B:This original shortcut remains unsuitable: Accuracy can conceal poor performance on an important minority class.
D:This was the original control and is already implemented. Recall measures detected positives while precision measures how often flagged positives are true.
Question 93
A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy. Which TWO statements jointly identify the best initial approach and an observable verification result? (Select TWO.)
- Compare managed API operational simplicity with self-hosting control and maintenance
- Track recall and false negatives for the specific fraud class
- A controlled pilot reports manual-review time and cost savings alongside model metrics
- Treat accuracy as a complete monetary ROI measurement
- Add business KPIs and ROI to technical model metrics
Explanation
Correct Answers
C:Correct operating evidence. Observing a controlled pilot reports manual-review time and cost savings alongside model metrics verifies this approach instead of relying on unperformed plans.
E:Correct approach. Business success includes operational cost and value, not just predictive fit. This directly serves the stated situation: A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy.
Incorrect Answers
A:This addresses a different scenario: An IT team compares consuming managed inference from an API with hosting its own model-serving runtime. It does not constitute the requested approach or operating result for the current case.
B:This would be appropriate if the separate requirement arose: Managers later prioritize the minority fraud class missed by the model. That is not the present condition.
D:Predictive accuracy does not quantify operating cost or business outcomes. The suggested shortcut would not meet the present requirement.
Question 94
A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy. A colleague suggests: Treat accuracy as a complete monetary ROI measurement. Which finding BEST explains why the suggestion should be rejected?
- The shortcut is safe because its terminology is familiar to the team
- Predictive accuracy does not quantify operating cost or business outcomes
- The hosting choice changes infrastructure and maintenance responsibility
- Training accuracy is optimistically biased and not independent evidence
Explanation
Correct Answer
B:Predictive accuracy does not quantify operating cost or business outcomes. This is the direct defect in the proposed action: Treat accuracy as a complete monetary ROI measurement.
Incorrect Answers
A:Familiar wording is not proof that an action is appropriate. The actual defect is: Predictive accuracy does not quantify operating cost or business outcomes.
C:This finding is associated with a different problem: An IT team compares consuming managed inference from an API with hosting its own model-serving runtime.
D:This concern belongs to another situation: An ML team evaluates a classifier only on records it used for model fitting and claims its score predicts future accuracy.
Question 95
A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy. After implementing Add business KPIs and ROI to technical model metrics, which observation BEST verifies the intended result?
- A controlled pilot reports manual-review time and cost savings alongside model metrics
- The team approves Add business KPIs and ROI to technical model metrics but does not run an operational test
- A workload decision records cost, latency and operational ownership in a pilot
- The team schedules a future test of whether a controlled pilot reports manual-review time and cost savings alongside model metrics, but has no result
Explanation
Correct Answer
A:The observed result, A controlled pilot reports manual-review time and cost savings alongside model metrics, provides direct evidence. Business success includes operational cost and value, not just predictive fit.
Incorrect Answers
B:The required observable condition is: A controlled pilot reports manual-review time and cost savings alongside model metrics.
C:This observation would be evidence for another case: An IT team compares consuming managed inference from an API with hosting its own model-serving runtime, not the current scenario.
D:Verify the actual outcome: A controlled pilot reports manual-review time and cost savings alongside model metrics.
Question 96
The initial scenario was: A financial analyst wants an ML project evaluated by money saved per review and return on investment, not merely classifier accuracy. The original control is already in place. Now managers later prioritize the minority fraud class missed by the model. Which ADDITIONAL action BEST addresses the new condition?
- Treat accuracy as a complete monetary ROI measurement
- Track recall and false negatives for the specific fraud class
- A controlled pilot reports manual-review time and cost savings alongside model metrics
- Add business KPIs and ROI to technical model metrics
Explanation
Correct Answer
B:Managers later prioritize the minority fraud class missed by the model. The appropriate added action is: Track recall and false negatives for the specific fraud class.
Incorrect Answers
A:This original shortcut remains unsuitable: Predictive accuracy does not quantify operating cost or business outcomes.
C:This describes evidence for the original approach, not a new action: A controlled pilot reports manual-review time and cost savings alongside model metrics.
D:This was the original control and is already implemented. Business success includes operational cost and value, not just predictive fit.
Question 97
An IT team compares consuming managed inference from an API with hosting its own model-serving runtime. Which THREE statements together specify the correct approach, its rationale and direct evidence of operation? (Select THREE.)
- Managed inference reduces infrastructure ownership while self-hosting may require patching and scaling
- A workload decision records cost, latency and operational ownership in a pilot
- Reserve independent validation and test sets before assessing generalization
- The solution is confirmed merely because Compare managed API operational simplicity with self-hosting control and maintenance was approved on paper
- Assume managed APIs and self-hosting carry identical operational duties
- Compare managed API operational simplicity with self-hosting control and maintenance
Explanation
Correct Answers
A:Correct reasoning. This explicitly explains why the recommended action, Compare managed API operational simplicity with self-hosting control and maintenance, meets the described requirement.
B:Correct verification. Observing a workload decision records cost, latency and operational ownership in a pilot is operational evidence of the desired outcome.
F:Correct approach for this case. Managed inference reduces infrastructure ownership while self-hosting may require patching and scaling. It addresses the stated business requirement.
Incorrect Answers
C:This control applies instead to An ML team evaluates a classifier only on records it used for model fitting and claims its score predicts future accuracy. It is not a direct answer to the current scenario.
D:Approval of an action without testing is not evidence of effectiveness. Verify: A workload decision records cost, latency and operational ownership in a pilot.
E:Incorrect action: The hosting choice changes infrastructure and maintenance responsibility. It does not meet the present requirement.
Question 98
An IT team compares consuming managed inference from an API with hosting its own model-serving runtime. A colleague suggests: Assume managed APIs and self-hosting carry identical operational duties. Which finding BEST explains why the suggestion should be rejected?
- Text-to-speech service functionality is not a general ML training environment
- The hosting choice changes infrastructure and maintenance responsibility
- Training accuracy is optimistically biased and not independent evidence
- The shortcut is safe because its terminology is familiar to the team
Explanation
Correct Answer
B:The hosting choice changes infrastructure and maintenance responsibility. This is the direct defect in the proposed action: Assume managed APIs and self-hosting carry identical operational duties.
Incorrect Answers
A:This concern belongs to another situation: A company needs managed tools for preparing, training, evaluating, and deploying custom predictive models on AWS.
C:This finding is associated with a different problem: An ML team evaluates a classifier only on records it used for model fitting and claims its score predicts future accuracy.
D:Familiar wording is not proof that an action is appropriate. The actual defect is: The hosting choice changes infrastructure and maintenance responsibility.
Question 99
An IT team compares consuming managed inference from an API with hosting its own model-serving runtime. After implementing Compare managed API operational simplicity with self-hosting control and maintenance, which observation BEST verifies the intended result?
- A workload decision records cost, latency and operational ownership in a pilot
- The final report includes untouched test-set performance and data-split lineage
- The team schedules a future test of whether a workload decision records cost, latency and operational ownership in a pilot, but has no result
- The team approves Compare managed API operational simplicity with self-hosting control and maintenance but does not run an operational test
Explanation
Correct Answer
A:The observed result, A workload decision records cost, latency and operational ownership in a pilot, provides direct evidence. Managed inference reduces infrastructure ownership while self-hosting may require patching and scaling.
Incorrect Answers
B:This observation would be evidence for another case: An ML team evaluates a classifier only on records it used for model fitting and claims its score predicts future accuracy, not the current scenario.
C:Verify the actual outcome: A workload decision records cost, latency and operational ownership in a pilot.
D:The required observable condition is: A workload decision records cost, latency and operational ownership in a pilot.
Question 100
The initial scenario was: An IT team compares consuming managed inference from an API with hosting its own model-serving runtime. The original control is already in place. Now the product later needs a fully custom model trained on proprietary labeled examples. Which ADDITIONAL action BEST addresses the new condition?
- Compare managed API operational simplicity with self-hosting control and maintenance
- A workload decision records cost, latency and operational ownership in a pilot
- Assume managed APIs and self-hosting carry identical operational duties
- Evaluate a managed training workflow in SageMaker AI
Explanation
Correct Answer
D:The product later needs a fully custom model trained on proprietary labeled examples. The appropriate added action is: Evaluate a managed training workflow in SageMaker AI.
Incorrect Answers
A:This was the original control and is already implemented. Managed inference reduces infrastructure ownership while self-hosting may require patching and scaling.
B:This describes evidence for the original approach, not a new action: A workload decision records cost, latency and operational ownership in a pilot.
C:This original shortcut remains unsuitable: The hosting choice changes infrastructure and maintenance responsibility.