Isaca AAIA Practice Test 66
Question 650
An independent AI auditor reviews this case: A claims department disputes a denied payment but the system retained only the final score and not model version. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Define owner-led ongoing monitoring for quality, drift, safety, fairness and service impact with escalation.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Inspect feedback source identities, adjudication rates, unusual bursts, retraining eligibility and rollback.
- Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
Explanation
Correct Answers
C:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. In this case: A claims department disputes a denied payment but the system retained only the final score and not model version.
E:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. For this situation: A claims department disputes a denied payment but the system retained only the final score and not model version.
Incorrect Answers
A:This option concerns AI post-deployment monitoring and KRI ownership, which is a related but different AI governance concern. For this situation: A claims department disputes a denied payment but the system retained only the final score and not model version.
B:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. For this situation: A claims department disputes a denied payment but the system retained only the final score and not model version.
D:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. It does not establish control effectiveness for AI decision logs and explanation traceability.
Question 651
A governance and assurance review uncovers the following: A claims department disputes a denied payment but the system retained only the final score and not model version. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Inspect signed use cases, requirement trace matrix, outcome thresholds, known limitations and test cases.
- Inspect live KPIs and KRIs, baselines, incident triggers, ownership and corrective decisions.
Explanation
Correct Answer
B:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. This evidence directly tests the asserted control for AI decision logs and explanation traceability: Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
Incorrect Answers
A:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. The auditor should instead examine: Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
C:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. For this situation: A claims department disputes a denied payment but the system retained only the final score and not model version.
D:This option concerns AI post-deployment monitoring and KRI ownership, which is a related but different AI governance concern. The decisive principle here is: Auditability of an AI decision depends on traceable context, not just a final predicted label.
Question 652
A risk-based audit engagement examines this operating condition: A claims department disputes a denied payment but the system retained only the final score and not model version. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Approved feedback improves measured outcomes without adversarial self-reinforcing error.
- An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
- Each material requirement maps to a result and signoff before deploying the feature.
Explanation
Correct Answer
C:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. This is an observable validation result for AI decision logs and explanation traceability, not just management assurance: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
Incorrect Answers
A:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. Effective closure requires: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
B:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. For this situation: A claims department disputes a denied payment but the system retained only the final score and not model version.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. The decisive principle here is: Auditability of an AI decision depends on traceable context, not just a final predicted label.
Question 653
An audit committee asks for a defensible assessment of this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Define calibrated thresholds and safe defer-to-human or rule-based fallbacks for uncertain or missing-data conditions.
- Design actionable challenge, human reassessment, factual correction and remediation for adverse AI decisions.
- Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
Explanation
Correct Answer
C:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. In this case: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
Incorrect Answers
A:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. It does not establish control effectiveness for AI decision logs and explanation traceability.
B:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. It does not establish control effectiveness for AI decision logs and explanation traceability.
D:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. In this case: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
Question 654
During an AI controls assessment, the team learns that a hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- An appeal path is meaningful when it can correct underlying facts and change outcomes where justified.
- Auditability of an AI decision depends on traceable context, not just a final predicted label.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Feedback improves models only when its quality and susceptibility to manipulation are controlled.
Explanation
Correct Answer
B:The acceptable verified outcome is: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data. This is the applicable AI audit principle for AI decision logs and explanation traceability: Auditability of an AI decision depends on traceable context, not just a final predicted label.
Incorrect Answers
A:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. For this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
C:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. For this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
D:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. The decisive principle here is: Auditability of an AI decision depends on traceable context, not just a final predicted label.
Question 655
An independent AI auditor reviews this case: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect calibration, confusion matrices, missing-input behavior, escalation queue and approval history.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Inspect signed use cases, requirement trace matrix, outcome thresholds, known limitations and test cases.
Explanation
Correct Answer
C:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. The corrective action is: Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
Incorrect Answers
A:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. For this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
B:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. In this case: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
Question 656
A governance and assurance review uncovers the following: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Approved feedback improves measured outcomes without adversarial self-reinforcing error.
- An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- An independent rerun can identify the exact source data and material transformation decisions for a sampled model version.
Explanation
Correct Answer
B:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. Independent audit evidence includes: Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
Incorrect Answers
A:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. For this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
C:For this situation: A hospital cannot reconstruct which clinician accepted a recommendation because overrides are logged without identity.
D:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. It does not establish control effectiveness for AI decision logs and explanation traceability.
Question 657
A risk-based audit engagement examines this operating condition: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Create traceable business, human impact, security and quality requirements with measurable release and acceptance gates.
- Define calibrated thresholds and safe defer-to-human or rule-based fallbacks for uncertain or missing-data conditions.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
Explanation
Correct Answer
D:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. In this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
Incorrect Answers
A:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. In this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
B:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. The decisive principle here is: Auditability of an AI decision depends on traceable context, not just a final predicted label.
C:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. In this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
Question 658
An audit committee asks for a defensible assessment of this situation: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Auditability of an AI decision depends on traceable context, not just a final predicted label.
- Thresholds are business control decisions whose error costs vary by context and input quality.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes.
Explanation
Correct Answer
A:The acceptable verified outcome is: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data. In this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
Incorrect Answers
B:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. For this situation: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
C:This attractive shortcut does not resolve the AI decision logs and explanation traceability weakness: Store only aggregate daily counts and claim every individual AI decision remains fully explainable. For this situation: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
D:This option concerns Effective human oversight of AI recommendations, which is a related but different AI governance concern. It does not establish control effectiveness for AI decision logs and explanation traceability.
Question 659
During an AI controls assessment, the team learns that an insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect calibration, confusion matrices, missing-input behavior, escalation queue and approval history.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Review appeal turnaround, reviewer authority, data correction process, overturned cases and notices.
Explanation
Correct Answer
B:The acceptable verified outcome is: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
Incorrect Answers
A:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. The audit must corroborate: Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
C:For this situation: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
D:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. The decisive principle here is: Auditability of an AI decision depends on traceable context, not just a final predicted label.
Question 660
An independent AI auditor reviews this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Verify feedback provenance, reviewer authority and sampling before incorporating live corrections into future models.
- Store only aggregate daily counts and claim every individual AI decision remains fully explainable.
- Inspect calibration, confusion matrices, missing-input behavior, escalation queue and approval history.
Explanation
Correct Answers
A:The reason it is necessary is: Auditability of an AI decision depends on traceable context, not just a final predicted label. For this situation: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
B:This evidence directly tests the asserted control for AI decision logs and explanation traceability: Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
Incorrect Answers
C:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. In this case: An insurance chatbot's policy answer is challenged but logs omit the retrieval sources and prompt configuration.
D:It misses the key control principle: Auditability of an AI decision depends on traceable context, not just a final predicted label.
E:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. The outcome to verify is: An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.