Isaca AAIA Practice Test 19
Question 180
An independent AI auditor reviews this case: A city services chatbot identifies service outage risk but excludes misleading advice and inaccurate accessibility assistance. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Develop use-case-specific scenarios covering people, business process, privacy, safety, security and model behavior.
- Threat-model model-specific abuse paths, adversary access, safeguards and residual exposure.
- Reuse a generic network security risk list and conclude all AI-specific adverse decisions are covered.
- Review use-case map, stakeholders, failure modes, risk register, impact assumptions and challenge workshops.
- Inspect system purpose, actors, changes, market placement, impact, legal analysis and current phased applicability.
Explanation
Correct Answers
A:The reason it is necessary is: AI risk assessment must consider intended context and foreseeable misuse, not only traditional IT incidents. For this situation: A city services chatbot identifies service outage risk but excludes misleading advice and inaccurate accessibility assistance.
D:The corrective action is: Develop use-case-specific scenarios covering people, business process, privacy, safety, security and model behavior.
Incorrect Answers
B:This option concerns Adversarial risk and AI misuse scenarios, which is a related but different AI governance concern. For this situation: A city services chatbot identifies service outage risk but excludes misleading advice and inaccurate accessibility assistance.
C:It misses the key control principle: AI risk assessment must consider intended context and foreseeable misuse, not only traditional IT incidents.
E:This option concerns EU AI Act role and risk classification, which is a related but different AI governance concern. For this situation: A city services chatbot identifies service outage risk but excludes misleading advice and inaccurate accessibility assistance.
Question 181
A governance and assurance review uncovers the following: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Threat-model model-specific abuse paths, adversary access, safeguards and residual exposure.
- Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Define drift indicators and use-case-specific revalidation triggers with approved mitigation decisions.
Explanation
Correct Answer
B:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. Independent audit evidence includes: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
Incorrect Answers
A:This option concerns Adversarial risk and AI misuse scenarios, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
C:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued.
D:This option concerns Concept drift and changing customer behavior, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
Question 182
A risk-based audit engagement examines this operating condition: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Risk classification and provider/deployer roles affect obligations; they cannot be assumed from product branding.
- Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Data and concept distributions evolve; model performance can decay even when code and infrastructure remain unchanged.
Explanation
Correct Answer
B:Independent audit evidence includes: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics. This is the applicable AI audit principle for Residual AI risk acceptance and mitigation efficacy: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
Incorrect Answers
A:This option concerns EU AI Act role and risk classification, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
C:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. For this situation: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy.
D:This option concerns Concept drift and changing customer behavior, which is a related but different AI governance concern. For this situation: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy.
Question 183
An audit committee asks for a defensible assessment of this situation: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect temporal validation, segment error, data drift, concept labels, release dates and retraining criteria.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Inspect system purpose, actors, changes, market placement, impact, legal analysis and current phased applicability.
- Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
Explanation
Correct Answer
D:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. This evidence directly tests the asserted control for Residual AI risk acceptance and mitigation efficacy: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
Incorrect Answers
A:This option concerns Concept drift and changing customer behavior, which is a related but different AI governance concern. The decisive principle here is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
B:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. The auditor should instead examine: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
C:This option concerns EU AI Act role and risk classification, which is a related but different AI governance concern. For this situation: A pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy.
Question 184
During an AI controls assessment, the team learns that a pricing model fails a fairness test yet the business owner marks its risk closed after publishing an ethics policy. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Early warning signals prompt accountable preventive actions before unacceptable impact.
- Residual risk is accepted within appetite or escalated with validated control improvements.
- Critical decisions continue or fail safely during vendor disruption with documented recovery alternatives.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
Explanation
Correct Answer
B:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. This is an observable validation result for Residual AI risk acceptance and mitigation efficacy, not just management assurance: Residual risk is accepted within appetite or escalated with validated control improvements.
Incorrect Answers
A:This option concerns AI risk monitoring through leading KRIs, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
C:This option concerns Model concentration and systemic vendor dependency, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
D:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
Question 185
An independent AI auditor reviews this case: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Threat-model model-specific abuse paths, adversary access, safeguards and residual exposure.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Require decision-level explanations proportionate to the use case, validated predictive benefit, documented limitations and a meaningful appeal path.
- Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
Explanation
Correct Answer
D:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. The acceptable verified outcome is: Residual risk is accepted within appetite or escalated with validated control improvements.
Incorrect Answers
A:This option concerns Adversarial risk and AI misuse scenarios, which is a related but different AI governance concern. The decisive principle here is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
B:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. In this case: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
C:This option concerns Explainable credit-model selection for adverse decisions, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
Question 186
A governance and assurance review uncovers the following: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Multiple applications do not diversify AI exposure when they share a single provider or data dependency.
- Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Removing an explicit sensitive field does not guarantee fairness if correlated inputs and outcomes retain inequity.
Explanation
Correct Answer
B:Independent audit evidence includes: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics. The corrective action is: Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
Incorrect Answers
A:This option concerns Model concentration and systemic vendor dependency, which is a related but different AI governance concern. The decisive principle here is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
C:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. For this situation: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
D:This option concerns Fairness assessment for proxy discrimination, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
Question 187
A risk-based audit engagement examines this operating condition: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
- Review use-case map, stakeholders, failure modes, risk register, impact assumptions and challenge workshops.
- Inspect architecture data flows, attacker capabilities, attack trees, abuse test coverage and limiting controls.
Explanation
Correct Answer
B:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. The corrective action is: Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
Incorrect Answers
A:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. Effective closure requires: Residual risk is accepted within appetite or escalated with validated control improvements.
C:This option concerns AI use-case risk scenario identification, which is a related but different AI governance concern. It does not establish control effectiveness for Residual AI risk acceptance and mitigation efficacy.
D:This option concerns Adversarial risk and AI misuse scenarios, which is a related but different AI governance concern. For this situation: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
Question 188
An audit committee asks for a defensible assessment of this situation: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Residual risk is accepted within appetite or escalated with validated control improvements.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Material plausible failure scenarios have accountable controls, measurements and response plans.
- Early warning signals prompt accountable preventive actions before unacceptable impact.
Explanation
Correct Answer
A:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. In this case: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
Incorrect Answers
B:For this situation: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
C:This option concerns AI use-case risk scenario identification, which is a related but different AI governance concern. For this situation: A hospital logs an unmitigated model drift issue as accepted by a developer without clinical authority.
D:This option concerns AI risk monitoring through leading KRIs, which is a related but different AI governance concern. The decisive principle here is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
Question 189
During an AI controls assessment, the team learns that a fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Develop use-case-specific scenarios covering people, business process, privacy, safety, security and model behavior.
- Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
- Define drift indicators and use-case-specific revalidation triggers with approved mitigation decisions.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
Explanation
Correct Answer
B:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. In this case: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
Incorrect Answers
A:This option concerns AI use-case risk scenario identification, which is a related but different AI governance concern. The decisive principle here is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction.
C:This option concerns Concept drift and changing customer behavior, which is a related but different AI governance concern. In this case: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
D:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. In this case: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
Question 190
An independent AI auditor reviews this case: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Document inherent versus residual risk using tested control effectiveness and authorized business acceptance.
- Close risk solely because a remediation ticket was opened or a broad values statement was issued.
- Define drift indicators and use-case-specific revalidation triggers with approved mitigation decisions.
- Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
- Inspect architecture data flows, attacker capabilities, attack trees, abuse test coverage and limiting controls.
Explanation
Correct Answers
A:The reason it is necessary is: Mitigation exists only when control performance reduces measured exposure; a planned action is not risk reduction. For this situation: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
D:This evidence directly tests the asserted control for Residual AI risk acceptance and mitigation efficacy: Inspect initial impact, treatment choice, operating tests, risk acceptance authority and current residual metrics.
Incorrect Answers
B:This attractive shortcut does not resolve the Residual AI risk acceptance and mitigation efficacy weakness: Close risk solely because a remediation ticket was opened or a broad values statement was issued. For this situation: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
C:This option concerns Concept drift and changing customer behavior, which is a related but different AI governance concern. For this situation: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.
E:This option concerns Adversarial risk and AI misuse scenarios, which is a related but different AI governance concern. In this case: A fraud detector's control owner points to planned retraining but has no evidence that adverse false flags improved.