Isaca AAIA Practice Test 64
Question 630
An independent AI auditor reviews this case: An AI agent's external tool permissions are widened temporarily but never rolled back after testing. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Classify model, data, prompt and feature changes by potential behavior impact and require appropriate regression testing.
- Permit permanent undocumented exceptions after an urgent model outage.
- Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
- Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation.
- Inspect prompt history, version diffs, tested attack cases, tool allowlists and release tickets.
Explanation
Correct Answers
C:The reason it is necessary is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control. This evidence directly tests the asserted control for AI configuration and emergency change traceability: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
D:The reason it is necessary is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control. For this situation: An AI agent's external tool permissions are widened temporarily but never rolled back after testing.
Incorrect Answers
A:This option concerns Model version change impact classification, which is a related but different AI governance concern. The decisive principle here is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
B:This attractive shortcut does not resolve the AI configuration and emergency change traceability weakness: Permit permanent undocumented exceptions after an urgent model outage. For this situation: An AI agent's external tool permissions are widened temporarily but never rolled back after testing.
E:This option concerns Prompt template governance and injection-resilience changes, which is a related but different AI governance concern. It does not establish control effectiveness for AI configuration and emergency change traceability.
Question 631
A governance and assurance review uncovers the following: An AI agent's external tool permissions are widened temporarily but never rolled back after testing. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Compare provider release notes, model ID, output baselines, contractual notices and drift alerts.
- Permit permanent undocumented exceptions after an urgent model outage.
- Compare before-after distributions, update artifacts, critical use cases, approval rules and rollback records.
- Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
Explanation
Correct Answer
D:The reason it is necessary is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control. The acceptable verified outcome is: Emergency deviations expire or receive accountable renewal and critical controls are verified restored.
Incorrect Answers
A:This option concerns External foundation-model update change notices, which is a related but different AI governance concern. The decisive principle here is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
B:This attractive shortcut does not resolve the AI configuration and emergency change traceability weakness: Permit permanent undocumented exceptions after an urgent model outage. Effective closure requires: Emergency deviations expire or receive accountable renewal and critical controls are verified restored.
C:This option concerns Model version change impact classification, which is a related but different AI governance concern. For this situation: An AI agent's external tool permissions are widened temporarily but never rolled back after testing.
Question 632
A risk-based audit engagement examines this operating condition: An AI agent's external tool permissions are widened temporarily but never rolled back after testing. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Emergency deviations expire or receive accountable renewal and critical controls are verified restored.
- Material behavioral changes receive proportionate approvals and do not bypass previously defined controls.
- Permit permanent undocumented exceptions after an urgent model outage.
- Unacceptable changes are contained promptly and validated prior behavior is restored.
Explanation
Correct Answer
A:The reason it is necessary is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control. Independent audit evidence includes: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
Incorrect Answers
B:This option concerns Model version change impact classification, which is a related but different AI governance concern. The audit must corroborate: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
C:For this situation: An AI agent's external tool permissions are widened temporarily but never rolled back after testing.
D:This option concerns Canary releases and model rollback thresholds, which is a related but different AI governance concern. The decisive principle here is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
Question 633
An audit committee asks for a defensible assessment of this situation: An operations team disables content safety filtering as an emergency measure and forgets to restore it. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation.
- Control schema, source, feature and data refreshes using integrity and semantic compatibility tests.
- Permit permanent undocumented exceptions after an urgent model outage.
- Capture necessary model version, inputs or safe references, key context, outcome and human intervention metadata.
Explanation
Correct Answer
A:The reason it is necessary is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control. In this case: An operations team disables content safety filtering as an emergency measure and forgets to restore it.
Incorrect Answers
B:This option concerns AI dataset refresh and feature pipeline approvals, which is a related but different AI governance concern. The audit must corroborate: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
C:This attractive shortcut does not resolve the AI configuration and emergency change traceability weakness: Permit permanent undocumented exceptions after an urgent model outage. In this case: An operations team disables content safety filtering as an emergency measure and forgets to restore it.
D:This option concerns AI decision logs and explanation traceability, which is a related but different AI governance concern. It does not establish control effectiveness for AI configuration and emergency change traceability.
Question 634
During an AI controls assessment, the team learns that an operations team disables content safety filtering as an emergency measure and forgets to restore it. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Prompts are executable behavioral configuration and can change output and risk without code deployment.
- Permit permanent undocumented exceptions after an urgent model outage.
- Gradual deployment reduces blast radius only if meaningful indicators and rollback decisions are predefined.
- AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
Explanation
Correct Answer
D:The corrective action is: Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation. Independent audit evidence includes: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
Incorrect Answers
A:This option concerns Prompt template governance and injection-resilience changes, which is a related but different AI governance concern. The decisive principle here is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
B:This attractive shortcut does not resolve the AI configuration and emergency change traceability weakness: Permit permanent undocumented exceptions after an urgent model outage. For this situation: An operations team disables content safety filtering as an emergency measure and forgets to restore it.
C:This option concerns Canary releases and model rollback thresholds, which is a related but different AI governance concern. The audit must corroborate: Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
Question 635
An independent AI auditor reviews this case: An operations team disables content safety filtering as an emergency measure and forgets to restore it. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Compare before-after distributions, update artifacts, critical use cases, approval rules and rollback records.
- Inspect config state histories, privileges, break-glass logs, time bounds and post-incident review.
- Inspect canary assignment, segment KPIs, error thresholds, baseline model artifacts and rollback drill.
- Permit permanent undocumented exceptions after an urgent model outage.
Explanation
Correct Answer
B:The corrective action is: Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation.
Incorrect Answers
A:This option concerns Model version change impact classification, which is a related but different AI governance concern. A proportionate response is: Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation.
C:This option concerns Canary releases and model rollback thresholds, which is a related but different AI governance concern. For this situation: An operations team disables content safety filtering as an emergency measure and forgets to restore it.
D:It misses the key control principle: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
Question 636
A governance and assurance review uncovers the following: An operations team disables content safety filtering as an emergency measure and forgets to restore it. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Unacceptable changes are contained promptly and validated prior behavior is restored.
- Permit permanent undocumented exceptions after an urgent model outage.
- An authorized reviewer can reconstruct a sampled decision without overcollecting personal data.
- Emergency deviations expire or receive accountable renewal and critical controls are verified restored.
Explanation
Correct Answer
D:This is an observable validation result for AI configuration and emergency change traceability, not just management assurance: Emergency deviations expire or receive accountable renewal and critical controls are verified restored.
Incorrect Answers
A:This option concerns Canary releases and model rollback thresholds, which is a related but different AI governance concern. A proportionate response is: Log emergency AI configuration changes, require proportionate approval, expiry and post-change validation.
B:For this situation: An operations team disables content safety filtering as an emergency measure and forgets to restore it.
C:This option concerns AI decision logs and explanation traceability, which is a related but different AI governance concern. The decisive principle here is: AI safety depends on configuration state as well as model artifacts; emergency bypasses need disciplined control.
Question 637
A risk-based audit engagement examines this operating condition: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Use a one-click rubber stamp as proof humans control every consequential AI decision.
- Design actionable challenge, human reassessment, factual correction and remediation for adverse AI decisions.
- Provide reviewers timely context, override authority, training and auditable independent decision space.
- Define annotation rubrics, representative blind review, disagreement resolution and documented quality thresholds.
Explanation
Correct Answer
C:The reason it is necessary is: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes. In this case: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift.
Incorrect Answers
A:This attractive shortcut does not resolve the Effective human oversight of AI recommendations weakness: Use a one-click rubber stamp as proof humans control every consequential AI decision.
B:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. It does not establish control effectiveness for Effective human oversight of AI recommendations.
D:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. It does not establish control effectiveness for Effective human oversight of AI recommendations.
Question 638
An audit committee asks for a defensible assessment of this situation: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes.
- An appeal path is meaningful when it can correct underlying facts and change outcomes where justified.
- Use a one-click rubber stamp as proof humans control every consequential AI decision.
- Garbage or inconsistent ground-truth labels cap model validity even if the learning algorithm is sophisticated.
Explanation
Correct Answer
A:Independent audit evidence includes: Inspect reviewer workload, UI, explanations, override log and interviews on actual cases. This is the applicable AI audit principle for Effective human oversight of AI recommendations: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes.
Incorrect Answers
B:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. For this situation: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift.
C:This attractive shortcut does not resolve the Effective human oversight of AI recommendations weakness: Use a one-click rubber stamp as proof humans control every consequential AI decision. For this situation: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift.
D:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. For this situation: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift.
Question 639
During an AI controls assessment, the team learns that a clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect reviewer workload, UI, explanations, override log and interviews on actual cases.
- Inspect logging schema, privacy redaction, identifiers, time ordering, retention and replay tests.
- Review appeal turnaround, reviewer authority, data correction process, overturned cases and notices.
- Use a one-click rubber stamp as proof humans control every consequential AI decision.
Explanation
Correct Answer
A:The reason it is necessary is: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes. This evidence directly tests the asserted control for Effective human oversight of AI recommendations: Inspect reviewer workload, UI, explanations, override log and interviews on actual cases.
Incorrect Answers
B:This option concerns AI decision logs and explanation traceability, which is a related but different AI governance concern. It does not establish control effectiveness for Effective human oversight of AI recommendations.
C:This option concerns Customer appeal and remedy for automated outcomes, which is a related but different AI governance concern. The decisive principle here is: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes.
D:This attractive shortcut does not resolve the Effective human oversight of AI recommendations weakness: Use a one-click rubber stamp as proof humans control every consequential AI decision. The auditor should instead examine: Inspect reviewer workload, UI, explanations, override log and interviews on actual cases.
Question 640
An independent AI auditor reviews this case: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Limit agent authority by least-privilege tools, transaction ceilings, pre-action approval and post-action verification.
- Use a one-click rubber stamp as proof humans control every consequential AI decision.
- Inspect reviewer workload, UI, explanations, override log and interviews on actual cases.
- Inspect feedback source identities, adjudication rates, unusual bursts, retraining eligibility and rollback.
- Provide reviewers timely context, override authority, training and auditable independent decision space.
Explanation
Correct Answers
C:The reason it is necessary is: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes. For this situation: A clinician is required to click approve on an AI recommendation but cannot access supporting records during the shift.
E:The reason it is necessary is: Human-in-the-loop labeling does not create real oversight when reviewers cannot understand or influence outcomes. This response fits the risk associated with Effective human oversight of AI recommendations: Provide reviewers timely context, override authority, training and auditable independent decision space.
Incorrect Answers
A:This option concerns Autonomous agent action-limit supervision, which is a related but different AI governance concern. It does not establish control effectiveness for Effective human oversight of AI recommendations.
B:This attractive shortcut does not resolve the Effective human oversight of AI recommendations weakness: Use a one-click rubber stamp as proof humans control every consequential AI decision. Effective closure requires: Reviewers correctly reject unsafe recommendations and escalation works within operational time constraints.
D:This option concerns Feedback-loop contamination from user corrections, which is a related but different AI governance concern. It does not establish control effectiveness for Effective human oversight of AI recommendations.