Isaca AAIA Practice Test 56
Question 550
An independent AI auditor reviews this case: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Leave deprecated models and credentials indefinitely available because they are no longer advertised.
- Inventory and authenticate model components, third-party datasets and software dependencies throughout acquisition and updates.
- Use a decommission plan to disable endpoints, revoke access, retain required records and dispose of data appropriately.
- Inspect signed use cases, requirement trace matrix, outcome thresholds, known limitations and test cases.
- Review endpoint inventory, credentials, retained artifacts, disposal approvals, legal holds and restoration paths.
Explanation
Correct Answers
C:The reason it is necessary is: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement. This response fits the risk associated with Controlled model retirement and data disposition: Use a decommission plan to disable endpoints, revoke access, retain required records and dispose of data appropriately.
E:The reason it is necessary is: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement. This evidence directly tests the asserted control for Controlled model retirement and data disposition: Review endpoint inventory, credentials, retained artifacts, disposal approvals, legal holds and restoration paths.
Incorrect Answers
A:This attractive shortcut does not resolve the Controlled model retirement and data disposition weakness: Leave deprecated models and credentials indefinitely available because they are no longer advertised. For this situation: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned.
B:This option concerns AI vendor component and supply chain lifecycle, which is a related but different AI governance concern. The audit must corroborate: Review endpoint inventory, credentials, retained artifacts, disposal approvals, legal holds and restoration paths.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. The decisive principle here is: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement.
Question 551
A governance and assurance review uncovers the following: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Leave deprecated models and credentials indefinitely available because they are no longer advertised.
- Inspect image dependencies, seeds, pipelines, registry signatures, lineage and controlled reruns.
- Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
- Review endpoint inventory, credentials, retained artifacts, disposal approvals, legal holds and restoration paths.
Explanation
Correct Answer
D:The reason it is necessary is: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement. For this situation: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned.
Incorrect Answers
A:It misses the key control principle: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement.
B:This option concerns Reproducible model training and configuration management, which is a related but different AI governance concern. The decisive principle here is: AI lifecycle controls include end-of-life risks; deleting an app icon is not an auditable retirement.
C:This option concerns AI prototype experimentation versus production safety gates, which is a related but different AI governance concern. The audit must corroborate: Review endpoint inventory, credentials, retained artifacts, disposal approvals, legal holds and restoration paths.
Question 552
A risk-based audit engagement examines this operating condition: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Production release occurs only after required controls and independent signoffs are demonstrated.
- Leave deprecated models and credentials indefinitely available because they are no longer advertised.
- Affected decisions are reviewed, relevant stakeholders notified and preventive controls verified.
- The retired model cannot serve unauthorized predictions and remaining data is governed by approved retention.
Explanation
Correct Answer
D:This is an observable validation result for Controlled model retirement and data disposition, not just management assurance: The retired model cannot serve unauthorized predictions and remaining data is governed by approved retention.
Incorrect Answers
A:This option concerns AI prototype experimentation versus production safety gates, which is a related but different AI governance concern. For this situation: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned.
B:For this situation: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned.
C:This option concerns AI model rollback and stakeholder communication, which is a related but different AI governance concern. For this situation: A medical dataset stays accessible to ex-vendors after the associated model project is decommissioned.
Question 553
An audit committee asks for a defensible assessment of this situation: A team deploys a demonstration LLM agent to production with its experimental unrestricted tool API keys. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Create traceable business, human impact, security and quality requirements with measurable release and acceptance gates.
- Separate development, test and production roles with controlled promotion, scoped credentials and audit trails.
- Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
Explanation
Correct Answer
C:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. This is the proportionate control response to AI prototype experimentation versus production safety gates: Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
Incorrect Answers
A:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
B:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
D:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
Question 554
During an AI controls assessment, the team learns that a team deploys a demonstration LLM agent to production with its experimental unrestricted tool API keys. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Developer confidence cannot replace independent assessment for consequential model decisions.
- A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
- AI delivery involves models, data and code, so conventional app deployment approval alone may not cover behavior changes.
Explanation
Correct Answer
B:Independent audit evidence includes: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records. This is the applicable AI audit principle for AI prototype experimentation versus production safety gates: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
Incorrect Answers
A:This option concerns Independent validation before model deployment, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
C:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration. The auditor should instead examine: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
D:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. The decisive principle here is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
Question 555
An independent AI auditor reviews this case: A team deploys a demonstration LLM agent to production with its experimental unrestricted tool API keys. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect image dependencies, seeds, pipelines, registry signatures, lineage and controlled reruns.
- Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
- Inspect supplier attestations, component inventory, signed digests, license constraints, SBOM and update notices.
Explanation
Correct Answer
B:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. This evidence directly tests the asserted control for AI prototype experimentation versus production safety gates: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
Incorrect Answers
A:This option concerns Reproducible model training and configuration management, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
C:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration. For this situation: A team deploys a demonstration LLM agent to production with its experimental unrestricted tool API keys.
D:This option concerns AI vendor component and supply chain lifecycle, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
Question 556
A governance and assurance review uncovers the following: A team deploys a demonstration LLM agent to production with its experimental unrestricted tool API keys. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
- Production release occurs only after required controls and independent signoffs are demonstrated.
- Only approved traceable versions run and vulnerable components receive monitored remediation.
- Each material requirement maps to a result and signoff before deploying the feature.
Explanation
Correct Answer
B:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. This is an observable validation result for AI prototype experimentation versus production safety gates, not just management assurance: Production release occurs only after required controls and independent signoffs are demonstrated.
Incorrect Answers
A:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration. Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
C:This option concerns AI vendor component and supply chain lifecycle, which is a related but different AI governance concern. The decisive principle here is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. The decisive principle here is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
Question 557
A risk-based audit engagement examines this operating condition: A pilot fraud model receives the same global authorizations as a mature production decision service. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
- Create traceable business, human impact, security and quality requirements with measurable release and acceptance gates.
- Require risk-proportionate independent model validation, controlled challenge samples and release acceptance.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
Explanation
Correct Answer
A:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. Independent audit evidence includes: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
Incorrect Answers
B:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. The audit must corroborate: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
C:This option concerns Independent validation before model deployment, which is a related but different AI governance concern. The decisive principle here is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
D:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration. Effective closure requires: Production release occurs only after required controls and independent signoffs are demonstrated.
Question 558
An audit committee asks for a defensible assessment of this situation: A pilot fraud model receives the same global authorizations as a mature production decision service. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
- AI delivery involves models, data and code, so conventional app deployment approval alone may not cover behavior changes.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
- Thresholds are business control decisions whose error costs vary by context and input quality.
Explanation
Correct Answer
A:Independent audit evidence includes: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records. The corrective action is: Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
Incorrect Answers
B:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. The audit must corroborate: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
C:This attractive shortcut does not resolve the AI prototype experimentation versus production safety gates weakness: Promote a prototype directly because it impressed stakeholders in a small curated demonstration. For this situation: A pilot fraud model receives the same global authorizations as a mature production decision service.
D:This option concerns Threshold governance and safety fallbacks, which is a related but different AI governance concern. It does not establish control effectiveness for AI prototype experimentation versus production safety gates.
Question 559
During an AI controls assessment, the team learns that a pilot fraud model receives the same global authorizations as a mature production decision service. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect pipeline roles, artifact signatures, dataset permissions, approval gates and production change logs.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
- Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
- Inspect image dependencies, seeds, pipelines, registry signatures, lineage and controlled reruns.
Explanation
Correct Answer
C:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. The corrective action is: Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
Incorrect Answers
A:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. For this situation: A pilot fraud model receives the same global authorizations as a mature production decision service.
B:It misses the key control principle: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
D:This option concerns Reproducible model training and configuration management, which is a related but different AI governance concern. The decisive principle here is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact.
Question 560
An independent AI auditor reviews this case: A pilot fraud model receives the same global authorizations as a mature production decision service. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Version model artifacts, code, environments, hyperparameters and data references with reproducible promotion records.
- Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
- Review reviewer independence, held-out data provenance, challenge results, exceptions and signoffs.
- Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.
- Promote a prototype directly because it impressed stakeholders in a small curated demonstration.
Explanation
Correct Answers
B:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. This response fits the risk associated with AI prototype experimentation versus production safety gates: Separate sandbox experimentation from production through constrained access, risk approval and evidence-based readiness criteria.
D:The reason it is necessary is: A successful demo establishes feasibility, not sufficient reliability or authorization for real customer impact. The acceptable verified outcome is: Production release occurs only after required controls and independent signoffs are demonstrated.
Incorrect Answers
A:This option concerns Reproducible model training and configuration management, which is a related but different AI governance concern. For this situation: A pilot fraud model receives the same global authorizations as a mature production decision service.
C:This option concerns Independent validation before model deployment, which is a related but different AI governance concern. For this situation: A pilot fraud model receives the same global authorizations as a mature production decision service.
E:The auditor should instead examine: Inspect sandbox isolation, tool permissions, go-live checklist, safety test results and deployment records.