Isaca AAIA Practice Test 86
Question 850
An independent AI auditor reviews this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Evaluate unintended inference from model outputs and minimize observable detail and query access.
- Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
Explanation
Correct Answers
A:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. This evidence directly tests the asserted control for Poisoned embedding and vector retrieval index: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
D:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Incorrect Answers
B:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
C:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
E:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Question 851
A governance and assurance review uncovers the following: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
- Review label guidelines, inter-rater reliability, adjudication logs, sampled errors and retraining effects.
- Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
Explanation
Correct Answer
D:For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Incorrect Answers
A:It misses the key control principle: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
B:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
C:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Question 852
A risk-based audit engagement examines this operating condition: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
- Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Requests outside approved privilege and business policy are refused before any sensitive side effect.
Explanation
Correct Answer
B:This is an observable validation result for Poisoned embedding and vector retrieval index, not just management assurance: Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
Incorrect Answers
A:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
C:The auditor should instead examine: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
D:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. The audit must corroborate: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
Question 853
An audit committee asks for a defensible assessment of this situation: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Verify model provenance, storage integrity, executable dependencies and approved component changes.
- Evaluate unintended inference from model outputs and minimize observable detail and query access.
- Treat retrieved text as untrusted data, separate instruction authority and constrain downstream tool access.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
Explanation
Correct Answer
A:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. This is the proportionate control response to Foundation model dependency and artifact tampering: Verify model provenance, storage integrity, executable dependencies and approved component changes.
Incorrect Answers
B:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
C:This option concerns Indirect prompt injection through retrieved content, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
D:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
Question 854
During an AI controls assessment, the team learns that an AI team imports weights from an anonymous mirror that differs from the vendor's signed release. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
- Repeated API observations can reveal model behavior or sensitive correlations even without access to the weight files.
- Model weights, parsers and surrounding runtime code belong in the software and data supply-chain threat model.
Explanation
Correct Answer
D:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. The corrective action is: Verify model provenance, storage integrity, executable dependencies and approved component changes.
Incorrect Answers
A:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. For this situation: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release.
B:This option concerns Poisoned embedding and vector retrieval index, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
C:This option concerns AI model extraction and excessive query access, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
Question 855
An independent AI auditor reviews this case: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
- Inspect pipeline roles, artifact signatures, dataset permissions, approval gates and production change logs.
- Compare provider release notes, model ID, output baselines, contractual notices and drift alerts.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
Explanation
Correct Answer
A:The corrective action is: Verify model provenance, storage integrity, executable dependencies and approved component changes. This evidence directly tests the asserted control for Foundation model dependency and artifact tampering: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
Incorrect Answers
B:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
C:This option concerns External foundation-model update change notices, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
D:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. It misses the key control principle: Model weights, parsers and surrounding runtime code belong in the software and data supply-chain threat model.
Question 856
A governance and assurance review uncovers the following: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Unintended sensitive inference is bounded and logged access follows approved purpose.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Only signed approved model-data combinations reach production and privilege tests fail closed.
- Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
Explanation
Correct Answer
D:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. This is an observable validation result for Foundation model dependency and artifact tampering, not just management assurance: Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
Incorrect Answers
A:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. For this situation: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release.
B:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. Verify model provenance, storage integrity, executable dependencies and approved component changes.
C:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. For this situation: An AI team imports weights from an anonymous mirror that differs from the vendor's signed release.
Question 857
A risk-based audit engagement examines this operating condition: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Verify model provenance, storage integrity, executable dependencies and approved component changes.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Require contractual update notifications, version observability, revalidation and compensating fallback for material supplier changes.
- Separate development, test and production roles with controlled promotion, scoped credentials and audit trails.
Explanation
Correct Answer
A:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. The acceptable verified outcome is: Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
Incorrect Answers
B:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
C:This option concerns External foundation-model update change notices, which is a related but different AI governance concern. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
D:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
Question 858
An audit committee asks for a defensible assessment of this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- AI outputs cannot be audited reliably when their source records, transformations and model lineage cannot be reconstructed.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Repeated API observations can reveal model behavior or sensitive correlations even without access to the weight files.
- Model weights, parsers and surrounding runtime code belong in the software and data supply-chain threat model.
Explanation
Correct Answer
D:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
Incorrect Answers
A:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
B:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. For this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
C:This option concerns AI model extraction and excessive query access, which is a related but different AI governance concern. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
Question 859
During an AI controls assessment, the team learns that a third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Inspect output schemas, reconstruction probes, privacy threat model, aggregation and access restrictions.
Explanation
Correct Answer
A:The corrective action is: Verify model provenance, storage integrity, executable dependencies and approved component changes. The acceptable verified outcome is: Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
Incorrect Answers
B:This attractive shortcut does not resolve the Foundation model dependency and artifact tampering weakness: Assume every pretrained model download from a popular forum is trustworthy without signature or provenance. Effective closure requires: Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
C:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. It does not establish control effectiveness for Foundation model dependency and artifact tampering.
D:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
Question 860
An independent AI auditor reviews this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Treat retrieved text as untrusted data, separate instruction authority and constrain downstream tool access.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Verify model provenance, storage integrity, executable dependencies and approved component changes.
- Assume every pretrained model download from a popular forum is trustworthy without signature or provenance.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
Explanation
Correct Answers
C:Independent audit evidence includes: Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records. For this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
E:The corrective action is: Verify model provenance, storage integrity, executable dependencies and approved component changes. For this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
Incorrect Answers
A:This option concerns Indirect prompt injection through retrieved content, which is a related but different AI governance concern. In this case: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
B:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. For this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.
D:For this situation: A third-party model package includes an unexpected runtime hook but its license and dependencies were never reviewed.