Isaca AAIA Practice Test 85
Question 840
An independent AI auditor reviews this case: A claims assistant can approve payouts based on user messages without an independent policy gate. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
- Give an agent global tool permissions because its system prompt says it should never misuse them.
- Scope tools to specific identities and approved operations with pre-execution authorization and transaction caps.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Rate-limit and monitor queries, restrict unnecessary output detail and evaluate extraction risks proportionate to value.
Explanation
Correct Answers
C:The reason it is necessary is: Model-generated text is untrusted as an authorization basis for real-world privileged actions. For this situation: A claims assistant can approve payouts based on user messages without an independent policy gate.
D:This evidence directly tests the asserted control for AI tool misuse and excessive agency: Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
Incorrect Answers
A:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. The audit must corroborate: Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
B:It misses the key control principle: Model-generated text is untrusted as an authorization basis for real-world privileged actions.
E:This option concerns AI model extraction and excessive query access, which is a related but different AI governance concern. It does not establish control effectiveness for AI tool misuse and excessive agency.
Question 841
A governance and assurance review uncovers the following: An external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Define annotation rubrics, representative blind review, disagreement resolution and documented quality thresholds.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
- Evaluate unintended inference from model outputs and minimize observable detail and query access.
Explanation
Correct Answer
C:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. This is the proportionate control response to Poisoned embedding and vector retrieval index: Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
Incorrect Answers
A:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
B:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall.
D:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
Question 842
A risk-based audit engagement examines this operating condition: An external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Model weights, parsers and surrounding runtime code belong in the software and data supply-chain threat model.
- Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
- Garbage or inconsistent ground-truth labels cap model validity even if the learning algorithm is sophisticated.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
Explanation
Correct Answer
B:The corrective action is: Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity. This is the applicable AI audit principle for Poisoned embedding and vector retrieval index: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
Incorrect Answers
A:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
C:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. The decisive principle here is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
D:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. For this situation: An external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first.
Question 843
An audit committee asks for a defensible assessment of this situation: An external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Inspect output schemas, reconstruction probes, privacy threat model, aggregation and access restrictions.
- Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
- Inspect signatures, hash attestations, artifact ACLs, dependency inventory and rebuild records.
Explanation
Correct Answer
C:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. The corrective action is: Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
Incorrect Answers
A:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. The auditor should instead examine: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
B:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. The decisive principle here is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
D:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. The decisive principle here is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
Question 844
During an AI controls assessment, the team learns that an external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Production loads only authenticated approved artifacts and tamper attempts are denied or alerted.
- Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
- An independent rerun can identify the exact source data and material transformation decisions for a sampled model version.
Explanation
Correct Answer
C:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. This is an observable validation result for Poisoned embedding and vector retrieval index, not just management assurance: Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
Incorrect Answers
A:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
B:This option concerns Foundation model dependency and artifact tampering, which is a related but different AI governance concern. For this situation: An external documentation feed injects altered embeddings that rank a fraudulent vendor payment instruction first.
D:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
Question 845
An independent AI auditor reviews this case: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Evaluate unintended inference from model outputs and minimize observable detail and query access.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Scope tools to specific identities and approved operations with pre-execution authorization and transaction caps.
- Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
Explanation
Correct Answer
D:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. The acceptable verified outcome is: Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
Incorrect Answers
A:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. In this case: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
B:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. In this case: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
C:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
Question 846
A governance and assurance review uncovers the following: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Untrusted retrieved documents can manipulate model instructions but must not gain system-level privileges.
- AI outputs cannot be audited reliably when their source records, transformations and model lineage cannot be reconstructed.
- Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
Explanation
Correct Answer
D:The corrective action is: Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity. The acceptable verified outcome is: Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
Incorrect Answers
A:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. For this situation: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
B:This option concerns Indirect prompt injection through retrieved content, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
C:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. The decisive principle here is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
Question 847
A risk-based audit engagement examines this operating condition: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Inspect authentication, rate limits, output granularity, query anomalies and abuse response.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
Explanation
Correct Answer
D:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. In this case: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
Incorrect Answers
A:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. Effective closure requires: Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
B:This option concerns AI model extraction and excessive query access, which is a related but different AI governance concern. It does not establish control effectiveness for Poisoned embedding and vector retrieval index.
C:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. For this situation: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
Question 848
An audit committee asks for a defensible assessment of this situation: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Malicious document instructions cannot cause prohibited tool actions or confidential-data release.
- Only approved corpus changes influence outputs, and unexpected ranking changes trigger investigation.
- Labels are consistent against approved definitions, and model tests expose residual uncertain classes.
Explanation
Correct Answer
C:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. Independent audit evidence includes: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
Incorrect Answers
A:For this situation: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
B:This option concerns Indirect prompt injection through retrieved content, which is a related but different AI governance concern. For this situation: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
D:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. In this case: A shared vector store allows one tenant to overwrite metadata that controls other tenants' retrieval ranking.
Question 849
During an AI controls assessment, the team learns that a support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Scope tools to specific identities and approved operations with pre-execution authorization and transaction caps.
- Version and trace training, validation and inference datasets with accountable lineage, hashes and reproducible pipeline metadata.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
- Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
Explanation
Correct Answer
D:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Incorrect Answers
A:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. The decisive principle here is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers.
B:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
C:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Question 850
An independent AI auditor reviews this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
- Inspect tool manifests, service accounts, approval gates, injection tests and action receipts.
- Evaluate unintended inference from model outputs and minimize observable detail and query access.
- Authenticate retrieval corpus updates, isolate tenants and test ranking anomalies and source integrity.
- Treat a vector index as trusted merely because its database is behind a corporate firewall.
Explanation
Correct Answers
A:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. This evidence directly tests the asserted control for Poisoned embedding and vector retrieval index: Inspect index access, chunk hashes, ingest logs, tenant segregation and adversarial retrieval results.
D:The reason it is necessary is: Embedding and retrieval layers are separate data-integrity surfaces that can manipulate downstream model answers. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
Incorrect Answers
B:This option concerns AI tool misuse and excessive agency, which is a related but different AI governance concern. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
C:This option concerns Model inversion and sensitive attribute leakage, which is a related but different AI governance concern. In this case: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.
E:This attractive shortcut does not resolve the Poisoned embedding and vector retrieval index weakness: Treat a vector index as trusted merely because its database is behind a corporate firewall. For this situation: A support RAG index silently substitutes outdated policy chunks because no ingest integrity validation exists.