Isaca AAIA Practice Test 44
Question 430
An independent AI auditor reviews this case: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Inspect confusion matrices, base rates, stratified errors, class weighting choices and cost assumptions.
- Review label guidelines, inter-rater reliability, adjudication logs, sampled errors and retraining effects.
- Version and trace training, validation and inference datasets with accountable lineage, hashes and reproducible pipeline metadata.
- Select the model with the highest overall accuracy while ignoring minority-case misses.
- Evaluate class distribution with relevant precision, recall and business costs, and use justified stratification or targeted samples.
Explanation
Correct Answers
A:The reason it is necessary is: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives. The acceptable verified outcome is: Threshold and sample design meet documented detection and false-intervention goals for rare events.
E:The reason it is necessary is: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives. This response fits the risk associated with Class imbalance and minority event coverage: Evaluate class distribution with relevant precision, recall and business costs, and use justified stratification or targeted samples.
Incorrect Answers
B:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. The audit must corroborate: Inspect confusion matrices, base rates, stratified errors, class weighting choices and cost assumptions.
C:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. The audit must corroborate: Inspect confusion matrices, base rates, stratified errors, class weighting choices and cost assumptions.
D:This attractive shortcut does not resolve the Class imbalance and minority event coverage weakness: Select the model with the highest overall accuracy while ignoring minority-case misses. For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
Question 431
A governance and assurance review uncovers the following: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect confusion matrices, base rates, stratified errors, class weighting choices and cost assumptions.
- Select the model with the highest overall accuracy while ignoring minority-case misses.
- Inspect dataset snapshots, feature pipeline commits, record counts, model registry links and training execution manifests.
- Inspect signed use cases, requirement trace matrix, outcome thresholds, known limitations and test cases.
Explanation
Correct Answer
A:The reason it is necessary is: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives. For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
Incorrect Answers
B:It misses the key control principle: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives.
C:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. The decisive principle here is: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives.
Question 432
A risk-based audit engagement examines this operating condition: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Threshold and sample design meet documented detection and false-intervention goals for rare events.
- Select the model with the highest overall accuracy while ignoring minority-case misses.
- Synthetic samples add task value within approved privacy and fairness criteria with bounded memorization risk.
- Each material requirement maps to a result and signoff before deploying the feature.
Explanation
Correct Answer
A:The reason it is necessary is: Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives. In this case: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
Incorrect Answers
B:For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
C:This option concerns Synthetic training data utility and privacy controls, which is a related but different AI governance concern. For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
D:This option concerns AI requirements-to-acceptance traceability, which is a related but different AI governance concern. For this situation: A security anomaly detector uses random evaluation samples that contain too few confirmed attacks to measure recall.
Question 433
An audit committee asks for a defensible assessment of this situation: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Version and trace training, validation and inference datasets with accountable lineage, hashes and reproducible pipeline metadata.
- Validate synthetic data for utility, subgroup representation, memorization and plausible disclosure before release.
Explanation
Correct Answer
A:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. Independent audit evidence includes: Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
Incorrect Answers
B:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself.
C:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
D:This option concerns Synthetic training data utility and privacy controls, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
Question 434
During an AI controls assessment, the team learns that a fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
- Accuracy on imbalanced data can obscure missed rare high-consequence cases or overwhelming false positives.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- AI delivery involves models, data and code, so conventional app deployment approval alone may not cover behavior changes.
Explanation
Correct Answer
A:Independent audit evidence includes: Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records. This is the applicable AI audit principle for Data poisoning prevention in automated ingestion: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
Incorrect Answers
B:This option concerns Class imbalance and minority event coverage, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
C:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. For this situation: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input.
D:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
Question 435
An independent AI auditor reviews this case: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Inspect pipeline roles, artifact signatures, dataset permissions, approval gates and production change logs.
- Review label guidelines, inter-rater reliability, adjudication logs, sampled errors and retraining effects.
- Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
Explanation
Correct Answer
D:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. This evidence directly tests the asserted control for Data poisoning prevention in automated ingestion: Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
Incorrect Answers
A:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. The auditor should instead examine: Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
B:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. For this situation: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input.
C:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
Question 436
A governance and assurance review uncovers the following: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Contaminated feeds are contained and verified clean data can be restored without corrupting promoted models.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Synthetic samples add task value within approved privacy and fairness criteria with bounded memorization risk.
- Threshold and sample design meet documented detection and false-intervention goals for rare events.
Explanation
Correct Answer
A:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. This is an observable validation result for Data poisoning prevention in automated ingestion, not just management assurance: Contaminated feeds are contained and verified clean data can be restored without corrupting promoted models.
Incorrect Answers
B:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. Effective closure requires: Contaminated feeds are contained and verified clean data can be restored without corrupting promoted models.
C:This option concerns Synthetic training data utility and privacy controls, which is a related but different AI governance concern. For this situation: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input.
D:This option concerns Class imbalance and minority event coverage, which is a related but different AI governance concern. For this situation: A fraud pipeline accepts customer-supplied feedback as training labels without detecting coordinated malicious input.
Question 437
A risk-based audit engagement examines this operating condition: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
- Enforce point-in-time joins and temporal cutoffs for training and evaluation features.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Evaluate class distribution with relevant precision, recall and business costs, and use justified stratification or targeted samples.
Explanation
Correct Answer
A:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. The acceptable verified outcome is: Contaminated feeds are contained and verified clean data can be restored without corrupting promoted models.
Incorrect Answers
B:This option concerns Feature-store time leakage in model evaluation, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
C:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. In this case: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed.
D:This option concerns Class imbalance and minority event coverage, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
Question 438
An audit committee asks for a defensible assessment of this situation: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Future information leakage creates unrealistic validation metrics and cannot be tolerated in prospective inference.
- AI outputs cannot be audited reliably when their source records, transformations and model lineage cannot be reconstructed.
Explanation
Correct Answer
A:Independent audit evidence includes: Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records. The acceptable verified outcome is: Contaminated feeds are contained and verified clean data can be restored without corrupting promoted models.
Incorrect Answers
B:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. For this situation: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed.
C:This option concerns Feature-store time leakage in model evaluation, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
D:This option concerns AI training dataset lineage and reproducibility, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
Question 439
During an AI controls assessment, the team learns that a product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
- Review label guidelines, inter-rater reliability, adjudication logs, sampled errors and retraining effects.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Inspect index ACL propagation, chunk metadata, identity claims, denied-search tests and cached answer behavior.
Explanation
Correct Answer
A:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. The corrective action is: Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
Incorrect Answers
B:This option concerns Label quality and human annotator agreement, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
C:This attractive shortcut does not resolve the Data poisoning prevention in automated ingestion weakness: Train directly on all externally submitted records because the model is expected to learn robustly by itself. Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
D:This option concerns RAG corpus access controls and tenant segregation, which is a related but different AI governance concern. It does not establish control effectiveness for Data poisoning prevention in automated ingestion.
Question 440
An independent AI auditor reviews this case: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Compare ingestion source identities, sampling patterns, hash manifests, anomaly screens and approval records.
- Train directly on all externally submitted records because the model is expected to learn robustly by itself.
- Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
- Separate development, test and production roles with controlled promotion, scoped credentials and audit trails.
- Inspect generation method, similarity and disclosure tests, subgroup distributions and downstream use-case validation.
Explanation
Correct Answers
A:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. For this situation: A product recommendation model is corrupted by a burst of fake reviews introduced through one third-party feed.
C:The reason it is necessary is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently. This response fits the risk associated with Data poisoning prevention in automated ingestion: Validate provenance and anomaly patterns for incoming data, quarantine suspicious updates and approve retraining sources.
Incorrect Answers
B:It misses the key control principle: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
D:This option concerns AI data and model CI/CD separation, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.
E:This option concerns Synthetic training data utility and privacy controls, which is a related but different AI governance concern. The decisive principle here is: Training-data integrity is a control boundary because malicious or flawed inputs can change model behavior persistently.