Isaca AAIA Practice Test 104
Question 1030
An independent AI auditor reviews this case: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Inspect version timelines, drift monitors, incident dates, feature snapshots and time-based sampling criteria.
- Sample across relevant periods, model versions and operational shifts and reconstruct point-in-time inputs.
- Inspect source test inputs, environment version, expected result, output logs and exception handling.
- Reconcile source populations, failed records, joins and transformations before interpreting AI audit analytics.
- Assume last month's clean output validates all past and future behavior of a changing model.
Explanation
Correct Answers
A:The reason it is necessary is: AI controls can be effective in one period but fail after model, data or environmental changes. The acceptable verified outcome is: Audit tests distinguish current and historical control effectiveness with reproducible period evidence.
B:The reason it is necessary is: AI controls can be effective in one period but fail after model, data or environmental changes. For this situation: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
Incorrect Answers
C:This option concerns Reperformance and adversarial audit test cases, which is a related but different AI governance concern. In this case: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
D:This option concerns Audit data completeness and reconciliation, which is a related but different AI governance concern. For this situation: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
E:This attractive shortcut does not resolve the Time-based audit testing for drifting AI systems weakness: Assume last month's clean output validates all past and future behavior of a changing model. For this situation: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
Question 1031
A governance and assurance review uncovers the following: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Assume last month's clean output validates all past and future behavior of a changing model.
- Inspect version timelines, drift monitors, incident dates, feature snapshots and time-based sampling criteria.
- Inspect source test inputs, environment version, expected result, output logs and exception handling.
- Inspect row counts, independent totals, missing keys, excluded statuses and transformation logs.
Explanation
Correct Answer
B:For this situation: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
Incorrect Answers
A:It misses the key control principle: AI controls can be effective in one period but fail after model, data or environmental changes.
C:This option concerns Reperformance and adversarial audit test cases, which is a related but different AI governance concern. For this situation: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
D:This option concerns Audit data completeness and reconciliation, which is a related but different AI governance concern. The audit must corroborate: Inspect version timelines, drift monitors, incident dates, feature snapshots and time-based sampling criteria.
Question 1032
A risk-based audit engagement examines this operating condition: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Assume last month's clean output validates all past and future behavior of a changing model.
- Independent repeat tests reproduce control behavior and deviations generate substantiated findings.
- Reported conclusions state what the sample supports and do not overgeneralize judgmental observations.
- Audit tests distinguish current and historical control effectiveness with reproducible period evidence.
Explanation
Correct Answer
D:This is an observable validation result for Time-based audit testing for drifting AI systems, not just management assurance: Audit tests distinguish current and historical control effectiveness with reproducible period evidence.
Incorrect Answers
A:The auditor should instead examine: Inspect version timelines, drift monitors, incident dates, feature snapshots and time-based sampling criteria.
B:This option concerns Reperformance and adversarial audit test cases, which is a related but different AI governance concern. The audit must corroborate: Inspect version timelines, drift monitors, incident dates, feature snapshots and time-based sampling criteria.
C:This option concerns Attribute and variable sampling for AI controls, which is a related but different AI governance concern. In this case: A transaction detector had seasonal errors yet auditors sample only a quiet week from last year.
Question 1033
An audit committee asks for a defensible assessment of this situation: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Define objective risk-based audit criteria from approved organizational policies, relevant standards and applicable law.
- Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
- Reperform representative positive and negative controls using independently selected inputs and authorized challenge procedures.
Explanation
Correct Answer
C:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. In this case: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval.
Incorrect Answers
A:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
B:This option concerns AI audit criteria and control objectives, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
D:This option concerns Reperformance and adversarial audit test cases, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
Question 1034
During an AI controls assessment, the team learns that an auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Control operation is better evidenced by observed outcomes and reproducible test steps than management assertions.
- Audit scope must follow enterprise AI exposure, not only visible software projects or infrastructure boundaries.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
Explanation
Correct Answer
D:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. Independent audit evidence includes: Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
Incorrect Answers
A:This option concerns Reperformance and adversarial audit test cases, which is a related but different AI governance concern. For this situation: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval.
B:This option concerns Risk-based AI audit universe and scope, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
C:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. For this situation: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval.
Question 1035
An independent AI auditor reviews this case: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Reconcile AI inventory, data flows, business ownership, complaints, material incidents and risk appetite to audit plan.
- Inspect audit program, control objectives, regulatory applicability, measurements and management agreement on criteria.
Explanation
Correct Answer
A:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. This evidence directly tests the asserted control for Attribute and variable sampling for AI controls: Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
Incorrect Answers
B:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. It misses the key control principle: Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
C:This option concerns Risk-based AI audit universe and scope, which is a related but different AI governance concern. For this situation: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval.
D:This option concerns AI audit criteria and control objectives, which is a related but different AI governance concern. For this situation: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval.
Question 1036
A governance and assurance review uncovers the following: An auditor tests whether every model release had an approval but confuses evidence of existence with quality of approval. After management addresses the issue, which result MOST convincingly demonstrates effective remediation? Select ONE best answer.
- Independent auditors retain final conclusions and conflicts are mitigated with transparent quality review.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Reported conclusions state what the sample supports and do not overgeneralize judgmental observations.
- The audit reaches a defensible scoped conclusion or clearly reports evidence restrictions and residual risk.
Explanation
Correct Answer
C:The reason it is necessary is: Sampling claims require valid method, controls over selection and a clear interpretation of exceptions. This is an observable validation result for Attribute and variable sampling for AI controls, not just management assurance: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations.
Incorrect Answers
A:This option concerns Auditor independence with AI-enabled workpapers, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
B:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. The auditor should instead examine: Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
D:This option concerns Third-party AI assurance boundary and audit rights, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
Question 1037
A risk-based audit engagement examines this operating condition: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population. What is the MOST appropriate risk-based audit recommendation that addresses the root control weakness? Select ONE best answer.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Sample across relevant periods, model versions and operational shifts and reconstruct point-in-time inputs.
- Plan third-party evidence access, complementary user controls, limitation statements and risk-based alternative procedures.
- Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
Explanation
Correct Answer
D:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. This is the proportionate control response to Attribute and variable sampling for AI controls: Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
Incorrect Answers
A:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. Effective closure requires: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations.
B:This option concerns Time-based audit testing for drifting AI systems, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
C:This option concerns Third-party AI assurance boundary and audit rights, which is a related but different AI governance concern. The decisive principle here is: Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
Question 1038
An audit committee asks for a defensible assessment of this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population. Which principle BEST explains why the observed practice is a material governance or control concern? Select ONE best answer.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- A statistically large aggregate sample may fail to capture rare but material AI failure conditions.
- Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
- Outsourced AI decisions remain material to the customer organization even if source code is not accessible.
Explanation
Correct Answer
C:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. The corrective action is: Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
Incorrect Answers
A:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. For this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population.
B:This option concerns Stratified sampling for rare AI harms, which is a related but different AI governance concern. It does not establish control effectiveness for Attribute and variable sampling for AI controls.
D:This option concerns Third-party AI assurance boundary and audit rights, which is a related but different AI governance concern. For this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population.
Question 1039
During an AI controls assessment, the team learns that a team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population. What evidence should the auditor examine FIRST to substantiate or challenge the control owner’s claim? Select ONE best answer.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
- Inspect service organization reports, contract rights, complementary controls, model monitoring and exception records.
- Inspect sampling frame, strata, selection method, base rates, exclusions and subgroup results.
Explanation
Correct Answer
B:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. The reason it is necessary is: Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
Incorrect Answers
A:This attractive shortcut does not resolve the Attribute and variable sampling for AI controls weakness: Project an auditor-selected convenience sample to the full deployment as if it were statistically random. Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
C:This option concerns Third-party AI assurance boundary and audit rights, which is a related but different AI governance concern. The audit must corroborate: Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
D:This option concerns Stratified sampling for rare AI harms, which is a related but different AI governance concern. For this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population.
Question 1040
An independent AI auditor reviews this case: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population. Which TWO complementary elements should the auditor seek: an effective corrective control and the most probative independent evidence? Select TWO answers.
- Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
- Project an auditor-selected convenience sample to the full deployment as if it were statistically random.
- Preserve professional objectivity, disclose conflicts and independently validate AI-assisted audit decisions.
- Inspect population completeness, test objective, sampling design, tolerable error and audit projection rules.
- Inspect service organization reports, contract rights, complementary controls, model monitoring and exception records.
Explanation
Correct Answers
A:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. This response fits the risk associated with Attribute and variable sampling for AI controls: Match attribute, variables and judgmental methods to the test purpose with transparent population and exception logic.
D:The acceptable verified outcome is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations. For this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population.
Incorrect Answers
B:For this situation: A team draws a judgmental sample of prompts and presents it as an unbiased estimate for the entire population.
C:This option concerns Auditor independence with AI-enabled workpapers, which is a related but different AI governance concern. The decisive principle here is: Sampling claims require valid method, controls over selection and a clear interpretation of exceptions.
E:This option concerns Third-party AI assurance boundary and audit rights, which is a related but different AI governance concern. The outcome to verify is: Reported conclusions state what the sample supports and do not overgeneralize judgmental observations.