Question 400
An HR group claims fair outcomes based only on the average model accuracy across all employees. Which AI choice or business response BEST addresses the primary requirement?
Explanation
Correct Answer
Measure and mitigate differences in model performance across relevant populations and avoid using biased training data as unquestioned truth. This approach directly addresses the decision boundary. Aggregate benchmark success can hide disparate outcomes; fairness requires representative evaluations and governance. Validate key assumptions using: Inspect subgroup outcomes, sample coverage, annotation quality, evaluation design, fairness metrics and appeal processes. Scenario: An HR group claims fair outcomes based only on the average model accuracy across all employees.
Incorrect Answers
Reduce unsupported model assertions with grounded evidence, explicit uncertainty and targeted verification before using answers for business decisions. This response is aimed at Hallucination detection and source verification, not the controlling requirement here. Fluent generative text can contain false claims; a confident tone or low sampling temperature is not a factual guarantee. The targeted response is: Measure and mitigate differences in model performance across relevant populations and avoid using biased training data as unquestioned truth. Scenario: An HR group claims fair outcomes based only on the average model accuracy across all employees.
Use Google's Secure AI Framework (SAIF) as a structured way to identify and mitigate AI-specific risks across data, models, infrastructure and use. This response is aimed at Secure AI Framework risk categories and defense, not the controlling requirement here. SAIF guides security practices throughout the AI system; a framework name does not independently enforce access policy. The targeted response is: Measure and mitigate differences in model performance across relevant populations and avoid using biased training data as unquestioned truth. Scenario: An HR group claims fair outcomes based only on the average model accuracy across all employees.
Define outcome-oriented pilot metrics such as quality, time saved, cost per resolved case and customer experience, with a baseline and guardrails. This response is aimed at Pilot KPIs and return on investment, not the controlling requirement here. Interaction counts and generated token volume are activity metrics, not a proven return on investment. The targeted response is: Measure and mitigate differences in model performance across relevant populations and avoid using biased training data as unquestioned truth. Scenario: An HR group claims fair outcomes based only on the average model accuracy across all employees.


