Question 670
A vendor upgrades a model and a once-working form extractor begins omitting required values. Which TWO complementary actions identify the appropriate response AND the evidence needed to verify it? Select TWO.
Explanation
Correct Answers
Monitor deployed generative AI with reproducible evaluations, task KPIs, version records and drift or incident tracking, not only subjective user praise. This approach directly addresses the decision boundary. Foundation-model updates and data drift can change outcomes; continuous monitoring must include both technical and business indicators. Validate key assumptions using: Inspect evaluation baselines, model/prompt versions, sampling, error rates, cost metrics, alerts and release changes. This is the implementation part of the requested pair. Scenario: A vendor upgrades a model and a once-working form extractor begins omitting required values.
Inspect evaluation baselines, model/prompt versions, sampling, error rates, cost metrics, alerts and release changes. These observations test the stated cause before the team changes a system or policy. Foundation-model updates and data drift can change outcomes; continuous monitoring must include both technical and business indicators. The most suitable approach is: Monitor deployed generative AI with reproducible evaluations, task KPIs, version records and drift or incident tracking, not only subjective user praise. This is the verification part of the requested pair. Scenario: A vendor upgrades a model and a once-working form extractor begins omitting required values.
Incorrect Answers
Inspect whether the question requires public updates, citation freshness, source authority and outbound search policy. This step is associated with Grounding with Google Search for public current facts, but it is not one of the two complementary requirements here. The intended response and verification are: Monitor deployed generative AI with reproducible evaluations, task KPIs, version records and drift or incident tracking, not only subjective user praise. Plus: Inspect evaluation baselines, model/prompt versions, sampling, error rates, cost metrics, alerts and release changes. Scenario: A vendor upgrades a model and a once-working form extractor begins omitting required values.
Ground responses in authorized first-party business content when the question concerns internal policy, using retrieval with access and freshness checks. This step is associated with First-party enterprise grounding and source access, but it is not one of the two complementary requirements here. The intended response and verification are: Monitor deployed generative AI with reproducible evaluations, task KPIs, version records and drift or incident tracking, not only subjective user praise. Plus: Inspect evaluation baselines, model/prompt versions, sampling, error rates, cost metrics, alerts and release changes. Scenario: A vendor upgrades a model and a once-working form extractor begins omitting required values.
Only permitted enterprise data is accessed and attributable usage meets the organization's stated policy. This step is associated with Enterprise AI data control and governance, but it is not one of the two complementary requirements here. The intended response and verification are: Monitor deployed generative AI with reproducible evaluations, task KPIs, version records and drift or incident tracking, not only subjective user praise. Plus: Inspect evaluation baselines, model/prompt versions, sampling, error rates, cost metrics, alerts and release changes. Scenario: A vendor upgrades a model and a once-working form extractor begins omitting required values.


