Question 650
The data engineering team must correct this issue: A content pipeline sends customer free-text support tickets to a generative model for categorization without excluding sensitive identifiers. Which controlled engineering action is MOST appropriate?
Explanation
Correct Answer
De-identify permitted fields and apply reviewed model categorization with validation and restricted output. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use. AI-assisted enrichment must enforce input governance, data minimization, and output validation.
Incorrect Answers
Build idempotent or transactional external writes with stable business event keys. This addresses a different situation: An engineer claims an exactly-once Dataflow pipeline makes arbitrary external API side effects impossible to duplicate. The current scenario instead calls for the more directly applicable engineering action: De-identify permitted fields and apply reviewed model categorization with validation and restricted output. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.
Evolve the schema compatibly or route incompatible versions through a governed mapping. This addresses a different situation: A partner adds nested JSON attributes to events and downstream parsing jobs fail on unknown fields. The current scenario instead calls for the more directly applicable engineering action: De-identify permitted fields and apply reviewed model categorization with validation and restricted output. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.
Apply CDC changes using reliable source sequence/version ordering with replay safeguards. This addresses a different situation: Datastream CDC events sometimes reach the destination out of order after reconnection and older rows overwrite current values. The current scenario instead calls for the more directly applicable engineering action: De-identify permitted fields and apply reviewed model categorization with validation and restricted output. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.


