Anthropic CCA-F Practice Test 12
Question 110
A team wants to record tool effects only after the tool successfully runs. What change would make interception reliable?
- Combine tool restrictions with command-level validation at the host boundary
- Use a PostToolUse hook to inspect the completed tool result
- Configure a real programmatic hook for deterministic tool interception
- Fail closed and deny the destructive operation until authorization can be validated
Explanation
Correct Answer
B:A team wants to record tool effects only after the tool successfully runs. The relevant control is to use a PostToolUse hook to inspect the completed tool result. Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect. Match the hook to the intended tool and lifecycle event, and fail safely when the validation itself fails.
Incorrect Answers
A:A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy. This is not a substitute for “Use a PostToolUse hook to inspect the completed tool result”; that control is necessary in the stated circumstances. Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect.
C:A text instruction is probabilistic and does not create the execution-time callback required for enforcement. The proposed option cannot provide the specific “Use a PostToolUse hook to inspect the completed tool result” behavior that the case requires. Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect.
D:A security-critical guard should not interpret an unavailable policy decision as permission. The direct remedy is “Use a PostToolUse hook to inspect the completed tool result”, which the alternative does not itself accomplish. Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect.
Question 111
An agent may run arbitrary shell commands if the tool is allowed. How should the hook configuration be corrected?
- Configure a real programmatic hook for deterministic tool interception
- Fail closed and deny the destructive operation until authorization can be validated
- Combine tool restrictions with command-level validation at the host boundary
- Redact or quarantine the result and escalate the unexpected disclosure
Explanation
Correct Answer
C:The relevant control is to combine tool restrictions with command-level validation at the host boundary. A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy. This matters when an agent may run arbitrary shell commands if the tool is allowed. A pre-execution guard and a post-execution observer serve different purposes; verify the correct timing and scope.
Incorrect Answers
A:A text instruction is probabilistic and does not create the execution-time callback required for enforcement. Here, an agent may run arbitrary shell commands if the tool is allowed. Combine tool restrictions with command-level validation at the host boundary. A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy.
B:A security-critical guard should not interpret an unavailable policy decision as permission. This is not a substitute for “Combine tool restrictions with command-level validation at the host boundary”; that control is necessary in the stated circumstances. A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy.
D:A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred. Here, an agent may run arbitrary shell commands if the tool is allowed. Combine tool restrictions with command-level validation at the host boundary. A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy.
Question 112
A hook is described in a system prompt but no hook is installed. Which hook-related boundary prevents this failure?
- Fail closed and deny the destructive operation until authorization can be validated
- Redact or quarantine the result and escalate the unexpected disclosure
- Inspect the target tool name and structured arguments rather than keywords in the model narrative
- Configure a real programmatic hook for deterministic tool interception
Explanation
Correct Answer
D:A text instruction is probabilistic and does not create the execution-time callback required for enforcement. For this situation, the system should configure a real programmatic hook for deterministic tool interception. The factual trigger is a hook is described in a system prompt but no hook is installed. Match the hook to the intended tool and lifecycle event, and fail safely when the validation itself fails.
Incorrect Answers
A:A security-critical guard should not interpret an unavailable policy decision as permission. The direct remedy is “Configure a real programmatic hook for deterministic tool interception”, which the alternative does not itself accomplish. A text instruction is probabilistic and does not create the execution-time callback required for enforcement.
B:A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred. The required action is “Configure a real programmatic hook for deterministic tool interception”; the other measure addresses a separate concern. A text instruction is probabilistic and does not create the execution-time callback required for enforcement.
C:Policy enforcement should bind to actual invocation metadata, not an easily varied natural-language description. Here, a hook is described in a system prompt but no hook is installed. Configure a real programmatic hook for deterministic tool interception. A text instruction is probabilistic and does not create the execution-time callback required for enforcement.
Question 113
A security hook fails unexpectedly while handling a destructive operation. What change would make interception reliable?
- Fail closed and deny the destructive operation until authorization can be validated
- Redact or quarantine the result and escalate the unexpected disclosure
- Inspect the target tool name and structured arguments rather than keywords in the model narrative
- Correlate hook records with their specific invocation and session identifiers
Explanation
Correct Answer
A:When a security hook fails unexpectedly while handling a destructive operation, the system should fail closed and deny the destructive operation until authorization can be validated. A security-critical guard should not interpret an unavailable policy decision as permission. A pre-execution guard and a post-execution observer serve different purposes; verify the correct timing and scope.
Incorrect Answers
B:A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred. Here, a security hook fails unexpectedly while handling a destructive operation. Fail closed and deny the destructive operation until authorization can be validated. A security-critical guard should not interpret an unavailable policy decision as permission.
C:Checking the actual tool name and arguments makes an authorization hook more accurate when it runs normally. It does not define what happens if a security-critical hook itself fails. The execution boundary must fail closed: block the destructive operation until policy evaluation succeeds instead of interpreting the hook exception as approval.
D:Stable identity is required to attribute each outcome and avoid mixing separate tool call histories. This is not a substitute for “Fail closed and deny the destructive operation until authorization can be validated”; that control is necessary in the stated circumstances. A security-critical guard should not interpret an unavailable policy decision as permission.
Question 114
A PostToolUse monitor notices a tool returned an unexpected data class. How should the hook configuration be corrected?
- Inspect the target tool name and structured arguments rather than keywords in the model narrative
- Redact or quarantine the result and escalate the unexpected disclosure
- Correlate hook records with their specific invocation and session identifiers
- Use a pre-execution enforcement hook or server-side authorization guard
Explanation
Correct Answer
B:A PostToolUse monitor notices a tool returned an unexpected data class. The relevant control is to redact or quarantine the result and escalate the unexpected disclosure. A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred. Match the hook to the intended tool and lifecycle event, and fail safely when the validation itself fails.
Incorrect Answers
A:A pre-execution check can prevent the tool from running, but it cannot inspect the unexpected class of data already returned by a successful tool. The described problem arises after execution, so the post-tool result must be inspected, quarantined or sanitized before it is sent into model context.
C:Stable identity is required to attribute each outcome and avoid mixing separate tool call histories. The direct remedy is “Redact or quarantine the result and escalate the unexpected disclosure”, which the alternative does not itself accomplish. A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred.
D:A blocking control must run before the protected operation, whereas observing output after execution cannot prevent it. Here, a PostToolUse monitor notices a tool returned an unexpected data class. Redact or quarantine the result and escalate the unexpected disclosure. A post-use monitor can detect an outcome and constrain later propagation, though the initial tool action has occurred.
Question 115
A hook needs to distinguish a harmless file read from a production configuration write. Which hook-related boundary prevents this failure?
- Correlate hook records with their specific invocation and session identifiers
- Use a pre-execution enforcement hook or server-side authorization guard
- Inspect the target tool name and structured arguments rather than keywords in the model narrative
- Use a PostToolUse hook to inspect the completed tool result
Explanation
Correct Answer
C:The relevant control is to inspect the target tool name and structured arguments rather than keywords in the model narrative. Policy enforcement should bind to actual invocation metadata, not an easily varied natural-language description. This matters when a hook needs to distinguish a harmless file read from a production configuration write. A pre-execution guard and a post-execution observer serve different purposes; verify the correct timing and scope.
Incorrect Answers
A:Stable identity is required to attribute each outcome and avoid mixing separate tool call histories. This is not a substitute for “Inspect the target tool name and structured arguments rather than keywords in the model narrative”; that control is necessary in the stated circumstances. Policy enforcement should bind to actual invocation metadata, not an easily varied natural-language description.
B:A blocking control must run before the protected operation, whereas observing output after execution cannot prevent it. Here, a hook needs to distinguish a harmless file read from a production configuration write. Inspect the target tool name and structured arguments rather than keywords in the model narrative. Policy enforcement should bind to actual invocation metadata, not an easily varied natural-language description.
D:Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect. The direct remedy is “Inspect the target tool name and structured arguments rather than keywords in the model narrative”, which the alternative does not itself accomplish. Policy enforcement should bind to actual invocation metadata, not an easily varied natural-language description.
Question 116
Several tool invocations run concurrently and audit events become interleaved. What change would make interception reliable?
- Use a pre-execution enforcement hook or server-side authorization guard
- Use a PostToolUse hook to inspect the completed tool result
- Combine tool restrictions with command-level validation at the host boundary
- Correlate hook records with their specific invocation and session identifiers
Explanation
Correct Answer
D:Stable identity is required to attribute each outcome and avoid mixing separate tool call histories. For this situation, the system should correlate hook records with their specific invocation and session identifiers. The factual trigger is several tool invocations run concurrently and audit events become interleaved. Match the hook to the intended tool and lifecycle event, and fail safely when the validation itself fails.
Incorrect Answers
A:A blocking control must run before the protected operation, whereas observing output after execution cannot prevent it. The required action is “Correlate hook records with their specific invocation and session identifiers”; the other measure addresses a separate concern. Stable identity is required to attribute each outcome and avoid mixing separate tool call histories.
B:Post-execution hooks observe outcomes and can audit or route feedback but cannot retroactively prevent a completed side effect. Here, several tool invocations run concurrently and audit events become interleaved. Correlate hook records with their specific invocation and session identifiers. Stable identity is required to attribute each outcome and avoid mixing separate tool call histories.
C:A broad tool permission is insufficient if individual shell invocations can still violate enterprise policy. Here, several tool invocations run concurrently and audit events become interleaved. Correlate hook records with their specific invocation and session identifiers. Stable identity is required to attribute each outcome and avoid mixing separate tool call histories.
Question 117
A PostToolUse hook replaces a raw database response with a summary; auditors later need the original. How should logging work?
- Store authorized raw evidence securely before passing a sanitized concise result to the agent
- Shared correlation IDs linking invocation, completion and task context
- Fail safely with a visible structured error rather than passing unvalidated data onward
- Apply narrow deterministic parsing and transformations only where required
Explanation
Correct Answer
A:Preserve the original database response only in access-controlled, retention-governed evidence storage under the correct request ID, and send the sanitized summary as the model-visible tool result. A PostToolUse replacement changes the content Claude receives but does not retroactively remove raw data from earlier telemetry, so sensitive fields also need separate logging controls.
Incorrect Answers
B:Trace identifiers allow pre- and post-execution records to be joined. The required action is “Store authorized raw evidence securely before passing a sanitized concise result to the agent”; the other measure addresses a separate concern. Separating secure evidence retention from the model-visible payload preserves auditability without expanding the assistant's exposure to sensitive records.
C:Interception logic becomes part of the reliability boundary. Although useful elsewhere, it is not the direct mechanism to retain verifiable raw logs while sanitizing agent context.
D:Deterministic transformations are generally preferable to an extra model call, but they do not preserve original evidence after a PostToolUse summary replaces it. Save the raw response in separately authorized audit storage before providing the sanitized summary to the agent, with a traceable identifier.
Question 118
An insurance claim must always be extracted, validated and recorded in fixed order. Which THREE workflow features should be built? Choose THREE.
- A normalization and cross-source reconciliation pass after individual workstreams
- Route the uncertain field to specialized extraction or human verification before continuing
- Use explicit prompt chaining or a fixed workflow with stage-by-stage validation
- Separate creation from independent verification with explicit citation checks
- Validate extraction fields against a strict schema before entering the record-writing stage.
- Use deterministic stage transitions that stop or route failed validations for correction.
Explanation
Correct Answers
C:An insurance-claim pipeline with an invariant extraction, validation and recording sequence should use a fixed chain rather than let an autonomous agent improvise the order. Each stage should receive the validated output of the previous stage and stop on an error. This keeps a rejected extraction from reaching the final ledger and gives auditors evidence of which rule accepted or rejected a claim.
E:Schema gates keep malformed OCR output from silently contaminating persisted claims. Extraction output should be checked for required fields, types and permissible formats before writing a claim. A parseable but malformed result must move to correction, not be persisted as an authoritative insurance record.
F:Explicit transitions preserve the required extraction-validation-write order and safe failure handling. A fixed-order claim workflow should encode collection, validation and persistence as distinct guarded transitions. On a failed validation the system must stop or reroute to correction rather than relying on a model to remember the sequence.
Incorrect Answers
A:Reconciling terminology across separate research agents is useful for parallel synthesis, but this insurance claim has fixed extract, validate and record prerequisites. Normalization alone cannot guarantee that invalid extraction is blocked before writing; deterministic stage gates must enforce the required ordering.
B:Dynamic workflows branch based on observed confidence and task characteristics. That addresses a different part of the system, not the requirement to apply fixed step chaining to predictable procedures.
D:An independent verification work item questions the draft from a different role, reducing shared blind spots. This capability does not directly apply fixed step chaining to predictable procedures.
Question 119
A scientist asks why a model's behavior deteriorated across five product releases with unknown root causes. Which strategy fits?
- A normalization and cross-source reconciliation pass after individual workstreams
- Keep the small tightly coupled writing task within one agent
- Let a coordinator dynamically propose investigation branches and refine them from evidence
- Use explicit prompt chaining or a fixed workflow with stage-by-stage validation
Explanation
Correct Answer
C:Open-ended investigation needs decomposition that responds to discoveries. Preallocating only static report sections can miss emergent causes. Unknown failure causes across releases require hypothesis-driven branches informed by intermediate findings, not one frozen keyword search. Track which product versions and evidence each branch has already examined.
Incorrect Answers
A:Parallel research increases throughput but does not guarantee consistent terminology. It would leave the stated need to use adaptive decomposition for uncertain investigative scope unresolved.
B:A small, tightly coupled writing task usually benefits from a single agent, but investigating deterioration across five releases involves unknown causes and independently testable hypotheses. Keeping one short linear task does not provide adaptive branching as evidence reveals new components or regressions.
D:A fixed prompt chain is appropriate when the steps are known in advance. This regression investigation has uncertain root causes spanning five releases; imposing a single static chain could overlook emergent hypotheses. A coordinator should branch based on retrieved evidence and revise its plan as discoveries accumulate.
Question 120
A research report covers six jurisdictions but the coordinator assigns each agent a narrow regulation keyword, missing entire countries. What change improves completeness?
- A normalization and cross-source reconciliation pass after individual workstreams
- Use a lightweight deterministic precheck and escalate only uncertain cases to specialists
- Split first by jurisdictional coverage, then by relevant regulation topics within each
- Track per-document work units and aggregate statuses at checkpoints
Explanation
Correct Answer
C:Top-down coverage decomposition helps avoid blind spots. Narrow terms chosen too early may exclude whole categories before research even begins. Establish every applicable jurisdiction first so the delegation design cannot accidentally exclude a country with a relevant rule. Within each jurisdiction, subdivide by regulations and reconcile cross-border conflicts before synthesis.
Incorrect Answers
A:Parallel research increases throughput but does not guarantee consistent terminology. The scenario instead requires a way to partition the full coverage space before specialist detail.
B:Hierarchical decomposition can reserve expensive reasoning for cases that need it. Here, a research report covers six jurisdictions but the coordinator assigns each agent a narrow regulation keyword, missing entire countries. Split first by jurisdictional coverage, then by relevant regulation topics within each. Top-down coverage decomposition helps avoid blind spots.
D:Fine-grained progress accounting exposes stalls and supports partial retries. That addresses a different part of the system, not the requirement to partition the full coverage space before specialist detail.