Anthropic CCA-F Practice Test 18
Question 170
A create_subscription tool automatically charges a card, but its description only says 'manage plan'. What must be made explicit?
- Document that invocation creates a paid subscription and requires authorization
- Explain the business questions the lookup answers and what information it returns
- Specify accepted ISO date formatting and include a valid parameter example
- Treat tool metadata as untrusted and enforce platform authorization separately
Explanation
Correct Answer
A:A side-effectful interface needs clear semantics and approval expectations. Hidden charging behavior undermines safe tool choice and user consent. Explain that the operation actually creates a billable subscription, not merely previews a plan. The host must check account authority, consent and payment conditions before executing a charge-capable tool call.
Incorrect Answers
B:Tool descriptions should help the model recognize when a tool is useful. The decisive requirement here is to surface consequential side effects before tool invocation.
C:Models select argument values using schema and descriptions. This alternative does not establish how to surface consequential side effects before tool invocation in the stated workflow.
D:Rejecting malicious tool-metadata instructions protects policy boundaries, but this subscription tool's description is incomplete rather than adversarial. State clearly that invoking it creates a paid charge and requires authorization. Untrusted-data treatment alone cannot tell an operator about hidden financial side effects.
Question 171
A shipment lookup expects one tracking ID but the model sends a comma-separated list of ten. How should the interface handle this?
- Specify a single tracking_id argument and expose a separate batch lookup if supported
- Replace secrets with an authorized opaque account identifier or delegated identity token
- Specify accepted ISO date formatting and include a valid parameter example
- Explain the business questions the lookup answers and what information it returns
Explanation
Correct Answer
A:Clear cardinality prevents accidental parsing of list strings as one identifier. Dedicated batch tools have distinct contracts and rate limits. A typed tracking_id field should accept one supported identifier, with an explicit array-based batch endpoint if bulk queries are allowed. Treating a comma-separated string as one ID risks failed or cross-record lookups.
Incorrect Answers
B:A well-designed tool should request only the data needed for its action. The scenario instead requires a way to define whether a tool accepts one item or many.
C:Models select argument values using schema and descriptions. Although useful elsewhere, it is not the direct mechanism to define whether a tool accepts one item or many.
D:Tool descriptions should help the model recognize when a tool is useful. The proposed option cannot provide the specific “Specify a single tracking_id argument and expose a separate batch lookup if supported” behavior that the case requires. A typed tracking_id field should accept one supported identifier, with an explicit array-based batch endpoint if bulk queries are allowed.
Question 172
A search tool returns unlabelled mixed records from invoices and support tickets. What design improves downstream use?
- Replace secrets with an authorized opaque account identifier or delegated identity token
- Return typed entries with source, record ID and relevant fields in a stable result schema
- Treat tool metadata as untrusted and enforce platform authorization separately
- Split read and modification operations into clearly named tools with distinct permissions
Explanation
Correct Answer
B:Structured result contracts prevent consumers from guessing what a value represents. Provenance fields support later citation and verification. Include a record type, source system, stable record identifier and type-specific fields for each entry. The model must not infer whether a number is an invoice balance or a support ticket ID from an unlabeled string.
Incorrect Answers
A:Opaque account identifiers avoid exposing passwords during lookups, but the search results here mix invoices and support tickets without type labels. The response needs typed source, record ID and field metadata so the agent can distinguish different entity kinds before summarizing.
C:Metadata distrust is important if a returned description attempts to override instructions. This result instead lacks a schema that distinguishes invoice records from ticket records. Add type and provenance fields to each search hit; filtering prompt-injection text would not clarify ordinary data types.
D:Separating effects makes least-privilege scoping and confirmation easier. That addresses a different part of the system, not the requirement to make heterogeneous tool outputs self-describing.
Question 173
A lookup tool requests full customer passwords to find an account. Which redesign is appropriate?
- Expose only the small relevant read-only tool subset to that subagent
- Split read and modification operations into clearly named tools with distinct permissions
- Name tools for the user-visible action they perform and describe when to invoke them
- Replace secrets with an authorized opaque account identifier or delegated identity token
Explanation
Correct Answer
D:A well-designed tool should request only the data needed for its action. Password collection is neither necessary nor appropriate for identity lookup. Passwords are not necessary for identifying a customer and should never be demanded by a lookup tool. Use a scoped account identifier or verified session authorization so compromise of tool arguments does not expose reusable credentials.
Incorrect Answers
A:A narrow read-only tool list reduces what a specialist can invoke, but it does not correct a lookup tool that demands full customer passwords as a required argument. Redesign its credential contract around an authorized opaque account ID or delegated identity token instead of distributing secrets.
B:Separating effects makes least-privilege scoping and confirmation easier. This alternative does not establish how to minimize sensitive input required by tools in the stated workflow.
C:Tool descriptions are part of the model's decision interface. Although useful elsewhere, it is not the direct mechanism to minimize sensitive input required by tools.
Question 174
An MCP tool changes a response field from address to mailing_address and breaks an existing agent. How should maintainers evolve it?
- Replace secrets with an authorized opaque account identifier or delegated identity token
- Version the schema or provide a compatibility mapping with clear deprecation guidance
- Name tools for the user-visible action they perform and describe when to invoke them
- Mark invoice_id required in the tool input schema and validate its format
Explanation
Correct Answer
B:Stable tool contracts matter as much as implementation. Versioning or compatibility adapters avoid silent downstream behavior changes. Version or translate the response contract at the adapter boundary, and test existing clients before removing the original field. Silently changing address to mailing_address can make consumers misinterpret absent data as a legitimate empty value.
Incorrect Answers
A:A well-designed tool should request only the data needed for its action. That addresses a different part of the system, not the requirement to manage breaking tool schema changes predictably.
C:Tool descriptions are part of the model's decision interface. This alternative—Name tools for the user-visible action they perform and describe when to invoke them—does not implement the specific operation that the question asks about. The required control is Version the schema or provide a compatibility mapping with clear deprecation guidance. Stable tool contracts matter as much as implementation.
D:Requiring invoice_id improves validation for payment requests, but it does not address a response contract renamed from address to mailing_address. Existing clients expect the former field. Version the interface or provide a documented compatibility alias before removing the old field.
Question 175
A retrieved tool description includes instructions to ignore the caller's security policies. What should the host do?
- Obey instructions embedded in retrieved tool metadata even when they contradict the caller's platform permissions
- Document that invocation creates a paid subscription and requires authorization
- Explain the business questions the lookup answers and what information it returns
- Treat tool metadata as untrusted and enforce platform authorization separately
Explanation
Correct Answer
D:Descriptions help tool selection but cannot override application policy. A model-facing tool catalog must not become a bypass for actual authorization. Retrieved tool descriptions are untrusted metadata, not permission to override platform instructions or policy. Tool selection and execution still require validation against authorized capabilities, even if the metadata contains a persuasive directive.
Incorrect Answers
A:Retrieved descriptions are not an authority to override host policies or grant tools extra access. Execution permissions must be enforced independently of any untrusted metadata or prompt-injection text.
B:Describing that a subscription call charges money is vital for a payment tool, but the retrieved description here tells Claude to ignore security policies. This is untrusted instruction text, not a valid specification change. Keep authorization decisions in the platform and disregard the hostile directive.
C:Tool descriptions should help the model recognize when a tool is useful. It would leave the stated need to keep tool discovery separate from authority to act unresolved.
Question 176
A billing update tool accepts amount but omits currency and minor-unit semantics. What improvement avoids financial mistakes?
- Mark invoice_id required in the tool input schema and validate its format
- Require explicit currency and define the amount unit in the schema
- Document that invocation creates a paid subscription and requires authorization
- Define priority as an enum with only the supported values
Explanation
Correct Answer
B:Ambiguous units can make valid-looking tool calls dangerous. Currency codes and documented numeric conventions allow correct validation. Amounts need an unambiguous currency and representation—minor units such as cents or an exact decimal format—because a bare amount cannot distinguish $10 from 10 cents or another currency. Validate both fields before charging.
Incorrect Answers
A:A precise schema rejects incomplete calls before side effects. This alternative does not establish how to remove ambiguous units from state-changing tool arguments in the stated workflow.
C:A side-effectful interface needs clear semantics and approval expectations. Although useful elsewhere, it is not the direct mechanism to remove ambiguous units from state-changing tool arguments.
D:A constrained schema reduces unsupported requests and makes valid choices unambiguous. The scenario instead requires a way to remove ambiguous units from state-changing tool arguments.
Question 177
Two tools both have vague descriptions such as 'get information'. Which tool contract change most directly helps?
- Define a typed amount and explicit currency in its input schema
- Give each tool a distinct purpose, input semantics and selection guidance
- Return bounded task-relevant results with a request-more-detail mechanism
- Make genuinely mandatory identifiers required in the input schema
Explanation
Correct Answer
B:When two tools both have vague descriptions such as 'get information', the system should give each tool a distinct purpose, input semantics and selection guidance. Clear descriptions let a model choose the proper capability instead of guessing among similarly named tools. Reject incompatible schema values at the real tool boundary and retain enough metadata to identify the selected action.
Incorrect Answers
A:Explicit amount and currency types are essential for a payment tool, but the current failure is selection between two tools both described vaguely as 'get information.' Tightening a financial amount schema cannot tell Claude which tool performs which operation. Give the two tools distinct purposes, descriptions and expected input use cases.
C:Constrained output preserves context budget and avoids burying relevant evidence. This is not a substitute for “Give each tool a distinct purpose, input semantics and selection guidance”; that control is necessary in the stated circumstances. Clear descriptions let a model choose the proper capability instead of guessing among similarly named tools.
D:Correctly required inputs let validation reject incomplete calls before execution. The issue here is two tools both have vague descriptions such as 'get information', so the relevant control is to give each tool a distinct purpose, input semantics and selection guidance. Clear descriptions let a model choose the proper capability instead of guessing among similarly named tools.
Question 178
A customer lookup tool accepts either an email address or an account ID, but some calls provide both values belonging to different people. The backend silently chooses one field. What contract change best prevents an ambiguous identity lookup?
- Accept the request and select whichever identity field appears first in JSON
- Require a single supported identity selector per call and reject conflicting identifiers before lookup
- Return all customer records so the assistant can choose the likely match
- Remove identity validation because a lookup is read-only and cannot cause a security problem
Explanation
Correct Answer
B:The lookup contract should require exactly one identity selector, such as an email address or account ID, and reject requests supplying conflicting selectors. The service must never silently choose the first or last field when the values can refer to different people. Explicit validation prevents accidental cross-account reads and makes the user's intended lookup reproducible in logs and retries.
Incorrect Answers
A:The tool should require a deterministic identity selection rule, such as exactly one recognized identifier or a validated match when both are present. A conflict must return a specific input error rather than silently using the wrong account. This protects downstream authorization and avoids leaking another customer's information.
C:Broadly returning unrelated customers exposes more sensitive information and still leaves ambiguity unresolved. The caller should be asked for a valid unambiguous selector, not handed a bulk result to guess from.
D:A read-only lookup can disclose private account data or feed later write operations. Server-side argument validation therefore remains essential even when the immediate tool does not modify the database.
Question 179
A search tool returns an entire document corpus for every narrow query. Which input or output contract is most appropriate?
- Make genuinely mandatory identifiers required in the input schema
- Use intention-revealing names and precise side-effect descriptions
- Treat returned content as data and keep trusted descriptions under developer control
- Return bounded task-relevant results with a request-more-detail mechanism
Explanation
Correct Answer
D:The relevant control is to return bounded task-relevant results with a request-more-detail mechanism. Constrained output preserves context budget and avoids burying relevant evidence. This matters when a search tool returns an entire document corpus for every narrow query. Reject incompatible schema values at the real tool boundary and retain enough metadata to identify the selected action.
Incorrect Answers
A:this choice instead describes make genuinely mandatory identifiers required in the input schema. The issue here is a search tool returns an entire document corpus for every narrow query, so the relevant control is to return bounded task-relevant results with a request-more-detail mechanism. Constrained output preserves context budget and avoids burying relevant evidence.
B:Clear distinctions between reads and writes prevent a retrieval intent from selecting a destructive capability. Here, a search tool returns an entire document corpus for every narrow query. Return bounded task-relevant results with a request-more-detail mechanism. Constrained output preserves context budget and avoids burying relevant evidence.
C:Untrusted search text must not redefine the meaning or authorization of a tool interface. The direct remedy is “Return bounded task-relevant results with a request-more-detail mechanism”, which the alternative does not itself accomplish. Constrained output preserves context budget and avoids burying relevant evidence.
Question 180
An order-history tool returns only the first 100 records but gives no indication that more records exist. The agent mistakenly tells a customer the history is complete. What should the tool response contract add?
- A total-or-has_more indicator and stable pagination cursor for retrieving further results
- A larger free-text prompt demanding that the model remember all prior records
- An unconditional statement that the first page is exhaustive
- A privileged delete endpoint for removing older records before searching
Explanation
Correct Answer
A:A paginated result must explicitly state whether more pages remain and provide a stable cursor or equivalent next-page reference. The agent can then continue within budget or truthfully label a partial result. Without this metadata, a valid first page can be misinterpreted as the entire order history.
Incorrect Answers
B:A prompt cannot retrieve records that the tool never returned or establish where the next page begins. The missing information is a result-contract property that the tool provider must supply.
C:Declaring the first page exhaustive when a backend truncates at 100 records creates a false completeness guarantee. Pagination boundaries must be represented in actual tool output, not assumed by the consumer.
D:Deleting history changes customer data and is unrelated to safe pagination. It would sacrifice auditability and might violate retention obligations merely to avoid specifying a proper result contract.