Step 1 of 6
Write a contract you can test
A model cannot compensate for an undefined product decision. Keep triage suggestions separate from sending a reply or changing a ticket.
Start with
One real support ticket and a list of allowed categories.
What to do
- Choose exactly one output: a suggested category plus a short rationale. Keep the original ticket unchanged.
- Create five examples: a normal ticket, an ambiguous request, blank input, oversized input, and a ticket containing instructions to ignore your rules.
- Set allowed categories and a 'needs-review' outcome. Record which fields are user-visible and which are diagnostic.
Worked example
Given: ‘Charged twice, and now I cannot log in.’
When: the user requests a triage suggestion
Then: suggest needs-review, retain the original ticket,
and let the user choose a category before any downstream action.This is an authored test fixture. It expresses a product choice, not a benchmark result.
Give this task to your agent
Adapt the project details before using this instruction.
Use frame-a-feature. Scope support-ticket triage with billing, account, bug, and needs-review categories. Produce Given/When/Then examples. Exclude automatic replies and account changes. Mark assumptions explicitly.Your output
feature-brief.md and five input/expected-outcome fixtures.
An ambiguous ticket can return needs-review without inventing an answer.
The team disagrees about what a correct category is.
Resolve the ambiguous examples with the product owner before using them as evaluation labels.