Writing QA Example: Evaluating Task Fulfilment Beyond GrammarWriting QA Example: Evaluating Task Fulfilment Beyond Grammar
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
A polished email can still miss the task.
In my new fictional writing-QA example, the task asks the writer to offer Thursday at 14:00 or Friday at 10:00 and request a reply by Tuesday at 16:00.
The 137-word response sounds polite and offers Thursday. It leaves out Friday and the reply deadline.
Those omissions belong in a task-fulfilment decision. A strong grammar score cannot supply the missing information.
For an AI-writing review, I freeze the rubric, review the responses before seeing the AI scores, then compare the decisions and record the evidence behind each disagreement.
The free four-page example shows that process and a repair. Its scores are invented for illustration; this is not an actual model test or an independently rated benchmark.
Download it with the assessment-QA and course-review examples here: Free English Assessment & Course QA Samples
Benjamin's avatar
TRUEFRAME logo
offering thursday but dropping friday AND the deadline is such a real failure mode. do you weight a missed deadline heavier than a missed option?
Suliman's avatar
Good question, Benjamin. Yes, I would generally give a missed deadline greater weight because it can directly affect the outcome of the task. However, the weighting should depend on the context and consequences of each omission. In this example, both are task-fulfilment...
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started