A polished explanation can still misdiagnose a learner’s writing.

Illustrative QA case — synthetic content, not a real learner or vendor result.

The learner writes: “I look forward to hearing from you.”

An AI reviewer calls “hearing” a grammar error and changes it to “hear”. The original phrase is appropriate. The suggested correction introduces a problem.

A plausible overall score would not make that feedback acceptable. I would log a false correction, preserve the exact input and output, and add a retest that checks whether the system leaves the valid phrase intact.

Three useful checks for a writing-feedback team:

• Does each claimed error have evidence in the learner’s actual response? • Does the proposed revision preserve the intended meaning and valid language? • After a prompt change, do previously accepted cases still pass?

Keep feedback accuracy separate from score agreement. A system can pass one check and fail the other.

For EdTech teams preparing a writing-feature release, I offer a bounded review of rubric alignment, scoring consistency and feedback defects, with an evidence workbook and acceptance tests.

Tell me what your scorer measures, which rubric it follows and what concerns you want to investigate.