I fine-tuned a 1.5B model into a groundedness judge on my laptop — and it matched a frontier judge 100% of the time, for $0 per call.
Every RAG or agent eval gate needs a judge: something that reads a (question, context, answer) triple and rules whether every claim is actually...
github.com
GitHub - enached134-ctrl/groundcheck
Contribute to enached134-ctrl/groundcheck development by creating an account on GitHub.
I graded the official MCP servers. Two got an A, one got an F — and the most useful finding came from a layer nobody else measures.
mcp-vitals (open source) grades an MCP server's reliability A–F across three layers: static schema quality, behavioral tests run against the live...
enached134-ctrl.github.io
The State of MCP Reliability — graded A–F
I graded the official MCP reference servers for reliability and agent-usability. Two got an A, one got an F. Open-source CLI + GitHub Action.