The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Second Rater notes #1: an AI scorer can agree with examiners on average and still be wrong in one predictable place.
In this illustrative Spot-Check (fictional app, synthetic data), the scorer matched a blind second rater on 11 of 20 workplace emails. Seven of the nine disagreements went the same way: the AI scored higher, mostly at B1, where long, fluent emails skipped a required recommendation and still earned B2.
The fix is not a new model. It is a task-completion gate, a re-anchored B1/B2 boundary and length-matched probes in the regression set.
Full one-page verdict: https://contra.com/p/cYkPrW62-second-rater-spot-check-sample-verdict-synthetic-data
If you run an AI tutor or scorer and want to know where yours drifts, the Second Rater Spot-Check takes five days.
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Related posts
More screens for mystical tarot reading app concept, inspired by a little spooky season magic 🎃🔮
What if coffee packaging had a personality? 🐾
I designed Moku’s whole world, from bags and cold brew cans to drip packs and cups, around a cat who’s always having a better day than you.
See the full project and let me know what you think!
Woow Jerin that's stunning🔥🔥
The colors was so vibrant that's unbelievable
Serious numbers, calm design.
512Financial is an Austin-based firm that steps in as the finance, HR and hiring team growth-stage companies don’t have yet. Their world is board meetings, due diligence and funding rounds, which can feel heavy and intimidating for founders.
My goal with the website was to make it feel the opposite: clear, steady and human. Deep green tones, lots of breathing room, and a “Readiness by Stage” section that lets every founder find their next step in seconds, from Seed to Series B and beyond.
Live now: 512financial.com
