Claude Fable 5.1 is moments away from release. You need to start preparing immediately I HIGHLY r...Claude Fable 5.1 is moments away from release. You need to start preparing immediately I HIGHLY r...
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Claude Fable 5.1 is moments away from release.
You need to start preparing immediately
I HIGHLY recommend everyone builds their own testing harness based on the tasks they do most often
Trust NO benchmarks Anthropic or random people on X use
I built my own. Here's how:
Go to Claude Code (or your favorite coding agent)
Ask it to categorize the work you do into 5 high level categories
Say you want to build a model benchmarking harness. Ask it to come up with a benchmark test for each of your categories. These should be complex, multistep tests
Ask it to build a web app to host these tests. Ask it to plug into Vercel's AI router so you can get a full list of models available and test any of them head to head
The moment the model drops, run the battery of tests head to head with the new model and also compared to the model you've been using lately.
You'll be in a good spot to make a true judgement on just how good these new models are
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started