Ensuring Human Oversight in AI Decision-Making ProcessesEnsuring Human Oversight in AI Decision-Making Processes
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Every AI workflow needs someone officially responsible for catching it when it's wrong.
That sounds obvious, but that human oversight doesn't show up often enough in practice.
A March trial revealed that a government spreadsheet flagged an HVAC grant as a DEI initiative. The wholesale prompt for every line item was, "does this relate at all to DEI?" The model said yes to HVAC — improved climate control would support access to diverse audiences. A $349,000 grant to preserve museum artifacts was canceled and only partially restored later.
No rubric, no domain expertise, and no definition of DEI provided. The prompt was the policy.
The people who could have caught it — NEH's own career staff — had already reviewed the grants and marked them unproblematic, but their assessments were overridden anyway. The expertise was there, and it just wasn't consulted.
That's what everyone should focus on here. Not the chatbot or the politics. It's the unfounded decision to stop asking the people who knew best.
Variations of this pitfall exist in hiring pipelines, content moderation systems, customer service queues, and vendor evaluations across nearly every industry. The question isn't whether AI should be involved in workflows. We should be asking the harder one: What do human staff need to be entrusted with — and what happens when the model is wrong?
If you can't answer that before rolling out AI, the spreadsheet is already running the show.
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started