AI Assistant Testing and Quality

AI Assistant Testing and Quality Check for Small Businesses

Before your AI assistant talks to real customers, I test it with real customer questions, score every answer, and fix what fails, so your customers never receive a wrong price or a made-up promise.

What I deliver for your business

✅ A set of real customer questions for your business, including tricky ones about prices, payment methods, delivery areas, opening days, and items you do not sell ✅ A pass or fail score for every answer, with each result checked against the exact line in your business information ✅ Detection of invented offers, such as a discount that was never approved, and of wrong prices, such as a customer being quoted the price of a different dish ✅ Detection of rule-breaking, such as the assistant offering pay on delivery when your business accepts bank transfer only ✅ Clear fixes, such as adding the rule "Copy prices exactly as written. Never offer discounts or payment methods that are not listed", followed by a re-test of the same questions ✅ A final score report so you can see how reliable your assistant is before it goes live

Example of the work

Test 1: a customer asked the price of jollof rice, and the assistant quoted the price of fried rice. Result: FAIL. The listed price is N3,500, not N3,000.

Test 2: a customer asked about discounts, and the assistant promised 10 percent off. Result: FAIL. No discount was listed. The correct reply is to say it will ask the manager.

Test 3: a customer asked about delivery to another city, and the assistant correctly said delivery is within Port Harcourt only. Result: PASS.

Who this is for

Restaurants, salons, shops, and other small businesses that want to be sure their WhatsApp assistant is accurate before customers use it.

Skills Practiced • Model evaluation • Writing test questions for AI assistants • Scoring answers against business information • Detecting made-up answers and rule-breaking • Writing instruction fixes and re-testing • Careful reading and attention to detail

Tools Used • Claude (AI assistant) • WhatsApp (customer messaging format)