Freelancers using Structurely in AtlantaFreelancers using Structurely in Atlanta
ProjectsPeople
Joshua Rotimi's avatar
Joshua Rotimi
Atlanta, USA
AI Output Evaluator & LLM Quality Specialists
New to Contra
AI Output Evaluator & LLM Quality Specialists
Cover image for Built a custom evaluation rubric
Built a custom evaluation rubric for scoring AI customer support outputs across five weighted dimensions: factual accuracy, reasoning validity, instruction adherence, adversarial robustness, and format compliance. Each dimension includes plain-language scoring criteria so any team member can apply it consistently, no AI background required.
0
13
Cover image for Evaluated 60 multi-turn conversations from
Evaluated 60 multi-turn conversations from a retail support AI to track context retention, persona consistency, and task completion across longer exchanges. Found that context drops clustered around the third and fourth turn, pointing to a memory window limitation rather than random failures, and flagged each instance with the exact turn where context broke down.
1
17
Cover image for Ran 48 adversarial prompts against
Ran 48 adversarial prompts against a production LLM to surface jailbreak vulnerabilities, role override attempts, and context manipulation before a public launch. Found 11 vulnerabilities including 3 critical, documented every failure with reproducible prompts, and delivered a prioritised risk report with fixes.
1
16
Cover image for A sample LLM evaluation report
A sample LLM evaluation report analyzing AI responses for accuracy, reasoning quality, hallucinations, and failure patterns. Demonstrates structured testing and quality assessment workflows.
1
105
Structurely(1)