Senior AI/ML Engineer · Hermetic AI · Contract · Sep 2025 – Present
• Design and develop AI and machine learning solutions for complex business and technical use cases, from initial requirements through production readiness.
• Design, test, and optimize prompts for large language model applications to improve response accuracy, relevance, consistency, instruction adherence, and overall output quality.
• Create structured evaluation rubrics, reference answers, test cases, prompts, and datasets used to benchmark model performance and identify quality gaps.
• Investigate hallucinations, reasoning failures, edge cases, unsupported claims, instruction-following failures, and inconsistent model behavior through systematic error analysis.