Abstract
Most agentic AI evaluation today lives in the terminal, precision scores, latency benchmarks, hallucination rates. It's rigorous and it's necessary, but it completely misses the question that actually matters to the business: Does this agent think the way our people think?
At Hazelheartwood, we build AI with small lean teams, and we test it the same way, treating every evaluation cycle as a chance to cut waste and validate early rather than over engineer. This masterclass introduces our approach to testing for genuine business impact, how we define and iterate toward minimum viable accuracy (MVA), and how our framework separates data accuracy from business accuracy, checking whether the agent reasons the way the business user it supports would. You'll also see where human in the loop validation fits, because in the end, AI that serves people has to be tested by them too. Attendees will leave with a framework they can apply to test whether their own agents reason the way their business actually does.
Topics To Be Covered
Evaluate agents beyond technical benchmarks
Define Minimum Viable Accuracy effectively
Separate data from business accuracy
Test agents against business reasoning
Integrate human validation into evaluation
Perfect For
AI Product Managers
AI Architects
Data Scientists
AI Engineering Leaders
Enterprise AI Teams
Meet Your Speaker
Nour Eid
AI Product Analyst, Hazelheartwood
Nour Eid is an AI Product Analyst specializing in Generative AI and agentic systems, with a focus on evaluation, reliability, and scalable deployment.
Nour's work centers on testing and validating agentic systems in highly variable, non-deterministic environments, where each use case introduces unique behaviors and challenges traditional evaluation approaches. To address these challenges, she developed a comprehensive evaluation framework that has been adopted across multiple teams, enabling the delivery of more robust and production-ready AI systems.
She also designs AI maturity assessments and contributes to AI strategy initiatives, helping organizations define and measure AI value, identify high-impact use cases, and scale solutions that deliver measurable business outcomes.
ADDITIONAL INFORMATION
Time & Place
Thu, Nov 26
16:00 - 16:30
Mövenpick Amsterdam City Centre
Matterhorn I
Limited to 45 participants.
Secure your seat – registration required.
Notes
Agenda for this session
20 min presentation + Audience Q&A


.png)