ACCELQ Logo

Live Virtual Event • ACCELQ 7.1

AI mindset
Live Fireside Chat

🎙️The AI Eval Mindset: Moving from Vibe Checks to Automated Quality Gates

AI can produce an answer in seconds, sounding clear, confident, and useful; but sounding useful is not the same as being reliable. As software and quality engineering teams transition from traditional deterministic code to probabilistic AI, they can no longer rely on human-led “vibe checks” to verify quality. In this fireside chat, Millan Kaul will discuss how to build practical, automated evaluation pipelines that catch AI hallucinations and regressions before they reach your customers.

Starts in

15Days
04Hrs
24Min
03Sec
  • Thursday, 22nd Oct
  • 8 am – 9 am PST
  • Live virtual fireside chat

Key Takeaways:

  1. Stop "vibe checking" your codeDitch the 10,000-row benchmark dataset trap. Discover the 5-example "golden set" secret to catching critical AI failures instantly in your CI/CD pipeline.
  2. Stop burning API tokens on basic formattingWhy pay an AI to check basic code? Discover the 3-Tier Assertion Stack that rejects bad AI outputs for free before they ever reach your expensive LLM judge.
  3. Turn AI bugs into regression testsNever let the same hallucination happen twice. Learn to capture live defects and turn them into automated CI/CD quality gates that block bad code before deployment.
  4. Calibrate Your LLM-as-a-JudgeAn uncalibrated LLM judge is just a subjective impression running on automated infrastructure. Treat your evaluator as a system under test. Learn how to calibrate your judge against human experts so false passes stop leaking defects into production.

Speaker

Millan Kaul

Millan Kaul

Engineering Leader · Author, The AI Eval Mindset

Millan Kaul is an engineering leader and builder dedicated to bridging the gap between traditional software reliability and modern AI development. He has a deep background in quality and AI engineering. He is an international speaker and the author of The AI Eval Mindset. He operates on the foundational belief that useful AI systems deserve thoughtful testing, clear expectations, and continuous improvement, and he regularly shares his knowledge on his blog ↗

Host

Geosley Andrades

Geosley Andrades

Senior Director, AI Evangelist · ACCELQ

Geosley is Senior Director, Product Evangelist, and Community Builder at ACCELQ, shaping the future of AI-led quality engineering, product strategy, and global community engagement. With nearly two decades of experience in software quality and technology, he works with enterprise leaders to rethink how quality is built, governed, and scaled across complex digital ecosystems. A frequent international speaker, Geosley is a strong advocate for intelligent, autonomous testing and for elevating quality into a strategic business function.

FAQ

  • Is this session recorded? Yes—registrants will receive the recording.
  • How do I join? The join link will be emailed after registration.
  • Can I share internally? Yes—forward the registration link to your team.

Register Now

By submitting this form, you agree to our privacy policy

Speaker

Millan Kaul

Millan Kaul

Engineering Leader · Author, The AI Eval Mindset

Millan Kaul is an engineering leader and builder dedicated to bridging the gap between traditional software reliability and modern AI development. He has a deep background in quality and AI engineering. He is an international speaker and the author of The AI Eval Mindset. He operates on the foundational belief that useful AI systems deserve thoughtful testing, clear expectations, and continuous improvement, and he regularly shares his knowledge on his blog ↗

Host

Geosley Andrades

Geosley Andrades

Senior Director, AI Evangelist · ACCELQ

Geosley is Senior Director, Product Evangelist, and Community Builder at ACCELQ, shaping the future of AI-led quality engineering, product strategy, and global community engagement. With nearly two decades of experience in software quality and technology, he works with enterprise leaders to rethink how quality is built, governed, and scaled across complex digital ecosystems. A frequent international speaker, Geosley is a strong advocate for intelligent, autonomous testing and for elevating quality into a strategic business function.

FAQ

  • Is this session recorded? Yes—registrants will receive the recording.
  • How do I join? The join link will be emailed after registration.
  • Can I share internally? Yes—forward the registration link to your team.

© 2026 ACCELQ. All rights reserved.

Get started on your Codeless Test Automation journey

Talk to ACCELQ Team and see how you can get started.