How do you test something that can behave differently every single time?
In this episode, we speak with Amitha Pulijala, Chief Product Officer, and Christoph Börner, VP of Engineering, both at Cyara, about one of the most pressing challenges in conversational AI today. The shift from deterministic, scripted IVRs to generative AI agents is changing how conversational systems are built and tested.
The episode covers how Cyara approaches testing in a non-deterministic world, including using AI agents to test AI agents, and why traditional ideas like test coverage no longer apply in the same way.
Christoph and Amitha share what they are seeing across Cyara’s clients and the wider industry. The discussion unpacks what AI trust means in practice. We talk about hallucinations, model drift, factual accuracy, bias and regulatory compliance.
We explore the economics of generative AI. The cost of running it at scale in production and in testing, and how organisations are rethinking where large language models are necessary versus where smaller, domain-specific models are more effective.
The discussion also highlights how failure can scale in AI systems, where a single bad response can affect thousands of customers.
Get a free pass to Cyara’s Xchange 2026 in Dallas, TX, using code VUX: https://cyara.com/event/xchange-2026
Find out more about Cyara: https://cyara.com
Follow Amitha on LinkedIn: https://www.linkedin.com/in/amitha
Follow Christoph on LinkedIn: https://www.linkedin.com/in/christoph-b%C3%B6rner-7721ab147
Follow Kane on LinkedIn: https://www.linkedin.com/in/kanesimms
Subscribe to VUX World: https://vuxworld.typeform.com/to/Qlo5aaeW
Subscribe to The AI Ultimatum Substack: https://open.substack.com/pub/kanesimms
","author_name":"Kane Simms"}