À PROPOS DE CET ÉPISODE
In this episode, Ole Lensmar joins Richard Li, founder of Polar Sky, to explore how testing strategies must evolve for the age of AI. They discuss the journey of cloud-native tools like Telepresence and Richard's key insight for agentic coding: using automated tests as the "context" to guide AI behavior, rather than relying on complex prompts to describe system rules.
The conversation also digs into the mechanics of building AI-driven software, emphasizing why "evals" are critical for measuring success. Richard shares practical strategies for treating evaluations as data management problems and explains how his team uses simple AI agents to "babysit" CI pipelines and automatically resolve flaky tests.
Topics discussed:
- The Evolution of Telepresence: Moving from local debugging to headless execution in CI pipelines.
- Tests as Context: Why running a test suite is more effective than complex prompting for AI agents.
- Agentic Coding Strategy: Shifting focus from unit tests to integration and behavioral verification.
- AI Evals: Why evaluation is the most critical aspect of building reliable AI products.
- Babysitting CI: Using simple AI agents to identify and retry flaky tests automatically.
Anglais
États-Unis
TRANSCRIPTION 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
RECHERCHER LES ÉPISODES PASSÉS
Rechercher les épisodes précédents de Cloud Native Testing Podcast.
AUTRES ÉPISODES DANS CE PODCAST
In this episode, the main conversation is between host Ole Lensmar and guest Atul, who are joined by special guest Dmitry, the CEO of Testkube. Together, they dive deep into the evolving landscape of software testing, framed by Atul's fascinating journey from manual QA to a cloud native develo…
In this episode of the Cloud Native Testing Podcast, Ole Lensmar sits down with Benjamin Wilms, founder and CEO of Steadybit, to explore the role of chaos engineering in building resilient cloud-native systems—from early-stage startups to global enterprises.
Benjamin shares how his journey from con…
In this episode of the Cloud Native Testing Podcast, Ole Lensmar sits down with Tony Tam, creator of Swagger API (now known as the OpenAPI specification) and a pioneer in API specification standards, to explore the unexpected ways Swagger transformed software testing.
Tony shares the origin story o…
In this episode of the Cloud Native Testing Podcast, Ole Lensmar sits down with In this episode of the Cloud Native Testing Podcast, Ole Lensmar sits down with Cherif Sahraoui, QA Lead & Consultant working with 50Hertz Transmission—one of Germany’s four major electricity transmission system ope…
In this illuminating episode, we pull back the curtain on Cloudflare's intricate approach to testing at a truly global scale. Join us as Sachin from Cloudflare's team shares invaluable insights into how they leverage their vast, distributed network to push the boundaries of reliability an…
Avertissement: Le podcast et les illustrations intégrés sur cette page proviennent de Testkube, qui est la propriété de son propriétaire et n'est ni affilié ni approuvé par Listen Notes, Inc.
MODIFIER
Merci de nous avoir aidé à tenir la base de données de podcasts à jour.