Building Beta Programs That Go Beyond Bugs with Keith McDonald

Quick note – The video files didn’t quite cooperate for this episode, so enjoy the audio-only experience. Keith’s wisdom still shines, so don't sleep on this one!

In this episode, Chris Rader sits down with Keith McDonald, Beta Testing Lead at Square, to discuss the art of building beta programs that go beyond just finding bugs. Keith’s career spans more than a decade, including significant roles at Sonos, where he led beta testing for flagship products like the Playbar. Now at Square, he continues to innovate in beta program management, focusing on improving customer experiences and product quality through deep user feedback and strategic testing.

Keith shares his journey, the lessons learned along the way, and his thoughts on building high-performing teams with a blend of technical expertise and customer empathy. He also provides insights into the future of beta testing, including how AI could play a role in enhancing, but not replacing, the human touch in testing. Tune in to hear how beta programs can transform product development and why a focus on user experience is key to success.

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

(0:00) - Intro

(3:26) - Early challenges in testing at Sonos, launching the Playbar and other hardware products.

(10:21) - Keith’s transition to Square: Managing beta programs for hardware teams.

(14:10) - Building a beta testing team that balances technical and customer-focused skills.

(19:44) - The importance of user feedback and its role in shaping products.

(28:41) - Going beyond bugs: How to focus on enhancing user experience in beta programs.

(34:14) - Keith’s thoughts on AI’s role in the future of beta testing.

(40:00) - Rapid-fire questions