Why Most CRO Programs Fail Before They Start | Mahek Mahendra Shah

Teams that silo insights from testing are essentially doing well-documented guessing.

Next on the VWO Podcast, we bring you Mahek Mahendra Shah - the person helping evolve the platform that thousands of teams rely on for their CRO programs.

As Director of Product Management at VWO, Mahek ships the product, uses the product, and sees how teams of every size and maturity level actually run experiments in practice.

Hosted by Reuben John, Product Director at VWO AB Tasty, this episode delves into:

✅ Why optimization has now become a survival requirement

✅ How persona-based onboarding signals predict whether a free trial converts

✅ The PLG funnel VWO AB Tasty built on its own platform: from one welcome email to 38 targeted nudges

✅ What organizations lose when behavioral insights and testing operate in silos

✅ Feature flags: the shift from engineering release control to a business decision tool

Timestamps:

00:00 Trailer

02:16 About Wandz - VWO AB Tasty's agentic optimization system

03:36 What Mahek loves most about working in CRO

05:43 What keeps experimentation genuinely interesting

08:19 The Feynman principle applied to product decisions

09:20 Patterns in onboarding and what they signal about a business

12:29 The persona cues that predict free trial success

15:35 When customers use features in ways you never intended

19:24 PLG in action: the funnel VWO AB Tasty built on its own product

27:27 What organizations miss when testing and insights don't connect

31:34 When data becomes a flood: the tipping point

37:10 Why waiting for statistical significance can cost more than acting early

39:57 Feature flags: from engineering tool to business control panel

44:20 Deployment is engineering. Release is business. The difference matters

45:40 Experimentation culture: how many companies are actually living it?

52:55 AI and experimentation: speed, governance, and who owns the outcome

59:31 Build vs. buy: the honest case

01:02:21 Where experimentation is headed: excitement and concerns

01:06:49 Mahek's fun Nepal flag story

01:08:23 Rapid fire: One CRO metric people should stop obsessing over

01:09:00 What non-industry friends still don't understand about your job

01:09:04 One thing AI will completely take over in two years

01:09:32 If not CRO, what profession would you have chosen?

01:10:06 If starting a CRO career today, what would you do differently?

01:10:27 Final thoughts

01:10:39 Mahek & Reuben sign off