ABOUT THIS EPISODE
“AI Worth Using” exists to cut through exactly this kind of hype: the demo that looks incredible until someone asks, “Who’s actually checking the agent’s work?”
Justin McCarthy, (https://www.linkedin.com/in/justinmccarthy/) Founder of Diffusion AI (https://www.linkedin.com/company/diffusion-ai-inc/)and former Co-Founder and CTO of StrongDM, joins us with a very different answer: you don’t need a human reading every line. You need relentless, structured testing that proves the system actually works.
Justin walks us through the review architecture that makes trusting AI-generated code possible, then demos a toolkit he built overnight that gives coding agents a working sense of 3D space, live, on a Tinkercad model.
KEY TAKEAWAYS
00:00 The "dark software factory": factories that run with no humans on the floor
03:05 Why correctness changes how you deploy AI-written code
06:00 A single model's self-praise means nothing; real signal comes from an ensemble of models arguing it out
08:05 A dark software factory isn't one trick; it's an ensemble of components built to remove the human from the loop
10:59 Roughly 90% of tokens still go toward validation, not toward writing the code itself
13:00 Rebuilding Slack, Okta, and Salesforce for AI testing
21:00 Why a 5GB LiDAR scan required a toolkit, not a bigger model
31:39 Infinite loops matter more than bugs
36:12 Which coding skills will models absorb next?
See how people are actually using AI in their work on the "AI Worth Using" podcast at https://aiworthusing.com
RESOURCES MENTIONED
Diffusion AI, Inc, the software factory company Justin founded after StrongDM, referenced throughout as the source of the practices discussed:
https://diffusion.io
Dan Shapiro, who coined the term “dark software factory”: x.com/danshapiro
StrongDM, the privileged access management company Justin co-founded and led as CTO for a decade before its 2026 acquisition:
https://www.strongdm.com
Tinkercad, the browser-based CAD tool Justin uses to demo his agentic 3D toolkit live in this episode:
https://www.tinkercad.com
Claude Code, the coding harness Justin references throughout, including the moment a five-gigabyte LiDAR scan couldn't be dropped straight into it:
https://docs.claude.com/en/docs/claude-code/overview
Codex, one of the coding harnesses Justin says he "daily drives" alongside Claude Code, used in this episode's live demo:
https://openai.com/codex/
Warp, another coding harness Justin recommends engineers study closely to understand how these tools actually work under the hood:
https://www.warp.dev
#AI #DarkSoftwareFactory #AgenticEngineering
TRANSCRIPT 🔗
1
00:00:00.271 --> 00:00:03.413
Today we look at the Dark Software Factory with Justin McCarthy.
2
00:00:03.553 --> 00:00:12.499
Justin spent a decade as CTO of StrongDM building the security plumbing Fortune 500 enterprises run on, where correctness is not optional.
3
00:00:12.639 --> 00:00:13.960
He now runs Diffusion.
4
00:00:13.980 --> 00:00:19.784
Dan Shapiro coined that term Dark Software Factory after watching how Justin's team works.
5
00:00:20.284 --> 00:00:23.105
It's a factory …