ABOUT THIS EPISODE
Jeff and Seymour use stories and analogies to explain the two main approaches to AI: Bottom-Up and Top-Down. The recent wave of AI success is mostly based on the bottom up path which includes machine learning, neural networks, and deep learning. Related links:
- The case of the construction worker with a nail in his boot
- Murray Shanahan's excellent December 2022 paper Talking About Large Language Models
- Meta / Facebook AI research's September 2020 blog post on Retrieval Augmented Generation and Segmentation
- DeepMind / Google AI's December 2021 paper on using a Retrieval-Enhanced Transformer (aka Retro) and a database of 2-trillion tokens for improved LLM capabilities.
Questions and comments? Talk to us.
English
United States
TRANSCRIPT 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
SEARCH PAST EPISODES
Search past episodes of Stepfunction Podcast.
OTHER EPISODES IN THIS PODCAST
Jeff and Seymour debate the significance of the generative AI revolution relative to the invention of the WIMP interface, the web, and even the Industrial and Agricultural Revolutions. Prometheus refers to the humans learning how to control fire; is gen AI bigger than that?! Articles referenced: …
Jeff and Seymour mention audio generation technology which leads to a larger conversation about how we can tell if audio, text, images, and other media is a Deepfake. They end with questions about media gatekeepers, social polarization, and how do we know what's real?
Links:
Vim is Jeff's favor…
Jeff and Seymour look briefly at earnings and layoffs from 2023 Q1 for the Big 5 Tech giants which leads to further pessimism about Google BARD. This sparks a larger conversation about how best to organize internal research groups. Which extreme works best–Google or Apple? Links:
The Information…
Jeff and Seymour mention a framework of 3 personas: (1) end-users; (2) technical builders like EPD teams, i.e., Engineering-Product-Design; and (3) business leaders. Topics discussed:
End-user experience: what it's like to use the free and paid versions of ChatGPT, compared with other LLM user …
The news that Gordon Moore passed away broke last Friday just as we were recording the previous episode. Today, Jeff and Seymour discuss Moore's legacy, the past and future of Moore's Law, and how advancements in microchips have been the foundation of deep learning for more than a decade. Links:
…
Disclaimer: The podcast and artwork embedded on this page are from Jeff Hwang and Seymour Duncker, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
EDIT
Thank you for helping to keep the podcast database up to date.
