ABOUT THIS EPISODE
The news that Gordon Moore passed away broke last Friday just as we were recording the previous episode. Today, Jeff and Seymour discuss Moore's legacy, the past and future of Moore's Law, and how advancements in microchips have been the foundation of deep learning for more than a decade. Links:
- NY Times obituary for Gordon Moore and a remembrance by Walden Kirsch at Intel.
- Apple's latest iPhone has an A16 Bionic system-on-a-chip with 16 billion transistors, compared to 1993's then ground-breaking Intel Pentium which had 3 million transistors.
- Articles on Moore's Law and Dennard Scaling
- Excellent piece by The Computer History Museum in Mountain View, CA.
- 2018 piece by Micron on Moore's Law and Dennard Scaling (aka MOSFET scaling).
- 2007 piece in IEEE on 30 years of Dennard/MOSFET scaling (PDF).
- Types of chips
- AI Accelerators and Deep Learning Processors (DLP).
- CPUs, FPGAs, and ASICs.
- Google's Tensor Processing Units (TPUs).
- Accleration of AI progress above Moore's Law
- Seymour refers to the chart in this 2021 IEEE Spectrum article.
- 2022 article in Discover magazine by the Physics arXiv Blog.
Send questions/comments to stepfunctionpod@gmail.com and find us on the web at www.stepfunction.org.
English
United States
TRANSCRIPT 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
SEARCH PAST EPISODES
Search past episodes of Stepfunction Podcast.
OTHER EPISODES IN THIS PODCAST
Jeff and Seymour look briefly at earnings and layoffs from 2023 Q1 for the Big 5 Tech giants which leads to further pessimism about Google BARD. This sparks a larger conversation about how best to organize internal research groups. Which extreme works best–Google or Apple? Links:
The Information…
Jeff and Seymour mention a framework of 3 personas: (1) end-users; (2) technical builders like EPD teams, i.e., Engineering-Product-Design; and (3) business leaders. Topics discussed:
End-user experience: what it's like to use the free and paid versions of ChatGPT, compared with other LLM user …
Jeff and Seymour debate the significance of the generative AI revolution relative to the invention of the WIMP interface, the web, and even the Industrial and Agricultural Revolutions. Prometheus refers to the humans learning how to control fire; is gen AI bigger than that?! Articles referenced: …
Jeff and Seymour mention audio generation technology which leads to a larger conversation about how we can tell if audio, text, images, and other media is a Deepfake. They end with questions about media gatekeepers, social polarization, and how do we know what's real?
Links:
Vim is Jeff's favor…
Disclaimer: The podcast and artwork embedded on this page are from Jeff Hwang and Seymour Duncker, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
EDIT
Thank you for helping to keep the podcast database up to date.
