אודות פרק זה

אנגלית
ארצות הברית

תעתיק 🔗

חיפוש פרקים ישנים

חפש פרקים קודמים של Learn AI in Bits.

פרקים אחרים בפודקאסט הזה

A hidden recording device was found behind a television in an OpenAI executive conference room, concealed in toilet paper and plugged into a USB port, leading to an FBI arrest and federal charges. This episode follows the publicly reported timeline and examines OpenAI's statement that its own AI ‮…
If you already know your job well, AI raises a new question: which parts of your work could you do better, faster, or at a larger scale with an assistant that reads, writes, analyzes, searches, and sometimes acts? This episode maps what's available from OpenAI, Anthropic, and Google beyond basic ‮…
When a large language model generates text one token at a time, even a fast GPU hits a sequential bottleneck. This episode explains speculative decoding, an inference technique that prepares several tokens at once and checks them together, and when the extra computation pays off. Ordinary gener‮…
When an AI model answers slowly, the problem usually isn't its intelligence — it's how the serving system moves data through a GPU. This episode goes one level below the basic inference loop covered in an earlier episode, into GPU memory, the key-value cache, attention kernels, and the scheduling‮…

081 - How Does AI Inference Work?

When you type a question into an AI assistant and watch the answer appear word by word, what's happening underneath is inference: the process of running a trained model to produce that answer. This episode follows one request through the full inference path, from tokenization to the KV cache to p‮…
הצהרה: הפודקאסט והגרפיקה המוטבעים בדף זה הם מ-Dan W, שהוא רכושו של בעליו ואינו קשור או מאושר על ידי Listen Notes, Inc.