SOBRE ESTE EPISÓDIO

Inglês
Estados Unidos da América

TRANSCRIÇÃO 🔗

PESQUISAR EPISÓDIOS PASSADOS

Pesquisar episódios anteriores de Learn AI in Bits.

OUTROS EPISÓDIOS NESTE PODCAST

When you type a question into an AI assistant and watch the answer appear word by word, what's happening underneath is inference: the process of running a trained model to produce that answer. This episode follows one request through the full inference path, from tokenization to the KV cache to pr…
If you already know your job well, AI raises a new question: which parts of your work could you do better, faster, or at a larger scale with an assistant that reads, writes, analyzes, searches, and sometimes acts? This episode maps what's available from OpenAI, Anthropic, and Google beyond basic c…
When a large language model generates text one token at a time, even a fast GPU hits a sequential bottleneck. This episode explains speculative decoding, an inference technique that prepares several tokens at once and checks them together, and when the extra computation pays off. Ordinary genera…
A hidden recording device was found behind a television in an OpenAI executive conference room, concealed in toilet paper and plugged into a USB port, leading to an FBI arrest and federal charges. This episode follows the publicly reported timeline and examines OpenAI's statement that its own AI m…
When an AI model answers slowly, the problem usually isn't its intelligence — it's how the serving system moves data through a GPU. This episode goes one level below the basic inference loop covered in an earlier episode, into GPU memory, the key-value cache, attention kernels, and the scheduling …
Aviso: O podcast e a arte incorporada nesta página são de Dan W, que é propriedade de seu proprietário e não é afiliado ou endossado por Listen Notes, Inc.