OM DENNE EPISODE

Engelsk
USA

SØK BLANT TIDLIGERE EPISODER

Søk etter gamle episoder av Deep Papers.

ANDRE EPISODE I DENNE PODKAST

We discuss Accurate KV Cache Quantization with Outlier Tokens Tracing, a deep dive into improving the efficiency of LLM inference. The authors enhance KV Cache quantization, a technique for reducing memory and compute costs during inference, by introducing a method to identify and exclude outlier t…
In this week's episode, we talk about Elastic Reasoning, a novel framework designed to enhance the efficiency and scalability of large reasoning models by explicitly separating the reasoning process into two distinct phases: thinking and solution.  This separation allows for independent alloca…
This week we discuss The Illusion of Thinking, a new paper from researchers at Apple that challenges today’s evaluation methods and introduces a new benchmark: synthetic puzzles with controllable complexity and clean logic.  Their findings? Large Reasoning Models (LRMs) show surprising failure mode…
What if your LLM could think ahead—preparing answers before questions are even asked? In this week's paper read, we dive into a groundbreaking new paper from researchers at Letta, introducing sleep-time compute: a novel technique that lets models do their heavy lifting offline, well before the…
Ansvarsfraskrivelse: Podkasten og kunstværket, det finnes indlejret på denne siden, er fra Arize AI, som tilhører dens eier og ikke er tilknyttet eller godkjent av Listen Notes, Inc.