TUNGKOL SA EPISODE NA ITO

Ingles
Estados Unidos

I-SEARCH ANG MGA NAKARAANG EPISODE

I-search ang mga nakaraang episode ng Deep Papers.

IBA PANG MGA EPISOD SA PODCAST NA ITO

We discuss Accurate KV Cache Quantization with Outlier Tokens Tracing, a deep dive into improving the efficiency of LLM inference. The authors enhance KV Cache quantization, a technique for reducing memory and compute costs during inference, by introducing a method to identify and exclude outlier t…
The authors of the new paper *Self-Adapting Language Models (SEAL)* shared a behind-the-scenes look at their work, motivations, results, and future directions. The paper introduces a novel method for enabling large language models (LLMs) to adapt their own weights using self-generated data and trai…
What if your LLM could think ahead—preparing answers before questions are even asked? In this week's paper read, we dive into a groundbreaking new paper from researchers at Letta, introducing sleep-time compute: a novel technique that lets models do their heavy lifting offline, well before the…
This week we discuss The Illusion of Thinking, a new paper from researchers at Apple that challenges today’s evaluation methods and introduces a new benchmark: synthetic puzzles with controllable complexity and clean logic.  Their findings? Large Reasoning Models (LRMs) show surprising failure mode…
In this week's episode, we talk about Elastic Reasoning, a novel framework designed to enhance the efficiency and scalability of large reasoning models by explicitly separating the reasoning process into two distinct phases: thinking and solution.  This separation allows for independent alloca…
Paunawa: Ang podcast at artwork na naka-embed sa page na ito ay mula sa Arize AI, na pag-aari ng may-ari nito at hindi kaakibat o ineendorso ng Listen Notes, Inc.