Token Engineering
Token Engineering
✓

From MIT Decoding Research to Today’s Inference Tradeoffs

00:30:53
Podcasts
RSS
Link

OM DETTA AVSNITT

Check out the latest episode of Inference Time Tactics. Our guest is Pawan Deshpande, founder, product leader, and angel investor in companies like Anthropic and Toast, with roles at Google, Scale AI and Domino Data Lab. 

 

Hosts Rob May & Calvin Cooper sit down with Pawan to cover:

  • Early MIT NLP research applied to today’s inference-time tradeoffs
  • How to evaluate enterprise agents in practice
  • Training data plus inference filtering in real deployments
  • Open source adoption realities in the enterprise
  • Where durable value lives in the stack

Connect with Pawan Deshpande

Website: https://pawandeshpande.com/

Academic / Research Works & Thesis
Decoding Algorithms for Complex Natural Language Tasks (MIT thesis, 2007)
Randomized Decoding for Selection-and-Ordering Problems


Connect with Neurometric:
Website: https://www.neurometric.ai/ 

Substack: https://neurometric.substack.com/ 

X: https://x.com/neurometricai/ 

Bluesky: https://bsky.app/profile/neurometric.bsky.social 

 

Hosts:

Rob May

https://x.com/robmay 

https://www.linkedin.com/in/robmay

 

Calvin Cooper

https://x.com/cooper_nyc_ 

https://www.linkedin.com/in/coopernyc

Teknologi
Engelsk
USA
AnvändAPIför att hämta det här avsnittet iJSON

I DETTA AVSNITT

Redigera dessa taggar

UTSKRIFT 🔗

Are you the producer of this podcast? Add a podcast transcript
Need Audio-to-Text? Transcribe with Listen411 in Just 60 Seconds

SÖK TIDIGARE AVSNITT

Sök efter tidigare avsnitt från Token Engineering.
Bädda in sökfältet på din webbplats

ANDRA EPISODER I DENNA PODCAST

Drag, Drop, and Deploy: Rethinking How We Build AI Systems

Drag, Drop, and Deploy: Rethinking How We Build AI Systems

· utskrift
In this episode of Inference Time Tactics, Rob, Cooper, Byron, and Dave share product updates for Neurometric’s Inference Time Compute Studio and what they reveal about the shift from single models to full AI systems. They discuss why wiring models together at scale is so challenging, how a drag-an…
00:20:28
DELA
SPARA
Beyond Vibe Testing: Smarter Eval for Agentic AI

Beyond Vibe Testing: Smarter Eval for Agentic AI

· utskrift
In this episode of Inference Time Tactics, Rob, Cooper, and Byron explore Salesforce’s CRMArena-Pro benchmark and what it reveals about the limits of enterprise AI agents. They share why benchmark scores often fail in production, how inference-time tactics like best-of-N can improve reliability, an…
00:22:40
DELA
SPARA
Solving the Cold Start Problem in AI Inference

Solving the Cold Start Problem in AI Inference

In this episode of Inference Time Tactics, Rob, Cooper, and Byron sit down with Prashanth Velidandi, co-founder of InferX, to explore how serverless inference is tackling the AI “cold start problem.” They dig into why 90% of the model lifecycle happens at inference—not training—and how cold starts …
00:34:45
DELA
SPARA
Benchmarking Generalization: How AI Learns Beyond Training Data

Benchmarking Generalization: How AI Learns Beyond Training Data

In this episode of Inference Time Tactics, Rob and Cooper from Neurometric sit down with Yash Sharma, an AI researcher whose work is reshaping how we understand model generalization. Yash recently completed his PhD at the Max Planck Institute for Intelligent Systems and has held research roles at G…
00:36:54
DELA
SPARA
Ansvarsfriskrivning: Podcasten och konstverket som är inbäddat på den här sidan är från NeuroMetric AI, som är dess ägares egendom och inte anslutet till eller godkänt av Listen Notes, Inc.
PROMOTED
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
PodcastAPI.com

REKOMMENDATIONER
Använd API för att hämta detta avsnitt