Token Engineering
Token Engineering
✓

From MIT Decoding Research to Today’s Inference Tradeoffs

00:30:53
Podcasts
RSS
Link

이 에피소드에 관해

Check out the latest episode of Inference Time Tactics. Our guest is Pawan Deshpande, founder, product leader, and angel investor in companies like Anthropic and Toast, with roles at Google, Scale AI and Domino Data Lab. 

 

Hosts Rob May & Calvin Cooper sit down with Pawan to cover:

  • Early MIT NLP research applied to today’s inference-time tradeoffs
  • How to evaluate enterprise agents in practice
  • Training data plus inference filtering in real deployments
  • Open source adoption realities in the enterprise
  • Where durable value lives in the stack

Connect with Pawan Deshpande

Website: https://pawandeshpande.com/

Academic / Research Works & Thesis
Decoding Algorithms for Complex Natural Language Tasks (MIT thesis, 2007)
Randomized Decoding for Selection-and-Ordering Problems


Connect with Neurometric:
Website: https://www.neurometric.ai/ 

Substack: https://neurometric.substack.com/ 

X: https://x.com/neurometricai/ 

Bluesky: https://bsky.app/profile/neurometric.bsky.social 

 

Hosts:

Rob May

https://x.com/robmay 

https://www.linkedin.com/in/robmay

 

Calvin Cooper

https://x.com/cooper_nyc_ 

https://www.linkedin.com/in/coopernyc

기술
영어
미국
API를 사용하여JSON에서 이 에피소드를 가져옵니다.

이 에피소드 내

이 태그 수정하기

전사 🔗

Are you the producer of this podcast? Add a podcast transcript
Need Audio-to-Text? Transcribe with Listen411 in Just 60 Seconds

과거 에피소드 검색

Token Engineering의 과거 에피소드를 검색하세요.
이 검색 창을 웹 사이트에 삽입

이 팟캐스트의 다른 에피소드

Drag, Drop, and Deploy: Rethinking How We Build AI Systems

Drag, Drop, and Deploy: Rethinking How We Build AI Systems

· 전사
In this episode of Inference Time Tactics, Rob, Cooper, Byron, and Dave share product updates for Neurometric’s Inference Time Compute Studio and what they reveal about the shift from single models to full AI systems. They discuss why wiring models together at scale is so challenging, how a drag-an…
00:20:28
공유하기
저장하기
Benchmarking Generalization: How AI Learns Beyond Training Data

Benchmarking Generalization: How AI Learns Beyond Training Data

In this episode of Inference Time Tactics, Rob and Cooper from Neurometric sit down with Yash Sharma, an AI researcher whose work is reshaping how we understand model generalization. Yash recently completed his PhD at the Max Planck Institute for Intelligent Systems and has held research roles at G…
00:36:54
공유하기
저장하기
Beyond Vibe Testing: Smarter Eval for Agentic AI

Beyond Vibe Testing: Smarter Eval for Agentic AI

· 전사
In this episode of Inference Time Tactics, Rob, Cooper, and Byron explore Salesforce’s CRMArena-Pro benchmark and what it reveals about the limits of enterprise AI agents. They share why benchmark scores often fail in production, how inference-time tactics like best-of-N can improve reliability, an…
00:22:40
공유하기
저장하기
Solving the Cold Start Problem in AI Inference

Solving the Cold Start Problem in AI Inference

In this episode of Inference Time Tactics, Rob, Cooper, and Byron sit down with Prashanth Velidandi, co-founder of InferX, to explore how serverless inference is tackling the AI “cold start problem.” They dig into why 90% of the model lifecycle happens at inference—not training—and how cold starts …
00:34:45
공유하기
저장하기
면책 조항: 이 페이지에 포함된 팟캐스트와 작품은 NeuroMetric AI에서 가져온 것입니다. 이 팟캐스트는 소유자의 재산이며 Listen Notes, Inc.와 제휴하거나 보증하지 않습니다.
PROMOTED
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
PodcastAPI.com

추천
API를 사용하여 이 에피소드 가져오기