Token Engineering
Token Engineering
✓

From MIT Decoding Research to Today’s Inference Tradeoffs

00:30:53
Podcasts
RSS
Link

このエピソードについて

Check out the latest episode of Inference Time Tactics. Our guest is Pawan Deshpande, founder, product leader, and angel investor in companies like Anthropic and Toast, with roles at Google, Scale AI and Domino Data Lab. 

 

Hosts Rob May & Calvin Cooper sit down with Pawan to cover:

  • Early MIT NLP research applied to today’s inference-time tradeoffs
  • How to evaluate enterprise agents in practice
  • Training data plus inference filtering in real deployments
  • Open source adoption realities in the enterprise
  • Where durable value lives in the stack

Connect with Pawan Deshpande

Website: https://pawandeshpande.com/

Academic / Research Works & Thesis
Decoding Algorithms for Complex Natural Language Tasks (MIT thesis, 2007)
Randomized Decoding for Selection-and-Ordering Problems


Connect with Neurometric:
Website: https://www.neurometric.ai/ 

Substack: https://neurometric.substack.com/ 

X: https://x.com/neurometricai/ 

Bluesky: https://bsky.app/profile/neurometric.bsky.social 

 

Hosts:

Rob May

https://x.com/robmay 

https://www.linkedin.com/in/robmay

 

Calvin Cooper

https://x.com/cooper_nyc_ 

https://www.linkedin.com/in/coopernyc

テクノロジー
英語
アメリカ合衆国
APIを使用して、JSONでこのエピソードを取得します

エピソード内

これらのタグを編集

文字起こし 🔗

Are you the producer of this podcast? Add a podcast transcript
Need Audio-to-Text? Transcribe with Listen411 in Just 60 Seconds

過去のエピソードを検索

Token Engineeringの以前のエピソードを検索します。
この検索バーをあなたのウェブサイトに埋め込む

このポッドキャストの他のエピソード

Benchmarking Generalization: How AI Learns Beyond Training Data

Benchmarking Generalization: How AI Learns Beyond Training Data

In this episode of Inference Time Tactics, Rob and Cooper from Neurometric sit down with Yash Sharma, an AI researcher whose work is reshaping how we understand model generalization. Yash recently completed his PhD at the Max Planck Institute for Intelligent Systems and has held research roles at G…
00:36:54
シェア
保存
Beyond Vibe Testing: Smarter Eval for Agentic AI

Beyond Vibe Testing: Smarter Eval for Agentic AI

· トランスクリプト
In this episode of Inference Time Tactics, Rob, Cooper, and Byron explore Salesforce’s CRMArena-Pro benchmark and what it reveals about the limits of enterprise AI agents. They share why benchmark scores often fail in production, how inference-time tactics like best-of-N can improve reliability, an…
00:22:40
シェア
保存
Drag, Drop, and Deploy: Rethinking How We Build AI Systems

Drag, Drop, and Deploy: Rethinking How We Build AI Systems

· トランスクリプト
In this episode of Inference Time Tactics, Rob, Cooper, Byron, and Dave share product updates for Neurometric’s Inference Time Compute Studio and what they reveal about the shift from single models to full AI systems. They discuss why wiring models together at scale is so challenging, how a drag-an…
00:20:28
シェア
保存
Solving the Cold Start Problem in AI Inference

Solving the Cold Start Problem in AI Inference

In this episode of Inference Time Tactics, Rob, Cooper, and Byron sit down with Prashanth Velidandi, co-founder of InferX, to explore how serverless inference is tackling the AI “cold start problem.” They dig into why 90% of the model lifecycle happens at inference—not training—and how cold starts …
00:34:45
シェア
保存
免責: このページに埋め込まれているポッドキャストとアートワークは NeuroMetric AI からのものであり、その所有者の所有物であり、Listen Notes, Inc. と提携または承認されていません。
PROMOTED
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
The best Podcast API to search all podcasts and episodes. Trusted by 15,200+ companies and developers.
PodcastAPI.com

おすすめ
APIを使用してこのエピソードを取得する