TUNGKOL SA EPISODE NA ITO

Ingles
Estados Unidos

KOPYA NG SALIN 🔗

I-SEARCH ANG MGA NAKARAANG EPISODE

I-search ang mga nakaraang episode ng Data Science in the Wild.

IBA PANG MGA EPISOD SA PODCAST NA ITO

Should you recalibrate CTR models on fresh data? Rui Liu's Avazu study: a 6-hour Platt/isotonic refit made calibration worse in about a third of applications. Key takeaways: Random splits flatter calibration. On Avazu (40.4M impressions; LR, DeepFM, DCN-v2), a random split reported LR's ECE at 55–…
Is difference-in-differences broken? Brown economist Peter Hull used AI agents to replicate 1,346 staggered-adoption results from 108 papers: TWFE and modern DiD estimates correlate about 0.9, and significant sign flips are rare. Key takeaways: The worry. In staggered rollouts, two-way fixed effec…
Do LLM recommenders pick by position? A University of Granada study ran 40,000 shuffled prompts through 8 open models, and every one failed both statistical tests for position independence. Key takeaways: Order matters for every model. On a RAG testbed (50,000 Amazon products, 2,000 queries × 20 o…
LCM-Promo (Prosus and iFood) turns a 4B-parameter LLM into an uplift model for discounts. In a one-month A/B test on churned users it lifted conversion 1% and cut promotion cost 6% vs. the old policy. Key takeaways: Discounts as tokens. Each prompt holds session context (day, lunch or dinner shift…
Can you ship an LLM change on evals alone? Spotify's Mårten Schultzberg: only if eval effects predict A/B results. On 183 Upworthy tests, his gate ships none. Key takeaways: The question. Judge–human agreement doesn't tell you which changes can skip an A/B test. That needs trial-level surrogacy: e…
Paunawa: Ang podcast at artwork na naka-embed sa page na ito ay mula sa Peter Liu, na pag-aari ng may-ari nito at hindi kaakibat o ineendorso ng Listen Notes, Inc.