درباره این اپیزود
LCM-Promo (Prosus and iFood) turns a 4B-parameter LLM into an uplift model for discounts. In a one-month A/B test on churned users it lifted conversion 1% and cut promotion cost 6% vs. the old policy.
Key takeaways:
- Discounts as tokens. Each prompt holds session context (day, lunch or dinner shift), an LCM-generated user summary, and discount options mapped to letters. The model predicts one letter, or a no-purchase token, read as the smallest discount that would make the user order.
- Monotonic by construction. Summing those probabilities up the discount ladder gives a response curve that never falls as the discount grows, and the no-purchase mass keeps it below 100%.
- Online result. 90% control on Segment-EMA, 10% on LCM-Promo, same budget and same allocator: +1% relative conversion and 6% lower promotion cost. Allocation grew from about 50 segments to over 1,000 clusters and from 10 wallet configurations to over a million combinations; it now serves all churn users.
- Offline check. Against an uplift random forest (causalml) on RCT data, LCM-Promo was comparable on AUUC (0.0608 vs 0.0578) and Qini (0.0490 vs 0.0466) and lower on Uplift@30 (0.1626 vs 0.1708). The waterfall-label variant did much worse (AUUC 0.0278).
- Our caveats. Results cover one lifecycle stage on one platform. Our take: uplift margins may be thinner for high-intent daily users, and precomputed user summaries can't react to mid-session changes.
Chapters:
00:00 Cold open: the pizza and the 10% coupon
01:00 The paper: LCM-Promo from Prosus and iFood
02:29 Headline: one-month churn-reactivation A/B test
03:21 Large Commerce Models and the 4B base
04:49 Discounts as letters, one-token prediction
05:50 Conversion thresholds and monotonic curves
07:21 Offline test vs. uplift random forest
08:46 The waterfall labels that failed
10:08 Online A/B test design and results
11:16 From 50 segments to 1,000+ clusters
12:30 Serving: vLLM, BESH, 8 H200s
13:31 What's genuinely new
14:29 Our caveats
15:56 Recap and closing question
Sources:
- LCM-Promo: An LLM-Based Uplift Model for Promotion Allocation (Midavaine, Fok, Mendes, Silva, Akaçık, Lima, Genç (Prosus, iFood); arXiv, Oct 27, 2026; ECML PKDD 2026)
- CausalML: Python package for causal machine learning (Chen et al.; arXiv 2020)
Enjoyed it? Follow Data Science in the Wild (one real production ML/AI system or paper per episode, hosted by Peter Liu) and rate it on Apple Podcasts or Spotify.
Also from Peter: The GenAI Evolution Atlas, Wednesday AI deep dives and Friday news roundups.
Made with AI-generated voices; curated by Peter Liu from the sources above.