# Chinchilla Scaling
פרקי פודקאסט מובילים
מְעוּדכָּן:
Top podcast episodes featuring chinchilla scaling.
#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban
Our 163rd episode with a summary and discussion of last week's big AI news!
Note: apology for this one coming out a few days late, got delayed in editing it -Andrey
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@…
Latest AI Trends June 02nd 2023: What is the carbon footprint of machine learning for AI?; MIT Researchers Introduce Saliency Cards; How to Keep Scaling Large Language Models when Data Runs Out?; OpenAI Launches $1M Cybersecurity Grant Program;
AI in June 2023:
Welcome, dear readers, to another fascinating edition of our monthly blog: "Lates AI trends in June 2023". It's no secret that AI is reshaping every facet of our lives, from how we communicate to how we work, play, and even think. In our latest blog, we'll be your navigators on th…
#126 - few have tried ChatGPT, Baidu’s $145M AI fund, AI job culling, OpenAI grant program
Our 126th episode with a summary and discussion of last week's big AI news!
NOTE: sorry about the poor audio quality :( will be better next week!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai
Time…
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws
The paper modifies the DeepMind Chinchilla scaling laws for large language models (LLMs) to include the cost of inference. The analysis suggests that LLM researchers should train smaller and longer models than the Chinchilla-optimal for large inference demand.
https://arxiv.org/abs//2401.00448
…
[short] Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws
The paper modifies the DeepMind Chinchilla scaling laws for large language models (LLMs) to include the cost of inference. The analysis suggests that LLM researchers should train smaller and longer models than the Chinchilla-optimal for large inference demand.
https://arxiv.org/abs//2401.00448
…
Ethan Caballero–Scale is All You Need
Ethan is known on Twitter as the edgiest person at MILA. We discuss all the gossips around scaling large language models in what will be later known as the Edward Snowden moment of Deep Learning. On his free time, Ethan is a Master’s degree student at MILA in Montreal, and has published papers on …
EP31: Fine-Tuned MrBeast Model Results, Chris Makes a Game, AGI Safety Paper + ERNIE GPT
Anthropic and OpenAI continue their awkward dance as they both court developers, while Apple spends millions training the next Siri. And when an AI generates its own MrBeast video, hilarity and fake deaths ensue. Tune in to hear the bros' spicy takes on the latest in the AI world!
Consider liking …
Chinchilla Scaling: A replication attempt
Hoffmann et al. (2022) propose three methods for estimating a compute-optimal scaling law. Replication of their third method reveals inconsistencies and implausibly narrow confidence intervals.
https://arxiv.org/abs//2404.10102
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: htt…
#172 - Claude and Gemini updates, Gemma 2, GPT-4 Critic
Our 172nd episode with a summary and discussion of last week's big AI news!
With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris)
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
If you would lik…
מנוע חיפוש PODCAST
אתה יכול להשתמש באתר שלנו כדי לחפש3,829,336פודקאסטים ופודקאסטים196,563,750לפי אנשים, מקומות או נושאים.
השקעה בידע מניבה את התשואה הטובה ביותר, ולכן אני מאזין לפודקאסטים.
‐ Benjamin "Llamacorn" Franklin
