āĻāĻ āĻĒāĻĄāĻāĻžāϏā§āĻāĻāĻŋ āϏāĻŽā§āĻŦāύā§āϧ⧠🔗
We discuss seminal mathematical papers (sometimes really old đ ) that have shaped and established the fields of machine learning and data science as we know them today. The goal of the podcast is to introduce you to the evolution of these fields from a mathematical and slightly philosophical perspective.
We will discuss the contribution of these papers, not just from pure a math aspect but also how they influenced the discourse in the field, which areas were opened up as a result, and so on.
Our podcast episodes are also available on our youtube:
https://youtu.be/wThcXx_vXjQ?si=vnMfs
We will discuss the contribution of these papers, not just from pure a math aspect but also how they influenced the discourse in the field, which areas were opened up as a result, and so on.
Our podcast episodes are also available on our youtube:
https://youtu.be/wThcXx_vXjQ?si=vnMfs
āĻāĻĒāϏā§āĻĨāĻžāĻĒāĻ:
āĻāĻĒāĻĄā§āĻ āĻĢā§āϰāĻŋāĻā§āϝāĻŧā§āύā§āϏāĻŋ:
monthly
āĻāĻĄāĻŧ āĻ
āĻĄāĻŋāĻ āĻĻā§āϰā§āĻā§āϝ:
48 minutes
āĻāĻāϰā§āĻāĻŋ
āĻŽāĻžāϰā§āĻāĻŋāύ āϝā§āĻā§āϤāϰāĻžāώā§āĻā§āϰ
34 āĻĒāϰā§āĻŦ
7 āĻā§āϞāĻžāĻ, 2024āĻĨā§āĻā§
episodic
āĻāĻ āĻĒāĻĄāĻāĻžāϏā§āĻā§ 🔗
āϏāĻžāĻŽā§āĻĒā§āϰāϤāĻŋāĻ āĻāĻĒāĻŋāϏā§āĻĄ 🔗
On the 34th episode, we review the 1986 paper, "Learning representations by back-propagating errors" , which was pivotal because it provided a clear, generalized framework for training neural networks with internal 'hidden' units. The core of the procedure, back-propagation, repeatedly adjusts the âĻ
āĻ āϤā§āϤā§āϰ āĻāĻĒāĻŋāϏā§āĻĄāĻā§āϞāĻŋ āĻ āύā§āϏāύā§āϧāĻžāύ āĻāϰā§āύ
Data Science Decoded āĻāϰ āĻ
āϤā§āϤā§āϰ āĻāĻĒāĻŋāϏā§āĻĄāĻā§āϞāĻŋ āĻ
āύā§āϏāύā§āϧāĻžāύ āĻāϰā§āύāĨ¤
āĻĒā§āϰā§āĻŦāĻŦāϰā§āϤ⧠āĻāĻĒāĻŋāϏā§āĻĄāϏāĻŽā§āĻš 🔗
On the 33rd episdoe we review Paul Werbosâs âApplications of Advances in Nonlinear Sensitivity Analysisâ which presents efficient methods for computing derivatives in nonlinear systems, drastically reducing computational costs for large-scale models.
Werbos, Paul J. "Applications of advancesâĻ
We reviewed Richard Bellmanâs âA Markovian Decision Processâ (1957), which introduced a mathematical framework for sequential decision-making under uncertainty.
By connecting recurrence relations to Markov processes, Bellman showed how current choices shape future outcomes and formalized the prinâĻ
On the 31st episode of the podcast, we add Liron to the team, we review a gem from 1921, where Sewallâ¯Wright introduced path analysis, mapping hypothesized causal arrows into simple diagrams and proving that any sample correlation can be written as the sum of products of âpath coefficients.â
By tâĻ
In the 30th episode we review the the bootstrap, method which was introduced by Bradley Efron in 1979, is a non-parametric resampling technique that approximates a statisticâs sampling distribution by repeatedly drawing with replacement from the observed data, allowing estimation of standard errorsâĻ
In the 29th episode, we go over the 1979 paper by Gordon Vivian Kass that introduced the CHAID algorithm.CHAID (Chi-squared Automatic Interaction Detection) is a tree-based partitioning method introduced by G. V. Kass for exploring large categorical data sets by iteratively splitting records into mâĻ
In the 28th episode, we go over Burton Bloom's Bloom filter from 1970, a groundbreaking data structure that enables fast, space-efficient set membership checks by allowing a small, controllable rate of false positives.Unlike traditional methods that store full data, Bloom filters use a compact bit âĻ
Mansfield Merriman's 1877 paper traces the historical development of the Method of Least Squares, crediting Legendre (1805) for introducing the method, Adrain (1808) for the first formal probabilistic proof, and Gauss (1809) for linking it to the normal distribution.
He evaluates multiple proofs,âĻ
In this episode, we review Cauchyâs 1847 paper, which introduced an iterative method for solving simultaneous equations by minimizing a function using its partial derivatives. Instead of elimination, he proposed progressively reducing the functionâs value through small updates, forming an early verâĻ
At the 24th episode we go over the paper titled:Dempster, Arthur P., Nan M. Laird, and Donald B. Rubin. "Maximum likelihood from incomplete data via the EM algorithm." Journal of the royal statistical society: series B (methodological) 39.1 (1977): 1-22.The Expectation-Maximization (EM) algorithm iâĻ
āĻĻāĻžāĻŦāĻŋ āĻĒāϰāĻŋāϤā§āϝāĻžāĻ: āĻāĻ āĻĒā§āώā§āĻ āĻžāϝāĻŧ āĻāĻŽā§āĻŦā§āĻĄ āĻāϰāĻž āĻĒāĻĄāĻāĻžāϏā§āĻ āĻāĻŦāĻ āĻāϰā§āĻāĻāϝāĻŧāĻžāϰā§āĻ Mike E āĻĨā§āĻā§ āĻāϏā§āĻā§, āϝāĻž āĻāϰ āĻŽāĻžāϞāĻŋāĻā§āϰ āϏāĻŽā§āĻĒāϤā§āϤāĻŋ āĻāĻŦāĻ Listen Notes, Inc āĻĻā§āĻŦāĻžāϰāĻž āĻ
āύā§āĻŽā§āĻĻāĻŋāϤ āĻŦāĻž āĻ
āύā§āĻŽā§āĻĻāĻŋāϤ āύāϝāĻŧ⧎
āĻĒāĻĄāĻāĻžāϏā§āĻ āϏāĻžāϰā§āĻ āĻāĻā§āĻāĻŋāύ
āĻāĻĒāύāĻŋ āĻāĻŽāĻžāĻĻā§āϰ āĻāϝāĻŧā§āĻŦāϏāĻžāĻāĻ āĻŦā§āϝāĻŦāĻšāĻžāϰ āĻāϰāϤ⧠āĻĒāĻžāϰā§āύ3,828,185āĻĒāĻĄāĻāĻžāϏā§āĻ āĻāĻŦāĻ196,370,134āĻĒāϰā§āĻŦāĻā§āϞāĻŋ āĻŽāĻžāύā§āώ, āϏā§āĻĨāĻžāύ, āĻŦāĻž āĻŦāĻŋāώāϝāĻŧ āĻĻā§āĻŦāĻžāϰāĻž āĻ
āύā§āϏāύā§āϧāĻžāύ āĻāϰāϤā§ā§ˇ
I have no special talent. I am only passionately curious, and
I listen to podcasts.
‐ Albert "Llamacorn" Einstein
āĻ āϤā§āϤā§āϰ āĻāĻĒāĻŋāϏā§āĻĄāĻā§āϞāĻŋ āĻ āύā§āϏāύā§āϧāĻžāύ āĻāϰā§āύ
Data Science Decoded āĻāϰ āĻ
āϤā§āϤā§āϰ āĻāĻĒāĻŋāϏā§āĻĄāĻā§āϞāĻŋ āĻ
āύā§āϏāύā§āϧāĻžāύ āĻāϰā§āύāĨ¤
āĻāĻ āĻĒāĻĄāĻāĻžāϏā§āĻāĻāĻŋ āĻĻāĻžāĻŦāĻŋ āĻāϰā§āύ
Why to claim podcasts?
If you are a podcaster, the best way to manage your podcasts on Listen Notes is by claiming your Listen Notes
podcast pages.
It is a great, free way to engage the podcast community and increase the visibility of your podcasts.
After claiming your Listen Notes podcast pages, you will be able to:
â
Manually refresh the RSS feed to sync up
â
Get a verified badge (
â
) alongside with your podcast name on Listen Notes
â
Post āĻļā§āϰā§āĻŖā§āĻŦāĻĻā§āϧ āĻŦāĻŋāĻā§āĻāĻžāĻĒāύ for sponsorship,
guests, co-hosts,
cross-promotion...
â
Respond to listener comments on Listen Notes
â
Use speech-to-text techniques to transcribe your show and
edit transcripts
â
Improve the presence of your podcasts, e.g., self-service
āĻĒāĻĄāĻāĻžāϏā§āĻāĻžāϰ āϏāĻžāĻā§āώāĻžā§āĻāĻžāϰ...
â
If you share your Listen Notes page and at-mention @ListenNotes
on X (formerly Twitter),
āĻāĻŽāĻžāĻĻā§āϰ āĻ
āĻĢāĻŋāϏāĻŋāϝāĻŧāĻžāϞ X (āĻĒā§āϰā§āĻŦā§ Twitter) āĻ
ā§āϝāĻžāĻāĻžāĻāύā§āĻ will retweet to promote
your show to our followers.
Coming soon:
◯ Self-service promotion on Listen Notes
◯ Track your podcast stats on Listen
Notes, e.g., listens, page
views...
◯ Manage episodes
āϏāĻŽā§āĻĒāĻžāĻĻāύāĻž
āĻĒāĻĄāĻāĻžāϏā§āĻ āĻĄā§āĻāĻžāĻŦā§āϏ āĻāĻĒ āĻā§ āĻĄā§āĻ āϰāĻžāĻāϤ⧠āϏāĻžāĻšāĻžāϝā§āϝ āĻāϰāĻžāϰ āĻāύā§āϝ āĻāĻĒāύāĻžāĻā§ āϧāύā§āϝāĻŦāĻžāĻĻāĨ¤