āđ€āļāļĩāđˆāļĒāļ§āļāļąāļšāļžāļ­āļ”āđāļ„āļŠāļ•āđŒāļ™āļĩāđ‰ 🔗

āļœāļđāđ‰āļˆāļąāļ”:
āļ„āļ§āļēāļĄāļ–āļĩāđˆāđƒāļ™āļāļēāļĢāļ­āļąāļžāđ€āļ”āļ•:
monthly
āļ„āļ§āļēāļĄāļĒāļēāļ§āđ€āļŠāļĩāļĒāļ‡āđ‚āļ”āļĒāđ€āļ‰āļĨāļĩāđˆāļĒ:
48 minutes
āļ āļēāļĐāļēāļ­āļąāļ‡āļāļĪāļĐ
āļŠāļŦāļĢāļąāļāļ­āđ€āļĄāļĢāļīāļāļē
34 āļ•āļ­āļ™
āļ•āļąāđ‰āļ‡āđāļ•āđˆ 7 āļāļĢāļāļŽāļēāļ„āļĄ 2024
episodic

āļ•āļ­āļ™āļĨāđˆāļēāļŠāļļāļ” 🔗

On the 34th episode, we review the 1986 paper, "Learning representations by back-propagating errors" , which was pivotal because it provided a clear, generalized framework for training neural networks with internal 'hidden' units. The core of the procedure, back-propagation, repeatedly adjusts the â€Ķ

āļ„āđ‰āļ™āļŦāļēāļ•āļ­āļ™āļ—āļĩāđˆāļœāđˆāļēāļ™āļĄāļē

āļ„āđ‰āļ™āļŦāļēāļ•āļ­āļ™āļ—āļĩāđˆāļœāđˆāļēāļ™āļĄāļēāļ‚āļ­āļ‡ Data Science Decoded

āļ•āļ­āļ™āļāđˆāļ­āļ™āļŦāļ™āđ‰āļēāļ™āļĩāđ‰

Data Science #33 - The Backpropagation method, Paul Werbos (1980)

On the 33rd episdoe we review Paul Werbos’s “Applications of Advances in Nonlinear Sensitivity Analysis” which presents efficient methods for computing derivatives in nonlinear systems, drastically reducing computational costs for large-scale models. Werbos, Paul J. "Applications of advancesâ€Ķ

Data Science #32 - A Markovian Decision Process, Richard Bellman (1957)

We reviewed Richard Bellman’s “A Markovian Decision Process” (1957), which introduced a mathematical framework for sequential decision-making under uncertainty. By connecting recurrence relations to Markov processes, Bellman showed how current choices shape future outcomes and formalized the prinâ€Ķ

Data Science #31 - Correlation and causation (1921), Wright Sewall

On the 31st episode of the podcast, we add Liron to the team, we review a gem from 1921, where Sewallâ€ŊWright introduced path analysis, mapping hypothesized causal arrows into simple diagrams and proving that any sample correlation can be written as the sum of products of “path coefficients.” By tâ€Ķ

Data Science #30 - The Bootstrap Method (1977)

In the 30th episode we review the the bootstrap, method which was introduced by Bradley Efron in 1979, is a non-parametric resampling technique that approximates a statistic’s sampling distribution by repeatedly drawing with replacement from the observed data, allowing estimation of standard errorsâ€Ķ
In the 29th episode, we go over the 1979 paper by Gordon Vivian Kass that introduced the CHAID algorithm.CHAID (Chi-squared Automatic Interaction Detection) is a tree-based partitioning method introduced by G. V. Kass for exploring large categorical data sets by iteratively splitting records into mâ€Ķ

Data Science #28 - The Bloom filter algorithm

In the 28th episode, we go over Burton Bloom's Bloom filter from 1970, a groundbreaking data structure that enables fast, space-efficient set membership checks by allowing a small, controllable rate of false positives.Unlike traditional methods that store full data, Bloom filters use a compact bit â€Ķ

Data Science #27 - The History of Least Squares (1877)

Mansfield Merriman's 1877 paper traces the historical development of the Method of Least Squares, crediting Legendre (1805) for introducing the method, Adrain (1808) for the first formal probabilistic proof, and Gauss (1809) for linking it to the normal distribution. He evaluates multiple proofs,â€Ķ
In this episode, we review Cauchy’s 1847 paper, which introduced an iterative method for solving simultaneous equations by minimizing a function using its partial derivatives. Instead of elimination, he proposed progressively reducing the function’s value through small updates, forming an early verâ€Ķ

Data Science #24 - The Expectation Maximization (EM) algorithm Paper review (1977)

At the 24th episode we go over the paper titled:Dempster, Arthur P., Nan M. Laird, and Donald B. Rubin. "Maximum likelihood from incomplete data via the EM algorithm." Journal of the royal statistical society: series B (methodological) 39.1 (1977): 1-22.The Expectation-Maximization (EM) algorithm iâ€Ķ
āļ‚āđ‰āļ­āļŠāļ‡āļ§āļ™āļŠāļīāļ—āļ˜āļīāđŒ: āļžāļ­āļ”āđāļ„āļŠāļ•āđŒāđāļĨāļ°āļ­āļēāļĢāđŒāļ•āđ€āļ§āļīāļĢāđŒāļ„āļ—āļĩāđˆāļāļąāļ‡āļ­āļĒāļđāđˆāđƒāļ™āļŦāļ™āđ‰āļēāļ™āļĩāđ‰āļĄāļēāļˆāļēāļ Mike E āļ‹āļķāđˆāļ‡āđ€āļ›āđ‡āļ™āļ—āļĢāļąāļžāļĒāđŒāļŠāļīāļ™āļ‚āļ­āļ‡āđ€āļˆāđ‰āļēāļ‚āļ­āļ‡āđāļĨāļ°āđ„āļĄāđˆāļĄāļĩāļŠāđˆāļ§āļ™āđ€āļāļĩāđˆāļĒāļ§āļ‚āđ‰āļ­āļ‡āļŦāļĢāļ·āļ­āļĢāļąāļšāļĢāļ­āļ‡āđ‚āļ”āļĒ Listen Notes, Inc.