![Bit of a Tangent](https://pbcdn1.podbean.com/imglogo/image-logo/5300762/bit_of_a_tangent_logo.jpg)
19.2K
Downloads
31
Episodes
Two aspiring rationalists bring you mind-bending ideas from science, philosophy, artificial intelligence, and medicine. Whether you enjoy wide-ranging discussions or are looking to upgrade your reasoning and critical thinking skills, this podcast will satisfy your intellectual hunger and sharpen your skeptical eye.
Episodes
![025 | Self-Supervised Machine Learning: Introduction, Intuitions, and Use-Cases](https://pbcdn1.podbean.com/imglogo/ep-logo/pbblog5300762/boat_post_025_300x300.jpg)
Thursday Mar 05, 2020
025 | Self-Supervised Machine Learning: Introduction, Intuitions, and Use-Cases
Thursday Mar 05, 2020
Thursday Mar 05, 2020
On this episode of Bit of A Tangent, we discuss the emerging field of self-supervised machine learning. This is an immensely exciting area of active research in machine learning and AI - one which most people haven’t even heard about yet! We build up to the intuition for the topic by covering supervised and unsupervised learning; autoencoders and dimensionality reduction, and exploring how these techniques could be applied to Gianluca’s Quantified Self n=1 sleep quality dataset. We culminate in a detailed discussion of the state-of-the-art Contrastive Predictive Coding model, and how it allows us to learn about the structure of the world, without tonnes of labelled training data!
--------
Shownotes:
--------
Jared on Twitter: www.twitter.com/jnearestn
Gianluca on Twitter: www.twitter.com/QVagabond
Bit of a Tangent on Twitter (www.twitter.com/podtangent) and Instagram (instagram.com/podtangent/)
Summer school on Computational Neuroscience: http://imbizo.africa/
Control problem in AI: https://intelligence.org/stanford-talk/
Coordination problem: https://conceptually.org/concepts/coordination-problems
Deep learning overview: https://lilianweng.github.io/lil-log/2017/06/21/an-overview-of-deep-learning.html
t-SNE explained: https://mlexplained.com/2018/09/14/paper-dissected-visualizing-data-using-t-sne-explained/
Variational autoencoders explained: https://anotherdatum.com/vae.html
Self-supervised learning by fast.ai: https://www.fast.ai/2020/01/13/self_supervised/
CPC model papers on Arxiv: https://arxiv.org/pdf/1807.03748.pdf https://arxiv.org/pdf/1905.09272.pdf
Blog posts explaining CPC: https://lilianweng.github.io/lil-log/2019/11/10/self-supervised-learning.html
https://mf1024.github.io/2019/05/27/contrastive-predictive-coding/
Comments (0)
To leave or reply to comments, please download free Podbean or
No Comments
To leave or reply to comments,
please download free Podbean App.