DeepMind x UCL | Deep Learning Lectures | 10/12 | Unsupervised Representation Learning

Share this & earn $10
DeepMind
Published at : 08 Jan 2021
14906 views
244
10

Unsupervised learning is one of the three major branches of machine learning (along with supervised learning and reinforcement learning). It is also arguably the least developed branch. Its goal is to find a parsimonious description of the input data by uncovering and exploiting its hidden structures. This is presumed to be more reminiscent of how the brain learns compared to supervised learning. Furthermore, it is hypothesised that the representations discovered through unsupervised learning may alleviate many known problems with deep supervised and reinforcement learning. However, lacking an explicit ground truth goal to optimise towards, developmental progress in unsupervised learning has been slow. In this talk DeepMind Research Scientist Irina Higgins and DeepMind Research Engineer Mihaela Rosca give an overview the historical role of unsupervised representation learning and difficulties with developing and evaluating such algorithms. They then take a multidisciplinary approach to think about what might make a good representation and why, before doing a broad overview of the current state of the art approaches to unsupervised representation learning.

Download the slides here:
https://storage.googleapis.com/deepmind-media/UCLxDeepMind_2020/L10%20-%20UCLxDeepMind%20DL2020.pdf

Find out more about how DeepMind increases access to science here:
https://deepmind.com/about#access_to_science

Speaker Bios:

Irina is a research scientist at DeepMind, where she works in the Frontiers team. Her work aims to bring together insights from the fields of neuroscience and physics to advance general artificial intelligence through improved representation learning. Before joining DeepMind, Irina was a British Psychological Society Undergraduate Award winner for her achievements as an undergraduate student in Experimental Psychology at Westminster University, followed by a DPhil at the Oxford Centre for Computational Neuroscience and Artificial Intelligence, where she focused on understanding the computational principles underlying speech processing in the auditory brain. During her DPhil, Irina also worked on developing poker AI, applying machine learning in the finance sector, and working on speech recognition at Google Research.

Mihaela Rosca is a Research Engineer at DeepMind and PhD student at UCL, focusing on generative models research and probabilistic modelling, from variational inference to generative adversarial networks and reinforcement learning. Prior to joining DeepMind, she worked for Google on using deep learning to solve natural language processing tasks. She has an MEng in Computing from Imperial College London.

About the lecture series:

The Deep Learning Lecture Series is a collaboration between DeepMind and the UCL Centre for Artificial Intelligence. Over the past decade, Deep Learning has evolved as the leading artificial intelligence paradigm providing us with the ability to learn complex functions from raw data at unprecedented accuracy and scale. Deep Learning has been applied to problems in object recognition, speech recognition, speech synthesis, forecasting, scientific computing, control and many more. The resulting applications are touching all of our lives in areas such as healthcare and medical research, human-computer interaction, communication, transport, conservation, manufacturing and many other fields of human endeavour. In recognition of this huge impact, the 2019 Turing Award, the highest honour in computing, was awarded to pioneers of Deep Learning.

In this lecture series, research scientists from leading AI research lab, DeepMind, deliver 12 lectures on an exciting selection of topics in Deep Learning, ranging from the fundamentals of training neural networks via advanced ideas around memory, attention, and generative modelling to the important topic of responsible innovation.
Artificial IntelligenceAIDeep Learning

Character ft. Oskido & Mono-T "Inxeba Lendoda"

Character ft. Oskido & Mono-T "Inxeba Lendoda"

How to House Cleanse with Smoke║Witchcraft 101

How to House Cleanse with Smoke║Witchcraft 101

DJ Snake, Lauv - A Different Way (DEVAULT Remix)

DJ Snake, Lauv - A Different Way (DEVAULT Remix)

"Focusing is about saying no" - Steve Jobs (WWDC'97)

"Focusing is about saying no" - Steve Jobs (WWDC'97)

Gov. Cuomo Expands Coronavirus Testing Criteria To Include Front Line Workers | MSNBC

Gov. Cuomo Expands Coronavirus Testing Criteria To Include Front Line Workers | MSNBC

Diana and family games with kids for outside

Diana and family games with kids for outside

John Newman - Love Me Again

John Newman - Love Me Again

This entire video is a blooper but anyways.... 😳 ASMR Whispered Personal Attention Lo-fi

This entire video is a blooper but anyways.... 😳 ASMR Whispered Personal Attention Lo-fi

The Real Reason Walmart Is Closing Down Stores

The Real Reason Walmart Is Closing Down Stores

Reiki Music: Emotional healing music, reiki healing, meditation music for positive energy 30111R

Reiki Music: Emotional healing music, reiki healing, meditation music for positive energy 30111R

AUTOGRAPH - JOHN DENVER

AUTOGRAPH - JOHN DENVER

CALCUL DE LA VAN, DU TIR ET DU DRCI . ACE PARIS

CALCUL DE LA VAN, DU TIR ET DU DRCI . ACE PARIS

Adding Fish To Nano River Aquarium (Hillstream Loach & Panda Garra) | MD Fish Tanks

Adding Fish To Nano River Aquarium (Hillstream Loach & Panda Garra) | MD Fish Tanks

The Sensation - Black Eyed Woman • TopPop

The Sensation - Black Eyed Woman • TopPop

Joyner Lucas & Will Smith - Will (Remix)

Joyner Lucas & Will Smith - Will (Remix)

"They're trying to stop me!" | Lewis Hamilton reacts to his TWO 5 second penalties in Russian GP

"They're trying to stop me!" | Lewis Hamilton reacts to his TWO 5 second penalties in Russian GP

(mainly) MatsuHana moments pt. 2 =Haikyuu Winners versus losers=

(mainly) MatsuHana moments pt. 2 =Haikyuu Winners versus losers=

Legendary Ball Controls

Legendary Ball Controls

Properties of Matter: Formation of Precipitate—Evidence of Chemical Change

Properties of Matter: Formation of Precipitate—Evidence of Chemical Change

How the Inexpensive Sneakers is Made | Excursion to the Chinese Factory

How the Inexpensive Sneakers is Made | Excursion to the Chinese Factory

New earth like planet discovered which may support aliens life||Urdu/Hindi

New earth like planet discovered which may support aliens life||Urdu/Hindi

Video 1 - At the restaurant

Video 1 - At the restaurant

Calibre - The Dep

Calibre - The Dep

10 Incredible Abilities Of Stick Insects

10 Incredible Abilities Of Stick Insects

Basic Accounting Terms |  Bad Debts, Insolvent & Solvent | Class 11

Basic Accounting Terms | Bad Debts, Insolvent & Solvent | Class 11

Huge Win Streak: 7-0! B L U D G E D! | Ascension 20 Ironclad Run | Slay the Spire

Huge Win Streak: 7-0! B L U D G E D! | Ascension 20 Ironclad Run | Slay the Spire

Numbers 0 to 1 trillion in words (Read description for more info)

Numbers 0 to 1 trillion in words (Read description for more info)

Madonna - Live To Tell (Official Music Video)

Madonna - Live To Tell (Official Music Video)

AND - Wish You're My Girl

AND - Wish You're My Girl

Access Beginner Tutorial

Access Beginner Tutorial

The State Of Smash Ultimate

The State Of Smash Ultimate

Does God exist? | J. Krishnamurti

Does God exist? | J. Krishnamurti

How to Solve the 4x4x4 Rubik's Cube! (simplest way)

How to Solve the 4x4x4 Rubik's Cube! (simplest way)

Feisty and Tacky

Feisty and Tacky

DUBAI OUTLET MALL HAUL! AND SECOND HAND/PRE-LOVED CHANEL! - LUCY STEWART-ADAMS

DUBAI OUTLET MALL HAUL! AND SECOND HAND/PRE-LOVED CHANEL! - LUCY STEWART-ADAMS

THE BRALESS OLYMPICS CHALLENGE #2 (WET 'N WILD LIMBO RACK!)

THE BRALESS OLYMPICS CHALLENGE #2 (WET 'N WILD LIMBO RACK!)

Believe This Fishing? Unique Fish Trapping System | New Technique Of Catching Country Fish

Believe This Fishing? Unique Fish Trapping System | New Technique Of Catching Country Fish

RIPPING AND TEARING THE HEAVENS

RIPPING AND TEARING THE HEAVENS

JPEGMAFIA - PRONE! (Audio)

JPEGMAFIA - PRONE! (Audio)

Coronary Artery Bypass Graft (CABG) - NewYork-Presbyterian Hospital & Weill Cornell Medicine

Coronary Artery Bypass Graft (CABG) - NewYork-Presbyterian Hospital & Weill Cornell Medicine

Skunk Anansie - Lately

Skunk Anansie - Lately

The Astounding Eyes Of Rita - Anouar Brahem

The Astounding Eyes Of Rita - Anouar Brahem

Life Will Deceive You In A Very Bitter Way, If You Don't Do This! A Powerful Talk by Sadhguru

Life Will Deceive You In A Very Bitter Way, If You Don't Do This! A Powerful Talk by Sadhguru

Make cyberspace a better place - Katie - Cybersafety

Make cyberspace a better place - Katie - Cybersafety

A Heart of Compassion - Tuesday, January 5, 2021

A Heart of Compassion - Tuesday, January 5, 2021

Second Conditional Sentences - English Grammar Lesson - Unlikely Situations

Second Conditional Sentences - English Grammar Lesson - Unlikely Situations

The Female Fighters of Ukraine's Forgotten War

The Female Fighters of Ukraine's Forgotten War

Fasten – der Change Katalysator | Leo Wilhelmi | TEDxBodensee

Fasten – der Change Katalysator | Leo Wilhelmi | TEDxBodensee

My life is a never ending disaster

My life is a never ending disaster