Deep Learning State of the Art (2020)

Share this & earn $10
Lex Fridman
Published at : 19 Jan 2021
878069 views
20193
374

Lecture on most recent research and developments in deep learning, and hopes for 2020. This is not intended to be a list of SOTA benchmark results, but rather a set of highlights of machine learning and AI innovations and progress in academia, industry, and society in general. This lecture is part of the MIT Deep Learning Lecture Series.

Website: https://deeplearning.mit.edu
Slides: http://bit.ly/2QEfbAm
References: http://bit.ly/deeplearn-sota-2020
Playlist: http://bit.ly/deep-learning-playlist

OUTLINE:
0:00 - Introduction
0:33 - AI in the context of human history
5:47 - Deep learning celebrations, growth, and limitations
6:35 - Deep learning early key figures
9:29 - Limitations of deep learning
11:01 - Hopes for 2020: deep learning community and research
12:50 - Deep learning frameworks: TensorFlow and PyTorch
15:11 - Deep RL frameworks
16:13 - Hopes for 2020: deep learning and deep RL frameworks
17:53 - Natural language processing
19:42 - Megatron, XLNet, ALBERT
21:21 - Write with transformer examples
24:28 - GPT-2 release strategies report
26:25 - Multi-domain dialogue
27:13 - Commonsense reasoning
28:26 - Alexa prize and open-domain conversation
33:44 - Hopes for 2020: natural language processing
35:11 - Deep RL and self-play
35:30 - OpenAI Five and Dota 2
37:04 - DeepMind Quake III Arena
39:07 - DeepMind AlphaStar
41:09 - Pluribus: six-player no-limit Texas hold'em poker
43:13 - OpenAI Rubik's Cube
44:49 - Hopes for 2020: Deep RL and self-play
45:52 - Science of deep learning
46:01 - Lottery ticket hypothesis
47:29 - Disentangled representations
48:34 - Deep double descent
49:30 - Hopes for 2020: science of deep learning
50:56 - Autonomous vehicles and AI-assisted driving
51:50 - Waymo
52:42 - Tesla Autopilot
57:03 - Open question for Level 2 and Level 4 approaches
59:55 - Hopes for 2020: autonomous vehicles and AI-assisted driving
1:01:43 - Government, politics, policy
1:03:03 - Recommendation systems and policy
1:05:36 - Hopes for 2020: Politics, policy and recommendation systems
1:06:50 - Courses, Tutorials, Books
1:10:05 - General hopes for 2020
1:11:19 - Recipe for progress in AI
1:14:15 - Q&A: what made you interested in AI
1:15:21 - Q&A: Will machines ever be able to think and feel?
1:18:20 - Q&A: Is RL a good candidate for achieving AGI?
1:21:31 - Q&A: Are autonomous vehicles responsive to sound?
1:22:43 - Q&A: What does the future with AGI look like?
1:25:50 - Q&A: Will AGI systems become our masters?

CONNECT:
- If you enjoyed this video, please subscribe to this channel.
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
LearningState(2020)

LightWave Getting Started with Poser Tutorial

LightWave Getting Started with Poser Tutorial

GENERATIONS from EXILE TRIBE / EXPerience Greatness(MusicVideo)

GENERATIONS from EXILE TRIBE / EXPerience Greatness(MusicVideo)

Majnr - YouTubeři Hodnotí Můj Projekt

Majnr - YouTubeři Hodnotí Můj Projekt

10 Types of Logo Design Trends in 2020 || How Many types of Logo Design are there ?

10 Types of Logo Design Trends in 2020 || How Many types of Logo Design are there ?

All About Horse Blanketing

All About Horse Blanketing

I Hosted A Party FOR STRANGERS IN A FOREIGN COUNTRY

I Hosted A Party FOR STRANGERS IN A FOREIGN COUNTRY

The king of queens pilot the duvet

The king of queens pilot the duvet

Counterparts "Cherished"

Counterparts "Cherished"

Addition for Kids/Addition Song

Addition for Kids/Addition Song

Money Printer Go BRRR [ Then vs Now ]

Money Printer Go BRRR [ Then vs Now ]

Behind the Scenes of "Israel Is My Playground"

Behind the Scenes of "Israel Is My Playground"

Top 20 World's Most Beautiful Fish In The Ocean

Top 20 World's Most Beautiful Fish In The Ocean

I Reached Max Level 1000 In Shinobi Life 2 Roblox! Noob To Master

I Reached Max Level 1000 In Shinobi Life 2 Roblox! Noob To Master

Minecraft vs C0R0NAV!RU$

Minecraft vs C0R0NAV!RU$

У ТЕБЯ ЕЩЁ ЕСТЬ ВРЕМЯ | Мотивация

У ТЕБЯ ЕЩЁ ЕСТЬ ВРЕМЯ | Мотивация

my YouTube journey, and most importantly what is in the works...

my YouTube journey, and most importantly what is in the works...

Tip 48 - How To Create a Custom Clock in After Effects

Tip 48 - How To Create a Custom Clock in After Effects

The Seeking - How Did You Know?

The Seeking - How Did You Know?

Homeowner who pulled gun on protesters: I was a victim of a mob

Homeowner who pulled gun on protesters: I was a victim of a mob

Installing a CPU - How To: Basics

Installing a CPU - How To: Basics

16 Self Defense Tips That May Save Your Life

16 Self Defense Tips That May Save Your Life

Class 11 chap 3 : Motion in a Straight Line 02 || Instantaneous Velocity || Kinematics || IIT/ NEET

Class 11 chap 3 : Motion in a Straight Line 02 || Instantaneous Velocity || Kinematics || IIT/ NEET

Improvisation by Hence Makalew

Improvisation by Hence Makalew

Hydraulic machines also have opponents?

Hydraulic machines also have opponents?

James Acaster + Richard Ayoade = AWKWARDOFF | Hypothetical | Dave

James Acaster + Richard Ayoade = AWKWARDOFF | Hypothetical | Dave

LOUIS PATTEN X KURISU - TAKE SOME TIME

LOUIS PATTEN X KURISU - TAKE SOME TIME

Andain - Beautiful Things (Taken from Tiësto In Concert)

Andain - Beautiful Things (Taken from Tiësto In Concert)

ContinualAI RG: "Does Continual Learning = Catastrophic Forgetting?"

ContinualAI RG: "Does Continual Learning = Catastrophic Forgetting?"

CAN WE PULL OFF THE IMPOSSIBLE?! FIFA 21 | Hull City RTG Career Mode S4 Ep11

CAN WE PULL OFF THE IMPOSSIBLE?! FIFA 21 | Hull City RTG Career Mode S4 Ep11

*NEW* SECRET LOCATION In Your HOUSE You Did Not Know About In Adopt Me.. (Roblox)

*NEW* SECRET LOCATION In Your HOUSE You Did Not Know About In Adopt Me.. (Roblox)

Things I've Been Enjoying in the Past Couple of Months 2020 | TheGreenQueen

Things I've Been Enjoying in the Past Couple of Months 2020 | TheGreenQueen

Selling everything I own! It’s over

Selling everything I own! It’s over

A regular day in the northernmost town | Shopping + Spa + Café | Longyearbyen Svalbard

A regular day in the northernmost town | Shopping + Spa + Café | Longyearbyen Svalbard

8 Hours of Beautiful Piano Music: Sleep Music, Fall Asleep, Relaxing Music, Sleeping Music

8 Hours of Beautiful Piano Music: Sleep Music, Fall Asleep, Relaxing Music, Sleeping Music

SATISFIED (Hamilton)  - RUS VERSION - РУССКИЙ КАВЕР -  Live

SATISFIED (Hamilton) - RUS VERSION - РУССКИЙ КАВЕР - Live

Expanded Form Arrow Cards

Expanded Form Arrow Cards

Apocrypha Audio Bible|KJV| 1 Esdras|Chapters 1-3

Apocrypha Audio Bible|KJV| 1 Esdras|Chapters 1-3

You Would Wishes To Form How | My First Video

You Would Wishes To Form How | My First Video

TARGET RUN!?

TARGET RUN!?

The 8-Step SEO Strategy for Higher Rankings in 2020

The 8-Step SEO Strategy for Higher Rankings in 2020

24kGoldn - Mood (Official Video) ft. iann dior

24kGoldn - Mood (Official Video) ft. iann dior

Mother of Thousands (1000's) Alligator plant | Kamal Sehgal Sood

Mother of Thousands (1000's) Alligator plant | Kamal Sehgal Sood

Thomas Quick del 2

Thomas Quick del 2

Meet the Judge Who Went Viral For His Creative Punishments

Meet the Judge Who Went Viral For His Creative Punishments

STUDY POWER | Focus, Increase Concentration, Calm Your Mind | White Noise For Homework & School

STUDY POWER | Focus, Increase Concentration, Calm Your Mind | White Noise For Homework & School

[Jail Time] Red Dead Online - How to go to Jail...(Yep, that can happen.)

[Jail Time] Red Dead Online - How to go to Jail...(Yep, that can happen.)

My Favorite GYM LEGGINGS, Best GYMWEAR Try On Haul - Deerforce Collection Launch. Apžvalga

My Favorite GYM LEGGINGS, Best GYMWEAR Try On Haul - Deerforce Collection Launch. Apžvalga

If I Take Damage, Everyone Gets Launched 100 Blocks...

If I Take Damage, Everyone Gets Launched 100 Blocks...

How You See Your Crush Vs. How They Actually Look

How You See Your Crush Vs. How They Actually Look