ContinualAI RG: "Does Continual Learning = Catastrophic Forgetting?"

Share this & earn $10
ContinualAI
Published at : 10 Feb 2021
112 views
5
0

This Friday 05-02-2021, 5.30pm CET, for the ContinualAI Reading Group, Anh Thai (Georgia Institute of Technology) presented the paper:

Title: Does Continual Learning = Catastrophic Forgetting?

Abstract: Continual learning is known for suffering from catastrophic forgetting, a phenomenon where earlier learned concepts are forgotten at the expense of more recent samples. In this work, we challenge the assumption that continual learning is inevitably associated with catastrophic forgetting by presenting a set of tasks that surprisingly do not suffer from catastrophic forgetting when learned continually. We attempt to provide an insight into the property of these tasks that make them robust to catastrophic forgetting and the potential of having a proxy representation learning task for continual classification. We further introduce a novel yet simple algorithm, YASS that outperforms state-of-the-art methods in the class-incremental categorization learning task. Finally, we present DyRT, a novel tool for tracking the dynamics of representation learning in continual models. The codebase, dataset and pre-trained models released with this article can be found at this https URL.

The event was moderated by: Vincenzo Lomonaco.

You can find the slides, the paper and more materials in our forum: https://continualai.discourse.group/t/continualai-reading-group-does-continual-learning-catastrophic-forgetting/228

------------------------ About ContinualAI ------------------------

ContinualAI is an official non-profit research organization and the largest open community on Continual Learning for AI. We aim at connecting people and working better together on this fascinating topic we consider fundamental for the future of AI.

• Official website: https://www.continualai.org​
• Join us now at https://www.continualai.org/join_us​

Please consider supporting us with a small donation at: https://www.continualai.org/supporters​

It's thanks to people like you that we are making ContinualAI a reality!
ContinualAI"DoesContinual

entirety - 6 nouns which are synonym to entirety (sentence examples)

entirety - 6 nouns which are synonym to entirety (sentence examples)

Dial Tone (feat. Ayesha Erotica & Slayyyter)

Dial Tone (feat. Ayesha Erotica & Slayyyter)

Can Scotland become independent? | Inside Story

Can Scotland become independent? | Inside Story

1ShotPlays - Dark Souls III (Part 53) - Archdragon Peak (Blind)

1ShotPlays - Dark Souls III (Part 53) - Archdragon Peak (Blind)

List All Positive Factors of 30

List All Positive Factors of 30

What Law Did Jesus Abolish?

What Law Did Jesus Abolish?

Branding your Business via Jyotish- (COLORS)- Part-1- Introduction

Branding your Business via Jyotish- (COLORS)- Part-1- Introduction

Sarah Wigglesworth and Piers Taylor discuss straw bale house in Jim Stephenson's latest film

Sarah Wigglesworth and Piers Taylor discuss straw bale house in Jim Stephenson's latest film

Java Programming: 12 - Packages

Java Programming: 12 - Packages

Samsung Galaxy Note 20 Ultra Tamil Long-Term Review — After Android 11 One UI 3 update

Samsung Galaxy Note 20 Ultra Tamil Long-Term Review — After Android 11 One UI 3 update

I Wanted it, I Made it Happen | Lili Golestan | TEDxTehran

I Wanted it, I Made it Happen | Lili Golestan | TEDxTehran

Saosin - Voices (New Version)

Saosin - Voices (New Version)

Is There Meaning to Life? | William Lane Craig, Rebecca Goldstein, Jordan Peterson - Toronto 2018

Is There Meaning to Life? | William Lane Craig, Rebecca Goldstein, Jordan Peterson - Toronto 2018

We are going to pretend we didn't see that

We are going to pretend we didn't see that

What is Duration & Modified Duration? | Macauley Duration & Modified Duration calculations

What is Duration & Modified Duration? | Macauley Duration & Modified Duration calculations

things bts say that seem like fake subs but aren’t REACTION [LMAOOOOO]

things bts say that seem like fake subs but aren’t REACTION [LMAOOOOO]

who's most likely to challenge || Jenna Micha Filler

who's most likely to challenge || Jenna Micha Filler

Why Study Religion?

Why Study Religion?

XQC Rages off the new server before it even starts

XQC Rages off the new server before it even starts

The Foundations - Build Me Up Buttercup

The Foundations - Build Me Up Buttercup

Studio Acoustic Treatment on a Budget

Studio Acoustic Treatment on a Budget

Secrets of Althorp: The Spencers

Secrets of Althorp: The Spencers

Top 6 PUBG Mobile Alternatives Free Games For Android & iOS 😍😍 !!

Top 6 PUBG Mobile Alternatives Free Games For Android & iOS 😍😍 !!

Converting leads and horse racing, a sensible analogy?

Converting leads and horse racing, a sensible analogy?

The Civil Lawsuit Against Kyle Rittenhouse and Co. Has Been Dismissed WITH PREJUDICE

The Civil Lawsuit Against Kyle Rittenhouse and Co. Has Been Dismissed WITH PREJUDICE

How to Host Your Website for Free (FOREVER!)

How to Host Your Website for Free (FOREVER!)

PUMPIN - THE JETTIES

PUMPIN - THE JETTIES

13 Impressive Things That Won't Leave Anyone Indifferent

13 Impressive Things That Won't Leave Anyone Indifferent

Output Problem 2 || Pointers || CBSE Class 12 CBSE

Output Problem 2 || Pointers || CBSE Class 12 CBSE

Brand New - Sic Transit Gloria

Brand New - Sic Transit Gloria

Light | The Dr. Binocs Show | Learn Videos For Kids

Light | The Dr. Binocs Show | Learn Videos For Kids

The SILVER SHORT SQUEEZE: Eat My Shorts - Mike Maloney

The SILVER SHORT SQUEEZE: Eat My Shorts - Mike Maloney

How to Pay For a Shipping Label With ebay Managed Payments | ebay Step by Step

How to Pay For a Shipping Label With ebay Managed Payments | ebay Step by Step

Johnyboy - Alcatraz

Johnyboy - Alcatraz

FIRST GLIMPSE OF OUR NEW HOME!! AND MY BABY CLOTHES MUST HAVES 😍 VLOG 26 of my Motherhood journey...

FIRST GLIMPSE OF OUR NEW HOME!! AND MY BABY CLOTHES MUST HAVES 😍 VLOG 26 of my Motherhood journey...

Zé Maia Rodrigues - "Talk is Cheap" | Prova Cega | The Voice Portugal

Zé Maia Rodrigues - "Talk is Cheap" | Prova Cega | The Voice Portugal

Only 2 Paths To Choose From In Life

Only 2 Paths To Choose From In Life

Helpful or harmful? Messages in Souls games - Messages

Helpful or harmful? Messages in Souls games - Messages

Haywyre - Endlessly (Live Performance) [Monstercat Release]

Haywyre - Endlessly (Live Performance) [Monstercat Release]

Mitch Jones & Simply - Twerk It 🔥

Mitch Jones & Simply - Twerk It 🔥

Overview-ประยุทธ์โดนด่ายับ โควิดพุ่งจ่อพัน ทวีศิลป์ชี้ประชาชนคือภาระ ทำประเทศพัง แต่ไม่อยากเยียวยา

Overview-ประยุทธ์โดนด่ายับ โควิดพุ่งจ่อพัน ทวีศิลป์ชี้ประชาชนคือภาระ ทำประเทศพัง แต่ไม่อยากเยียวยา

DIY Iphone 12 Pro Max Notebook Organizer

DIY Iphone 12 Pro Max Notebook Organizer

Kiss Me (Sixpence None The Richer) Cover by The Lecturers

Kiss Me (Sixpence None The Richer) Cover by The Lecturers

Deep Frying Water (DON’T TRY THIS AT HOME!) | Eitan Bernath

Deep Frying Water (DON’T TRY THIS AT HOME!) | Eitan Bernath

Verb Tenses | Most COMMONLY USED Grammar | Learn American English | Go Natural English

Verb Tenses | Most COMMONLY USED Grammar | Learn American English | Go Natural English

MAJOR Dragon Ball Super Manga Chapter 67 Spoilers - WTF!?

MAJOR Dragon Ball Super Manga Chapter 67 Spoilers - WTF!?

Why Don't We - Lotus Inn [Official Music Video]

Why Don't We - Lotus Inn [Official Music Video]

However का सही use | Use of However | However meaning

However का सही use | Use of However | However meaning

Kwabs - Last Stand produced by SOHN (Official Audio)

Kwabs - Last Stand produced by SOHN (Official Audio)