ANC Workshop - 29/04/2025

Speakers: Tom Lee and Ben Sanati

 

Title: Continual Learning with Neural Networks. The fundamental problem of forgetting.

 

Abstract: Humans learn and adapt over time. However, the training process for many neural models is destructive - adaptive learning continuously over time either fails to learn new things or produces destructive effects on previously learnt things. Even in the modern world of vast models, fine tuning and prompting, this is still an issue. We will explore in a couple of talks two issues and ideas around continual learning and forgetting.