Description du projet
Améliorer l’efficacité de la recherche dans le domaine de l’apprentissage profond
L’apprentissage profond a permis à la société moderne de faire des progrès remarquables, grâce à l’éventail d’outils et de dispositifs dont nous disposons au quotidien et aux secteurs industriels qui utilisent la pléthore de fonctionnalités qu’il offre. Malheureusement, en dépit de ces avancées, l’apprentissage profond exige des dispositifs très gourmands en mémoire, en puissance de calcul et en énergie, qui entravent son utilisation et son application dans les outils du quotidien. Le projet REDIAL, financé par l’UE, entend changer la donne en étudiant et en remédiant à cette demande de ressources. Pour ce faire, les chercheurs du projet utiliseront des programmes de formation efficaces et mèneront des recherches supplémentaires sur l’efficacité de l’apprentissage profond.
Objectif
In just a few short years, breakthroughs from the field of deep learning have transformed how computers perform a wide-variety of tasks such as recognizing a face, driving a car or translating a language. Not only has deep learning become an everyday tool, it is also the most promising direction for tackling a number of still open problems in machine learning and artificial intelligence. However, routine deep learning activities (such as training a model) exert severe resource demands (e.g. memory, compute, energy) that are currently slowing the advancement of the field, and preventing full global participation in this research to only the largest of companies.
The goal of REDIAL is to solve core technical challenges that span the areas of machine learning and system research which collectively can enable a radical jump in the efficiency of deep learning. It aims to address both the challenge of high training costs and time, as well as the barrier to deploying models on constrained devices (like wearables, sensors) that currently require new efficiency techniques to be invented each time a deep learning innovation occurs. To accomplish this REDIAL takes two complementary approaches. First, it seeks to build a theoretical understanding of current approaches to deep learning efficiency, a desperately needed step given current over reliance on empirical observations. Second, it aims to develop new architectures and methods for training and inference that tackle core efficiency bottlenecks, such as: dependencies preventing parallelization and excessive on-chip data movement; while also opening new opportunities including the greater adoption of analog processing within accelerators. REDIAL aims to change the way the world trains its models, and deploys them to constrained devices, by producing a series of new deep architectures and algorithms with properties that promote high efficiency that can serve as a foundation for new machine learning innovation.
Champ scientifique
Programme(s)
Thème(s)
Régime de financement
ERC-STG - Starting GrantInstitution d’accueil
CB2 1TN Cambridge
Royaume-Uni