Project description DEENESFRITPL Improving deep learning research efficiency Deep learning has offered significant advancements to modern society, with both a variety of tools and appliances in our everyday life, and industrial sectors utilising the multitude of features it provides. Unfortunately, despite the improvements, deep learning requires a lot of memory, computational power and energy from devices, which hinders its utilisation and further application in everyday tools. The EU-funded REDIAL project plans to change this by studying and overcoming this resource demand. To that end, the project researchers will utilise efficient training programmes and carry out further research on deep learning efficiency. Show the project objective Hide the project objective Objective In just a few short years, breakthroughs from the field of deep learning have transformed how computers perform a wide-variety of tasks such as recognizing a face, driving a car or translating a language. Not only has deep learning become an everyday tool, it is also the most promising direction for tackling a number of still open problems in machine learning and artificial intelligence. However, routine deep learning activities (such as training a model) exert severe resource demands (e.g. memory, compute, energy) that are currently slowing the advancement of the field, and preventing full global participation in this research to only the largest of companies. The goal of REDIAL is to solve core technical challenges that span the areas of machine learning and system research which collectively can enable a radical jump in the efficiency of deep learning. It aims to address both the challenge of high training costs and time, as well as the barrier to deploying models on constrained devices (like wearables, sensors) that currently require new efficiency techniques to be invented each time a deep learning innovation occurs. To accomplish this REDIAL takes two complementary approaches. First, it seeks to build a theoretical understanding of current approaches to deep learning efficiency, a desperately needed step given current over reliance on empirical observations. Second, it aims to develop new architectures and methods for training and inference that tackle core efficiency bottlenecks, such as: dependencies preventing parallelization and excessive on-chip data movement; while also opening new opportunities including the greater adoption of analog processing within accelerators. REDIAL aims to change the way the world trains its models, and deploys them to constrained devices, by producing a series of new deep architectures and algorithms with properties that promote high efficiency that can serve as a foundation for new machine learning innovation. Fields of science engineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsnatural sciencescomputer and information sciencesartificial intelligencemachine learningdeep learning Programme(s) H2020-EU.1.1. - EXCELLENT SCIENCE - European Research Council (ERC) Main Programme Topic(s) ERC-2018-STG - ERC Starting Grant Call for proposal ERC-2018-STG See other projects for this call Funding Scheme ERC-STG - Starting Grant Coordinator THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF CAMBRIDGE Net EU contribution € 1 495 036,00 Address Trinity lane the old schools CB2 1TN Cambridge United Kingdom See on map Region East of England East Anglia Cambridgeshire CC Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 Beneficiaries (2) Sort alphabetically Sort by Net EU contribution Expand all Collapse all THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF CAMBRIDGE United Kingdom Net EU contribution € 1 495 036,00 Address Trinity lane the old schools CB2 1TN Cambridge See on map Region East of England East Anglia Cambridgeshire CC Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD Participation ended United Kingdom Net EU contribution € 0,00 Address Wellington square university offices OX1 2JD Oxford See on map Region South East (England) Berkshire, Buckinghamshire and Oxfordshire Oxfordshire Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00
