Skip to main content

Neural Computational Learning

Objective

The aim of NEUROCOLT is to develop a fundamental understanding of learning and of when and how it can be implemented algorithmically. Particular classes of adaptive systems include neural networks with discrete and continuous activations, genetic algorithms and other paradigms.

ACTIVITIES

The group's activities will be divided into three areas. Foundations of Learning will investigate the frameworks within a study of learning that can be undertaken. There are already a number of different settings that have been analysed. Of particular interest will be representational issues, the influence of different probability distributions governing data occurrence, learning via queries, as well as relations between the different frameworks. The understanding of learning already developed has revealed the crucial role of finding compact description of the data. This Minimum Description Length (MDL) principle will be studied in connection with genetic programming, as will Bayesian and stochastic methods for structural induction. In the area of Algorithmics, the emphasis will be on neural learning for continuous and other networks, also within the framework of agnostic on-line learning. In addition, the algorithmic implications of MDL and genetic programming, as well as the principled analysis of Bayesian and Constraint Networks will be studied. Neural Networks and Continuous Complexity Theory will study neural network representational power, with the focus again on neural networks with real activations, their behaviour as recurrent networks, and their analysis through the development of a theory of complexity over the reals. This theory will also applied to other analog models of computation.

These three work areas will bring together the wide range of research being undertaken within the Working Group. The main interactions will take place via group visits to collaborating sites focussing on a particular topic. There will also be a yearly week-long meeting, when work area groups and all project sites will share results and plan future activities. In addition, a Working Group Technical Report Series will be initiated and made publically available via remote ftp. The group will organise one international conference in the area of Computational Learning Theory and Continuous Complexity.

POTENTIAL

In the short term the group's work will provide fundamental insights into the principles involved in developing adaptive learning systems, both in terms of the algorithmic implications of the adaption process, as well as in the design of systems with sufficient capabilities for particular tasks. These insights will allow the development of concrete applications in a wide range of domains, including those where analog values are involved.

Coordinator

ROYAL HOLLOWAY AND BEDFORD NEW COLLEGE
Address
Egham Hill
TW20 0EX Egham, Surrey
United Kingdom

Participants (9)

AACHEN UNIVERSITY OF TECHNOLOGY
Germany
Address
Templergraben 55
52056 Aachen
HELSINGIN YLIOPISTO
Finland
Address
Teollisuuskatu, 23, 26
SF-00014 Helsinki
LONDON SCHOOL OF ECONOMICS AND POLITICAL SCIENCE
United Kingdom
Address
Houghton Street
London
STICHTING MATHAMATISCH CENTRUM
Netherlands
Address
Kruislaan, 413, 4079
1098 SJ Amsterdam
TECHNISCHE UNIVERSITAT GRAZ
Austria
Address
Rechbauerstrabe, 12
Graz
UNIVERSITA DEGLI STUDI DI MILANO
Italy
Address
-Via Comelico -39
-20135 -Milano
UNIVERSITAT POMPEU FABRA
Spain
Address
Balmes, 132
08008 Barcelona
UNIVERSITE DE MONS HAINAUT
Belgium
Address
, 20
7000 Mons
École Normale Supérieure de Lyon
France
Address
46 Allée D'italie
69364 Lyon