Project description Challenging current Thinking Show the project objective Hide the project objective TWO!EARS replaces current thinking about auditory modelling by a systemic approach in which human listeners are regarded as multi-modal agents that develop their concept of the world by exploratory interaction. The goal of the project is to develop an intelligent, active computational model of auditory perception and experience in a multi-modal context. Our novel approach is based on a structural link from binaural perception to judgment and action, realised by interleaved signal-driven (bottom-up) and hypothesis-driven (top-down) processing within an innovative expert system architecture. The system achieves object formation based on Gestalt principles, meaning assignment, knowledge acquisition and representation, learning, logic-based reasoning and reference-based judgment. More specifically, the system assigns meaning to acoustic events by combining signal- and symbol-based processing in a joint model structure, integrated with proprioceptive and visual percepts. It is therefore able to describe an acoustic scene in much the same way that a human listener can, in terms of the sensations that sounds evoke (e.g. loudness, timbre, spatial extent) and their semantics (e.g. whether the sound is unexpected or a familiar voice). Our system will be implemented on a robotic platform, which will actively parse its physical environment, orientate itself and move its sensors in a humanoid manner. The system has an open architecture, so that it can easily be modified or extended. This is crucial, since the cognitive functions to be modelled are domain and application specific. TWO!EARS will have significant impact on future development of ICT wherever knowledge and control of aural experience is relevant. It will also benefit research in related areas such as biology, medicine and sensory and cognitive psychology. Fields of science natural sciencesbiological sciencesneurobiologycognitive neurosciencenatural sciencescomputer and information sciencesartificial intelligenceexpert systemsnatural sciencesphysical sciencesacousticsengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorssocial sciencespsychologycognitive psychology Programme(s) FP7-ICT - Specific Programme "Cooperation": Information and communication technologies Topic(s) ICT-2013.9.1 - Challenging current Thinking Call for proposal FP7-ICT-2013-C See other projects for this call Funding Scheme CP - Collaborative project (generic) Coordinator TECHNISCHE UNIVERSITAET ILMENAU Address Ehrenbergstrasse 29 98693 Ilmenau Germany See on map Region Thüringen Thüringen Ilm-Kreis Activity type Higher or Secondary Education Establishments Administrative Contact Thomas Mirow Links Contact the organisation Opens in new window Website Opens in new window EU contribution No data Participants (10) Sort alphabetically Sort by EU Contribution Expand all Collapse all UNIVERSITAET ROSTOCK Germany EU contribution € 271 200,00 Address Universitatsplatz 1 18055 Rostock See on map Region Mecklenburg-Vorpommern Mecklenburg-Vorpommern Rostock, Kreisfreie Stadt Activity type Higher or Secondary Education Establishments Administrative Contact Kristin Arnold (Ms.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data TECHNISCHE UNIVERSITAT BERLIN Germany EU contribution € 593 900,00 Address Strasse des 17 juni 135 10623 Berlin See on map Region Berlin Berlin Berlin Activity type Higher or Secondary Education Establishments Administrative Contact Christian Schmidt (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data RUHR-UNIVERSITAET BOCHUM Germany EU contribution € 548 400,00 Address Universitaetsstrasse 150 44801 Bochum See on map Region Nordrhein-Westfalen Arnsberg Bochum, Kreisfreie Stadt Activity type Higher or Secondary Education Establishments Administrative Contact Edith Klaus (Mrs.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data DANMARKS TEKNISKE UNIVERSITET Denmark EU contribution € 374 940,00 Address Anker engelunds vej 101 2800 Kongens lyngby See on map Region Danmark Hovedstaden Københavns omegn Activity type Higher or Secondary Education Establishments Administrative Contact Torsten Dau (Prof.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data UNIVERSITE PIERRE ET MARIE CURIE - PARIS 6 France EU contribution € 250 866,00 Address Place jussieu 4 75252 Paris See on map Activity type Higher or Secondary Education Establishments Administrative Contact Ella Bouquet (Mrs.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS France EU contribution € 201 021,00 Address Rue michel ange 3 75794 Paris See on map Region Ile-de-France Ile-de-France Paris Activity type Research Organisations Administrative Contact Patrick MOUNAUD (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data TECHNISCHE UNIVERSITEIT EINDHOVEN Netherlands EU contribution € 250 224,00 Address Groene loper 3 5612 AE Eindhoven See on map Region Zuid-Nederland Noord-Brabant Zuidoost-Noord-Brabant Activity type Higher or Secondary Education Establishments Administrative Contact Jos Hermus (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data THE UNIVERSITY OF SHEFFIELD United Kingdom EU contribution € 309 900,00 Address Firth court western bank S10 2TN Sheffield See on map Region Yorkshire and the Humber South Yorkshire Sheffield Activity type Higher or Secondary Education Establishments Administrative Contact Joanne Watson (Ms.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data Rensselaer Polytechnic Institute United States EU contribution € 0,00 Address 8th street 110 12180 Troy See on map Activity type Higher or Secondary Education Establishments Administrative Contact Tanya Rautine (Mrs.) Links Contact the organisation Opens in new window Other funding No data UNIVERSITE PAUL SABATIER TOULOUSE III France EU contribution € 59 280,00 Address Route de narbonne 118 31062 Toulouse cedex 9 See on map Region Occitanie Midi-Pyrénées Haute-Garonne Activity type Higher or Secondary Education Establishments Administrative Contact Michel RUFFAT (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data