Skip to main content

MultiModal Mall Entertainment Robot

Objective

"In MuMMER (""MultiModal Mall Entertainment Robot""), we propose to address the important and growing market of consumer entertainment robotics by advancing the technologies needed to support this area of robotics, and also by explicitly addressing issues of consumer acceptance, thus creating new European business and employment opportunities in consumer robotics. Specifically, we will develop a humanoid robot (based on Aldebaran's Pepper platform) able to engage and interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers, to develop truly engaging robot behaviours, including telling jokes or playing games, as well as providing guidance, information, and collecting customer feedback. Crucially, our robot will exhibit behaviour that is socially appropriate, combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, social-signal processing, high-level action selection, and human-aware robot navigation.

Throughout the project, the robot will be deployed in a large public shopping mall in Finland: initially for short visits to aid in collaborative scenario development, co-design, and system evaluation, and later for a long-term field study in the 4th year of the project. Through our co-design approach, we will both study and foster acceptance of consumer robots and thus positively influence the consumer markets of service robots.
"

Coordinator

UNIVERSITY OF GLASGOW
Net EU contribution
€ 815 178,75
Address
University Avenue
G12 8QQ Glasgow
United Kingdom

See on map

Region
West Central Scotland Glasgow City
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00

Participants (6)

HERIOT-WATT UNIVERSITY
United Kingdom
Net EU contribution
€ 904 287,50
Address
Riccarton
EH14 4AS Edinburgh

See on map

Region
Eastern Scotland Edinburgh
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
FONDATION DE L'INSTITUT DE RECHERCHE IDIAP
Switzerland
Net EU contribution
€ 0,00
Address
Rue Marconi 19
1920 Martigny

See on map

Region
Schweiz/Suisse/Svizzera Région lémanique Valais / Wallis
Activity type
Research Organisations
Non-EU contribution
€ 1 047 302,50
CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS
France
Net EU contribution
€ 851 771,25
Address
Rue Michel Ange 3
75794 Paris

See on map

Region
Ile-de-France Ile-de-France Paris
Activity type
Research Organisations
Non-EU contribution
€ 0,00
SOFTBANK ROBOTICS EUROPE
France
Net EU contribution
€ 958 750,00
Address
Rue Colonel Pierre Avia 43
75015 Paris

See on map

Region
Ile-de-France Ile-de-France Paris
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 0,00
TEKNOLOGIAN TUTKIMUSKESKUS VTT OY
Finland
Net EU contribution
€ 600 347,50
Address
Tekniikantie 21
02150 Espoo

See on map

Region
Manner-Suomi Helsinki-Uusimaa Helsinki-Uusimaa
Activity type
Research Organisations
Non-EU contribution
€ 0,00
KIINTEISTO OY IDEAPARK AB
Finland
Net EU contribution
€ 167 500,00
Address
Ideaparkinkatu 4
37570 Lempäälä

See on map

Region
Manner-Suomi Länsi-Suomi Pirkanmaa
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 0,00