Community Research and Development Information Service - CORDIS


TIMESTORM Report Summary

Project ID: 641100
Funded under: H2020-EU.1.2.2.

Periodic Reporting for period 1 - TIMESTORM (Mind and Time: Investigation of the Temporal Traits of Human-Machine Convergence)

Reporting period: 2015-01-01 to 2015-12-31

Summary of the context and overall objectives of the project

"The TimeStorm project has been funded by the EU FETPROACT-2-2014 invited innovative and high impact research under the topic "Knowing, doing, being: cognition beyond problem solving". The goal of the TimeStorm project entitled "Mind and Time: Investigation of the Temporal Traits of Human-Machine Convergence" is to examine the role of time in multi-agent collaboration, considering particularly the case of daily human-robot interaction.
More specifically, the increasing need for robots smoothly integrated into our daily lives assumes focused exploration of the temporal aspects which are innately present in human machine interaction. In contrast to humans, ordinary computational systems cannot efficiently handle time, an issue that significantly harnesses fluency in short-term human-robot interaction and long-term human-robot symbiosis.
TimeStorm postulates that sense of time acts as a neuro-cognitive 'glue' that integrates processes from different cognitive modalities, resulting in more complete and powerful intelligent systems. In that sense, the equipment of artificial agents with temporal cognition establishes a new framework for the investigation and integration of "knowing", "doing", and "being" in artificial systems.
TimeStorm aims at the multidisciplinary investigation of time perception in order to extract working principles that enable implementing a computational architecture, analogous to natural temporal cognition, in robotic systems. To this end, TimeStorm explores the temporal aspects of multi-modal cognition in the context of real-world scenarios. The project aims at implementing a new generation of autonomous robots perfectly situated both in space and time depending on the goals and the wider collaborative framework. The achievement of TimeStorm goals will be demonstrated in the context of assistive human-robot interaction, in a kitchen environment."

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

"TimeStorm postulates that the perception of time and temporal cognition is not an optional extra but a necessity towards the development of truly autonomous and intelligent machines that are seamlessly and actively integrated into human societies.

Empirical work is in full progress in the first year of the project. We adopt novel experimental setups to address unexplored aspect of time perception in the three main research directions considered in the project, namely, "knowing", "doing" and "being". It is a major goal of the TimeStorm empirical work to formulate a holistic theory that adequately explains all experimental data, and thus provide a clear target for modeling.

The overlapping interests of TimeStorm partners on temporal cognition has greatly facilitated collaborations, specifying bridging points between individual research endeavours. From the first year of the project we have already identified research directions where collaboration between TimeStorm partners will provide significant insight in mind-time interactions and will also accomplish high scientific impact.

Significant work has already begun in modeling time perception and time-related cognitive capacities. We have used various technologies to implement particularly novel models addressing, among others, short- and long-term time perception, mental time travel in the form of episode recall, and multi-criteria time-informed planning.

In parallel, major endeavors have already started in practically testing the implemented models. Current efforts have mainly considered the simulated environment ArmarX and realistic scenarios of robot-robot collaboration in a kitchen environment. This procedure reveals potential shortcomings in the first versions of the implemented models, therefore pointing out directions for immediate improvements in the following months.

The strong coupling of neuroscientific and computational research endeavours is in the centre of TimeStorm workplan. In this direction we have already compiled a research agenda inviting bipartite, tripartite and more complex collaborations among the beneficiaries. We expect that the implemented models will provide novel means for exploring temporal cognition (e.g. artificial damages on timing models, experimental setups that cannot be applied in human subjects) providing significant feedback to neuroscience by revealing unexplored aspects of mind-time coupling."

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

In the first year of the project, the development of TimeStorm is in agreement to the information provided in the DoA, with respect to the expected impacts by the project.
To maximize the impact of TimeStorm, the consortium has so far implemented the following concrete actions:

TimeStorm website. Development of the TimeStorm website to maximize the visibility of the project and assist the project goals and experimental results be appreciated by scientific community and the wider public.

Scientific publications. The project beneficiaries have already published 10 articles that acknowledge TimeStorm in the most relevant scientific journals in the field. A list of the relevant articles is given below:
• S. Droit-Volet, J. Wearden, & P. Zélanti (2015). Cognitive abilities required in time judgment depending on the temporal task used: a comparison of children and adults. Quarterly Journal of Experimental Psychology, 68(11), pp. 2216-2242.
• S. Droit-Volet, M., Lamotte, & M. Izaute (2015). The conscious awareness of time distortions regulates the effect of emotion on the perception of time. Consciousness and Cognition, 38, pp.155-164.
• S. Droit-Volet, & S. Gil (2015). The Emotional body and time perception. Cognition & Emotion, 1-13.
• D. Linares, I. Cos, & W. Roseboom (2016). Adaptation for multisensory relative timing, Current Opinion in Behavioral Sciences, 8, pp. 35-41.
• H. Van Rijn (2016). How Memory Mechanisms Influence Interval Timing: A Review, Current Opinions in Behavioral Sciences.
• Halbersma, & H. Van Rijn (2016). An Evaluation of the Effect of Auditory Emotional Stimuli on Interval Timing. Timing and Time Perception.
• S. Droit-Volet, & J. Wearden, J. (2016). Passage of time judgments are not duration judgments: Evidence from a study using Experience Sampling Methodology. Frontiers in psychology, 7:176. doi: 10.3389/fpsyg.2016.00176
• M. Maniadakis, & P. Trahanias (2015). Integrated Intrinsic and Dedicated Representations of Time: A Computational Study Involving Robotic Agents, Timing & Time Perception, 3 (3-4), pp. 246 – 268.
• Droit-Volet, S. (In press). Temporalités, Emotion, Humeur, et troubles de l’humeur. In E. Laurent & P. Vandel (eds.). De l’humeur quotidienne à la dépression sévère: Manuel pluridisciplinaire de la thymie. Éditions De Boeck-Solal.
• Droit-Volet, S. (In press). Developpement du temps, psychologie. Encyclopaedia Universalis.

Moreover a number of articles have been submitted and are currently considered for publication in scientific journals and conferences.

Related information

Record Number: 186651 / Last updated on: 2016-07-14