Anticipatory Human-Computer Interaction

Project Information

ANTICIPATE

Grant agreement ID: 801708

DOI

10.3030/801708

Project closed

EC signature date 30 January 2019

Start date 1 February 2019

End date 31 January 2024

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 499 625,00

EU contribution

€ 1 499 625,00

Coordinated by

UNIVERSITY OF STUTTGART
Germany

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (31)

MultiMediate ’23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

Author(s): Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Dominik Schiller, Mohammed Guermal, Dominike Thomas, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling
Published in: Proc. of the 31st ACM International Conference on Multimedia 2023, 2023
Publisher: ACM
DOI: 10.1145/3581783.3613851

Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

Author(s): Anna Penzkofer, Simon Schaefer, Florian Strohm, Mihai Bâce, Stefan Leutenegger, Andreas Bulling
Published in: Proc. Adaptive and Learning Agents Workshop (ALA)2023, 2023
Publisher: ACM

Designing for Noticeability: The Impact of Visual Importance on Desktop Notifications

Author(s): Philipp Müller, Sander Staal, Mihai Bâce, Andreas Bulling
Published in: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)2022, 2022
Publisher: ACM
DOI: 10.1145/3491102.3501954

VQA-MHUG: A gaze dataset to study multimodal neural attention in VQA

Author(s): Ekta Sood, Fabian Kögel, Florian Strohm, Prajit Dhar, Andreas Bulling
Published in: Proc. ACL SIGNLL Conference on Computational Natural Language Learning (CoNLL), 2021, Page(s) 27-43
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.3

Neural Photofit: Gaze-based Mental Image Reconstruction

Author(s): Florian Strohm, Ekta Sood, Sven Mayer, Philipp Müller, Mihai Bâce, Andreas Bulling
Published in: Proc. IEEE International Conference on Computer Vision (ICCV), 2021
Publisher: IEEE Computer Society

Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

Author(s): Guanhua Zhang, Zhiming Hu, Mihai Bâce, Andreas Bulling
Published in: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), 2024, Page(s) pp. 1–17
Publisher: ACM
DOI: 10.1145/3613904.3642141

Predicting Next Actions and Latent Intents during Text Formatting

Author(s): Guanhua Zhang, Susanne Hindennach, Jan Leusmann, Felix Bühler, Benedict Steuerlein, Sven Mayer, Mihai Bâce, Andreas Bulling
Published in: Proc. the CHI Workshop Computational Approaches for Understanding, Generating, and Adapting User Interfaces, 2022
Publisher: ACM

Facial Composite Generation with Iterative Human Feedback

Author(s): Florian Strohm, Ekta Sood, Dominike Thomas, Mihai Bâce, Andreas Bulling
Published in: Proc. The 1st Gaze Meets ML workshop, PMLR 2023, 2023
Publisher: PMLR

Multimodal Integration of Human-Like Attention in Visual Question Answering

Author(s): Ekta Sood, Fabian Kögel, Philipp Müller, Dominike Thomas, Mihai Bâce, Andreas Bulling
Published in: Proc. Workshop on Gaze Estimation and Prediction in the Wild (GAZE), CVPRW 2023, 2023
Publisher: IEEE

Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

Author(s): Ekta Sood, Lei Shi, Matteo Bortoletto, Yao Wang, Philipp Müller, Andreas Bulling
Published in: Proc. the 45th Annual Meeting of the Cognitive Science Society (CogSci)2023, 2023
Publisher: eScholarship

ConAn: A Usable Tool for Multimodal Conversation Analysis

Author(s): Anna Penzkofer, Philipp Müller, Felix Bühler, Sven Mayer, Andreas Bulling
Published in: Proc. ACM International Conference on Multimodal Interaction (ICMI), 2021, Page(s) 341-351
Publisher: ACM
DOI: 10.1145/3462244.3479886

Learning-based Region Selection for End-to-End Gaze Estimation

Author(s): Xucong Zhang, Yusuke Sugano, Andreas Bulling, Otmar Hilliges
Published in: British Machine Vision Conference, 2020
Publisher: The British Machine Vision Association

Anticipating Averted Gaze in Dyadic Interactions

Author(s): Philipp Müller, Ekta Sood, Andreas Bulling
Published in: Symposium on Eye Tracking Research and Applications, 2020, Page(s) 1-10, ISBN 9781450371339
Publisher: ACM
DOI: 10.1145/3379155.3391332

Gaze-enhanced Crossmodal Embeddings for Emotion Recognition

Author(s): Ahmed Abdou, Ekta Sood, Philipp Müller, Andreas Bulling
Published in: Proc. International Symposium on Eye Tracking Research and Applications (ETRA)2022, 2022
Publisher: ACM
DOI: 10.1145/3530879

Usable and Fast Interactive Mental Face Reconstruction

Author(s): Florian Strohm, Mihai Bâce, Andreas Bulling
Published in: Proc. ACM Symposium on User Interface Software and Technology (UIST)2023, 2023
Publisher: ACM
DOI: 10.1145/3586183.3606795

SalChartQA: Question-driven Saliency on Information Visualisations

Author(s): Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling
Published in: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)2024, 2024
Publisher: ACM
DOI: 10.1145/3613904.3642942

Mindful Explanations: Prevalence and Impact of Mind Attribution in XAI Research

Author(s): Susanne Hindennach, Lei Shi, Filip Miletic, Andreas Bulling
Published in: Proc. ACM on Human-Computer Interaction (PACM HCI)2024, 2024
Publisher: ACM
DOI: 10.1145/3641009

Improving natural language processing tasks with human gaze-guided neural attention

Author(s): Sood, E.; Tannert, S.; Müller, P.; Andreas Bulling
Published in: Advances in Neural Information Processing Systems (NeurIPS), 2020
Publisher: Curran Associates

OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

Author(s): Adnen Abdessaied, Manuel Hochmeister, Andreas Bulling
Published in: Proc. 31st Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), 2024
Publisher: European Language Resources Association (ELRA)

Combining Gaze Estimation and Optical Flow for Pursuits Interaction

Author(s): Mihai Bace, Vincent Becker, Chenyang Wang, Andreas Bulling
Published in: Symposium on Eye Tracking Research and Applications, 2020, Page(s) 1-10, ISBN 9781450371339
Publisher: ACM
DOI: 10.1145/3379155.3391315

SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

Author(s): Chuhan Jiao, Zhiming Hu, Mihai Bâce, Andreas Bulling
Published in: Proc. ACM Symposium on User Interface Software and Technology (UIST)2023, 2023
Publisher: ACM

Video Language Co-Attention with Multimodal Fast-Learning Feature Fusion for VideoQA

Author(s): Adnen Abdessaied*, Ekta Sood*, Andreas Bulling
Published in: Proc. of the 7th Workshop on Representation Learning for NLP (Repl4NLP)2022, 2022
Publisher: ACL

Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

Author(s): Xucong Zhang, Yusuke Sugano, Andreas Bulling
Published in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 2019, Page(s) 1-13, ISBN 9781-450359702
Publisher: ACM Press
DOI: 10.1145/3290605.3300646

Quantification of Users’ Visual Attention During Everyday Mobile Device Interactions

Author(s): Mihai Bâce, Sander Staal, Andreas Bulling
Published in: SIGCHI Conference on Human Factors in Computing Systems, 2020
Publisher: ACM Press
DOI: 10.1145/3313831.3376449

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

Author(s): Guanhua Zhang, Matteo Bortoletto, Zhiming Hu, Lei Shi, Mihai Bâce, Andreas Bulling
Published in: Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT)2023, 2023
Publisher: ACM

MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

Author(s): Philipp Müller, Dominik Schiller, Dominike Thomas, Guanhua Zhang, Michael Dietz, Patrick Gebhard, Elisabeth André, Andreas Bulling
Published in: Proc. ACM Multimedia (MM) - Introduction to challenge papers, 2021, Page(s) 4878–4882
Publisher: ACM
DOI: 10.1145/3474085.3479219

MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

Author(s): Philipp Müller, Dominik Schiller, Dominike Thomas, Michael Dietz, Hali Lindsay, Patrick Gebhard, Elisabeth André, Andreas Bulling
Published in: Proc. ACM Multimedia (MM)2022, 2022
Publisher: ACM
DOI: 10.1145/3503161.3551589

Neural Reasoning About Agents’ Goals, Preferences, and Actions

Author(s): Matteo Bortoletto, Lei Shi, Andreas Bulling
Published in: Proc. 38th AAAI Conference on Artificial Intelligence (AAAI),2024, 2024
Publisher: AAAI Press

Neuro-Symbolic Visual Dialog

Author(s): Adnen Abdessaied, Mihai Bâce, Andreas Bulling
Published in: Proc. of the 29th International Conference on Computational Linguistics (COLING)2022, 2022
Publisher: ACL

VD-GR: Boosting Visual Dialog with Cascaded Spatial-Temporal Multi-Modal GRaphs

Author(s): Adnen Abdessaied, Lei Shi, Andreas Bulling
Published in: Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024, 2024
Publisher: IEEE Computer Society

Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

Author(s): Ekta Sood, Simon Tannert, Diego Frassinelli, Andreas Bulling, Ngoc Thang Vu
Published in: Proceedings of the 24th Conference on Computational Natural Language Learning, 2020, Page(s) 12-25
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.conll-1.2

Peer reviewed articles (9)

Privacy-Aware Eye Tracking: Challenges and Future Directions

Author(s): Céline Gressel, Rebekah Overdorf, Inken Hagenstedt, Murat Karaboga, Helmut Lurtz, Michael Raschke, Andreas Bulling
Published in: IEEE Pervasive Computing, Issue 22 (1), 2023, Page(s) pp. 95-102, ISSN 1536-1268
Publisher: IEEE Computer Society
DOI: 10.1109/mprv.2022.3228660

Deep gaze pooling: Inferring and visually decoding search intents from human gaze fixations

Author(s): Hosnieh Sattar, Mario Fritz, Andreas Bulling
Published in: Neurocomputing, Issue 387, 2020, Page(s) 369-382, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/j.neucom.2020.01.028

VisRecall: Quantifying Information Visualisation Recallability via Question Answering

Author(s): Yao Wang, Chuhan Jiao, Mihai Bâce, Andreas Bulling
Published in: IEEE Transactions on Visualization and Computer Graphics (TVCG)2022, Issue 28 (12), 2022, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1145/3517031.3531166

EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

Author(s): Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang
Published in: IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2021.3138902

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

Author(s): Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue 41/1, 2019, Page(s) 162-175, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2017.2778103

Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach

Author(s): Christoph Strauch, Teresa Hirzle, Stefan Van der Stigchel, Andreas Bulling
Published in: Journal of Vision, Issue 21/7, 2021, Page(s) 6, ISSN 1534-7362
Publisher: Association for Research in Vision and Ophthalmology
DOI: 10.1167/jov.21.7.6

How Far Are We From Quantifying Visual Attention in Mobile HCI?

Author(s): Mihai Bace, Sander Staal, Andreas Bulling
Published in: IEEE Pervasive Computing, Issue 19/2, 2020, Page(s) 46-55, ISSN 1536-1268
Publisher: IEEE Computer Society
DOI: 10.1109/MPRV.2020.2967736

Scanpath Prediction on Information Visualisations

Author(s): Yao Wang, Mihai Bâce, Andreas Bulling
Published in: IEEE Transactions on Visualization and Computer Graphics (TVCG)2023, 2023, Page(s) pp. 1–15, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2023.3242293

FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

Author(s): Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang
Published in: IEEE Transactions on Visualization and Computer Graphics (TVCG), Issue 27/5, 2021, Page(s) 2681–2690, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2021.3067779