Anticipatory Human-Computer Interaction

Información del proyecto

ANTICIPATE

Identificador del acuerdo de subvención: 801708

DOI

10.3030/801708

Proyecto cerrado

Fecha de la firma de la CE 30 Enero 2019

Fecha de inicio 1 Febrero 2019

Fecha de finalización 31 Enero 2024

Financiado con arreglo a

• EXCELLENT SCIENCE - European Research Council (ERC)

Coste total

€ 1 499 625,00

Aportación de la UE

€ 1 499 625,00

Coordinado por

UNIVERSITY OF STUTTGART
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Publicaciones

Conference proceedings (31)

MultiMediate ’23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

Autores: Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Dominik Schiller, Mohammed Guermal, Dominike Thomas, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling
Publicado en: Proc. of the 31st ACM International Conference on Multimedia 2023, 2023
Editor: ACM
DOI: 10.1145/3581783.3613851

Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

Autores: Anna Penzkofer, Simon Schaefer, Florian Strohm, Mihai Bâce, Stefan Leutenegger, Andreas Bulling
Publicado en: Proc. Adaptive and Learning Agents Workshop (ALA)2023, 2023
Editor: ACM

Designing for Noticeability: The Impact of Visual Importance on Desktop Notifications

Autores: Philipp Müller, Sander Staal, Mihai Bâce, Andreas Bulling
Publicado en: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)2022, 2022
Editor: ACM
DOI: 10.1145/3491102.3501954

VQA-MHUG: A gaze dataset to study multimodal neural attention in VQA

Autores: Ekta Sood, Fabian Kögel, Florian Strohm, Prajit Dhar, Andreas Bulling
Publicado en: Proc. ACL SIGNLL Conference on Computational Natural Language Learning (CoNLL), 2021, Página(s) 27-43
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.conll-1.3

Neural Photofit: Gaze-based Mental Image Reconstruction

Autores: Florian Strohm, Ekta Sood, Sven Mayer, Philipp Müller, Mihai Bâce, Andreas Bulling
Publicado en: Proc. IEEE International Conference on Computer Vision (ICCV), 2021
Editor: IEEE Computer Society

Mouse2Vec: Learning Reusable Semantic Representations of Mouse Behaviour

Autores: Guanhua Zhang, Zhiming Hu, Mihai Bâce, Andreas Bulling
Publicado en: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), 2024, Página(s) pp. 1–17
Editor: ACM
DOI: 10.1145/3613904.3642141

Predicting Next Actions and Latent Intents during Text Formatting

Autores: Guanhua Zhang, Susanne Hindennach, Jan Leusmann, Felix Bühler, Benedict Steuerlein, Sven Mayer, Mihai Bâce, Andreas Bulling
Publicado en: Proc. the CHI Workshop Computational Approaches for Understanding, Generating, and Adapting User Interfaces, 2022
Editor: ACM

Facial Composite Generation with Iterative Human Feedback

Autores: Florian Strohm, Ekta Sood, Dominike Thomas, Mihai Bâce, Andreas Bulling
Publicado en: Proc. The 1st Gaze Meets ML workshop, PMLR 2023, 2023
Editor: PMLR

Multimodal Integration of Human-Like Attention in Visual Question Answering

Autores: Ekta Sood, Fabian Kögel, Philipp Müller, Dominike Thomas, Mihai Bâce, Andreas Bulling
Publicado en: Proc. Workshop on Gaze Estimation and Prediction in the Wild (GAZE), CVPRW 2023, 2023
Editor: IEEE

Improving Neural Saliency Prediction with a Cognitive Model of Human Visual Attention

Autores: Ekta Sood, Lei Shi, Matteo Bortoletto, Yao Wang, Philipp Müller, Andreas Bulling
Publicado en: Proc. the 45th Annual Meeting of the Cognitive Science Society (CogSci)2023, 2023
Editor: eScholarship

ConAn: A Usable Tool for Multimodal Conversation Analysis

Autores: Anna Penzkofer, Philipp Müller, Felix Bühler, Sven Mayer, Andreas Bulling
Publicado en: Proc. ACM International Conference on Multimodal Interaction (ICMI), 2021, Página(s) 341-351
Editor: ACM
DOI: 10.1145/3462244.3479886

Learning-based Region Selection for End-to-End Gaze Estimation

Autores: Xucong Zhang, Yusuke Sugano, Andreas Bulling, Otmar Hilliges
Publicado en: British Machine Vision Conference, 2020
Editor: The British Machine Vision Association

Anticipating Averted Gaze in Dyadic Interactions

Autores: Philipp Müller, Ekta Sood, Andreas Bulling
Publicado en: Symposium on Eye Tracking Research and Applications, 2020, Página(s) 1-10, ISBN 9781450371339
Editor: ACM
DOI: 10.1145/3379155.3391332

Gaze-enhanced Crossmodal Embeddings for Emotion Recognition

Autores: Ahmed Abdou, Ekta Sood, Philipp Müller, Andreas Bulling
Publicado en: Proc. International Symposium on Eye Tracking Research and Applications (ETRA)2022, 2022
Editor: ACM
DOI: 10.1145/3530879

Usable and Fast Interactive Mental Face Reconstruction

Autores: Florian Strohm, Mihai Bâce, Andreas Bulling
Publicado en: Proc. ACM Symposium on User Interface Software and Technology (UIST)2023, 2023
Editor: ACM
DOI: 10.1145/3586183.3606795

SalChartQA: Question-driven Saliency on Information Visualisations

Autores: Yao Wang, Weitian Wang, Abdullah Abdelhafez, Mayar Elfares, Zhiming Hu, Mihai Bâce, Andreas Bulling
Publicado en: Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)2024, 2024
Editor: ACM
DOI: 10.1145/3613904.3642942

Mindful Explanations: Prevalence and Impact of Mind Attribution in XAI Research

Autores: Susanne Hindennach, Lei Shi, Filip Miletic, Andreas Bulling
Publicado en: Proc. ACM on Human-Computer Interaction (PACM HCI)2024, 2024
Editor: ACM
DOI: 10.1145/3641009

Improving natural language processing tasks with human gaze-guided neural attention

Autores: Sood, E.; Tannert, S.; Müller, P.; Andreas Bulling
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2020
Editor: Curran Associates

OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog

Autores: Adnen Abdessaied, Manuel Hochmeister, Andreas Bulling
Publicado en: Proc. 31st Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), 2024
Editor: European Language Resources Association (ELRA)

Combining Gaze Estimation and Optical Flow for Pursuits Interaction

Autores: Mihai Bace, Vincent Becker, Chenyang Wang, Andreas Bulling
Publicado en: Symposium on Eye Tracking Research and Applications, 2020, Página(s) 1-10, ISBN 9781450371339
Editor: ACM
DOI: 10.1145/3379155.3391315

SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

Autores: Chuhan Jiao, Zhiming Hu, Mihai Bâce, Andreas Bulling
Publicado en: Proc. ACM Symposium on User Interface Software and Technology (UIST)2023, 2023
Editor: ACM

Video Language Co-Attention with Multimodal Fast-Learning Feature Fusion for VideoQA

Autores: Adnen Abdessaied*, Ekta Sood*, Andreas Bulling
Publicado en: Proc. of the 7th Workshop on Representation Learning for NLP (Repl4NLP)2022, 2022
Editor: ACL

Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

Autores: Xucong Zhang, Yusuke Sugano, Andreas Bulling
Publicado en: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 2019, Página(s) 1-13, ISBN 9781-450359702
Editor: ACM Press
DOI: 10.1145/3290605.3300646

Quantification of Users’ Visual Attention During Everyday Mobile Device Interactions

Autores: Mihai Bâce, Sander Staal, Andreas Bulling
Publicado en: SIGCHI Conference on Human Factors in Computing Systems, 2020
Editor: ACM Press
DOI: 10.1145/3313831.3376449

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

Autores: Guanhua Zhang, Matteo Bortoletto, Zhiming Hu, Lei Shi, Mihai Bâce, Andreas Bulling
Publicado en: Proc. IFIP TC13 Conference on Human-Computer Interaction (INTERACT)2023, 2023
Editor: ACM

MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

Autores: Philipp Müller, Dominik Schiller, Dominike Thomas, Guanhua Zhang, Michael Dietz, Patrick Gebhard, Elisabeth André, Andreas Bulling
Publicado en: Proc. ACM Multimedia (MM) - Introduction to challenge papers, 2021, Página(s) 4878–4882
Editor: ACM
DOI: 10.1145/3474085.3479219

MultiMediate’22: Backchannel Detection and Agreement Estimation in Group Interactions

Autores: Philipp Müller, Dominik Schiller, Dominike Thomas, Michael Dietz, Hali Lindsay, Patrick Gebhard, Elisabeth André, Andreas Bulling
Publicado en: Proc. ACM Multimedia (MM)2022, 2022
Editor: ACM
DOI: 10.1145/3503161.3551589

Neural Reasoning About Agents’ Goals, Preferences, and Actions

Autores: Matteo Bortoletto, Lei Shi, Andreas Bulling
Publicado en: Proc. 38th AAAI Conference on Artificial Intelligence (AAAI),2024, 2024
Editor: AAAI Press

Neuro-Symbolic Visual Dialog

Autores: Adnen Abdessaied, Mihai Bâce, Andreas Bulling
Publicado en: Proc. of the 29th International Conference on Computational Linguistics (COLING)2022, 2022
Editor: ACL

VD-GR: Boosting Visual Dialog with Cascaded Spatial-Temporal Multi-Modal GRaphs

Autores: Adnen Abdessaied, Lei Shi, Andreas Bulling
Publicado en: Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024, 2024
Editor: IEEE Computer Society

Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

Autores: Ekta Sood, Simon Tannert, Diego Frassinelli, Andreas Bulling, Ngoc Thang Vu
Publicado en: Proceedings of the 24th Conference on Computational Natural Language Learning, 2020, Página(s) 12-25
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2020.conll-1.2

Peer reviewed articles (9)

Privacy-Aware Eye Tracking: Challenges and Future Directions

Autores: Céline Gressel, Rebekah Overdorf, Inken Hagenstedt, Murat Karaboga, Helmut Lurtz, Michael Raschke, Andreas Bulling
Publicado en: IEEE Pervasive Computing, Edición 22 (1), 2023, Página(s) pp. 95-102, ISSN 1536-1268
Editor: IEEE Computer Society
DOI: 10.1109/mprv.2022.3228660

Deep gaze pooling: Inferring and visually decoding search intents from human gaze fixations

Autores: Hosnieh Sattar, Mario Fritz, Andreas Bulling
Publicado en: Neurocomputing, Edición 387, 2020, Página(s) 369-382, ISSN 0925-2312
Editor: Elsevier BV
DOI: 10.1016/j.neucom.2020.01.028

VisRecall: Quantifying Information Visualisation Recallability via Question Answering

Autores: Yao Wang, Chuhan Jiao, Mihai Bâce, Andreas Bulling
Publicado en: IEEE Transactions on Visualization and Computer Graphics (TVCG)2022, Edición 28 (12), 2022, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1145/3517031.3531166

EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality

Autores: Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang
Publicado en: IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2021.3138902

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

Autores: Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 41/1, 2019, Página(s) 162-175, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2017.2778103

Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach

Autores: Christoph Strauch, Teresa Hirzle, Stefan Van der Stigchel, Andreas Bulling
Publicado en: Journal of Vision, Edición 21/7, 2021, Página(s) 6, ISSN 1534-7362
Editor: Association for Research in Vision and Ophthalmology
DOI: 10.1167/jov.21.7.6

How Far Are We From Quantifying Visual Attention in Mobile HCI?

Autores: Mihai Bace, Sander Staal, Andreas Bulling
Publicado en: IEEE Pervasive Computing, Edición 19/2, 2020, Página(s) 46-55, ISSN 1536-1268
Editor: IEEE Computer Society
DOI: 10.1109/MPRV.2020.2967736

Scanpath Prediction on Information Visualisations

Autores: Yao Wang, Mihai Bâce, Andreas Bulling
Publicado en: IEEE Transactions on Visualization and Computer Graphics (TVCG)2023, 2023, Página(s) pp. 1–15, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2023.3242293

FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments

Autores: Zhiming Hu, Andreas Bulling, Sheng Li, Guoping Wang
Publicado en: IEEE Transactions on Visualization and Computer Graphics (TVCG), Edición 27/5, 2021, Página(s) 2681–2690, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2021.3067779