OPTINT: Optimization-based Design of Interactive Technologies

Project Information

OPTINT

Grant agreement ID: 717054

DOI

10.3030/717054

Project closed

EC signature date 29 November 2016

Start date 1 February 2017

End date 31 July 2022

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 500 000,00

EU contribution

€ 1 500 000,00

Coordinated by

EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
Switzerland

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Peer reviewed articles (5)

Learning Functionally Decomposed Hierarchies for Continuous Control Tasks With Path Planning

Author(s): Sammy Christen, Lukas Jendele, Emre Aksan, Otmar Hilliges
Published in: IEEE Robotics and Automation Letters, Issue 6/2, 2021, Page(s) 3623-3630, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/lra.2021.3060403

EyeNeRF: a hybrid representation for photorealistic synthesis, animation and relighting of human eyes

Author(s): Gengyan Li, Abhimitra Meka, Franziska Mueller, Marcel C. Buehler, Otmar Hilliges, Thabo Beeler
Published in: ACM Transactions on Graphics, Issue 15577368, 2022, ISSN 1557-7368
Publisher: ACM
DOI: 10.1145/3528223.3530130

Deep inertial poser

Author(s): Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J. Black, Otmar Hilliges, Gerard Pons-Moll
Published in: ACM Transactions on Graphics, Issue 37/6, 2019, Page(s) 1-15, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3272127.3275108

Computational Design of Kinesthetic Garments

Author(s): V. Vechev; J. Zarate; B. Thomaszewski; O. Hilliges
Published in: Computer Graphics Forum, Issue 14678659, 2022, Page(s) 535-546, ISSN 1467-8659
Publisher: Wiley
DOI: 10.1111/cgf.14492

Accurate Real‐time 3D Gaze Tracking Using a Lightweight Eyeball Calibration

Author(s): Q. Wen, D. Bradley, T. Beeler, S. Park, O. Hilliges, J. Yong, F. Xu
Published in: Computer Graphics Forum, Issue 39/2, 2020, Page(s) 475-485, ISSN 0167-7055
Publisher: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13945

Book chapters (3)

ETH-XGaze: A Large Scale Dataset for Gaze Estimation Under Extreme Head Pose and Gaze Variation

Author(s): Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang, Otmar Hilliges
Published in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part V, Issue 12350, 2020, Page(s) 365-381, ISBN 978-3-030-58557-0
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-58558-7_22

Deep Pictorial Gaze Estimation

Author(s): Seonwook Park; Adrian Spurr; Otmar Hilliges
Published in: Lecture Notes in Computer Science, 11217, 2020
Publisher: Springer
DOI: 10.48550/arxiv.1807.10002

Towards End-to-End Video-Based Eye-Tracking

Author(s): Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges
Published in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XII, Issue 12357, 2020, Page(s) 747-763, ISBN 978-3-030-58609-6
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-58610-2_44

Conference proceedings (27)

Context-Aware Online Adaptation of Mixed Reality Interfaces

Author(s): David Lindlbauer, Anna Maria Feit, Otmar Hilliges
Published in: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019, Page(s) 147-160, ISBN 9781450368162
Publisher: ACM
DOI: 10.1145/3332165.3347945

Few-Shot Adaptive Gaze Estimation

Author(s): Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 9367-9376, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00946

Structured Prediction Helps 3D Human Motion Modelling

Author(s): Emre Aksan, Manuel Kaufmann, Otmar Hilliges
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 7143-7152, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00724

D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions

Author(s): Sammy Christen, Muhammed Kocabas, Emre Aksan, Jemin Hwangbo, Jie Song, Otmar Hilliges
Published in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, Page(s) 20577-20586
Publisher: IEEE/CVF
DOI: 10.48550/arxiv.2112.03028

TacTiles: Dual-Mode Low-Power Electromagnetic Actuators for Rendering Continuous Contact and Spatial Haptic Patterns in VR

Author(s): Velko Vechev, Juan Zarate, David Lindlbauer, Ronan Hinchet, Herbert Shea, Otmar Hilliges
Published in: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Page(s) 312-320, ISBN 978-1-7281-1377-7
Publisher: IEEE
DOI: 10.1109/vr.2019.8797921

Self-Learning Transformations for Improving Gaze and Head Redirection

Author(s): Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges
Published in: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Publisher: Curran Associates, Inc.
DOI: 10.3929/ethz-b-000455057

Convolutional Autoencoders for Human Motion Infilling

Author(s): Manuel Kaufmann, Emre Aksan, Jie Song, Fabrizio Pece, Remo Ziegler, Otmar Hilliges
Published in: 2020 International Conference on 3D Vision (3DV), 2020, Page(s) 918-927, ISBN 978-1-7281-8128-8
Publisher: IEEE
DOI: 10.1109/3dv50981.2020.00102

Optimal Control for Electromagnetic Haptic Guidance Systems

Author(s): Thomas Langerak, Juan José Zárate, Velko Vechev, David Lindlbauer, Daniele Panozzo, Otmar Hilliges
Published in: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, 2020, Page(s) 951-965, ISBN 9781450375146
Publisher: ACM
DOI: 10.1145/3379337.3415593

LiP-Flow: Learning Inference-time Priors for Codec Avatars via Normalizing Flows in Latent Space

Author(s): Emre Aksan, Shugao Ma, Akin Caliskan, Stanislav Pidhorskyi, Alexander Richard, Shih-En Wei, Jason Saragih, Otmar Hilliges
Published in: European Conference on Computer Vision (ECCV), 2022
Publisher: Springer
DOI: 10.48550/arxiv.2203.07881

VariTex: Variational Neural Face Textures

Author(s): Marcel C. Buehler, Abhimitra Meka, Gengyan Li, Thabo Beeler, Otmar Hilliges
Published in: IEEE/CVF International Conference on Computer Vision, 2021, Page(s) 13890-13899
Publisher: IEEE
DOI: 10.48550/arxiv.2104.05988

Hedgehog: Handheld Spherical Pin Array based on a Central Electromagnetic Actuator

Author(s): Aline Abler, Juan Zarate, Thomas Langerak, Velko Vechev, Otmar Hilliges
Published in: 2021 IEEE World Haptics Conference (WHC), 2021, Page(s) 133-138, ISBN 978-1-6654-1871-3
Publisher: IEEE
DOI: 10.1109/whc49131.2021.9517197

Detecting Relevance during Decision-Making from Eye Movements for UI Adaptation

Author(s): Anna Maria Feit, Lukas Vordemann, Seonwook Park, Caterina Berube, Otmar Hilliges
Published in: ACM Symposium on Eye Tracking Research and Applications, 2020, Page(s) 1-11, ISBN 9781450371339
Publisher: ACM
DOI: 10.1145/3379155.3391321

CoSE: Compositional Stroke Embeddings

Author(s): Emre Aksan, Thomas Deselaers, Andrea Tagliasacchi, Otmar Hilliges
Published in: Advances in Neural Information Processing Systems 33 (NeurIPS 2020), 2020
Publisher: Curran Associates, Inc.
DOI: 10.3929/ethz-b-000456039

Learning to find eye region landmarks for remote gaze estimation in unconstrained settings

Author(s): Seonwook Park, Xucong Zhang, Andreas Bulling, Otmar Hilliges
Published in: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications - ETRA '18, 2018, Page(s) 1-10, ISBN 9781-450357067
Publisher: ACM Press
DOI: 10.1145/3204493.3204545

AdaM - Adapting Multi-User Interfaces for Collaborative Environments in Real-Time

Author(s): Seonwook Park, Antti Oulasvirta, Otmar Hilliges, Christoph Gebhardt, Roman Rädle, Anna Maria Feit, Hana Vrzakova, Niraj Ramesh Dayama, Hui-Shyong Yeo, Clemens N. Klokmose, Aaron Quigley
Published in: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Page(s) 1-14, ISBN 9781450356206
Publisher: ACM Press
DOI: 10.1145/3173574.3173758

DeepWriting - Making Digital Ink Editable via Deep Generative Modeling

Author(s): Emre Aksan, Fabrizio Pece, Otmar Hilliges
Published in: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Page(s) 1-14, ISBN 9781-450356206
Publisher: ACM Press
DOI: 10.1145/3173574.3173779

Guiding InfoGAN with Semi-supervision

Author(s): Adrian Spurr, Emre Aksan, Otmar Hilliges
Published in: Proceedings of Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2017, 2017, Page(s) 119-134
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-71249-9_8

Deep Pictorial Gaze Estimation

Author(s): Seonwook Park, Adrian Spurr, Otmar Hilliges
Published in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, 2018, Page(s) 721-738
Publisher: The Computer Vision Foundation

Learning Human Motion Models for Long-Term Predictions

Author(s): Partha Ghosh, Jie Song, Emre Aksan, Otmar Hilliges
Published in: 2017 International Conference on 3D Vision (3DV), 2017, Page(s) 458-466, ISBN 978-1-5386-2610-8
Publisher: IEEE
DOI: 10.1109/3DV.2017.00059

Cross-Modal Deep Variational Hand Pose Estimation

Author(s): Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges
Published in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, Page(s) 89-98, ISBN 978-1-5386-6420-9
Publisher: IEEE
DOI: 10.1109/cvpr.2018.00017

STCN: Stochastic Temporal Convolutional Networks

Author(s): Aksan, Emre; Hilliges, Otmar
Published in: Proccedings of the International Conference on Learning Representations (ICLR), 2019
Publisher: OpenReview

How do People Type on Mobile Devices? - Observations from a Study with 37,000 Volunteers

Author(s): Kseniia Palin, Anna Maria Feit, Sunjun Kim, Per Ola Kristensson, Antti Oulasvirta
Published in: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '19, 2019, Page(s) 1-12, ISBN 9781-450368254
Publisher: ACM Press
DOI: 10.1145/3338286.3340120

Computational Design of Active Kinesthetic Garments

Author(s): Velko Vechev, Ronan Hinchet, Stelian Coros, Bernhard Thomaszewski, and Otmar Hilliges
Published in: ACM Symposium on User Interface Software and Technologies (UIST), 2022
Publisher: ACM

Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors

Author(s): Xi Wang, Gen Li, Yen-Ling Kuo, Muhammed Kocabas, Emre Aksan, Otmar Hilliges
Published in: International Conference on 3D Vision (3DV), 2022
Publisher: IEEE
DOI: 10.48550/arxiv.2209.02485

Contact-free Nonplanar Haptics with a Spherical Electromagnet

Author(s): Juan Jose Zarate, Thomas Langerak, Bernhard Thomaszewski, Otmar Hilliges
Published in: 2020 IEEE Haptics Symposium (HAPTICS), 2020, Page(s) 698-704, ISBN 978-1-7281-0234-4
Publisher: IEEE
DOI: 10.1109/haptics45997.2020.ras.hap20.33.99093c10

A Spatio-temporal Transformer for 3D Human Motion Prediction

Author(s): Emre Aksan, Manuel Kaufmann, Peng Cao, and Otmar Hilliges
Published in: International Conference on 3D Vision (3DV), 2021, Page(s) 565 - 574
Publisher: IEEE
DOI: 10.1109/3dv53792.2021.00066

Omni - Volumetric Sensing and Actuation of Passive Magnetic Tools for Dynamic Haptic Feedback

Author(s): Thomas Langerak, Juan José Zárate, David Lindlbauer, Christian Holz, Otmar Hilliges
Published in: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, 2020, Page(s) 594-606, ISBN 9781450375146
Publisher: ACM
DOI: 10.1145/3379337.3415589