Robotic Manipulation for Nuclear Sort and Segregation

Deliverables

Project website. Report.

Project website

Force cues based on integral error signals

Project interfaces and data types

Multi-modal, multi-category object modelling

Learning with the different types of instructions

Learning Active segmentation from human instructions

Real-time visual localisation and control

semi-autonomous learning for reactive grasping and disentangling objects

performance evaluation of the RoMaNS robotic manipulation system

Performance evaluation of the RoMaNS robotic manipulation system

Semi-autonomous learning for trajectory and grasp planning

measuring expert MSM operator population

Adaptive visual tracking for arbitrary objects without training

Mapping between human and robot hands

bench-mark performance measurement on standardised tasks

Bench-mark performance measurement on standardised tasks

Searching for OpenAIRE data...

Publications

A Visual-Based Shared Control Architecture for Remote Telemanipulation

Author(s): Robuffo Giordano, Paolo; Abi-Farraj, Firas; Pedemonte, Nicolò
Published in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'16, Oct 2016, Daejeon, South Korea, Issue 1, 2016

Towards Categorization and Pose Estimation of Sets of Occluded Objects in Cluttered Scenes from Depth Data and Generic Object Models Using Joint Parsing

Author(s): H. Basevi, A. Leonardis.
Published in: ECCV Workshop on 6DOF Pose Estimation, 2016

Projected Inverse Dynamics Control and Optimal Control for Robots in Contact with the Environment: A Comparison

Author(s): V. Ortenzi, R. Stolkin, J. Kuo, M. Mistry
Published in: IROS, 2015

Towards advanced robotic manipulation for nuclear decommissioning: a pilot study on tele-operation and autonomy

Author(s): N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Published in: IEEE Robotics and Automation for Humanitarian Applications (RAHA), 2016

Regularized Covariance Estimation for Weighted Maximum Likelihood Policy Search Methods

Author(s): A. Abdolmaleki, Lau, N., Reis, L. & Neumann, G.
Published in: IEEE Humanoids, 2015

Kinematics-Based Estimation of Contact Constraints Using Only Proprioception

Author(s): V. Ortenzi, H. Lin, M. Azad, R. Stolkin, Kuo Jeffrey, M. Mistry
Published in: IEEE Humanoids, 2016

Autonomous vision-guided bi-manual grasping and manipulation

Author(s): A. Rastegarpanah, R. Stolkin
Published in: IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO), 2017

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Author(s): Marturi, N., Ortenzi, V., Xiao, J., Adjigble, M., Stolkin, R. and Leonardis, A.
Published in: IEEE-RAS Int. Conf. Humanoid Robots (Humanoids), 2015

Task-relevant grasp selection: a joint solution to planning grasps and manipulative motion trajectories

Author(s): A. M.Ghalamzan E., N. Mavrakis, M. Kopicki, A. Leonardis, R. Stolkin
Published in: IROS, 2016

The Kernel Kalman Rule - Efficient Nonparametric Inference with Recursive Least Squares

Author(s): Gebhardt, G. H. W, Kupcsik, A. and Neumann, G.
Published in: National Conference on Artificial Intelligence (AAAI), 2017

Towards robotic decommissioning of legacy nuclear plant: results of human-factors experiments with tele-robotic manipulation, and a discussion of challenges and approaches for decommissioning

Author(s): M. Talha, C. Takahashi, A. Ghalamzan, J. Kuo, W. Ingamells, R. Stolkin
Published in: IEEE International Symposium on Safety, Security and Rescue Robotics, 2016

Single Target Tracking Using Adaptive Clustered Decision Trees and Dynamic Multi-Level Appearance Models

Author(s): J. Xiao, R. Stolkin and A. Leonardis
Published in: CVPR, 2015

Optimal Control and Inverse Optimal Control by Distribution Matching

Author(s): O. Arenz, Abdulsamad, H. and Neumann, G.
Published in: IROS, 2016

Distractor-supported single target tracking in extremely cluttered scenes

Author(s): J. Xiao, L. Qiao, R. Stolkin and A. Leonardis
Published in: ECCV, 2016

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Author(s): T. Osa, Peters, J. and Neumann, G.
Published in: International Symposium on Experimental Robotics (ISER), 2016

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Author(s): V. Ortenzi, N. Marturi, R. Stolkin, J. Kuo, M. Mistry
Published in: IROS, 2016

Analysis of the inertia and dynamics of grasped objects, for choosing optimal grasps to enable torque-efficient post-grasp manipulations

Author(s): N. Mavrakis, A. Ghalamzan, L. Baronti, R. Stolkin, M. Castellani
Published in: IEEE Humanoids, 2016

Evaluating Deep Convolutional Neural Networks for Material Classification'

Author(s): G. Kalliatakis, G. Stamatiadis, S. Ehsan, A. Leonardis, J. Gall, A. Sticlaru and K. McDonald-Maier
Published in: VISAPP, 2017

Visual-Based Shared Control Architecture for Remote Telemanipulation

Author(s): Abi-Farraj, F., Pedemonte N., and Robuffo Giordano, P. A
Published in: IEEE Int. Conf. on Intelligent Robots and Systems (IROS), 2016

Humanoid Teleoperation using Task-Relevant Haptic Feedback

Author(s): Abi-Farraj , Firas; Henze , Bernd; Werner , Alexander; Panzirsch , Michael; Ott , Christian; Roa , Máximo ,
Published in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'18, Oct 2018, Madrid, Spain. 2018, Issue 1, 2017

A real-time tracking and optimised gaze control for a redundant humanoid robot head

Author(s): Naresh Marturi, Valerio Ortenzi, Jingjing Xiao, Maxime Adjigble, Rustam Stolkin, Ales Leonardis
Published in: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Page(s) 467-474
DOI: 10.1109/humanoids.2015.7363591

Grasp that optimises objectives along post-grasp trajectories

Author(s): E, Amir M Ghalamzan; Mavrakis, Nikos; Stolkin, Rustam
Published in: Issue 5, 2017

Optimal control and inverse optimal control by distribution matching

Author(s): Oleg Arenz, Hany Abdulsamad, Gerhard Neumann
Published in: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Page(s) 4046-4053
DOI: 10.1109/iros.2016.7759596

Hybrid control trajectory optimization under uncertainty

Author(s): Joni Pajarinen, Ville Kyrki, Michael Koval, Siddhartha Srinivasa, Jan Peters, Gerhard Neumann
Published in: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, Page(s) 5694-5701
DOI: 10.1109/IROS.2017.8206460

Model-Based Relative Entropy Stochastic Search

Author(s): Abbas Abdolmaleki, Rodulf Lioutikov, Nuno Lua, Luis Paulo Reis, Jan Peters, Gerhard Neumann
Published in: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion - GECCO '16 Companion, 2016, Page(s) 153-154
DOI: 10.1145/2908961.2930952

A fully end-to-end deep learning approach for real-time simultaneous 3D reconstruction and material recognition

Author(s): Cheng Zhao, Li Sun, Rustam Stolkin
Published in: 2017 18th International Conference on Advanced Robotics (ICAR), 2017, Page(s) 75-82
DOI: 10.1109/ICAR.2017.8023499

Vision-guided state estimation and control of robotic manipulators which lack proprioceptive sensors

Author(s): Valerio Ortenzi, Naresh Marturi, Rustam Stolkin, Jeffrey A. Kuo, Michael Mistry
Published in: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, Page(s) 3567-3574
DOI: 10.1109/iros.2016.7759525

Regularized covariance estimation for weighted maximum likelihood policy search methods

Author(s): Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis, Gerhard Neumann
Published in: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015, Page(s) 154-159
DOI: 10.1109/humanoids.2015.7363529

Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting

Author(s): Sun, Li; Aragon-Camarasa, Gerardo; Rogers, Simon; Stolkin, Rustam; Siebert, J. Paul
Published in: Issue 12, 2017

Safe Robotic Grasping: Minimum Impact-Force Grasp Selection

Author(s): Mavrakis, Nikos; E., Amir M. Ghalamzan; Stolkin, Rustam
Published in: Issue 10, 2017

Towards advanced robotic manipulation for nuclear decommissioning: A pilot study on tele-operation and autonomy

Author(s): Naresh Marturi, Alireza Rastegarpanah, Chie Takahashi, Maxime Adjigble, Rustam Stolkin, Sebastian Zurek, Marek Kopicki, Mohammed Talha, Jeffrey A. Kuo, Yasemin Bekiroglu
Published in: 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), 2016, Page(s) 1-8
DOI: 10.1109/raha.2016.7931866

User evaluation of a haptic-enabled shared-control approach for robotic telemanipulation

Author(s): Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo
Published in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Issue 4, 2018

A Learning-based Shared Control Architecture for Interactive Task Execution

Author(s): Abi-Farraj , Firas; Osa , Takayuki; Pedemonte , Nicolò; Peters , Jan; Neumann , Gerhard; Robuffo Giordano , Paolo
Published in: https://hal.inria.fr/hal-01482137, Issue 8, 2017

Human-in-the-loop optimisation: mixed initiative grasping for optimally facilitating post-grasp manipulative actions

Author(s): Ghalamzan , Amir ,; Abi-Farraj , Firas; Robuffo Giordano , Paolo; Stolkin , Rustam
Published in: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'17, Issue 6, 2017

Utilizing Human Feedback in POMDP Execution and Specification

Author(s): Hoelscher, J.; Koert, D.; Peters, J.; Pajarinen, J.
Published in: 2018

Learning monocular visual odometry with dense 3D mapping from dense 3D flow

Author(s): C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Published in: IEEE Int. Conf. Intelligent Robots and Systems (IROS), 2018

Model-Free Preference-Based Reinforcement Learning

Author(s): Wirth, C.; Fürnkranz, J.; Neumann G
Published in: Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15), 2015

Sample and Feedback Efficient Hierarchical Reinforcement Learning from Human Preferences

Author(s): Pinsler, R.; Akrour, R.; Osa, T.; Peters, J.; Neumann, G
Published in: 2018

Single target tracking using adaptive clustered decision trees and dynamic multi-level appearance models

Author(s): Jingjing Xiao, Rustam Stolkin, Ales Leonardis
Published in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, Page(s) 4978-4987
DOI: 10.1109/cvpr.2015.7299132

State-Regularized Policy Search for Linearized Dynamical Systems

Author(s): Abdulsamad, H.; Arenz, O.; Peters, J.; Neumann, G
Published in: International Conference on Automated Planning and Scheduling (ICAPS), 2017

Learning Robust Policies for Object Manipulation with Robot Swarms

Author(s): Gebhardt, G.H.W.; Daun, K.; Schnaubelt, M.; Neumann, G
Published in: IEEE International Conference on Robotics and Automation, 2018

Efficient Gradient-Free Variational Inference using Policy Search

Author(s): Arenz, O.; Zhong, M.; Neumann, G
Published in: 35th International Conference on Machine Learning, 2018

Iterative Cost Learning from Different Types of Human Feedback

Author(s): Arenz, O.; Neumann, G
Published in: IROS 2016 Workshop on Human-Robot Collaboration, 2016

Model-free and learning-free grasping by Local Contact Moment matching

Author(s): M Adjigble, N Marturi, V Ortenzi, V Rajasekaran, P Corke, R Stolkin
Published in: 2018

Continuously Adaptive Data Fusion and Model Relearning for Particle Filter Tracking With Multiple Features

Author(s): Xiao J, Stolkin R, Oussalah M, Leonardis A.
Published in: IEEE Sensors, 2016, ISSN 1530-437X

Guiding Trajectory Optimization by Demonstrated Distributions

Author(s): Takayuki Osa, Amir M. Ghalamzan Esfahani, Rustam Stolkin, Rudolf Lioutikov, Jan Peters, and Gerhard Neumann
Published in: IEEE ROBOTICS AND AUTOMATION LETTERS, Issue 2, 2, April 2017, 2017, Page(s) 819, ISSN 2377-3766

Assisting Movement Training and Execution With Visual and Haptic Feedback

Author(s): Marco Ewerton, David Rother, Jakob Weimar, Gerrit Kollegger, Josef Wiemeyer, Jan Peters, Guilherme Maeda
Published in: Frontiers in Neurorobotics, Issue 12, 2018, ISSN 1662-5218
DOI: 10.3389/fnbot.2018.00024

Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications Which Lack Large-scale Annotated Training Data

Author(s): Sun, Li; Zhao, Cheng; Stolkin, Rustam
Published in: IEEE Sensors, Issue 16, 2018, Page(s) 3099, ISSN 1530-437X

Hierarchical Relative Entropy Policy Search

Author(s): C. Daniel, Neumann, G., Kroemer, O. and Peters, J
Published in: Journal of Machine Learning, 2016, ISSN 1532-4435

Dynamic grasp and trajectory planning for moving objects

Author(s): Naresh Marturi, Marek Kopicki, Alireza Rastegarpanah, Vijaykumar Rajasekaran, Maxime Adjigble, Rustam Stolkin, Aleš Leonardis, Yasemin Bekiroglu
Published in: Autonomous Robots, 2018, ISSN 0929-5593
DOI: 10.1007/s10514-018-9799-1

Haptic-based shared-control methods for a dual-arm system

Author(s): Selvaggio , Mario; Abi-Farraj , Firas; Pacchierotti , Claudio; Robuffo Giordano , Paolo; Siciliano , Bruno
Published in: IEEE Robotics and Automation Letters, IEEE 2018, 3 (4), pp.4249-4256, Issue 1, 2018, ISSN 2377-3766

Design and Evaluation of a Wearable Haptic Device for Skin Stretch, Pressure, and Vibrotactile Stimuli

Author(s): Marco Aggravi, Florent Pause, Paolo Robuffo Giordano, Claudio Pacchierotti
Published in: IEEE Robotics and Automation Letters, Issue 3/3, 2018, Page(s) 2166-2173, ISSN 2377-3766
DOI: 10.1109/LRA.2018.2810887

Passive Task-Prioritized Shared-Control with Haptic Guidance

Author(s): M. Selvaggio, P. Robuffo Giordano, F. Ficuciello, and B. Siciliano
Published in: Robotics and Automation Letters, 2018, ISSN 2377-3766

Dynamic multi-level appearance models and adaptive clustered decision trees for single target tracking

Author(s): J Xiao, R Stolkin, A Leonardis
Published in: Pattern Recognition, 2017, ISSN 0031-3203

An Algorithmic Perspective on Imitation Learning

Author(s): Osa, T.; Pajarinen, J.; Neumann, G.; Bagnell, J.A.; Abbeel, P.; Peters, J
Published in: Foundations and Trends in Robotics, 2018, ISSN 1935-8253

Dense RGB-D semantic mapping with pixel-voxel neural network

Author(s): C Zhao, L Sun, P Purkait, T Duckett, R Stolkin
Published in: Sensors, 2018, ISSN 1424-8220

A Survey of Preference-Based Reinforcement Learning Methods

Author(s): Wirth, C.; Akrour, R.; Fürnkranz, J.; Neumann G
Published in: Journal of Machine Learning Research (JMLR), 2017, ISSN 1532-4435

A local-global coupled-layer puppet model for robust online human pose tracking

Author(s): Ma, M., Marturi, N., Li, Y., Stolkin, R., Leonardis, A
Published in: Computer Vision and Image Understanding, 2016, ISSN 1077-3142

Torque-Based Balancing for a Humanoid Robot Performing High-Force Interaction Tasks

Author(s): F. Abi-Farraj, B. Henze, C. Ott, P. Robuffo Giordano, and M. Roa
Published in: IEEE Robotics and Automation Letters, 2018, ISSN 2377-3766

A Haptic Shared-Control Architecture for Guided Robotic Grasping in Unknown Environments

Author(s): F. Abi-Farraj, C. Pacchierotti, O. Arenz, G. Neumann, and P. Robuffo Giordano
Published in: IEEE Transactions on Haptics, 2018, ISSN 1939-1412

Hierarchical Reinforcement Learning of Multiple Grasping Strategies with Human Instructions

Author(s): Osa, T.; Peters, J.; Neumann, G
Published in: Advanced Robotics, 2018, ISSN 1568-5535

Region-sequence based six-stream CNN features for general and fine-grained human action recognition in videos

Author(s): M Ma, N Marturi, Y Li, A Leonardis, R Stolkin
Published in: Pattern Recognition, 2018, ISSN 0031-3203

Robust Fusion of Color and Depth Data for RGB-D Target Tracking Using Adaptive Range-Invariant Depth Models and Spatio-Temporal Consistency Constraints

Author(s): J Xiao, R Stolkin, Y Gao, A Leonardis
Published in: IEEE Transactions on Cybernetics, 2018, ISSN 2168-2275

Vision-based framework to estimate robot configuration and kinematic constraints.

Author(s): N. Marturi, A. Rastegarpanah, C. Takahashi, M. Kopicki, M. Talha, S. Zurek, M. Adjigble, J.A. Kuo, R. Stolkin, Y. Bekiroglu
Published in: IEEE/ASME Transactions on Mechatronics, 2018, ISSN 1083-4435

Hybrid motion/force control: a review

Author(s): V Ortenzi, R Stolkin, J Kuo, M Mistry
Published in: Advanced Robotics, 2017, ISSN 0169-1864

Experiments with Hierarchical Reinforcement Learning of Multiple Grasping Policies

Author(s): Takayuki Osa, Jan Peters, Gerhard Neumann
Published in: 2016 International Symposium on Experimental Robotics, Issue 1, 2017, Page(s) 160-172
DOI: 10.1007/978-3-319-50115-4_15

Deliverables

Publications

Share this page

Download