Skip to main content

Spatial-temporal information processing for collision detection in dynamic environments

Deliverables

The first and second training seminars

Seminar 1: Present the early models to, and provide preliminary training on, biologically plausible neural systems for the key neural vision chip designer and researchers to apply the neural vision models to robotics. Seminar 2: Train key researchers on VLSI chip design and the identified neural system model for realization.

Kick off workshop

Contact persons and key researchers will participate to facilitate preliminary ideas exchange for all WPs.

Implementation of visual neural sytems to a robotic platform

The preliminary visual neural systems will be selected and implemented individually on a robotic platform.

Neural vision chip structure identification

Investigation of optimal sensor components, techniques and tools to design the VLSI vision chip.

Preliminary demonstrator system for robust collision detection

A demonstrator system will be developed to show simple collision avoidance based on the visual-motor system.

Visual neural systems integration for single cue extraction enhancements

Integration of appropriate neural 'sub-systems' with a view to connect multiple neural systems modelling and integrate the latest experimental visual neuroscience research.

Identified visual neural systems for realization

Comparison of visual neural models.

Preliminary visual neural system models for collision cues extraction

Modelling work will take recent developments into account and continue throughout the whole project period. It will provide robust visual neural algorithms for chip design.

Progress Report

Submission of first progress report showing progress of the project.

Project website

Project website to host important progress reports and outcomes in one place for public access.

Searching for OpenAIRE data...

Publications

An improved LPTC neural model for background motion direction estimation

Author(s): Hongxin Wang, Jigen Peng, Shigang Yue
Published in: 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 2017, Page(s) 47-52
DOI: 10.1109/DEVLRN.2017.8329786

Towards computational models of insect motion detectors for robot vision

Author(s): Qinbing Fu, Cheng Hu, Pengcheng Liu, Shigang Yue
Published in: 19th Towards Autonomous Robotic Systems (TAROS), 2018, Page(s) pp. 465-467

Colias IV: The Affordable Micro Robot Platform with Bio-inspired Vision

Author(s): Cheng Hu, Qinbing Fu, Shigang Yue
Published in: 19th Towards Autonomous Robotic Systems (TAROS), 2018, Page(s) 197-208
DOI: 10.1007/978-3-319-96728-8_17

A Hybrid Visual-Model Based Robot Control Strategy for Micro Ground Robots

Author(s): Cheng Hu, Qinbing Fu, Tian Liu, Shigang Yue
Published in: From Animals to Animats 15, 2018, Page(s) 162-174
DOI: 10.1007/978-3-319-97628-0_14

A Bio-inspired Collision Detector for Small Quadcopter

Author(s): Jiannan Zhao, Cheng Hu, Chun Zhang, Zhihua Wang, Shigang Yue
Published in: 2018 International Joint Conference on Neural Networks (IJCNN), 2018, Page(s) 1-7
DOI: 10.1109/ijcnn.2018.8489298

Collision selective LGMDs neuron models research benefits from a vision-based autonomous micro robot

Author(s): Qinbing Fu, Cheng Hu, Tian Liu, Shigang Yue
Published in: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, Page(s) 3996-4002
DOI: 10.1109/IROS.2017.8206254

An Analysis of a Ring Attractor Model for Cue Integration

Author(s): Xuelong Sun, Michael Mangan, Shigang Yue
Published in: Living Machines 2018: Conference on Biomimetic and Biohybrid System, 2018, Page(s) 459-470
DOI: 10.1007/978-3-319-95972-6_49

Mimicking fly motion tracking and fixation behaviors with a hybrid visual neural network

Author(s): Qinbing Fu, Shigang Yue
Published in: 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2017, Page(s) 1636-1641
DOI: 10.1109/ROBIO.2017.8324652

Adaptive pedestrian detection by modulating features in dynamical environment

Author(s): Song Tang, Lijuan Chen, Jinpeng Mi, Mao Ye, Qingdu Li, Jianwei Zhang
Published in: 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), Issue 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2017, Page(s) 62-67
DOI: 10.1109/ROBIO.2017.8324395

A Model for Detection of Angular Velocity of Image Motion Based on the Temporal Tuning of the Drosophila

Author(s): Huatian Wang, Jigen Peng, Paul Baxter, Chun Zhang, Zhihua Wang, Shigang Yue
Published in: 2018, Page(s) 37-46
DOI: 10.1007/978-3-030-01421-6_4

A Feedback Neural Network for Small Target Motion Detection in Cluttered Backgrounds

Author(s): Wang, Hongxin; Peng, Jigen; Yue, Shigang
Published in: Issue 1, 2018
DOI: 10.1007/978-3-030-01424-7_71

Visual Cue Integration for Small Target Motion Detection in Natural Cluttered Backgrounds

Author(s): Hongxin Wang, Jigen Peng, Qinbing Fu, Huatian Wang, Shigang Yue
Published in: 2019 International Joint Conference on Neural Networks (IJCNN), 2019, Page(s) 1-7
DOI: 10.1109/ijcnn.2019.8851913

Performance of a Visual Fixation Model in an Autonomous Micro Robot Inspired by Drosophila Physiology

Author(s): Qinbing Fu, Nicola Bellotto, Cheng Hu, Shigang Yue
Published in: 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2018, Page(s) 1802-1808
DOI: 10.1109/robio.2018.8665074

Constant Angular Velocity Regulation for Visually Guided Terrain Following

Author(s): Huatian Wang, Qinbing Fu, Hongxin Wang, Jigen Peng, Shigang Yue
Published in: Artificial Intelligence Applications and Innovations - 15th IFIP WG 12.5 International Conference, AIAI 2019, Hersonissos, Crete, Greece, May 24–26, 2019, Proceedings, Issue 559, 2019, Page(s) 597-608
DOI: 10.1007/978-3-030-19823-7_50

An LGMD Based Competitive Collision Avoidance Strategy for UAV

Author(s): Jiannan Zhao, Xingzao Ma, Qinbing Fu, Cheng Hu, Shigang Yue
Published in: Artificial Intelligence Applications and Innovations - 15th IFIP WG 12.5 International Conference, AIAI 2019, Hersonissos, Crete, Greece, May 24–26, 2019, Proceedings, Issue 559, 2019, Page(s) 80-91
DOI: 10.1007/978-3-030-19823-7_6

Generating Robust Grasps for Unknown Objects in Clutter Using Point Cloud Data

Author(s): Hongzhuo Liang, Shuang Li, Michael Görner, and Jianwei Zhang
Published in: i-CREATe 2018 Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, 2018, Page(s) Pages 298-301

Path Planning for Wheeled Mobile Service Robots based on Improved Genetic Algorithm

Author(s): Shuang Li, Hongzhuo Liang, Jianwei Zhang
Published in: i-CREATe 2018 Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, 2018, Page(s) Pages 249-252

ColCOS Φ: A Multiple Pheromone Communication System for Swarm Robotics and Social Insects Research

Author(s): Xuelong Sun, Tian Liu, Cheng Hu, Qinbing Fu, Shigang Yue
Published in: 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM), Issue 3-5 July 2019, 2019, Page(s) 59-66
DOI: 10.1109/icarm.2019.8833989

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

Author(s): Qinbing Fu, Nicola Bellotto, Huatian Wang, F. Claire Rind, Hongxin Wang, Shigang Yue
Published in: Artificial Intelligence Applications and Innovations - 15th IFIP WG 12.5 International Conference, AIAI 2019, Hersonissos, Crete, Greece, May 24–26, 2019, Proceedings, Issue 559, 2019, Page(s) 67-79
DOI: 10.1007/978-3-030-19823-7_5

Angular Velocity Estimation of Image Motion Mimicking the Honeybee Tunnel Centring Behaviour

Author(s): Huatian Wang, Qinbing Fu, Hongxin Wang, Jigen Peng, Paul Baxter, Cheng Hu, Shigang Yue
Published in: 2019 International Joint Conference on Neural Networks (IJCNN), 2019, Page(s) 1-7
DOI: 10.1109/ijcnn.2019.8852321

Modeling direction selective visual neural network with ON and OFF pathways for extracting motion cues from cluttered background

Author(s): Shigang Yue, Qinbing Fu
Published in: 2017 International Joint Conference on Neural Networks (IJCNN), 2017, Page(s) 831-838
DOI: 10.1109/ijcnn.2017.7965938

LGMD and DSNs neural networks integration for collision predication

Author(s): Guopeng Zhang, Chun Zhang, Shigang Yue
Published in: 2016 International Joint Conference on Neural Networks (IJCNN), 2016, Page(s) 1174-1179
DOI: 10.1109/IJCNN.2016.7727330

Bio-inspired Collision Detector with Enhanced Selectivity for Ground Robotic Vision System

Author(s): Qinbing Fu, Shigang Yue, Cheng Hu
Published in: Procedings of the British Machine Vision Conference 2016, 2016, Page(s) 6.1-6.13
DOI: 10.5244/c.30.6

Bio-inspired small target motion detector with a new lateral inhibition mechanism

Author(s): Hongxin Wang, Jigen Peng, Shigang Yue
Published in: 2016 International Joint Conference on Neural Networks (IJCNN), 2016, Page(s) 4751-4758
DOI: 10.1109/IJCNN.2016.7727824

Visual pattern recognition using unsupervised spike timing dependent plasticity learning

Author(s): Daqi Liu, Shigang Yue
Published in: 2016 International Joint Conference on Neural Networks (IJCNN), 2016, Page(s) 285-292
DOI: 10.1109/IJCNN.2016.7727210

A 5-50 Gb/s quarter rate transmitter with a 4-tap multiple-MUX based FFE in 65 nm CMOS

Author(s): Xuqiang Zheng, Chun Zhang, Fangxu Lv, Feng Zhao, Shigang Yue, Ziqiang Wang, Fule Li, Zhihua Wang
Published in: ESSCIRC Conference 2016: 42nd European Solid-State Circuits Conference, 2016, Page(s) 305-308
DOI: 10.1109/ESSCIRC.2016.7598303

Shaping the collision selectivity in a looming sensitive neuron model with parallel ON and OFF pathways and spike frequency adaptation

Author(s): Qinbing Fu, Cheng Hu, Jigen Peng, Shigang Yue
Published in: Neural Networks, Issue 106, 2018, Page(s) 127-143, ISSN 0893-6080
DOI: 10.1016/j.neunet.2018.04.001

Event-Driven Continuous STDP Learning With Deep Structure for Visual Pattern Recognition

Author(s): Daqi Liu, Shigang Yue
Published in: IEEE Transactions on Cybernetics, 2018, Page(s) 1-14, ISSN 2168-2267
DOI: 10.1109/TCYB.2018.2801476

Infinite-dimensional Bayesian approach for inverse scattering problems of a fractional Helmholtz equation

Author(s): Junxiong Jia, Shigang Yue, Jigen Peng, Jinghuai Gao
Published in: Journal of Functional Analysis, 2018, ISSN 0022-1236
DOI: 10.1016/j.jfa.2018.08.002

A Directionally Selective Small Target Motion Detecting Visual Neural Network in Cluttered Backgrounds

Author(s): Hongxin Wang, Jigen Peng, Shigang Yue
Published in: IEEE Transactions on Cybernetics, 2018, Page(s) 1-15, ISSN 2168-2267
DOI: 10.1109/TCYB.2018.2869384

Unidirectional Optomotor Responses and Eye Dominance in Two Species of Crabs

Author(s): Yair Barnatan, Daniel Tomsic, Julieta Sztarker
Published in: Frontiers in Physiology, Issue 10, 2019, ISSN 1664-042X
DOI: 10.3389/fphys.2019.00586

A Robust Visual System for Small Target Motion Detection Against Cluttered Moving Backgrounds

Author(s): Hongxin Wang, Jigen Peng, Xuqiang Zheng, Shigang Yue
Published in: IEEE Transactions on Neural Networks and Learning Systems, 2018, Page(s) 1-15, ISSN 2162-237X
DOI: 10.1109/tnnls.2019.2910418

Deep Spiking Neural Network for Video-Based Disguise Face Recognition Based on Dynamic Facial Movements

Author(s): Daqi Liu, Nicola Bellotto, Shigang Yue
Published in: IEEE Transactions on Neural Networks and Learning Systems, Issue 19 July 2019, 2019, Page(s) 1-10, ISSN 2162-237X
DOI: 10.1109/tnnls.2019.2927274

A Robust Collision Perception Visual Neural Network With Specific Selectivity to Darker Objects

Author(s): Qinbing Fu, Cheng Hu, Jigen Peng, F. Claire Rind, Shigang Yue
Published in: IEEE Transactions on Cybernetics, 2019, Page(s) 1-15, ISSN 2168-2267
DOI: 10.1109/tcyb.2019.2946090

Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review

Author(s): Qinbing Fu, Hongxin Wang, Cheng Hu, Shigang Yue
Published in: Artificial Life, Issue 25/3, 2019, Page(s) 263-311, ISSN 1064-5462
DOI: 10.1162/artl_a_00297

Fast unsupervised learning for visual pattern recognition using spike timing dependent plasticity

Author(s): Daqi Liu, Shigang Yue
Published in: Neurocomputing, Issue 249, 2017, Page(s) 212-224, ISSN 0925-2312
DOI: 10.1016/j.neucom.2017.04.003

A 14-bit 250 MS/s IF Sampling Pipelined ADC in 180 nm CMOS Process

Author(s): Xuqiang Zheng, Zhijun Wang, Fule Li, Feng Zhao, Shigang Yue, Chun Zhang, Zhihua Wang
Published in: IEEE Transactions on Circuits and Systems I: Regular Papers, Issue 63/9, 2016, Page(s) 1381-1392, ISSN 1549-8328
DOI: 10.1109/TCSI.2016.2580703

What has been missed for predicting human attention in viewing driving clips?

Author(s): Jiawei Xu, Shigang Yue, Federica Menchinelli, Kun Guo
Published in: PeerJ, Issue 5, 2017, Page(s) e2946, ISSN 2167-8359
DOI: 10.7717/peerj.2946

A Resilient Image Matching Method with an Affine Invariant Feature Detector and Descriptor

Author(s): Zhao, Biao; Yue, Shigang
Published in: arXiv:1802.09623 [cs.CV], Issue 7, 2018

Collision Selective Visual Neural Network Inspired by LGMD2 Neurons in Juvenile Locusts

Author(s): Fu, Qinbing; Hu, Cheng; Yue, Shigang
Published in: arXiv:1801.06452 [q-bio.NC], Issue 6, 2017

Synthetic Neural Vision System Design for Motion Pattern Recognition in Dynamic Robot Scenes

Author(s): Fu, Qinbing; Hu, Cheng; Liu, Pengcheng; Yue, Shigang
Published in: arXiv:1904.07180 [cs.NE], Issue 1, 2019

PointNetGPD: Detecting Grasp Configurations from Point Sets

Author(s): Liang, Hongzhuo; Ma, Xiaojian; Li, Shuang; Görner, Michael; Tang, Song; Fang, Bin; Sun, Fuchun; Zhang, Jianwei
Published in: arXiv:1809.06267 [cs.RO], Issue 1, 2018

A Directionally Selective Neural Network with Separated ON and OFF Pathways for Translational Motion Perception in a Visually Cluttered Environment

Author(s): Fu, Qinbing; Bellotto, Nicola; Yue, Shigang
Published in: arXiv:1808.07692 [cs.NE], Issue 3, 2018

Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring

Author(s): Liang, Hongzhuo; Li, Shuang; Ma, Xiaojian; Hendrich, Norman; Gerkmann, Timo; Sun, Fuchun; Zhang, Jianwei
Published in: arXiv:1903.00650 [cs.RO], Issue 1, 2019

Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network

Author(s): Li, Shuang; Ma, Xiaojian; Liang, Hongzhuo; Görner, Michael; Ruppel, Philipp; Fang, Bing; Sun, Fuchun; Zhang, Jianwei
Published in: arXiv:1809.06268 [cs.RO], Issue 1, 2018

Effects of luminance contrast on the looming-sensitive neuron of the praying mantis Tenodera aridifolia

Author(s): Suda, R and Yamawaki, Y
Published in: ELCAS Journal, Issue 4, 2019-03, 2019, Page(s) 4-10