1. Problems being addressed:
- Current intracortical brain-computer interfaces (iBCI) are severely limited by the lack of a high-bandwidth and miniature wireless telemetry system to support the recording from a large number of neurons with high spatial and temporal resolution. Progress in comprehending the brain and nervous system largely relies on the capacity to simultaneously record and transmit extracellular electrical activity from a vast number of neurons. Studies indicate that the number of neurons being concurrently recorded has doubled every 6.4 years since the 1960s. However, existing wireless telemetry systems fall short in efficiently transmitting neural data from even only 100 recording channels, due to the substantial size of extracellular neural data or "spikes,". This limitation hampers real-time analysis and interpretation of neural signals in various research settings. Consequently, this leads to increased energy consumption for wireless telemetry and data routing, posing risks such as tissue damage, hindrance in miniaturization, and reliance on large rechargeable batteries, which can result in chemical leakage or overheating.
- Existing transcranial telemetry systems of iBCIs have limitations that prevent scaling up to a network for brain-wide spatial coverage. In order to increase spatial sampling and to understand the spatial interactions, several neuroscience groups presented a highly distributed neural recording in multiple regions of the cortex. However, existing wireless telemetry systems for iBCI are either too bulky or lack of a efficient network method that allows distributed brain implants in the iBCI to communicate with each other.
2. Society importance: The research and technologies advances in this project will lead to significant impacts in a range of application areas, in particular iBCI and low-latency closed-loop neuromodulation:
- Implantable iBCIs: Several neurotechnology companies, e.g. Neuralink, etc., aim to develop iBCIs for various therapeutic purposes. A key limitation in their BCI prototypes is the absence of high-bandwidth wireless telemetry, essential for diagnostic purposes. The proposed retinomorphic encoding method reduces data size and latency by 10-100×, significantly reducing the technical barrier of employing wireless telemetry. This can enable the full diagnosis capability, which will be crucial for many scenarios.
- Low-latency closed-loop neuromodulation (CLN): Closed-loop neuromodulation uses real-time feedback to adjust the parameters (e.g. timing, intensity, etc) of the neural stimulation delivered to the brain or nerves, to optimize the effectiveness of stimulation in response to the ongoing brain's (or nerve’s) activities. The neural signal propagation between different parts of the nervous systems (e.g. brain to spinal cord) happens between 1’s and 10’s of milliseconds [5]. However, routing and processing large data recorded from high-channel count neural sensors inevitably require data buffering and pooling which introduce latency (>100’s ms) longer than the processing time of nervous tissues. The neural data compression and distributed neural telemetry reduce data size by more than an order and avoid data buffering, so latency can be significantly reduced to sub-millisecond. Low latency in CLN provides more precise and accurate control over the neural stimulation, reducing the risk of side effects and complications. One example is implantable seizure monitoring and intervention devices for patients with epilepsy. This innovation would allow for real-time monitoring and rapid detection of seizure events, enabling timely intervention to mitigate the impact of seizures and improve patient outcomes.
3. Research objectives
There are three primary objectives in this project:
- Neural implant compressive telemetry (WP1): we will develop new loss-less or low-loss data compression and telemetry methods, which use minimum hardware resource (power consumption, area) while achieving >10x data compression and transfer.
- Free-floating implant telemetry (WP2): we will explore new wireless data and power transfer modalities such that we can avoid to use bulky antenna and coils as adopted in most of conventional neural implant telemetry systems, allowing the implants being free-floating and placed on the surface of the cortex to minimize brain tissue scaring.
- Distributed neural telemetry (WP3): we will research efficient telemetry network to allow efficient data transfer between multiple spatially distributed neural implants, with low energy consumption and low latency.