Periodic Reporting for period 2 - SmartMic (Smart Multimodal Microscopy for High-Throughput Developmental Biology in Real-Time)
Reporting period: 2017-01-01 to 2018-06-30
To address this long-standing multi-disciplinary challenge, we propose to develop an entirely novel microscopy hard- and software platform to systematically image and analyze embryos in real time. We will design and assemble a fast and flexible multimodal light-sheet microscope (SPIM) with adaptive illumination and detection from multiple sides. A fundamentally new concept of this proposal is the ability to adaptively change the recording's spatial and temporal resolution during the experiment: The microscope learns to acquire only the data of interest. Using a high-throughput sample feeder, many samples can be automatically pumped through the microscope and imaged within seconds for large-scale comparative developmental studies. Real-time processing will dramatically reduce the size of the data stream and thus, provide for the first time a platform to collect data from hundreds of samples. At the same time, by establishing a model for the observed embryo, we will integrate information from multiple samples to draw statistically relevant conclusions.
Our ground-breaking concept of smart microscopy speeds up the acquisition, reduces the amount of data and limits photo-toxicity. It enables us to address fundamental questions in embryonic development that are out of reach by traditional methods. Smart microscopy will open up a new field of research: systematic realtime developmental biology."
The design of the fast and flexible light sheet microscope (aim 1) has made good progress and will be completed in the proposed remaining time of the project. A prototype has been built and the fast and adaptive illumination scheme has been tested meanwhile on a separate setup. We are currently preparing the two publications. The two concepts will then be fused into a single instrument.
Different smart acquisition concepts are currently being theoretically tested on existing data (aim 2) and will now be tested on biological data acquired in real time. The remaining time will allow us to evaluate and enhance the performance of the algorithms and present the world-wide first “smart microscope”. Applications to be tested include the smart acquisition of the cardio-vascular system and early cell divisions in zebrafish.
The algorithms developed in aim 2 will need to be implemented in a real-time environment to provide the targeted performance in aim 3. Due to the time constraints, we will implement all algorithms on CPU and will not test other architectures for even better performance.
A prototype of a high-throughput sample feeder (aim 5) has been developed and is currently been tested for a variety of applications. In the remaining time of the project the system will be benchmarked and implemented in the four-lens microscope (aim 1) and the smart acquisition scheme (aim 2) will be used to control the flow and sample delivery.
After the first demonstrations of a multimodal SPIM/OPT system (Bassi et al, Development, 2015) we are now exploring the spectral response of transmission images in live zebrafish. We hope to gain valuable information of the tissue under observation from the respective spectral transmission. While the implementation of these concepts will be successfully tested and implemented on stand-alone systems, we do not foresee an integration into the four-lens
microscope as originally planned for the five-year project.