Fast & automated droplet tracking tool for microfluidics

Projektinformationen

DROPTRACK

ID Finanzhilfevereinbarung: 101081171

DOI

10.3030/101081171

Projekt abgeschlossen

EK-Unterschriftsdatum 7 Juli 2022

Startdatum 1 Oktober 2022

Enddatum 31 März 2024

Finanziert unter

• European Research Council (ERC)

Gesamtkosten

Keine Daten

EU-Beitrag

€ 150 000,00

Koordiniert durch

FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Italy

Periodic Reporting for period 1 - DROPTRACK (Fast & automated droplet tracking tool for microfluidics)

Berichtszeitraum: 2022-10-01 bis 2024-03-31

Zusammenfassung vom Kontext und den Gesamtzielen des Projekts

Microfluidic applications require investigation of droplet dynamics and morphologies. This is particularly important for processes like drug delivery and production of cosmetics and paints, where droplet shape evolution is crucial. Traditionally, specialized equipment was needed to quantify droplet size, packing fraction, flow rates etc. We present DropTrack, a computer vision tool that infers these physical parameters by analyzing droplet images from experiments and production lines. DropTrack can detect droplets in static images and track their motion in videos. The extracted data allows for the calculation of droplet morphologies and key physical parameters like their sizes and packing fraction, which are essential for quality control in microfluidic manufacturing.

Arbeit, die ab Beginn des Projekts bis zum Ende des durch den Bericht erfassten Berichtszeitraums geleistet wurde, und die wichtigsten bis dahin erzielten Ergebnisse

DropTrack utilizes the YOLO (You Only Look Once) and DeepSORT algorithms for droplet identification and tracking. We trained these algorithms using a dataset comprised of approximately 2,000 manually annotated images obtained from microfluidic experiments, supplemented with another 2,000 synthetically generated images. These images contained labelled droplets. The dataset was then employed to train multiple YOLOv5 and YOLOv7 models alongside the DeepSORT algorithm. The resulting trained networks achieve robust droplet detection under diverse conditions and generate their trajectories. This data enables the computation of crucial physical parameters such as packing fraction, droplet size distribution, flow rate, and packing order. Both the training dataset and the trained networks are freely available for further development.

Fortschritte, die über den aktuellen Stand der Technik hinausgehen und voraussichtliche potenzielle Auswirkungen (einschließlich der bis dato erzielten sozioökonomischen Auswirkungen und weiter gefassten gesellschaftlichen Auswirkungen des Projekts)

The project emphasizes two primary outcomes. Firstly, a comprehensive dataset comprising droplets and corresponding annotations is provided, facilitating the training of various computer vision models. Dataset compilation represents a foundational task in the development of computer vision applications. To the best of our knowledge, there exists no other dataset containing labeled droplet images specific to microfluidics, apart from the one curated within this project. Secondly, we release pre-trained weights for YOLOv5, YOLOv7, and DeepSORT, all trained on this dataset. These weights enable the tracking of droplets within a given sequence of images across a spectrum of microfluidics manufacturing processes and experimental setups.

In subsequent iterations, DropTrack could be enhanced to incorporate additional functionalities, such as droplet boundary identification (masking) and the mapping of droplet shapes to minimal representations. These enhancements are crucial for enabling self-learning algorithms to autonomously control microfluidics production processes. These functionalities will be pivotal for the development of commercial software prior to market entry.