a. Objectives and workplan
PRISM workplan included two major tracks (picture attached): Empirical research and exploration; Advanced learning and studying. In the former, I planned to collect different urban transport datasets, and do their initial exploration through non-PGM methods. The second half of the first year would conclude with first approaches for a PGM based version of that work. The second year would be dedicated to refinements, and a field test in ITSWorld 2018.
On the advanced learning and studying side, I planned to study Probabilistic Graphical Models (PGMs) in depth. On the second semester, I expected to work on preparation of a course based on PGMs, and start studying new methods for optimization, and transport demand modeling.
b. Work developed
During the first six months, together with the team, and building on a collaboration with Google research and Movia (Denmark’s public transport agency), we collected and analysed different datasets, which already arrived anonymized and deidentified to my team. We also used a large public dataset of New York City taxis.
Using the mentioned datasets, and looking into the distributed nature of traffic (i.e. multi-outputs, where each model output predicts for a specific area in the network or city), we developed a Multi-Output Gaussian Processes for Crowdsourced Traffic Data Imputation (Rodrigues et al, 2019). In this model, we take advantage of the correlation structure that emerges between the different network links in the city (e.g. neighbor links have correlated speed profiles). The effect was particularly notorious in improving the data (i.e. imputation) across the network, more than actual prediction itself.
During the second semester of PRISM (Oct-2017-Feb 2018), another essential part of the workplan was developed, namely the design and creating of a new Masters course in Probabilistic Graphical Models. The name of the course is “Model Based Machine Learning”. It ran already in Spring 2018 and 2019.
The second year was dedicated to the development of more elaborate models. Besides PGMs, myself and my team decided also to consider Deep Neural Networks, and especially their combination with Bayesian methods, and generally speaking comparison with other methods, such as Gaussian Processes. In this period, other works were created, triggered by earlier developments from PRISM, namely:
- Deep Learning from Crowds (Rodrigues and Pereira, 2018) – presented in one of the most prestigious AI conferences (AAAI). This work falls into the “multiple annotators” category, where we use a large dataset labeled by people with different levels of expertise (e.g. different medical doctors have different skills in evaluating patients). The novelty is in the way we combine the experts knowledge into a deep neural network
- Predicting taxi demand hotspots using automated Internet Search Queries (Markou et al, 2019) – back to the NYC dataset, the goal is to automatically explain demand anomalies (e.g. “why so any people?”) by automatically generating and interpreting search queries, through search engine APIs (Google and Bing)
- Multi-output bus travel time prediction with convolutional LSTM neural network (Petersen et al, 2019) – using the Movia dataset, of bus location information, generate arrival time estimates that are better than the current system in Denmark. This was the first task of the new PhD student, under the Movia collaboration.
I believe we can say that, in the end, the general objectives of PRISMs were already achieved, in terms of the methodologies, but also in terms of deliverables and “by-products”:
- 3 journal papers + 1 prestigious conference (with full acknowledgement to PRISM funding)
- 9 journal papers in related topics (without full acknowledgement to PRISM funding)
- 1 Special issue on “Social network analysis in future transportation systems: Contributions on observability, behaviour and structure”, Transport Research Part C, Elsevier, 2018. (with C. Antoniou and L. Dimitriou)
- 1 edited book on “Mobility Patterns, Big Data and Transport Analytics”, Elsevier 2019 (with C. Antoniou and L. Dimitriou)
- 2 new Masters courses (42186 – Model Based Machine Learing; 42184 – Data Sciences and GIS for Mobility)
- Group growth from 4 to 12 people in only 2 years.
- Currently new active collaborations with TUM (2 PhD student co-supervisions, N. Motamedi and D. Rodas), EPFL (1 MSc co-supervision, N. Ortelli), and MIT (1 PhD student supervision, Y, Han). These collaborations add to the already established or concluded ones in the same period (e.g. 1 PhD student graduated at MIT, H. Zhang; 2 PhD student long term visits from TUM and U. Washington)
