Better 4D video
So-called 4D video involves combining video files of the same subject from many cameras, resulting in a 3D picture seamlessly viewable from various angles. The combination of ubiquitous mobile video devices and internet video-sharing systems offers new opportunity for reconstructing public events. The EU-funded 4DVIDEO (4DVideo: 4D spatio-temporal modeling of real-world events from video streams) project focused on developing algorithms suitable for capture and analysis of such events. Research also posed fundamental questions and problems concerning realistic operation of the technology. To answer the questions, the team developed a network of smart cameras able to perform various observation tasks. Types included surveillance, tracking and high-fidelity immersive reconstruction. Results enable users to draw upon large video collections, such as from YouTube, and reconstruct events in ways not bound to any particular position. The algorithms allow users to smoothly switch viewpoints, while also maintaining orientation. Applications of the 4DVIDEO project's developments may include forensic reconstruction of incidents from multiple mobile video sources.
Keywords
4D video, mobile video, real-world events, observation, surveillance