Skip to main content
An official website of the European UnionAn official EU website
European Commission logo
English English
CORDIS - EU research results
CORDIS
CORDIS Web 30th anniversary CORDIS Web 30th anniversary

Multi-camera autonomous robotic set for the ultimate and cost-effective live video

Periodic Reporting for period 2 - Multi RoboDOP (Multi-camera autonomous robotic set for the ultimate and cost-effective live video)

Reporting period: 2021-06-01 to 2022-06-30

Multi RoboDoP is the first flexible and customizable multi-camera video production automation platform for the creation of high-quality live video footage. It can interface with a variety of movable cameras (PTZs) and robots to adapt to a diverse set of use cases from corporate events and hybrid lectures to live stage performances. Our algorithms use state-of-the-art computer vision, machine learning and model predictive control to autonomously move and coordinate multiple cameras and adapt to dynamic scenes with ease, delivering engaging and dynamic multi-angle video. With our straightforward Software-as-a-Service model one can create custom automation workflows that seamlessly interact with a multitude of video production hard- and software to deliver use case-specific automation within an existing environment and workflow.

Video productions have traditionally been complex, very labor-intensive, investment-heavy and expensive. Multi RoboDoP is the solution to digitalize and dramatically simplify video productions by automating major parts of the camera operation and production overall. It is easy-to-use and highly customizable, making video productions more profitable, enjoyable and effortless for everyone involved.

Demand for visual communication and entertainment has been on an uninterrupted rise further amplified by the global pandemic. As a result, video content production is at an all-time high and people are looking for better solutions. Multi RoboDoP lowers the barrier for video productions by making them cheaper, and requiring less technical expertise and equipment. This enables more and more people to create more high quality video content.

Our ultimate objective is to give people the tools to tell their story without making any compromises. We want the tool to be simple and highly autonomous, so that any person can focus on what is truly important - realizing their creative vision and bringing their stories to a larger audience.

With the successful conclusion of this project and the stable release of version 29.0.0 of the “Seervision Suite”, we are ready to bring Multi RoboDoP into the European market.
We split the main work of the Multi RoboDoP project into three parts.
1) Iterative development, testing and validation of the software platform resulted in the 29.0.0 release of the Seervision Suite.
2) Industrialization of the solution and preparations for entering the market resulted in a successful entry to the European market.
3) Communication and dissemination of the project with development partners, prospective customers and the greater public resulted in 6 new investors for a financing round in 2021, 10 Multi RoboDOP deals and CHF32,500 of revenue in 2022.

To successfully develop Multi RoboDoP, our goal was to start testing as quickly as possible. To achieve that, we collaborated with key development partners. We also built an in-house testing space to conduct tests during development and an in-house studio to run our own productions and demo the solutions to partners and prospects. To extend our single camera subject tracking solution, we developed a modular architecture based on "smart" components. Through the development of an open API and Bitfocus Companion module, these components can interface with a large variety of production devices and applications, and become the building blocks for our users to build their own custom multi-camera video production automation workflows. We also heavily improved the underlying perception, cinematography and control modules, the "eyes, brain and hands" of our solution. We conducted a successful remote production together with a Zurich-based video production company to demonstrate the value of automation also for this purpose. We have also successfully tested a prototype of a fully cloud-based version of the software platform.

To industrialize Multi RoboDoP and prepare for its deployment in the European market we focused on the following. We built a customer success team and created documentation to conduct customer onboarding and provide support. We created processes and documentation for the assembly operation and maintenance of the compute units on which we deploy the Multi RoboDoP software. We created supply chain and stock management processes that we needed to maintain creatively to cope with widespread shortages of semiconductor-based components.

To effectively communicate, disseminate and exploit the project results during the pandemic, we did the following: we invested in our webpage, we managed our social media presence, we published monthly newsletters, we generated and contacted 62 Multi RoboDOP leads, we signed agreements with 11 partners for distribution, we attended the 4 most relevant trade shows, we invested in digital media campaigns, we invested in our in-house studio to hold virtual demos and we held showcase productions and demos.
Seervision’s camera automation and subject tracking solution have been the state of the art in our industry. With Multi RoboDoP we are able to further push Seervision’s technological edge in this area due to an improved computer vision pipeline and approach to camera control. More importantly, we set a new standard in automation for video productions with our flexible, AI-driven workflow automation solution that enables our users to combine intelligent customizable components into smart, easy-to-use automation "Containers". These Containers can be executed with a single click or even triggered through our powerful, open API. The range and variety of integrations of video production hard- and software further distinguish our solution. Multi RoboDoP can “plug into” our customers’ existing video production workflows and help them automate the most pressing aspects of their productions.

The global COVID-19 pandemic has started a shift towards remote and hybrid work. In many corporate environments, meetings are now hybrid by default and communication and marketing activities happen online. Similarly, lecture capturing and hybrid classrooms have emerged as a new standard for universities and educational institutes. Students and workers globally appreciate the increase in flexibility and time savings this brings. Hybrid work also brings new challenges and needs new tools and solutions to deliver on its promise. One key challenge is around "meeting equity" or the ability of remote participants to take part on the same level as the people on-site. To achieve this, we must improve the flexibility, affordability, quality, and ease of use of the on-site audio-visual equipment. Multi RoboDoP achieves this by providing an automation solution that offers a high level of immersion, flexibility and ease of use without needing extra manpower. The benefits of the added time and flexibility for students, workers and companies, as well as the emergence of reliable and easy-to-use tools such as ours will drive the wider adoption of hybrid work.
View from the Seervision Studio
Seervision system overview