Community Research and Development Information Service - CORDIS

Mobile and collaborative system for augmented reality image synthesis

The mobile and collaborative system within the ARIS (Augmented Reality Image Synthesis) context is characterizing the implementations of an augmented reality application for the photorealistic and collaborative virtual furnishing of interior spaces.

The system features a portable local central unit (containing a database of furniture models and the server for the communication of different participants), an arbitrary number of client devices (featuring a lightweight portable computer equipped with a head-mounted-display) communicating over a local wireless LAN. A connection to the central server of the furniture company providing for this service is also possible, if a communication channel with an interior designer located there is desired.

A set of preparatory tasks are necessary for the system to operate smoothly in any new environment and are usually operated by a technician sent by the retailer to install the necessary equipment at the customer's environment. The preparatory phase requires less than half an hour, even for rather complex surroundings.

The mobile AR-unit (client devices for each one of the customers participating) is performing the tracking of the position of the user who wears it. The visualization of the furniture models on top of the real environment that can be captured through a camera and presented on a pair of Head-Mounted Displays (HMDs) is also taking place on the client device, thus implementing a video-see-through augmented reality solution.

Customers are in portions to select and position furniture out of a catalogue displayed in their HMD. The primary interaction device is a joystick attached to the notebook PC. Additionally there is the option of activating the speech recognition component, which allows for a completely free movement in the environment. The speech recognition used in the ARIS solution is an off-the-shelf system.

When in collaborative mode, the selection and update of the position of furniture is instantly transferred to the display of all participants of the collaborative session, presented in their correct geometry and lighting condition (adjusted to the viewpoint of the participants). There is always one person responsible for the selection and manipulation, i.e. the system uses a token to grant manipulation rights to any of the participants requesting them.

The communication between different mobile clients and eventually also the remotely located 3D e-commerce server (where an expert in interior design may be sitting to provide remotely some additional services) is handled by a communication module, which is also responsible for the communication between clients themselves through the local area network. In the case where many mobile clients operate at the same room, only one of them can collaborate with a remote expert (decorator, designer) from the store. This client is denoted as the coordinator of the collaboration and it includes an additional module, the collaboration module. However, the results of the collaboration and any suggestion/changes that the remote expert makes should be made visible to all other participants.

More information on the Aris project can be found at:

Related information

Reported by

Intracom S.A. Hellenic Telecommunications and Electronics Industry
19,5 km Markopoulou Ave.
19002 Peania
Follow us on: RSS Facebook Twitter YouTube Managed by the EU Publications Office Top