Interactive storytelling tools for museums

You're viewing a sculpture from the Classical Period in Greek history. Fascinating in itself. Yet how much more interesting would it be if you could see how the characters from the period interact? That is the premise behind the IST project ART-E-FACT.

ART-E-FACT researchers have developed a generic mixed-reality platform that enables museums and other cultural institutions to construct interactive storytelling facilities around key exhibits. "It is a combination of virtual and physical environments," says Anja Hoffman of the Department of Digital Storytelling at the Zentrum für Graphische Datenverarbeitung in Darmstadt, Germany. "When a person stands within a designated area holding a certain object - a magnifying glass, say - his or her gestures are monitored using an infra-red video-tracking system that is sensitive to a special marker on the object."
Discussing Plato's Republic
The platform can present two virtual characters on screen and have them discuss, for example, Plato's Republic and the virtues of justice, wisdom, courage and moderation. The characters' responses to the user are driven by gestures towards certain parts of the exhibit, or by direct interaction using a keyboard and a chat facility.
What is unique about the system, Hoffman maintains, is the ability it gives to users to design and programme virtual characters. "We have an engine that controls the storyline with artificial intelligence and rule-based logic behind it, so that characters react intelligently to interactions with the user. If a user stands still and makes no reaction, the characters will be pro-active and start a discussion on their own."
To make the discussions more lively, the virtual characters can be programmed with human traits and shortcomings, in emotions as well as appearance. One character can have the patience of a saint, for example, while another can be extremely short-tempered.
The platform has been piloted at two locations; at the Academy of Fine Arts in Vienna, where two virtual characters discuss works of art, the artists and the history of art, and at the site of the Greek partner the Sacred Convent of The Annunciation, where two characters discuss Byzantine icons and their history.
Interactive aspects appreciated, ,Most users particularly appreciated the interactive aspects of the system, and apart from some dislike of the characters, user feedback has generally been positive. Hoffman says that character designers in particular liked the system and appreciated the possibilities it offered compared to Flash or similar tools.
ART-E-FACT finished at the end of February 2005. However, the project partners are still developing the environment. They are trying to incorporate more learning concepts in response to some user comments which saw the systems as good "edutainment only. The platform will be presented at another exhibition" at the Vienna Academy of Fine Arts in June 2005, and the team are hoping to demonstrate the system at further museums or exhibitions.
Contact: ,Anja Hoffman ,Department of Digital Storytelling ,Zentrum für Graphische Datenverarbeitung ,Fraunhoferstr 5 ,D-64283 Darmstadt ,Germany,Tel: [phone] ,Fax: [phone] ,Email: [e-mail] by the IST Results service which brings you online ICT news and analysis on the emerging results from the European Commission's Information Society Technologies research initiative. The service reports on prototype products and services ready for commercialisation as well as work in progress and interim results with significant potential for exploitation.

Countries

Germany