LiWAProject reference: 216267
Funded under: FP7-ICT
Living Web Archives
Total cost:EUR 3 624 871
EU contribution:EUR 2 682 371
Call for proposal:FP7-ICT-2007-1
Funding scheme:CP - Collaborative project (generic)
LiWA developed web archiving tools able to capture content from a wide variety of sources, to improve archive fidelity and authenticity, and to ensure long term interpretability of web content.
The interest in Web content preservation is strongly growing, not only in traditional library and archival organisations, but also in sectors such as industry and services. But the typical characteristics of Web content - variety of formats, high dynamics, volatility, interactivity and context-dependency - make adequate Web archiving a particular challenge. With the LiWA project, Web archiving has been established as a new topic for scientific research and development within the digital preservation domain.
At the centre of the project was the concept of 'Living Web Archives', as opposed to the current practice of producing periodic snapshots of pages. 'Living' here refers to:
- long term interpretability as the archive evolves and adapts over time,
- improved archive fidelity and authenticity by filtering out irrelevant information,
- captured content from a wide variety of sources.
To enhance archive fidelity and authenticity, LiWA has developed and tested new methods based on content interpretation and intelligent pattern detection of traps and Web spam. This allows reducing the amount of fake content and helping prioritise crawls by automatically detecting content of value.
To improve the integrity and temporal, structural and semantic coherence of Web archives, some work was dedicated to temporal Web archive construction. This serves the objective to significantly improve content positioning in time and (topic) space and will lay the foundations for fast and effective access to evolving Web content.
To facilitate archive interpretability, LiWA applied methods for semantic and terminology extraction, able to detect and handle evolving semantics, interpretations of domain concepts and terminology. This is a contribution to the task of preserving the usefulness, quality, and accessibility of Web archives over time.
For validating the LiWA approach, two demonstrator applications have been built on top of the LiWA services. The applications focus on the social Web and on the special challenge of archiving audio-visual content.
The potential benefit of this research is twofold: Archiving institutions will be able to automatically archive higher volumes of dynamic and volatile digital content, resulting in a significant increase of preserved digital content. Archive users will benefit from the higher quality of archive content and improved search services.
Web content plays an increasingly important role in the knowledge-based society, and the preservation and long-term accessibility of Web history has high value (e.g., for scholarly studies, market analyses, intellectual property disputes, etc.). There is strongly growing interest in its preservation by library and archival organizations as well as emerging industrial services. Web content characteristics (high dynamics, volatility, contributor and format variety) make adequate Web archiving a challenge.\nLiWA will look beyond the pure "freezing" of Web content snapshots for a long time, transforming pure snapshot storage into a "Living" Web Archive. "Living" refers to a) long term interpretability as archives evolve, b) improved archive fidelity by filtering out irrelevant noise and c) considering a wide variety of content.\nLiWA will extend the current state of the art and develop the next generation of Web content capture, preservation, analysis, and enrichment services to improve fidelity, coherence, and interpretability of web archives. By developing methods which improve archive fidelity, the project will contribute to adequate preservation of complete and high-quality content. By developing methods for improved archive coherence and interpretability, the project contributes to ensuring its long-term usability.\nLiWA RTD will focus on innovative methods for content capturing, filtering out spam and other noise, improving temporal archive coherence, and dealing with semantic and terminology evolution. Two exemplary LiWA applications - focusing on audiovisual streams and social web content, respectively – will show the benefits of advanced Web archiving to interested stakeholders.\nTo ensure demand-driven RTD development and broad, sustained project impact, the LiWA consortium will closely work with the International Internet Preservation Consortium (IIPC) as well as important library and archiving organizations, two of which are members of LiWA.
Tel.: +49 51176217764
Fax: +49 51176217779
110 01 PRAHA 1
Tel.: 420 541646115
Fax: +420 541646100
Tel.: +33 9 5487 8293
Fax: +33 9 5987 8293
EC2A 4HB LONDON
Tel.: +44 2088168226
Fax: +44 8701641643