A policy-based system for institutional web archiving

Abstract

Archiving Web content is an important topic for digital libraries and especially for deposit libraries. Web archiving systems usually collect Web resources using search robot software and/or by human labor. However, these resource gathering methods have disadvantages: for example, it is difficult to collect all historical versions of a resource or to collect hidden or dynamic resources. This paper proposes a Web archiving system which is designed to collect resources in accordance with a resource archiving policy determined by the person or organization which provides the resources on the Web. This paper presents the model of the Web archiving system and a prototype system implemented based on the model. © Springer-Verlag Berlin Heidelberg 2004.