Monitrix - A monitoring and reporting dashboard for web archivists

Abstract

This demonstration paper introduces Monitrix, an upcoming monitoring and reporting tool for Web archivists. Monitrix works in conjunction with the Heritrix 3 Open Source Web crawler and provides real-time analytics about an ongoing crawl, as well as summary information aggregated about crawled hosts and URLs. In addition, Monitrix monitors the crawl for the occurrence of suspicious patterns that may indicate undesirable behavior, such as crawler traps or blocking hosts. Monitrix is developed as a cooperation between the British Library's UK Web Archive and the Austrian Institute of Technology, and is licensed under the terms of the Apache 2 Open Source license. © 2013 Springer-Verlag.