Empirical study on Web content consistency

Abstract

In this paper, we would like to perform detail analysis on the consistency situation of current web content. Both data and the associated attributes of web objects on replica / CDN (Content Delivery Network) are monitored over the Internet and the correctness and appropriateness of various headers are discussed. It is found that there are lots of discrepancies in data object and attributes found by comparing the original copy and the retrieved copy of the content. This result is important to content delivery and distribution because incorrect headers can easily lead into wrong decision in network and content presentation related functions such as caching, content adaptation and personalization. © 2006 IEEE.