An incremental acquisition method for web forensics

Abstract

In order to solve the problems of repeated acquisition, data redundancy, and low efficiency in the process of website forensics, this paper proposes an incremental acquisition method oriented to dynamic websites. This method realized the incremental collection on dynamically updated websites through acquiring and parsing web pages, URL deduplication, web page denoising, web page content extraction, and hashing. Experiments show that the algorithm has relative high acquisition precision and recall rate and can be combined with other data to perform effective digital forensics on dynamically updated real-time websites.