Unsupervised analysis of web page semantic structures by hierarchical Bayesian modeling

Abstract

We propose a Bayesian probabilistic modeling of the semantic structures of HTML documents. We assume that HTML documents have logically hierarchical structures and model them as links between blocks. These links or dependency structures are estimated by sampling methods. We use hierarchical Bayesian modeling where each block is given labels such as "heading" or "contents", and words and layout features (i.e., symbols and HTML tags) are generated simultaneously, based on these labels. © 2014 Springer International Publishing.