IEEE article data extraction from internet

Abstract

Article data extraction from internet is a way to download and extract the required data automatically from web servers. In this paper, we present a method called the Internet Robot to extract the data directly from a web server by using Perl scripting language with the powerful regular expressions. The regular expressions are widely used in this method to reduce the complexity of the program code as well as increase up the downloading and extracting speed. The Internet Robot in this paper is a process of three steps: data collection, data filtering and processing, data presentation. The final result of this process will be the html files- with all required data in the format as Fig. 1- presented under different links of a webpage as Fig. 5. The accuracy and speed make this method become unique in processing and extracting data not only from the internet but also from an available database. ©2009 IEEE.