Patents and Publications Web Scraping

Abstract

-Web scraping is a software technique of extracting information from websites. This type of software programs simulates human browsing or exploration of the World Wide Web by the means of applying low-level Hypertext Transfer Protocol (HTTP). Web scraping is a technique of collecting information from WWW using a Web Crawler and it is a common technique used by most Application Programming Interface (API's). This paper is used to fetch the recent publications and patents related to the pharmaceutical industries by developing an efficient web crawler which will fetch all possible information on publications and patents from different pharmaceutical industry websites based on their recent news, meetings and innovations.