IMPLEMENTASI WEB SCRAPING PADA SITUS JURNAL SINTA MENGGUNAKAN FRAMEWORK SELENIUM WEBDRIVER PYTHON

Abstract

The search for references to scientific articles is the initial stage of designing a study. Researchers often start by looking for a wide variety of references that have the same topic and purpose as what is being studied. Scientific articles are very easy to find through the internet. It's just that with the large number of scientific articles, the search process will take a long time. This is because some articles have been deleted or need more access to open them. Therefore, to speed up students and researchers to get scientific articles that are in accordance with the research topic, a special website is needed that is able to collect some information about scientific articles. This study aims to create a web page that contains special information about references to scientific articles that can help students of the Bakti Asih College of Analysts and researchers to speed up the search for references to scientific articles. The design of this system uses a web scraping method for data retrieval of scientific articles, which uses the Python programming language using the selenium library, pandas library, BeautifulSoup library and openpyxl library. The result of the scraping data in the form of an excel file created by a web page on the siakad web of the Bakti Asih Bandung College of Analysts using the CodeIgniter Framework with the Php programming language.System development uses the SDLC (Waterfall) method and system testing uses the blackbox testing method