Open Conference Systems, The 1st International Conference on Advanced Information Technology and Communication (IC-AITC)

Font Size: 
Implementation of Web Crawling to Collecting Data of Scientific Articles
Lusiana Indawa, Dedi Darwis

Last modified: 2021-12-10

Abstract


The amount of information on scientific articles found on internet websites, one of which is Google Scholar, makes it difficult for internet users to collect scientific article information. This is because scientific articles published continue to increase. This study aims to assist internet users in obtaining scientific article information quickly and easily in accordance with the required period by applying web crawling techniques. Where the application design uses two programming languages, Python for data crawling and PHP is used to display crawled data. This study uses the extreme programming system development method, taking into account three aspects of system testing, namely usability, performance efficiency and functionality at ISO 25010 for 5 respondents. The result of this research is a web crawling application to collect scientific article information has been successfully implemented with the results of the assessment of Functionality 94.54%, Usability 93.67% and Performance Efficiency 95%.

 

Keyword : Crawling, Extreme Programming, Google Scholar, ISO 25010


Conference registration is required in order to view papers.