Web-based RIG performance reporting system using web scraping technique / Siti Rasyiqah Muhamad Zaki

Data is a piece of information that exists in almost everywhere in the Internet and it is represented in either in the form of unstructured, semi-structured or structured data. In cases like these, when people want to copy certain data they do extraction from the web to the readable file. This system will be using scraping technique that can retrieve information from multiple sources and display it in the table form. The requirement for scraping the data from different sources can be done by using Python language and tools like BeautifulSoup or Pandas. BeautifulSoup can read and parse html and xml files by getting the certain data that needed. Meanwhile, Pandas purpose can clean and is a data analysis tools. The sources target limited to UiTM lecturer‟s publication which is Pure and Google Scholar. This web-based is important as it can reduce in extracting the data manually. There are many tools for collecting the data in the Internet; however, this research can help in the use of data collection method that can make the extraction easier.