Enhancing latent semantic analysis (LSA) using tagging algorithm in retrieving Malay documents / Afiqah Bazlla Md Soom

Md Soom, Afiqah Bazlla (2018) Enhancing latent semantic analysis (LSA) using tagging algorithm in retrieving Malay documents / Afiqah Bazlla Md Soom. Masters thesis, Universiti Teknologi MARA.

Abstract

Latent Semantic Analysis (LSA) algorithm is a mathematical approach that uses Singular Value Decomposition (SVD) to discover the important association of the relationship between terms and terms, terms and documents and also documents and documents. Furthermore, LSA uses cosine similarity measurement to measure the similarity between the query word and terms as well as the documents. This approach seem to be efficient if each of the term only have single meaning and a meaning only represent a single term. Unfortunately, in Malay language there exists many terms that have multiple meanings and a single meaning that are represented by multiple terms. If these terms are treated as a single word, it will lead the search engine to retrieve irrelevant documents. These irrelevant documents retrieved will effect the effectiveness of the search engine. To investigate the enhancement of LSA using tagging algorithm (LSAT) in retrieving Malay documents, eight experiments are conducted in this research. The first experiment is conducted to compare the time taken for extracting normal term list and tagged term list, total number of both lists and also the time taken for the creation of term document matrix. Another six experiments record all the results of the LSA and LSAT search engine by using different dimension and threshold value. While the last experiment to compare the LSAT result with previous work on LSA using the same test collection. Outcomes of this study indicate that by using tagging algorithm, the recall value of the LSA algorithm can be enhanced up to 4% , the precision value also can be enhanced up to 16% and the F-measure value of LSA retrieval result can be enhanced by approximately up to 7% compared to LSA retrieval result without tagging algorithm. Furthermore, this research provides fundamental analyses to the other Information Retrieval (IR) developer in selecting the value of dimension and threshold value of retrieval that using LSA.

Metadata

Item Type: Thesis (Masters)
Creators:
CreatorsID Num. / Email
Md Soom, Afiqah BazllaUNSPECIFIED
Subjects: Q Science > QA Mathematics > Analysis
Q Science > QA Mathematics > Instruments and machines > Electronic computers. Computer science > Algorithms
Q Science > QA Mathematics > Instruments and machines > Electronic computers. Computer science > Algorithms
Divisions: Universiti Teknologi MARA, Shah Alam > Faculty Computer and Mathematical Sciences
Item ID: 26905
Uncontrolled Keywords: Latent Semantic Analysis, Singular Value Decomposition, retrieve irrelevant documents
URI: http://ir.uitm.edu.my/id/eprint/26905

Download

[img] Text
TM_AFIQAH BAZLLA MD SOOM CS 18_5.pdf

Download (277kB)

Fulltext

Fulltext is available at:
UNSPECIFIED

ID Number

26905

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year