The evaluation of accuracy performance in an enhanced embedded feature selection for unstructured text classification

Nur Syafiqah, Mohd Nafis and Suryanti, Awang (2020) The evaluation of accuracy performance in an enhanced embedded feature selection for unstructured text classification. Iraqi Journal of Science, 61 (12). pp. 3397-3407. ISSN 0067-2904. (Published)

[img]
Preview
Pdf
The Evaluation of Accuracy Performance.pdf
Available under License Creative Commons Attribution.

Download (634kB) | Preview

Abstract

Text documents are unstructured and high dimensional. Effective feature selection is required to select the most important and significant feature from the sparse feature space. Thus, this paper proposed an embedded feature selection technique based on Term Frequency-Inverse Document Frequency (TF-IDF) and Support Vector Machine-Recursive Feature Elimination (SVM-RFE) for unstructured and high dimensional text classificationhis technique has the ability to measure the feature’s importance in a high-dimensional text document. In addition, it aims to increase the efficiency of the feature selection. Hence, obtaining a promising text classification accuracy. TF-IDF act as a filter approach which measures features importance of the text documents at the first stage. SVM-RFE utilized a backward feature elimination scheme to recursively remove insignificant features from the filtered feature subsets at the second stage. This research executes sets of experiments using a text document retrieved from a benchmark repository comprising a collection of Twitter posts. Pre-processing processes are applied to extract relevant features. After that, the pre-processed features are divided into training and testing datasets. Next, feature selection is implemented on the training dataset by calculating the TF-IDF score for each feature. SVM-RFE is applied for feature ranking as the next feature selection step. Only top-rank features will be selected for text classification using the SVM classifier. Based on the experiments, it shows that the proposed technique able to achieve 98% accuracy that outperformed other existing techniques. In conclusion, the proposed technique able to select the significant features in the unstructured and high dimensional text document.

Item Type: Article
Uncontrolled Keywords: Embedded feature selection; Text classification; Text mining; Sentiment analysis
Subjects: T Technology > T Technology (General)
Faculty/Division: Faculty of Computer System And Software Engineering
Institute of Postgraduate Studies
Depositing User: Dr. Suryanti Awang
Date Deposited: 25 Feb 2021 03:14
Last Modified: 05 Jan 2024 08:26
URI: http://umpir.ump.edu.my/id/eprint/30746
Download Statistic: View Download Statistics

Actions (login required)

View Item View Item