Nur Syafiqah, Mohd Nafis and Suryanti, Awang (2020) The evaluation of accuracy performance in an enhanced embedded feature selection for unstructured text classification. Iraqi Journal of Science, 61 (12). pp. 3397-3407. ISSN 0067-2904. (Published)
|
Pdf
The Evaluation of Accuracy Performance.pdf Available under License Creative Commons Attribution. Download (634kB) | Preview |
Abstract
Text documents are unstructured and high dimensional. Effective feature selection is required to select the most important and significant feature from the sparse feature space. Thus, this paper proposed an embedded feature selection technique based on Term Frequency-Inverse Document Frequency (TF-IDF) and Support Vector Machine-Recursive Feature Elimination (SVM-RFE) for unstructured and high dimensional text classificationhis technique has the ability to measure the feature’s importance in a high-dimensional text document. In addition, it aims to increase the efficiency of the feature selection. Hence, obtaining a promising text classification accuracy. TF-IDF act as a filter approach which measures features importance of the text documents at the first stage. SVM-RFE utilized a backward feature elimination scheme to recursively remove insignificant features from the filtered feature subsets at the second stage. This research executes sets of experiments using a text document retrieved from a benchmark repository comprising a collection of Twitter posts. Pre-processing processes are applied to extract relevant features. After that, the pre-processed features are divided into training and testing datasets. Next, feature selection is implemented on the training dataset by calculating the TF-IDF score for each feature. SVM-RFE is applied for feature ranking as the next feature selection step. Only top-rank features will be selected for text classification using the SVM classifier. Based on the experiments, it shows that the proposed technique able to achieve 98% accuracy that outperformed other existing techniques. In conclusion, the proposed technique able to select the significant features in the unstructured and high dimensional text document.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Embedded feature selection; Text classification; Text mining; Sentiment analysis |
| Subjects: | T Technology > T Technology (General) |
| Faculty/Division: | Faculty of Computer System And Software Engineering Institute of Postgraduate Studies |
| Depositing User: | Dr. Suryanti Awang |
| Date Deposited: | 25 Feb 2021 03:14 |
| Last Modified: | 05 Jan 2024 08:26 |
| URI: | http://umpir.ump.edu.my/id/eprint/30746 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |