Hybrid sampling and random forest machine learning approach for software detect prediction

Md. Anwar, Hossen and Md. Shariful, Islam and Nurhafizah, Abu Talip and Md. Sakib, Rahman and Fatema, Siddika and Mostafijur, Rahman and Sabira, Khatun and Mohamad Shaiful, Abdul Karim and S. M, Hasan Mahmud (2019) Hybrid sampling and random forest machine learning approach for software detect prediction. In: 5th International Conference on Electrical, Control and Computer Engineering (INECCE 2019) , 29 - 30 Julai 2019 , Swiss-Garden Beach Resort, Kuantan, Pahang. pp. 1-12.. (Unpublished)

[img] Pdf
42. Hybrid sampling and random forest machine learning.pdf
Restricted to Repository staff only

Download (253kB) | Request a copy
[img]
Preview
Pdf
42.1 Hybrid sampling and random forest machine learning.pdf

Download (70kB) | Preview

Abstract

The software has turn into an imperious part of human’s life. In the recent computing era, many large-scale complex network systems and millions of modern technological devices produce a huge amount of data every second. Among these data, the amount of imbalanced data is relatively excessive. The machine learning model is miss leaded by these imbalanced data. Software Defect Prediction (SDP) is a standout amongst the most helping exercises during the testing phase. The estimated cost of finding and fixing defects is approximately billions of pounds per year. To reduce this problem, software defect prediction has come forth but need fine tuning to have expected efficiency. In this chapter, we have proposed a new model based on machine learning approach to predict software defect and identify the key factors that may help the software engineer to identify the most defect-prone part of the system. The proposed model works as follows. First, need to remove highly correlated features and turn all the feature in the same scale using the scaling feature approach. Second, we have used Synthetic Minority Over-sampling Technique (SMOTE), Adaptive Synthetic (ADASYN) and Hybrid sampling method to balance highly imbalanced datasets. Third, Random Forest Importance and Chi-square algorithms are chosen to find out the factors which have high effect on software defect. Cross validation is used to remove overriding problem. Scikit-learn library is used for machine learning algorithms. Pandas library is used for data processing. Matplotlib, and PyPlot are used for graph and data visualization respectively. The hybrid sampling method and Random Forest (RF) algorithms achieved the highest prediction accuracy about 93.26% by showing its superiority.

Item Type: Conference or Workshop Item (Lecture)
Uncontrolled Keywords: Software defect prediction; Machine learning; Imbalanced dataset; Chi square; Random forest importance
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering
Faculty/Division: Faculty of Electrical & Electronic Engineering
Depositing User: Pn. Hazlinda Abd Rahman
Date Deposited: 13 Feb 2020 02:20
Last Modified: 13 Feb 2020 02:20
URI: http://umpir.ump.edu.my/id/eprint/26687
Download Statistic: View Download Statistics

Actions (login required)

View Item View Item