Big data streaming platforms : A review

Kumar, Harish and Soh, Ping Jack and Mohd Arfian, Ismail (2022) Big data streaming platforms : A review. Iraqi Journal for Computer Science and Mathematics, 3 (2). pp. 95-100. ISSN 2788-7421. (Published)

	Pdf Big Data Streaming Platforms_A Review.pdf Restricted to Repository staff only Download (326kB) | Request a copy
Preview	Pdf Big data streaming platforms_A review_ABS.pdf Download (269kB) | Preview

Abstract

Yesterday’s “Big Data” is today’s “data.” As technology advances, new difficulties and new solutions emerge. In recent years, as a result of the development of Internet of Things (IoT) applications, the area of Data Mining has been confronted with the difficulty of analyzing and interpreting data streams in real time and at a high data throughput. This situation is known as the velocity element of big data. The rapid advancement of technology has come with an increased use of social media, computer networks, cloud computing, and the IoT. Experiments in the laboratory also generate a large quantity of data, which must be gathered, handled, and evaluated. This massive amount of data is referred to as “Big Data.” Analysts have seen an upsurge in data including valuable and worthless elements. In extracting usable information, data warehouses struggle to keep up with the rising volume of data collected. This article provides an overview of big data architecture and platforms, tools for data stream processing, and examples of implementations. Streaming computing is the focus of our project, which is building a data stream management system to deliver large-scale, cost-effective big data services. Owing to this study, the feasibility of large-scale data processing for distributed, real-time computing is improved even when the systems are overwhelmed.

Item Type:	Article
Additional Information:	Indexed by Scopus
Uncontrolled Keywords:	Big data; Kafka; Spark; Streaming processing
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General) T Technology > TA Engineering (General). Civil engineering (General)
Faculty/Division:	College of Engineering Faculty of Computing
Depositing User:	Mr Muhamad Firdaus Janih@Jaini
Date Deposited:	08 Nov 2023 02:51
Last Modified:	08 Nov 2023 02:51
URI:	http://umpir.ump.edu.my/id/eprint/38853
Download Statistic:	View Download Statistics

Actions (login required)

View Item