Weather data analysis using hadoop : Applications and challenges

Mohammed Adam Ibrahim, Fakharaldien and Khalid, Adam and Noor Akma, Abu Bakar and Mazlina, Abdul Majid (2019) Weather data analysis using hadoop : Applications and challenges. In: IOP Conference Series: Materials Science and Engineering, Joint Conference on Green Engineering Technology & Applied Computing 2019 , 4-5 February 2019 , Bangkok, Thailand. pp. 1-6., 551 (012044). ISSN 1757-8981 (Print), 1757-899X (Online)

Pdf (Open access)
Weather data analysis using hadoop.pdf
Available under License Creative Commons Attribution.

Download (368kB) | Preview


Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data.

Item Type: Conference or Workshop Item (Lecture)
Additional Information: Indexed by Scopus
Uncontrolled Keywords: Distributed environments; Distributed processing technologies; Fault-tolerant; Geographical locations; Historical data; Historical weather datum; Weather parameters; Weather prediction
Subjects: Q Science > QA Mathematics > QA76 Computer software
Q Science > QC Physics
T Technology > TA Engineering (General). Civil engineering (General)
Faculty/Division: Faculty of Computer System And Software Engineering
Faculty of Electrical & Electronic Engineering
Institute of Postgraduate Studies
Depositing User: Mrs Norsaini Abdul Samat
Date Deposited: 20 Dec 2019 07:48
Last Modified: 20 Dec 2019 07:48
Download Statistic: View Download Statistics

Actions (login required)

View Item View Item