Mohammed Adam Ibrahim, Fakharaldien and Khalid, Adam and Noor Akma, Abu Bakar and Mazlina, Abdul Majid (2019) Weather data analysis using hadoop : Applications and challenges. In: IOP Conference Series: Materials Science and Engineering, Joint Conference on Green Engineering Technology & Applied Computing 2019 , 4-5 February 2019 , Bangkok, Thailand. pp. 1-6., 551 (012044). ISSN 1757-8981 (Print), 1757-899X (Online)
|
Pdf (Open access)
Weather data analysis using hadoop.pdf Available under License Creative Commons Attribution. Download (368kB) | Preview |
Abstract
Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data.
| Item Type: | Conference or Workshop Item (Lecture) |
|---|---|
| Additional Information: | Indexed by Scopus |
| Uncontrolled Keywords: | Distributed environments; Distributed processing technologies; Fault-tolerant; Geographical locations; Historical data; Historical weather datum; Weather parameters; Weather prediction |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software Q Science > QC Physics T Technology > TA Engineering (General). Civil engineering (General) |
| Faculty/Division: | Faculty of Computer System And Software Engineering Faculty of Electrical & Electronic Engineering Institute of Postgraduate Studies |
| Depositing User: | Mrs Norsaini Abdul Samat |
| Date Deposited: | 20 Dec 2019 07:48 |
| Last Modified: | 20 Dec 2019 07:48 |
| URI: | http://umpir.ump.edu.my/id/eprint/26182 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |