Application of Hadoop in DataIntensive Processing of Meteorological Data
- Article
- Figures
- Metrics
- Preview PDF
- Reference
- Related
- Cited by
- Materials
Abstract:
The statistical analysis of meteorological data processing is dataintensive and always conducts on a single machine. The speed is too slow when the data set is large, which restrains researches of meteorological data. Hadoop and MapReduce are used to speed up the dataintensive processing of meteorological data. In allusion to the low efficiency of processing enormous and small files by using Hadoop, a preprocess is conducted to integrate the enormous and small files to a large one. The experiment proved that this method can solve the low efficiency problem when using Hadoop to process enormous and small files. Comparing with Oracle, it is more useful to use Hadoop to process dataintensive Meteorological computing.
Keywords:
Project Supported:
Clc Number:
You are thevisitors
Supported by:Beijing E-Tiller Technology Development Co., Ltd.
Supported by:Beijing E-Tiller Technology Development Co., Ltd.