一種基于NoSQL的氣象非結構化數據產品存儲方法
DOI:
作者:
作者單位:

作者簡介:

通訊作者:

中圖分類號:

基金項目:

中國氣象局小型建設項目“高時空分辨率氣象預報分布式計算能力建設”、浙江省氣象局重點項目“氣象業務標準化數據庫建設關鍵技術”(2013ZD10)資助


Meteorological Unstructured Data Storage Service Based on Distributed NoSQL Technology
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 圖/表
  • |
  • 訪問統計
  • |
  • 參考文獻
  • |
  • 相似文獻
  • |
  • 引證文獻
  • |
  • 資源附件
  • |
  • 文章評論
    摘要:

    基于一種面向氣象非結構化數據產品的NoSQL存儲方法,綜合氣象網格化數據產品的結構及其應用場景,設計了NoSQL中的列存儲數據庫,并通過優化表格存儲方式提高存儲、訪問效率。根據數據產品的類型、時間、預報時效等信息,制定主鍵列,屬性列和數據列,設計數據存儲模型。對數據列大網格進行切分,用網格點序號標記數據列名,并制定數據壓縮策略,從而提高數據訪問的整體效率。以氣象數值預報產品為例,利用阿里云的OTS產品進行模擬測試,結果表明,基于NoSQL技術的列存儲數據庫可以滿足產品服務平臺的數據支撐要求,為分布式數據、云計算等技術的推廣應用提供參考。

    Abstract:

    A NoSQL storage design for meteorological grid data products is introduced. An analysis is made of the meteorological structure of grid data products and their application scenarios, and the column storage database in NoSQL is designed to increase the efficiency of storage and access through optimizing the way of table store. According to the type, time and forecast effectiveness of data products, we work out the primary key column, attribute column, and data column, then, split the big grids of data column, use the grid sequence number to record data column names, and design data compression strategies to improve the overall efficiency of data access. Taking numerical prediction products as an example, we make use of Aliyun OTS to simulate tests. The results show that the column storage database based on NoSQL technology can meet with the requirements of the underlying data support of product service platform, which has a certain reference significance for the extension and application of key technologies, such as distributed data environment, cloud computing, and so on.

    參考文獻
    相似文獻
    引證文獻
引用本文

陳正旭,李爽爽,孫曉燕.一種基于NoSQL的氣象非結構化數據產品存儲方法[J].氣象科技,2017,45(3):430~434

復制
分享
文章指標
  • 點擊次數:
  • 下載次數:
  • HTML閱讀次數:
  • 引用次數:
歷史
  • 收稿日期:2016-05-07
  • 定稿日期:2016-10-13
  • 錄用日期:
  • 在線發布日期: 2017-07-03
  • 出版日期:
您是第位訪問者
技術支持:北京勤云科技發展有限公司
午夜欧美大片免费观看,欧美激情综合五月色丁香,亚洲日本在线视频观看,午夜精品福利在线
>