GBase 8a MPP Cluster Empowers National and Provincial Radar Data Sharing for Meteorological Bureaus
GBase 8a MPP Cluster is a mature analytical MPP database independently developed by GBase for the big data era. The latest GBase 8a MPP Cluster V9 has been deployed across meteorology, telecommunications, finance, and other industries.
Project Background
In accordance with the "Meteorological Radar Development Special Plan (2017-2020)" and its implementation plan, an efficient distributed real-time and historical integrated data storage and management system must be established at national and provincial levels to meet the demands for access, storage, and timely analysis of massive data. This project is a critical component of the radar data sharing platform, effectively advancing national and provincial meteorological radar data sharing and the informatization and intensification of meteorological operational applications.
The project aims to store long-term historical data at the national center and 31 provincial nodes using a mature, cost-effective distributed analytical database, supporting the data service and analysis needs of operational systems such as climate monitoring and prediction, and decision-making services.
The meteorological big data platform achieves unified management and service of the full data set, delivering platform computing services for processing and mining analysis of various meteorological data products beyond numerical weather prediction. It directly supports applications, empowers the comprehensive development of a "cloud + endpoint" business model, and forms an intensive, standardized, and open new meteorological ecosystem.
Requirements Analysis
Deployment at the National Meteorological Information Center Cluster
Deploy and install the GBase 8a MPP Cluster on the existing 12 servers provided by the client, with server expansion to follow based on the client's requirements.
Based on the available hardware resources, a configuration of 3 management nodes and 10 data nodes was adopted, with one node serving dual roles for both management and data.
Deployment at Provincial Meteorological Information Center Clusters
Additionally, 8 clusters were deployed at regional centers (8 nodes per province), and 23 clusters were deployed at provincial centers (6 nodes per province), totaling 32 clusters and 219 nodes.
Solution
The GBase 8a MPP Cluster serves as a historical analysis repository, synchronizing fundamental data such as meteorological observations, geographic information, and socio-economic data in real time via Kafka into the GBase 8a database, providing storage of long-term historical data and multi-dimensional analytical calculations.
It provides a unified database access interface, enabling transparent access to heterogeneous database engines, and facilitating unified data management and application migration and development.
Key Benefits
Unified management and service of the full data set: Based on GBase UP, transparent access to heterogeneous databases, a unified data service interface, and unified data management are achieved; managing the full range of meteorological data and providing platform computing services for product processing and mining analysis beyond numerical weather prediction.
Real-time data synchronization: Meteorological data enters the transactional database to provide real-time business query access; incremental data from the transactional database is synchronized in near real-time to the GBase 8a analytical database via Kafka. Leveraging GBase 8a's data storage, service, and analysis capabilities maximizes the value of data applications, supporting weather forecasting, disaster prevention and mitigation, and other operations.
High-performance analysis: Utilizing the high-performance distributed parallel computing power of the GBase 8a cluster significantly improves performance for complex analytical scenarios in meteorological operations.