Bank of China Heilongjiang Branch Big Data Platform — Supporting Reporting Systems for Various Business Departments

Bank of China Limited Heilongjiang Branch, amid the big data trend, proactively innovates its business by building a big data platform based on an MPP relational database to support massive data storage, analysis, and statistics. MPP

Value Delivered


Management Innovation: Change the data architecture model to consolidate all business model data into the database, providing reporting services to all business departments. Leverage the database's big data complex computing capabilities to facilitate business queries in collaboration with judicial and law enforcement authorities.


High Performance: Business scenarios have been fully tested, with batch processing performance 7 to 10 times faster than Oracle, and precise query performance on large data volumes improved by dozens of times, delivering high performance gains at low cost.


High Scalability: The cluster supports online expansion with multiple nodes, accommodating future business performance and data storage requirements.


High Availability: Ensures 24/7 continuous operation, avoiding downtime from single points of failure or system maintenance.


Solutions


This project deploys a 2×2 node cluster using the GBase 8a MPP Cluster, a large-scale distributed parallel database cluster system, to build the core data management layer of the data platform, creating a unified foundational data platform for all data. The current data volume is 10TB, with a daily incremental of 30GB, over 1,000 tables in total, and the largest table contains more than ten billion rows. Daily batch processing runs for 4-5 hours. Based on the business scenario, one loader node and four compute nodes are configured.


Requirements Analysis


Powerful functionality: integrated support for data migration, data processing, data querying, and application connectivity;

High performance: rapid response for data loading, import/export, processing, splitting, and querying;

High availability: 24/7 continuous operation with no downtime from single points of failure or scheduled maintenance;

High linear scalability: supports online scaling of multiple nodes.


Project Background


Under the big data trend, Bank of China Co., Ltd. Heilongjiang Branch proactively pursued business innovation by building a big data platform powered by an MPP relational database to support massive data storage, analysis, and statistics. The MPP database product is deployed in the reporting systems of various business departments and facilitates business queries in collaboration with public security, procuratorate, court, and other regulatory authorities or clients.