China Guangfa Bank Sybase IQ Database Migration Project

The GF Securities New Reporting Service Platform project built a new, domestically developed MPP data warehouse platform to meet the following requirements:

• High performance, high scalability, and high stability

• Data migration from the Precision Analytics Platform data warehouse

• Migrate existing Sybase IQ data to the new data warehouse platform, with a pre-compression capacity of 14 TB (high-frequency fact tables and dimension tables); only data migration is required, and the data model remains unchanged

Responsible for building new platforms, integrating new platform business, and data migration services

Five-Layer Architecture Description:

Data Source Layer: Various business systems of China Guangfa Bank (CGB)

Data Exchange Layer: Serves as an intermediate data exchange layer between source data and the data warehouse or data lake, compatible with various extraction tools

Data Processing Layer: This layer is divided into data processing and data refinement: it adopts a lakehouse architecture, where data cleansing and coarse processing are performed on Hadoop. Leveraging the data fusion capability of GBase 8a, processed data is seamlessly loaded into the warehouse without staging.

Data Refinement Layer: After cleansing and processing, data enters the central data warehouse, where fundamental and shared data processing is completed. The central warehouse is powered by GBase 8a.

Data Mart (Modeling) Layer: Completes data model creation and processing. GBase 8a supports a variety of data models, including relational and dimensional models.

Application & Presentation Layer: This layer comprises data application systems, including reporting systems, marketing systems, and other new business platforms. GBase 8a supports a wide range of BI platforms (Power BI, Cognos, Fanruan, Yonghong BI, Smartbi, etc.).

The project deployed the distributed database GBase 8a to build a reporting service platform, resolving issues such as long report-generation times and limited database scalability. It provides platform-based development capabilities, offering customized report services and self-service report data downloads, among other functions.