The Optimal Choice for Unified Lakehouse: GBase 8a MPP + XEOS

Recently, General Data Technology Co., Ltd. (hereinafter referred to as GBASE) completed the integration test of its distributed analytical database GBase 8a MPP with the enterprise-grade object storage XEOS from Beijing XSKY Data Technology Co., Ltd. (hereinafter referred to as XSKY). Both products demonstrated excellent compatibility and fully met functional requirements, with all functional and performance test results meeting expectations.

Data Warehouse Faces Storage Performance and Compatibility Challenges

As the adoption of China's homegrown IT solutions accelerates, domestic database vendors have made continuous improvements, maturing their products and accumulating substantial customer deployments. As these databases are rolled out and deployed in production environments at scale, data warehouse architectures are increasingly applied, bringing associated storage performance and compatibility issues to the forefront.

A data warehouse is built to further mine data resources and support decision-making, sitting atop existing databases. Designed to serve front-end query and analysis workloads, it requires substantial storage due to high data redundancy. Key characteristics of a data warehouse include:

Massive Data Volumes: A data warehouse contains historical data, granular data, and diverse data types. Managing, indexing, and persistently storing such massive amounts of data is a significant challenge.

Multiple File Formats: Data in a warehouse originates from various external systems and is consumed by different external applications. Organized by subject areas, the data generates a large number of files in different formats.

Long-Term Retention: Data warehouse data is primarily used for enterprise decision analysis, involving mainly query operations. Once data enters the warehouse, it is typically retained long-term, meaning there are numerous queries but very few modifications or deletions. Regular loading and refreshing are usually the only updates required. A data warehouse thus stores vast amounts of historical data.

Frequent Concurrent Read/Write: Serving multiple external applications and business systems, the warehouse handles files of varying sizes that are accessed and read frequently. This demands high performance from the underlying storage system.

To meet these demands, GBASE and XSKY established a strategic partnership and conducted in-depth compatibility testing. Tailored to diverse business scenarios, both parties carried out extensive compatibility and performance tests. GBase 8a MPP was commercially adapted to support the standard AWS S3 protocol, which XEOS object storage fully supports. After multiple rounds of joint testing and validation, performance and compatibility targets were successfully achieved.

Integration Between XEOS Object Storage and GBase Database

This testing was defined based on the actual requirements of a cloud-based data warehouse project for China Mobile headquarters, providing decision-making support for future platform construction. The test covered functional and performance testing, with all results meeting expectations.

Functional testing: Covering standard SQL, data loading, table data storage distribution methods, and development interfaces across 4 areas with 15 test items, all functional test items were fully supported and passed. Detailed test results are as follows:

Both functional and performance tests met the expected goals. The integration of GBase 8a MPP and XSKY enterprise-grade object storage XEOS ensures stable and reliable system operation with excellent performance.

Advantages of XEOS Object Storage

XEOS object storage is an enterprise-grade, software-defined storage product independently developed by XSKY with its own intellectual property rights. It is deeply adapted and optimized for Chinese-made CPUs and operating systems. With support for protocols including AWS S3, HDFS, NFS, and the S3 ecosystem, XEOS meets the demanding requirements of complex enterprise applications in terms of stability, reliability, usability, and performance.

Advantages of GBase 8a MPP

GBase 8a MPP is a high-performance, domestically developed analytical database independently created by GBASE for massive data query and analysis scenarios. It addresses the growing needs for data storage, management, and processing—such as data querying, statistics, analysis, mining, and backup—in data-intensive industries. It can serve as the foundational database for data warehouse systems, BI systems, and decision support systems. GBase 8a MPP is widely deployed in industries with massive business data, including finance, telecommunications, and energy, and performs exceptionally well in the business analytics and business intelligence market.