China Unicom Chongqing Branch BSS Detailed Bill History Database Upgrade – Columnar Storage with High Compression for Historical Data Archiving
Project Background
As voice and data service traffic grew, China Unicom Chongqing's existing call detail record (CDR) system gradually struggled to handle the storage pressure of the ever-increasing CDR data. The original CDR project relied on Oracle 9i for data storage and queries, but as data volumes continued to rise, the current storage system could no longer meet the requirements, prompting a search for a historical database solution capable of storing much larger data volumes.
Requirements Analysis
Based on the customer's specific requirements, the new historical database system is expected to meet the following criteria:
Store one year of data, ensuring that six months of data remains queryable;
Query response time of around 3 seconds;
Achieve a compression ratio of 10x or higher;
Build the historical database system within a limited budget.
Solutions
The new historical data system retains two months of data in Oracle, while GBase 8a MPP Cluster stores all historical data prior to the current month. Once a month, data from the most recent month is loaded from Oracle into GBase 8a MPP Cluster via GBase's data distribution server, and the corresponding data older than one month is simultaneously deleted from Oracle.
The application layer directs queries based on the retrieval period: data from the latest month is fetched from Oracle, and historical data older than one month is fetched from GBase 8a MPP Cluster.
Value Delivered
Doubled data retention: Leveraging the superior columnar storage and compression of the GBase 8a MPP Cluster database, the new system extends the detailed record data retention period from 6 months to 1 year.
High performance, low risk: By integrating with existing Oracle databases and controlling data access at the application layer based on time period, the solution ensures fast query performance on detailed records is maintained as the data retention period grows, while minimizing risks during migration of the historical data warehouse.
High availability, low cost: The system ensures high availability for the historical data warehouse through security groups and one-copy data redundancy. Built on Dell’s cost-effective x86 PC server platform, it fulfills the goal of a carrier-grade, highly available core data platform for massive data volumes at a low total cost.