CSRC Information Analysis System Platform — information aggregation, unified integration, and unified scheduling
Key Benefits
lLow Hardware Costs: Fully leverages x86 architecture-based PC servers, eliminating the need for expensive Unix servers and disk arrays.
lMassive Distributed and Compressed Storage: Handles petabytes of structured data, using hash distribution, random distribution, and other storage strategies. Employs advanced compression algorithms that reduce storage space by a factor of 1–20x, significantly boosting I/O performance.
lHigh-Efficiency Data Loading: Provides a policy-based data loading model, with cluster loading speeds up to 2TB/hour.
lHigh Scalability & Reliability: Supports online scaling, ensuring the cluster continues operating normally even if a node within the group fails.
lHigh Concurrency: Enables concurrent data loading and querying, with a single-node concurrency capacity of over 300 users.
Solution
Data sources primarily originate from the CSRC Central Regulatory Information Platform DW and its business systems. Data is loaded and synchronized into the GBase 8a MPP Cluster database via ETL. Upper-layer applications access OLAP software through interfaces such as ODBC and JDBC. Leveraging GBase 8a MPP Cluster's powerful data processing capabilities, hybrid OLAP computing is enabled, providing applications with a direct query channel to raw data.
Requirements Analysis
l Build a Data Platform:Build a unified big data analytics platform that standardizes data, enables data sharing, consolidates information, and coordinates operations to support upper-layer applications;
l Support Massive Data Volumes:Currently, internal data totals 5 TB; future plans require supporting the storage, query, and analysis of hundreds of terabytes of massive data;
l Build Data Mining Applications:Traditional IT systems lack flexible and effective data mining and analytics tools;
l Scalability:Adapt to the five-year big data platform roadmap with the ability to continuously scale.
Project Background
The China Securities Regulatory Commission (CSRC) Central Regulatory Information Analysis Platform project is designed to integrate data and resources across CSRC information systems, re-engineer regulatory operations and processes, and achieve a centralized, harmonized information environment with unified OLAP-driven analytical regulation.
Building the CSRC Central Regulatory Platform requires deep integration of business systems and data resources to lower regulatory costs and boost efficiency. Adopting unified standards, data, functions, and interfaces, covering all regulatory bodies and processes comprehensively, and sharing information through a central data platform are the fundamental principles of the project.