Population Development Center Big Data Platform Project — Columnar Database Supports Large-Scale Concurrent Queries: Project Background

lHigh Concurrency: Each node supports 300 concurrent connections, delivering high query performance;

lFast Loading: Data loading speed up to 2TB/hour;

lRapid Query with Smart Index: Leverages intelligent indexing technology for fast data lookup and query, achieving sub-second response times.

Leverage the GBase 8a columnar analytical database to meet the rapid data loading and concurrent query demands of a population big data platform.

Load population data into the database at speed using GBase 8a's native loading tool. Data ingestion reaches up to 2TB per hour, outperforming traditional row-store databases.

GBase 8a is a columnar database with intelligent indexes built on every column. For pinpoint queries, it first leverages intelligent indexes to quickly locate target records, then reads only the relevant columns from disk. This dramatically reduces query latency and boosts the efficiency of precise lookups.

Under heavy concurrent workloads, each GBase 8a node supports up to 300 concurrent sessions, with query performance markedly better than single-threaded execution. This effectively enhances query efficiency in high-concurrency scenarios.

Leverage a fast analytics database to rapidly ingest demographic data and perform exact queries, range queries, fuzzy queries, and other operations on the population database.

China has a population of nearly 1.4 billion, each person associated with a wide range of attribute information, generating an enormous total data volume. Due to the operational needs of government agencies at all levels—including public security departments—precise queries, segmented fuzzy searches, and demographic statistics must be conducted regularly. Recognizing the profound impact of population information on public administration and public service innovation in the big data era, the relevant authorities place a high priority on population informatization. They are actively building a national population development big data platform to facilitate population data exchange and sharing, providing a foundational population information backbone to support public services, social governance, and macro-level decision-making.