GBase 8a
性能调优
文章

如何测试kafka写入的性能,需要配置哪些东西

发表于2023-04-19 17:02:3987次浏览0个评论

问题描述:如何测试kafka写入的性能,需要配置哪些东西 解决方案:可以通过kafka consumer消费数据【全局变量】set global gcluster_kafka_consumer_latency_time_statistics = 1;【gcluster】#kafka consumer parameters, turn on/off according to your requirement.gcluster_lock_level = 10gcluster_assign_kafka_topic_period=20gcluster_kafka_max_message_size=100000000gcluster_kafka_batch_commit_dml_count=100000gcluster_kafka_local_queue_size=210000gcluster_kafka_consume_batch=10gcluster_kafka_parallel_commit = 1 (取决于coor的数量)#gcluster_kafka_delete_execute_directly=0#gcluster_kafka_loader_max_start_count=20gcluster_kafka_user_allowed_max_latency=2000gcluster_kafka_message_format_type=PUREDATAgcluster_kafka_consumer_enable= 1#gcluster_kafka_result_check=1#gcluster_suffix_consistency_check=1gcluster_kafka_primarykey_can_be_null=0gcluster_kafka_consumer_latency_time_statistics = 1#_t_gcluster_kafka_null_transform=0#gcluster_kafka_consumer_output_charset_name=UTF8#_gcluster_insert_cache_buffer_flag=1 (此参数可以开启)#gcluster_kafka_data_buf_size=20000 (此参数可以开启)【gnode】gbase_tx_log_mode=NO_USE,NO_STANDARD_TRANS_gbase_transaction_disable=1gbase_buffer_insert=1024Mgbase_tx_log_flush_time=5_gbase_kafka_transaction_mode = 1

评论已关闭