distributed-joins-enabled
Default value: true
使用分布式join而不是广播式join,可以支持更大的join。
广播式join要求最右侧的表需要能完全放到每个节点的内存中,而分布式join只需要集群的内存中能放进去就行。
redistribute-writes
Default value: true
resources.reserved-system-memory
Default value: JVM max memory * 0.4
-------------进程设置---------------
exchange.client-threads
Default value: 25
exchange.concurrent-request-multiplier
Default value: 3
exchange.max-buffer-size
Default value: 32MB
exchange.max-response-size
Default value: 16MB
sink.max-buffer-size
Default value: 32MB
task.concurrency
Default value: 16
task.http-response-threads
Default value: 100
task.http-timeout-threads
Default value: 3
task.info-update-interval
Default value: 3s
task.max-partial-aggregation-memory
Default value: 16MB
task.max-worker-threads
Default value: Node CPUs * 2
task.min-drivers
Default value: task.max-worker-threads * 2
task.writer-count
Default value: 1
node-scheduler.max-splits-per-node
Default value: 100
node-scheduler.max-pending-splits-per-task
Default value: 10
node-scheduler.min-candidates
Default value: 10
node-scheduler.network-topology
Allowed values: legacy, flat
Default value: legacy
optimizer.dictionary-aggregation
Default value: false
optimizer.optimize-hash-generation
Default value: true
optimizer.optimize-metadata-queries
Default value: false
optimizer.optimize-single-distinct
Default value: true
optimizer.push-aggregation-through-join
Default value: true
optimizer.push-table-write-through-union
Default value: true
网友评论