github/kubernetes
4
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Increase the fluentd buffer chunk size to improve write throughput.

Browse Source 
Also reduce the max wait between retries, 30 seconds should be more than
enough backoff.
This commit is contained in:
Alex Robinson
2016-01-26 23:57:02 +00:00
parent 2a83f5d5c7
commit 95a4ea3fc8
2 changed files with 13 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
cluster/addons/fluentd-elasticsearch/fluentd-es-image/td-agent.conf
View File

@@ -186,12 +186,12 @@
port 9200
logstash_format true
# Set the chunk limit the same as for fluentd-gcp.
buffer_chunk_limit 512K
# Cap buffer memory usage to 512KB/chunk * 128 chunks = 65 MB
buffer_queue_limit 128
buffer_chunk_limit 2M
# Cap buffer memory usage to 2MiB/chunk * 32 chunks = 64 MiB
buffer_queue_limit 32
flush_interval 5s
# Never wait longer than 5 minutes between retries.
max_retry_wait 300
max_retry_wait 30
# Disable the limit on the number of retries (retry forever).
disable_retry_limit
</match>