Commit Graph

375 Commits

Author SHA1 Message Date
danielqsj
c2a4906152 Bump k8s.io/klog to v1.0.0 2019-09-23 16:51:43 +08:00
Kubernetes Prow Robot
6789f38199
Merge pull request #80912 from monotek/fluentd-elasticsearch
[fluentd/elasticsearch] updated fluentd to 1.6.3
2019-08-20 23:05:16 -07:00
André Bauer
8cda6da27d use image in statefulset too
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-08-13 19:45:52 +02:00
draveness
495faa22db feat: cleanup pod critical pod annotations feature 2019-08-09 08:41:23 +08:00
André Bauer
bb51318a07 added latest tag
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-08-02 16:34:45 +02:00
André Bauer
596328de41 fixed whitespaces
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-08-02 16:32:31 +02:00
André Bauer
ca9424dd2a updated fluentd to 1.6.3
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-08-02 16:05:15 +02:00
Laurent Godet
19c0aa98e1 Fix es 7.x.x initial cluster formation 2019-07-24 16:42:40 +01:00
Tobias Bradtke
ce3e3f0660
Fix link to moved Docker image
See https://github.com/kubernetes/kubernetes/pull/79390
2019-07-22 20:15:08 +02:00
draveness
d83526d253 Revert "feat: cleanup pod critical pod annotations feature"
This reverts commit b6d41ee5cc.
2019-07-18 13:31:12 +08:00
draveness
b6d41ee5cc feat: cleanup pod critical pod annotations feature 2019-07-11 08:54:19 +08:00
André Bauer
146d7c85dc updated fluentd to 1.5.1, es & kibana to 7.1.1
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-07-03 12:26:55 +02:00
Kubernetes Prow Robot
68eb29cba0
Merge pull request #79390 from coffeepac/move-es-fd-to-quay
move images from gcr.io to quay.io
2019-06-28 12:43:32 -07:00
Pat Christopher
8c819a2dc1 add defaul latest tag as well 2019-06-26 12:11:00 -07:00
Benjamin Elder
1a28fbde4d clarify elastisearch script as bash 2019-06-25 22:19:45 -07:00
Pat Christopher
a1cda614dc move images from gcr.io to quay.io 2019-06-25 14:37:02 -07:00
Kubernetes Prow Robot
8c3b7d7679
Merge pull request #76955 from ialidzhikov/readiness-probe
Add probes for Kibana
2019-06-23 16:23:53 -07:00
Kubernetes Prow Robot
5d9d5bca79
Merge pull request #77765 from coffeepac/es-6.7.2
upgrade elasticsearch for vuln handling
2019-05-11 17:20:10 -07:00
Patrick Christopher
65fcbf4afb upgrade elasticsearch for vuln handling 2019-05-10 16:57:17 -07:00
ialidzhikov
7082ed4330 Add readiness probe for Kibana
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-05-09 10:23:02 +03:00
ialidzhikov
becbed87f1 Update gem versions
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-05-01 20:13:31 +03:00
ialidzhikov
5fc1bcba3f Clean up cluster-service label from fluentd-elastic
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-04-27 22:52:01 +03:00
yue9944882
b5e3acc5c0 remove internal client references in cluster/* 2019-04-09 21:43:54 +08:00
ialidzhikov
ebfb92bdce Update fluentd 1.4.1
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-04-01 18:24:47 +03:00
Kubernetes Prow Robot
753a6edc37
Merge pull request #74616 from ialidzhikov/fluentd-1.4.0
Update fluentd to 1.4.0
2019-03-26 12:33:48 -07:00
ialidzhikov
db6add318a Update fluentd to 1.4.0
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-03-20 08:48:26 +02:00
ialidzhikov
c72115dede Update golang to 1.12.0
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-03-08 11:45:46 +02:00
Kubernetes Prow Robot
45e5f6053b
Merge pull request #74424 from liggitt/drop-k8s-io-node-labels
Clean up self-set node labels
2019-03-06 08:24:26 -08:00
Kubernetes Prow Robot
95cd1d59e4
Merge pull request #74209 from monotek/fluentd-helm-readme
added production note about EFK stack to the readme
2019-03-04 17:55:12 -08:00
Kubernetes Prow Robot
1942c1ccb0
Merge pull request #71251 from monotek/kibana
updated kibana to 6.6.1
2019-02-26 23:40:33 -08:00
Jordan Liggitt
8975233788 Finish migration of fluentd to daemonset 2019-02-26 11:42:23 -05:00
André Bauer
9e2d9cfbb0 changed es image repo
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-26 09:09:21 +01:00
André Bauer
2bd6d3dc12 use image version 6.6.1
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-25 11:05:52 +01:00
André Bauer
2d15ffc9cc updated to 6.5.2
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-25 10:56:50 +01:00
André Bauer
0c29ea1a2e Update es-statefulset.yaml 2019-02-25 10:55:23 +01:00
André Bauer
53a936c359 Update Makefile 2019-02-25 10:55:23 +01:00
André Bauer
0e44fa6359 updated elasticsearch to 6.5.0 2019-02-25 10:55:23 +01:00
André Bauer
fc850b5ecd fixed wording
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-25 10:49:43 +01:00
André Bauer
421fcd8262 added prodution note to readme
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-25 10:47:26 +01:00
Kubernetes Prow Robot
743f864310
Merge pull request #73819 from coffeepac/move-fluentd-es-images
Move fluentd es images
2019-02-22 17:58:12 -08:00
Patrick Christopher
1bd45ba6eb review updates 2019-02-22 10:00:10 -08:00
xichengliudui
053332ad46 Fix shellcheck lint errors in cluster/addons/fluentd-elasticsearch/fluentd-es-image/run.sh
update pull request

update pull request

update pull request

update pull request

update pull request
2019-02-21 02:00:48 -05:00
André Bauer
d82d5fda35 updated kibana to 6.6.0
Signed-off-by: André Bauer <monotek23@gmail.com>
2019-02-18 11:00:02 +01:00
André Bauer
fa859e4644 Merge branch 'master' into kibana 2019-02-18 10:58:49 +01:00
patc
0e219f4caa boilerplate fix 2019-02-07 21:12:46 -08:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
patc
64918cc2b4 update makefiles to use cloud build and update README 2019-01-28 22:44:44 -08:00
patc
7f873f23b9 multi stage dckerfile builds discovery app and ES image 2019-01-23 00:01:58 -08:00
André Bauer
273fa998f7 updated fluentd to 1.3.3 & gem updates 2019-01-08 20:53:26 +01:00
André Bauer
dea164fda8 removed plugin dir creation as no plugin is installed 2018-12-21 00:21:21 +01:00
André Bauer
7b2651429a removed curl instalation as its not needed anymore 2018-12-21 00:20:49 +01:00
André Bauer
c33b5b60d1 removed fabric8 json plugin & replaced with fluetnds build in filter_parser
Signed-off-by: André Bauer <monotek23@gmail.com>
2018-12-21 00:07:56 +01:00
André Bauer
dd50d00c51 updated fluentd to 1.3.2 2018-12-17 23:44:26 +01:00
André Bauer
9da7a189b9 Merge remote-tracking branch 'upstream/master' into fluentd-elasticsearch 2018-12-17 23:40:25 +01:00
André Bauer
2c48c6fe7a
added monotek to fluentd-elasticsearch OWNERS file 2018-12-11 19:52:39 +01:00
André Bauer
0da558149c updated to kibana 6.5.2 2018-12-11 16:40:13 +01:00
André Bauer
14b208db26 prepared elasticsearch output plugin type_name for es 7.0.x 2018-11-19 19:30:21 +01:00
André Bauer
303c6ce638 - updated fluentd to 1.3.0
- added filter_parse_json_field to restore removed functionality of kubernetes_metadata (https://github.com/fabric8io/fluent-plugin-kubernetes_metadata_filter/issues/145)
- updated all gems to newest version
2018-11-18 11:37:54 +01:00
Lantao Liu
1670b4089a Make fluentd container runtime service configurable. 2018-11-16 02:17:55 -08:00
Davanum Srinivas
954996e231
Move from glog to klog
- Move from the old github.com/golang/glog to k8s.io/klog
- klog as explicit InitFlags() so we add them as necessary
- we update the other repositories that we vendor that made a similar
change from glog to klog
  * github.com/kubernetes/repo-infra
  * k8s.io/gengo/
  * k8s.io/kube-openapi/
  * github.com/google/cadvisor
- Entirely remove all references to glog
- Fix some tests by explicit InitFlags in their init() methods

Change-Id: I92db545ff36fcec83afe98f550c9e630098b3135
2018-11-10 07:50:31 -05:00
k8s-ci-robot
123d0a74ef
Merge pull request #70610 from zhihuiwu/min-master-nodes
Fix a wrong judgement in elasticsearch_logging_discovery.go
2018-11-05 12:58:16 -08:00
zhihui wu
eed65f75f9 Modify the judgement condtion in elasticsearch_logging_discovery.go
The number of endpoints's addresses can be greater or equal to the
value of "MINIMUM_MASTER_NODES".

Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2018-11-03 14:12:03 +08:00
Cédric de Saint Martin
def00298c3 Fluentd: concatenate long logs (>16KB) which have been splitted by Docker into several lines.
See https://github.com/kubernetes/kubernetes/issues/52444.

Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin
46c5c8e20a fluent-es-image: sort plugins in Gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin
079136fd59 fluent-es-image: add fluentd-plugin-concat to gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
htkuan
1cdc9059ba Update elasticsearch to v6.3.0 2018-10-08 23:51:40 +08:00
k8s-ci-robot
9c29560ac8
Merge pull request #68064 from gianrubio/fluentd-signal
fluentd doesn't receive the signal TERM
2018-09-25 03:52:00 -07:00
Giancarlo Rubio
a37c8afe02 Pass the terminaton signal to fluentd 2018-08-30 13:58:14 +02:00
Lubomir I. Ivanov
aefb5b3c0e cluser/addons: add labels to fluentd owner files 2018-08-30 00:38:08 +03:00
saravanan30erd
c493bef26e fix the fluentd config params 2018-08-28 17:26:27 +04:00
liangwei
5ea138f4e9 remove rescheduler 2018-08-22 11:49:14 +08:00
Kubernetes Submit Queue
3f6717a097
Merge pull request #67582 from monotek/kibana
Automatic merge from submit-queue (batch tested with PRs 67493, 67617, 67582, 67337). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

updates kibana to 6.3.2

**What this PR does / why we need it**:
* updates kibana to 6.3.2 

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
needed as es was updated to 6.3.2 too in https://github.com/kubernetes/kubernetes/pull/67484


**Release note**:

```release-note
updates kibana to 6.3.2 
```
2018-08-20 20:39:13 -07:00
André Bauer
f8cea1b028 updates kibana to 6.3.2 2018-08-20 10:00:01 +02:00
André Bauer
6390e590cc added missing pos files & added mapping type name in fluentd config 2018-08-20 09:55:38 +02:00
André Bauer
9b5c5650eb use image 2.2.0 again 2018-08-17 21:49:44 +02:00
André Bauer
6ab218d4dd fixed typo 2018-08-17 21:48:44 +02:00
André Bauer
61a709a7b2 fixed json logging in fluentd-elasticsearch image 2018-08-17 16:43:27 +02:00
André Bauer
9f88fe8016 updates es-image to elasticsearch 6.3.2 2018-08-16 09:51:52 +02:00
André Bauer
2b12f2f944 updated fluentd to 1.2.4 2018-08-15 15:17:00 +02:00
Oleg Ivanov
7e814ec5cc Incremented the elasticsearch version 2018-07-06 22:00:51 +03:00
Oleg Ivanov
ad381d885d Fixed the wrong elasticsearch node counter 2018-06-29 23:03:04 +03:00
Jeff Grafton
23ceebac22 Run hack/update-bazel.sh 2018-06-22 16:22:57 -07:00
André Bauer
cee9deb12c updated gems and versions 2018-06-20 09:33:04 +02:00
Kubernetes Submit Queue
fea9a3f1c5
Merge pull request #62910 from jklare/bump_addon_fluentd-es
Automatic merge from submit-queue (batch tested with PRs 64142, 64426, 62910, 63942, 64548). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

update fluentd-elasticsearch addon

**What this PR does / why we need it**:
Elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now).

This PR updates:
- fluentd from <=1.1.0 to ~>1.1.3
- elasticsearch and kibana from 5.6.2 to 6.2.4
- fluentd-elasticsearch-plugin from 2.4.1 to 2.9.1

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

https://github.com/fluent/fluentd/issues/1894

**Special notes for your reviewer**:

**Release note**:

```release-note

```
2018-06-20 00:05:14 -07:00
RaviSantosh Gudimetla
872addf9e3
Revert "Remove rescheduler and corresponding tests from master" 2018-05-31 22:18:49 -04:00
Kubernetes Submit Queue
a762ea1beb
Merge pull request #64364 from ravisantoshgudimetla/remove-rescheduler
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove rescheduler and corresponding tests from master

**What this PR does / why we need it**:
This is to remove rescheduler from master branch as we are promoting priority and preemption to beta.
**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Part of #57471

**Special notes for your reviewer**:
/cc @bsalamat @aveshagarwal 
**Release note**:

```release-note
Remove rescheduler from master.
```
2018-05-30 22:20:26 -07:00
André Bauer
807047a792 updated versions 2018-05-30 23:04:54 +02:00
ravisantoshgudimetla
aeccffc339 Phase out rescheduler in favor of priority and preemption 2018-05-29 19:52:06 -04:00
André Bauer
1f7a61b6aa raised version tag to 2.1.0 2018-05-27 13:54:27 +02:00
André Bauer
d4d7976b05 updated fluentd in fluentd-es-image to version 1.2.1 2018-05-27 13:50:01 +02:00
Zhen Wang
e9c7fe57d3 Use default seccomp profile for flutend-elasticsearch addon 2018-05-24 11:22:17 -07:00
Kubernetes Submit Queue
0c3edc6f96
Merge pull request #62166 from mbert/master
Automatic merge from submit-queue (batch tested with PRs 57954, 62166). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

fluentd-elasticsearch addon: allow graceful shutdown in fluentd-es image.

This PR contains an optimisation to the fluentd-elasticsearch addon. Restarting fluentd pods took unnecessarily long because the start script in the image did not support propagating signals to the actual fluentd process. This patch fixes this behaviour.

```release-note
NONE
```
2018-05-09 07:17:12 -07:00
Jan Klare
a7ed23be8e
update fluentd-elasticsearch addon
* elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now)
* remove disable flags for xpack, since *-oss images do not include this anymore
* bump elasticsearch and kibana version from 5.6.4 to 6.2.4
* use oss version from elastic as baseimg for kibana and elasticsearch
* bump fluentd version to ~>1.1.3
* bump gem 'fluent-plugin-elasticsearch' to '~>2.9.1' to allow usage of elasticsearch 6.x
* bump fluentd-es-image to v2.1.0
* fix elasticserach run.sh to align with new elasticsearch upstream container structure
2018-04-25 10:04:40 +02:00
Dobes Vandermeer
c73cb05a7e
Capture kernel logs in example fluentd.conf
I find it useful to have the kernel logs available for searching, for example that's the only place you can see processes killed when they hit memory limits.
2018-04-05 23:10:14 -07:00
Martin Dietze
6a79d9e67b fluentd-elasticsearc addon: allow graceful shutdown in fluentd-es image. 2018-04-05 15:45:24 +02:00
Mikhail Vyatskov
300fe8f179 Remove crassirostris from owners and reviewers
Signed-off-by: Mikhail Vyatskov <crassirostris@yandex.com>
2018-04-04 18:36:44 +02:00
Lantao Liu
db110f1b71 Add CRI container log format support back. 2018-03-28 01:29:00 +00:00
Filipe Brandenburger
cea4c98508 Remove mapping to /host/lib from fluentd-gcp container.
This mapping is no longer needed since fluentd-gcp v2.0.16, in which it
started using a container image based on Debian Stretch, in which the
systemd libraries already include support for all the supported
compression algorithms.

The /run.sh in the image no longer accesses /host/lib anyways, so let's
stop mapping it here.

Related changes:
- fluentd-gcp on GoogleCloudPlatform/k8s-stackdriver#101
- fluentd-es on GoogleCloudPlatform/google-fluentd#80
2018-03-02 10:20:08 -08:00
Mike Danese
c0b7364563 remove gcloud docker -- since it's deprecated 2018-02-28 00:24:27 -08:00
Mike Danese
7b4722964d remove deprecated /proxy paths
These were depercated in v1.2.
2018-02-20 14:42:19 -08:00