Commit Graph

263 Commits

Author SHA1 Message Date
Cédric de Saint Martin
def00298c3 Fluentd: concatenate long logs (>16KB) which have been splitted by Docker into several lines.
See https://github.com/kubernetes/kubernetes/issues/52444.

Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin
46c5c8e20a fluent-es-image: sort plugins in Gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin
079136fd59 fluent-es-image: add fluentd-plugin-concat to gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
htkuan
1cdc9059ba Update elasticsearch to v6.3.0 2018-10-08 23:51:40 +08:00
k8s-ci-robot
9c29560ac8
Merge pull request #68064 from gianrubio/fluentd-signal
fluentd doesn't receive the signal TERM
2018-09-25 03:52:00 -07:00
Giancarlo Rubio
a37c8afe02 Pass the terminaton signal to fluentd 2018-08-30 13:58:14 +02:00
Lubomir I. Ivanov
aefb5b3c0e cluser/addons: add labels to fluentd owner files 2018-08-30 00:38:08 +03:00
saravanan30erd
c493bef26e fix the fluentd config params 2018-08-28 17:26:27 +04:00
liangwei
5ea138f4e9 remove rescheduler 2018-08-22 11:49:14 +08:00
Kubernetes Submit Queue
3f6717a097
Merge pull request #67582 from monotek/kibana
Automatic merge from submit-queue (batch tested with PRs 67493, 67617, 67582, 67337). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

updates kibana to 6.3.2

**What this PR does / why we need it**:
* updates kibana to 6.3.2 

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
needed as es was updated to 6.3.2 too in https://github.com/kubernetes/kubernetes/pull/67484


**Release note**:

```release-note
updates kibana to 6.3.2 
```
2018-08-20 20:39:13 -07:00
André Bauer
f8cea1b028 updates kibana to 6.3.2 2018-08-20 10:00:01 +02:00
André Bauer
6390e590cc added missing pos files & added mapping type name in fluentd config 2018-08-20 09:55:38 +02:00
André Bauer
9b5c5650eb use image 2.2.0 again 2018-08-17 21:49:44 +02:00
André Bauer
6ab218d4dd fixed typo 2018-08-17 21:48:44 +02:00
André Bauer
61a709a7b2 fixed json logging in fluentd-elasticsearch image 2018-08-17 16:43:27 +02:00
André Bauer
9f88fe8016 updates es-image to elasticsearch 6.3.2 2018-08-16 09:51:52 +02:00
André Bauer
2b12f2f944 updated fluentd to 1.2.4 2018-08-15 15:17:00 +02:00
Oleg Ivanov
7e814ec5cc Incremented the elasticsearch version 2018-07-06 22:00:51 +03:00
Oleg Ivanov
ad381d885d Fixed the wrong elasticsearch node counter 2018-06-29 23:03:04 +03:00
Jeff Grafton
23ceebac22 Run hack/update-bazel.sh 2018-06-22 16:22:57 -07:00
André Bauer
cee9deb12c updated gems and versions 2018-06-20 09:33:04 +02:00
Kubernetes Submit Queue
fea9a3f1c5
Merge pull request #62910 from jklare/bump_addon_fluentd-es
Automatic merge from submit-queue (batch tested with PRs 64142, 64426, 62910, 63942, 64548). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

update fluentd-elasticsearch addon

**What this PR does / why we need it**:
Elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now).

This PR updates:
- fluentd from <=1.1.0 to ~>1.1.3
- elasticsearch and kibana from 5.6.2 to 6.2.4
- fluentd-elasticsearch-plugin from 2.4.1 to 2.9.1

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

https://github.com/fluent/fluentd/issues/1894

**Special notes for your reviewer**:

**Release note**:

```release-note

```
2018-06-20 00:05:14 -07:00
RaviSantosh Gudimetla
872addf9e3
Revert "Remove rescheduler and corresponding tests from master" 2018-05-31 22:18:49 -04:00
Kubernetes Submit Queue
a762ea1beb
Merge pull request #64364 from ravisantoshgudimetla/remove-rescheduler
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove rescheduler and corresponding tests from master

**What this PR does / why we need it**:
This is to remove rescheduler from master branch as we are promoting priority and preemption to beta.
**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Part of #57471

**Special notes for your reviewer**:
/cc @bsalamat @aveshagarwal 
**Release note**:

```release-note
Remove rescheduler from master.
```
2018-05-30 22:20:26 -07:00
André Bauer
807047a792 updated versions 2018-05-30 23:04:54 +02:00
ravisantoshgudimetla
aeccffc339 Phase out rescheduler in favor of priority and preemption 2018-05-29 19:52:06 -04:00
André Bauer
1f7a61b6aa raised version tag to 2.1.0 2018-05-27 13:54:27 +02:00
André Bauer
d4d7976b05 updated fluentd in fluentd-es-image to version 1.2.1 2018-05-27 13:50:01 +02:00
Zhen Wang
e9c7fe57d3 Use default seccomp profile for flutend-elasticsearch addon 2018-05-24 11:22:17 -07:00
Kubernetes Submit Queue
0c3edc6f96
Merge pull request #62166 from mbert/master
Automatic merge from submit-queue (batch tested with PRs 57954, 62166). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

fluentd-elasticsearch addon: allow graceful shutdown in fluentd-es image.

This PR contains an optimisation to the fluentd-elasticsearch addon. Restarting fluentd pods took unnecessarily long because the start script in the image did not support propagating signals to the actual fluentd process. This patch fixes this behaviour.

```release-note
NONE
```
2018-05-09 07:17:12 -07:00
Jan Klare
a7ed23be8e
update fluentd-elasticsearch addon
* elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now)
* remove disable flags for xpack, since *-oss images do not include this anymore
* bump elasticsearch and kibana version from 5.6.4 to 6.2.4
* use oss version from elastic as baseimg for kibana and elasticsearch
* bump fluentd version to ~>1.1.3
* bump gem 'fluent-plugin-elasticsearch' to '~>2.9.1' to allow usage of elasticsearch 6.x
* bump fluentd-es-image to v2.1.0
* fix elasticserach run.sh to align with new elasticsearch upstream container structure
2018-04-25 10:04:40 +02:00
Dobes Vandermeer
c73cb05a7e
Capture kernel logs in example fluentd.conf
I find it useful to have the kernel logs available for searching, for example that's the only place you can see processes killed when they hit memory limits.
2018-04-05 23:10:14 -07:00
Martin Dietze
6a79d9e67b fluentd-elasticsearc addon: allow graceful shutdown in fluentd-es image. 2018-04-05 15:45:24 +02:00
Mikhail Vyatskov
300fe8f179 Remove crassirostris from owners and reviewers
Signed-off-by: Mikhail Vyatskov <crassirostris@yandex.com>
2018-04-04 18:36:44 +02:00
Lantao Liu
db110f1b71 Add CRI container log format support back. 2018-03-28 01:29:00 +00:00
Filipe Brandenburger
cea4c98508 Remove mapping to /host/lib from fluentd-gcp container.
This mapping is no longer needed since fluentd-gcp v2.0.16, in which it
started using a container image based on Debian Stretch, in which the
systemd libraries already include support for all the supported
compression algorithms.

The /run.sh in the image no longer accesses /host/lib anyways, so let's
stop mapping it here.

Related changes:
- fluentd-gcp on GoogleCloudPlatform/k8s-stackdriver#101
- fluentd-es on GoogleCloudPlatform/google-fluentd#80
2018-03-02 10:20:08 -08:00
Mike Danese
c0b7364563 remove gcloud docker -- since it's deprecated 2018-02-28 00:24:27 -08:00
Mike Danese
7b4722964d remove deprecated /proxy paths
These were depercated in v1.2.
2018-02-20 14:42:19 -08:00
Jeff Grafton
ef56a8d6bb Autogenerated: hack/update-bazel.sh 2018-02-16 13:43:01 -08:00
Kubernetes Submit Queue
bc9c6df31d
Merge pull request #59103 from Random-Liu/upload-container-runtime-log
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Upload container runtime log to sd/es.

I've verified this in my environment. My stackdriver has an extra `container-runtime` entry for node log, and it collects container runtime daemon log correctly.

@yujuhong @feiskyer @crassirostris @piosz 
@kubernetes/sig-node-pr-reviews @kubernetes/sig-instrumentation-pr-reviews 
Signed-off-by: Lantao Liu <lantaol@google.com>

**Release note**:

```release-note
Container runtime daemon (e.g. dockerd) logs in GCE cluster will be uploaded to stackdriver and elasticsearch with tag `container-runtime`
```
2018-02-14 03:33:21 -08:00
Lantao Liu
8d920d095c Upload container runtime log to sd/es.
Signed-off-by: Lantao Liu <lantaol@google.com>
2018-02-13 18:25:02 +00:00
talk2vino
c1643e5871 libffi-dev dependency added in fluent-es-image Dockerfile to solve the docker build error 2018-02-13 21:27:40 +05:30
Kubernetes Submit Queue
7ef11bd964
Merge pull request #59237 from tanshanshan/addons1
Automatic merge from submit-queue (batch tested with PRs 59767, 56454, 59237, 59730, 55479). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Change critical pods’ template to use priority

**What this PR does / why we need it**:
Change critical pods’ template to use priority
Thanks.
**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
ref #57471

**Special notes for your reviewer**:

**Release note**:

```release-note

```
2018-02-12 15:44:36 -08:00
tanshanshan
95b2b94b1b Change critical pods’ template to use priority 2018-02-08 15:06:27 +08:00
Tim Hockin
3586986416 Switch to k8s.gcr.io vanity domain
This is the 2nd attempt.  The previous was reverted while we figured out
the regional mirrors (oops).

New plan: k8s.gcr.io is a read-only facade that auto-detects your source
region (us, eu, or asia for now) and pulls from the closest.  To publish
an image, push k8s-staging.gcr.io and it will be synced to the regionals
automatically (similar to today).  For now the staging is an alias to
gcr.io/google_containers (the legacy URL).

When we move off of google-owned projects (working on it), then we just
do a one-time sync, and change the google-internal config, and nobody
outside should notice.

We can, in parallel, change the auto-sync into a manual sync - send a PR
to "promote" something from staging, and a bot activates it.  Nice and
visible, easy to keep track of.
2018-02-07 21:14:19 -08:00
halfcrazy
9b64650311 fix typo in cluster 2018-02-03 11:08:06 +08:00
André Bauer
0aff9bcf04 switch to new detect-exeptiions plugin release 0.0.9 2018-01-20 01:34:46 +01:00
André Bauer
362b7cc84d use original pos filenames again 2018-01-20 01:31:43 +01:00
André Bauer
cbfcc3f0fb updated iamge & configmap versions 2018-01-19 18:08:33 +01:00
André Bauer
9ab59becbf updated fluentd configmap with 1.1.0 compatible version 2018-01-19 18:06:03 +01:00