Commit Graph

52 Commits

Author SHA1 Message Date
Manuel de Brito Fontes
341b2c1736 Update fluent images 2016-08-23 10:11:15 -03:00
Fabio Yeon
86928dbea0 Increase pod CPU/memory for fluentd, dns and kube-proxy. 2016-06-24 11:03:08 -07:00
Alex Robinson
19bf9d0624 Support journal logs in fluentd-gcp.
Only run the systemd-journal plugin when on a platform that requests it.
The plugin crashes the fluentd process if the journal isn't present, so
it can't just be run blindly in all configurations.
2016-06-24 00:30:32 +00:00
Alex Robinson
bb51c94172 Add collection of the new glbc and cluster-autoscaler logs 2016-06-03 15:50:52 +00:00
CJ Cullen
26a6c66de5 Change kube-proxy & fluentd CPU request to 20m/80m. 2016-03-30 18:14:24 -07:00
k8s-merge-robot
0a21fa06d9 Merge pull request #22539 from a-robinson/newf
Auto commit by PR queue bot
2016-03-05 08:26:59 -08:00
k8s-merge-robot
886c943379 Merge pull request #22367 from a-robinson/requests
Auto commit by PR queue bot
2016-03-05 06:18:14 -08:00
Alex Robinson
3216204668 Update to the latest version of google-fluentd.
It includes some performance improvements for parsing JSON (which is
very important for us, since all Docker logs are JSON) as well as a
couple new settings, like forcing of a flush of multiline logs after a
time period rather than having to wait until a new log is seen before
feeling confident flushing the previous one.
2016-03-05 00:18:31 +00:00
Alex Robinson
4e729c6c7c Reconfigure fluentd's resource limits and requests.
-Remove CPU limits to enable CPU bursting once 1.2 begins enforcing CPU limits.
-Add a memory limit for fluentd-es to match fluentd-gcp.
-Explicitly set requests to match limits.
2016-03-04 16:16:35 -08:00
Alex Robinson
feea376b5c Update the logging images to parse sub-second docker timestamps. 2016-03-03 10:21:30 -08:00
Abhishek Shah
51fba282ec Fluentd on GCE master should not use ClusterFirst 2016-02-17 11:32:41 -08:00
Alex Robinson
e5c5f76402 Update the default fluentd images to parse system logs. 2016-02-04 23:29:27 +00:00
Alex Robinson
6acf297231 Update the fluentd versions to include fixes for #19405. 2016-01-27 00:30:53 +00:00
Minhan Xia
f0c176dd6a add validation for fluentd pods 2015-12-14 16:23:11 -08:00
Alex Robinson
f0ebe4066f Update fluentd-gcp to include all recent improvements that are in the
new google-fluentd 1.5.4-1 build.
2015-10-29 11:54:07 +00:00
k8s-merge-robot
14ccba8924 Merge pull request #13886 from a-robinson/logtags
Auto commit by PR queue bot
2015-09-16 05:51:32 -07:00
Alex Robinson
8040f75594 Update fluentd-gcp to use a new google-fluentd build with my recent
changes to fluent-plugin-google-cloud to attach Kubernetes metadata to
logs.

Along with this, separate logs from containers in the cluster out from
logs from the daemons running on the node by instantiating two instances
of the output plugin, one which uses the new metadata (for containers)
and one which doesn't (for things like docker and the kubelet).
2015-09-15 23:14:43 +00:00
Alex Robinson
614b1cf3c1 Replace /varlog with /var/log in the fluentd-gcp config to match the
recently updated fluent-es config.
2015-09-11 16:52:49 -07:00
Alex Robinson
746dcb8075 Make fluentd-es output its warning logs and fluentd-gcp mount
/var/lib/docker read-only.
2015-09-10 18:28:27 +00:00
Alex Robinson
b3154a7815 Remove the garbage log file in the fluentd-gcp that gets filled with
gunk when installing the google-fluentd agent.

Also let it log things by not redirecting to a file within the container
and only using -q (warning logs only) rather than -qq (error logs only).
2015-08-27 21:41:44 +00:00
Clayton Coleman
02dbb95447 Add TerminationGracePeriodSeconds to API
Set defaulting for pod spec
2015-08-20 11:03:38 -04:00
Robert Bailey
08e6a43c1d Revert "Merge pull request #9165 from smarterclayton/graceful"
This reverts commit 4f856b595d, reversing
changes made to d78525a83b.

Conflicts:
	pkg/kubelet/status_manager.go
2015-08-18 17:34:49 -07:00
Clayton Coleman
b842a7dd15 Revert "Revert "Gracefully delete pods from the Kubelet""
This reverts commit 98115facfd.
2015-08-18 08:57:02 -04:00
Alex Robinson
7430181d65 Collect more of the VM's log files (monit, salt) in fluentd-gcp. 2015-08-05 00:21:47 +00:00
Alex Robinson
9e18c29e9f Make fluentd-gcp collect etcd's logs on the master. 2015-07-30 22:20:57 +00:00
Janet Kuo
180798cfa4 Use example syncer tags instead of hard-coded examples in doc 2015-07-27 14:48:41 -07:00
Alex Robinson
0889307522 Update the fluentd-gcp images to include their latest Dockerfile changes.
Their Dockerfiles were changed in #11768.
2015-07-24 01:27:42 +00:00
Brendan Burns
988aa6fdf6 Move things into a 'kube-system' namespace. 2015-07-06 15:08:23 -07:00
Zach Loafman
a2250d1caf Merge pull request #10597 from a-robinson/fluentd
Run fluentd on the master to collect the core master logs
2015-07-04 21:12:47 -07:00
Zach Loafman
1d16be675c Merge pull request #10653 from dchen1107/resource_management
Set resource limit for addon containers
2015-07-01 19:35:28 -07:00
Dawn Chen
54531d9b55 Set memory limit (200mi) to fluentd static pod 2015-07-01 17:00:06 -07:00
nikhiljindal
274792d7bb Stop exposing v1beta3 by default 2015-07-01 14:38:02 -07:00
Alex Robinson
e5ea6ae854 Run fluentd on the master node by default.
This involves adding the logging-write scope to the master when running on GCE.
2015-07-01 20:07:52 +00:00
Satnam Singh
33311b46a2 Adjust Fluentd source format for Docker files to be JSON for Cloud Logging 2015-06-15 10:22:27 -07:00
Filip Grzadkowski
98115facfd Revert "Gracefully delete pods from the Kubelet" 2015-06-02 23:40:05 +02:00
Clayton Coleman
f12a68cd60 Apply fix for #8642 to GracefulDeletion 2015-06-01 19:24:02 -04:00
Dawn Chen
626d25d50e Initial cpu limit for fluentd pods (file based). 2015-05-21 23:44:26 -07:00
Satnam Singh
32842b4d22 Update Fluentd GCP image 2015-05-19 16:12:50 -07:00
Satnam Singh
53ec5e38c7 Remove the use of secrets from node level logging agents 2015-05-13 10:11:07 -07:00
Satnam Singh
ade18e4ff3 Conver node level logging to Cloud Logging to use token-system-logging 2015-05-12 10:17:45 -07:00
Satnam Singh
e246685468 Convert Fluentd to Cloud Logging pod specs to YAML 2015-05-11 14:55:46 -07:00
Satnam Singh
941a457851 Trim Fleuntd tag for Cloud Logging 2015-04-30 13:39:35 -07:00
Satnam Singh
4a0cc7905d Convert node level logging agents to v1beta3 2015-04-27 17:21:42 -07:00
Satnam Singh
2444c1f943 Propagate pod and container name for log files 2015-04-22 15:08:51 -07:00
Satnam Singh
73a9ab2928 Rename logging image to use google_containers 2015-03-31 16:00:52 -07:00
Satnam Singh
666e2b69ac Update Salt config to use gcr.io Fluentd to Cloud Logging agent 2015-03-27 16:39:12 -07:00
Satnam Singh
0212e68e91 Adjust POS file for Fluentd to Cloud Logging 2015-03-17 11:44:04 -07:00
Satnam Singh
d395efa463 Make Fluentd to Cloud Logging collector read from head 2015-03-16 16:19:07 -07:00
Satnam Singh
16f49f6d09 Update Fluentd to Cloud Logging image 2015-02-26 15:18:22 -08:00
Satnam Singh
b4fcdd7e47 Collect Kubelet logs with Fluentd->Elasticsearch and Fluentd->Cloud Logging 2014-12-14 01:47:48 -08:00