Commit Graph

9760 Commits

Author SHA1 Message Date
Patrick Ohly
7d064812bb kube-controller-manager: finish conversion to contextual logging
This removes all exceptions and fixes the remaining unconverted log calls.
2023-07-12 14:57:29 +02:00
Mengjiao Liu
19869478c1 Migrate /pkg/controller/disruption to structured and contextual logging 2023-07-12 11:30:45 +08:00
Naman
09849b09cf migrated pkg/controller/endpointslice to contextual logging
Signed-off-by: Naman <namanlakhwani@gmail.com>
2023-07-11 01:28:22 +05:30
Kubernetes Prow Robot
10a12165de
Merge pull request #116755 from my-git9/feat/endpoint/logging
Migrated `pkg/controller/endpoint` to contextual logging
2023-07-10 05:37:05 -07:00
Maciej Szulik
3f07fc3acc
Remove long/golang version information making short the default 2023-07-07 18:46:34 +02:00
Ziqi Zhao
dfc1838379 Migrated pkg/controller/volume|util|replicaset|nodeipam to contextual logging
Signed-off-by: Ziqi Zhao <zhaoziqi9146@gmail.com>
2023-07-06 07:39:52 +08:00
Kubernetes Prow Robot
91698fe900
Merge pull request #114061 from Octopusjust/k8s-pr15
testutil: use contextual logging
2023-07-05 08:38:57 -07:00
Kubernetes Prow Robot
0235a5a206
Merge pull request #118707 from pacoxu/unwanted-status-order
update the unwanted-dependencies order
2023-07-04 12:20:54 -07:00
Kubernetes Prow Robot
8d4479a58f
Merge pull request #118767 from gxglls/master
fix(script): handle wait_for_success failed condition
2023-06-29 19:43:45 -07:00
Madhav Jivrajani
6fd830a075 hack/tools: bump golangci-lint and consequently staticcheck
This bump is done since the latest version of staticcheck includes
a fix for a false positive reported by us, discovered while bumping
to go1.20

Signed-off-by: Madhav Jivrajani <madhav.jiv@gmail.com>
2023-06-27 14:20:41 +02:00
Patrick Ohly
1af5425696 hack: disable gomega.Consistently/Eventually check due to false positives
For example, this is a false positive that currently exists in the code base:

    test/e2e_node/dra_test.go:129:4: ginkgo-linter: use a function call in Consistently. This actually checks nothing, because Consistently receives the function returned value, instead of function itself, and this value is never changed; consider using `gomega.Consistently(ctx, e2epod.Get).WithArguments(f.ClientSet, pod).WithTimeout(podInPendingStateTimeout).Should(e2epod.BeInPhase(v1.PodPending),
    	"Pod should be in Pending state as resource preparation time outed")` instead (ginkgolinter)
    			gomega.Consistently(ctx, e2epod.Get(f.ClientSet, pod)).WithTimeout(podInPendingStateTimeout).Should(e2epod.BeInPhase(v1.PodPending),
    			^

It's a false positive because e2epod.Get returns the function that Consistently
is meant to call.

This could be worked around by assigning e2epod.Get(f.ClientSet, pod) to a
variable and then use that variable, but that is less readable.
2023-06-27 14:20:41 +02:00
Kubernetes Prow Robot
28296ba59e
Merge pull request #113994 from mengjiao-liu/contextual-logging-controller-certificates
certificate controller: use contextual logging
2023-06-21 09:03:42 -07:00
ziyin.lu
687ca0e0bb fix(script): handle wait_for_success failed condition
In the wait_node_ready function, two steps are performed:
  1.Check if the node exists
  2.Wait for the node to enter the ready state
If one step fails, the second step should not continue, wasting 300 seconds.
2023-06-20 08:22:26 -04:00
Davanum Srinivas
564c236ce2
Do NOT prepull images for e2e-node jobs
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-06-19 22:01:12 -04:00
Paco Xu
8cd65e9cee reorder hack/unwanted-dependencies.json map keys and arrays
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
2023-06-18 14:09:57 +08:00
Paco Xu
f44029705f exit 1 if status are not as expected(order)
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
2023-06-18 14:09:50 +08:00
Davanum Srinivas
89adbc6e5b
check for AWS environment before running sudo
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-06-14 14:03:44 -04:00
Ziqi Zhao
7bc449d7e0 add contextual logging to job-controller
Signed-off-by: Ziqi Zhao <zhaoziqi9146@gmail.com>
2023-06-14 13:40:02 +08:00
Kubernetes Prow Robot
cdbdb17934
Merge pull request #118567 from chendave/node_arm_ci
Pass the mandatory parameters to build arm64 binaries
2023-06-13 08:22:11 -07:00
Kubernetes Prow Robot
ecf54b8bd5
Merge pull request #118320 from bart0sh/PR115-cleanup-boilerplate.py
Cleanup boilerpate.py
2023-06-12 09:35:49 -07:00
xin.li
325205efb7 Migrated pkg/controller/endpoint to contextual logging
Signed-off-by: xin.li <xin.li@daocloud.io>
2023-06-11 20:12:07 +08:00
Dave Chen
54cae70678 Pass the mandatory parameters to support testing on ARM64
The parameters are needed to build the test binaries, e.g. `e2e_node.test`
`ginkgo` etc.

Signed-off-by: Dave Chen <dave.chen@arm.com>
2023-06-08 17:33:37 +08:00
Kubernetes Prow Robot
c831a08c8e
Merge pull request #118253 from saschagrunert/streaming-cri-api
Move `cri/streaming` to `k8s.io/kubelet` staging repository
2023-06-06 14:14:12 -07:00
Kubernetes Prow Robot
f812ac5445
Merge pull request #118349 from bart0sh/PR116-fix-ginkgo-deprecation-warning
Fix ginkgo deprecation warning
2023-06-06 06:59:01 -07:00
Kubernetes Prow Robot
bba9833c39
Merge pull request #118404 from pohly/verify-failures
better JUnit failure messages for golangci-lint and verify in general
2023-06-05 08:31:26 -07:00
Sascha Grunert
db9fcfeed2
Move cri/streaming to k8s.io/kubelet staging repository
Container runtimes like CRI-O and containerd reuse the code by copying
it from Kubernetes. To have a single source of truth for the streaming
server we now move the already isolated implementation to the
k8s.io/kubelet staging repository. This way runtimes can re-use the code
without copying the parts.

Signed-off-by: Sascha Grunert <sgrunert@redhat.com>
2023-06-05 08:08:18 +02:00
Patrick Ohly
f4d326a1fc verify: produce JUnit file also for pull-kubernetes-verify-strict-lint
Because this doesn't get invoked through verify.sh, we have to call
logJu ourselves to get a JUnit file. errexit must not be set when
calling logJu, otherwise it does no post-processing.
2023-06-02 17:38:14 +02:00
Jefftree
322968e9b3 Update unwanted dependencies per CI instructions 2023-06-02 14:34:26 +00:00
Patrick Ohly
dbbb21469f verify: pick relevant lines from verify-golangci-lint.sh as failure message
When sh2ju.sh was called to generate the junit_verify.xml, it used to include
the entire output of a failed script twice: once as failure message, once as
log output.

This output can be large and often the actual failure isn't near the top, but
rather at the end or (in the case of the different golangci-lint invocations)
embedded in the log. This makes them hard to see at a glance when looking at
the Prow result page for a job.

Now a verify script can prefix relevant lines with "ERROR: " and then only
those lines are used as failure message in JUnit, without that prefix.

That string was chosen because Prow itself also then picks up those lines when
viewing the entire build log and it is unlikely that some script prints such
lines when they are not meant to be part of the failure.

If some script outputs no such lines, "see stderr for details" is used as
failure message. This is better than before because it avoids the redundancy.
2023-06-02 15:37:50 +02:00
Joe Betz
5c0b59891d Bump cel-go to v0.16.0 2023-05-31 18:36:43 -04:00
Ed Bartosh
c48c4c679a Fix ginkgo deprecation warning
Fixed ginkgo warning
   You're using deprecated Ginkgo functionality:
   =============================================
   --untilItFails is deprecated, use --until-it-fails instead

Used consistent approach with this flag in e2e_node and e2e scripts.
2023-05-31 12:53:11 +03:00
ZhangYu
f9ae3e774d testutil: use contextual logging 2023-05-30 10:07:04 +08:00
Ed Bartosh
534f5edb53 Cleanup boilerpate.py
- reformatted with https://github.com/psf/black
- fixed some of the https://github.com/pylint-dev/pylint warnings
2023-05-30 00:58:32 +03:00
Kubernetes Prow Robot
d05b79c836
Merge pull request #118269 from liggitt/genproto
Update google.golang.org/genproto
2023-05-26 14:43:25 -07:00
Jordan Liggitt
a045fedd02
Update google.golang.org/genproto 2023-05-26 13:20:33 -04:00
Kubernetes Prow Robot
a874f587b4
Merge pull request #118071 from kerthcet/cleanup/use-contextual-logging-in-statefulset
Chore: Apply to use contextual logging for all loggers in statefulSet
2023-05-26 07:56:53 -07:00
Kubernetes Prow Robot
74bd0ecdf4
Merge pull request #118223 from pohly/test-integration-vmodule-removal
integration: remove special verbosity for garbagecollector and graph_builder
2023-05-24 05:24:50 -07:00
Keita Mochizuki
0813904404
Fix: Restricted profile comply with PSS (#117543)
* restricted profile comply with PSA v1.27

* add test case

* Reflect review comments

* Reflect review comments 2

* Reflect review comments 3
2023-05-24 04:16:49 -07:00
Patrick Ohly
d459b4429f integration: remove special verbosity for garbagecollector and graph_builder
The setting for garbagecollector was added 7 years ago in 9ac91e5172 for
"debugging gc".  graph_builder was added 6 years in a98801c1 when restoring the
-vmodule parameter after some temporary removal, without an explanation.

It seems safe to assume that the garbage collector has been debugged
sufficiently...

These defaults cause performance overhead:
- Enabling -vmodule slows down all log calls because checking verbosity
  cannot take a simpler fast path.
- The amount of log output is much higher for those files.

The amount of log data also caused test output to get truncated, removing the
actual test failure explanation.
2023-05-24 10:02:53 +02:00
Kubernetes Prow Robot
12386e2de1
Merge pull request #114053 from brianpursley/fix-update-translations
hack/update-translations.sh: Improve backslash handling
2023-05-23 09:06:29 -07:00
Jordan Liggitt
1b206399f6
fix using stale binaries in local-up-cluster 2023-05-22 20:03:58 -04:00
Kubernetes Prow Robot
2e632c9c28
Merge pull request #118187 from thockin/update-vendor_log_capture_cleanup
Fix update-vendor.sh logging
2023-05-22 15:51:06 -07:00
Tim Hockin
ece68cf833
Fix update-vendor.sh logging
Previously it would corrupt the log when it ran stuff like:
    go mod tidy >> "${LOG_FILE}" 2>&1
because this would reopen the file.  Also, if that failed, the `finish`
function would be called ALSO with output to the log.

Now we let &1 and &2 always be the log, and &11 and &22 are the real
stdout/stderr, which means we have to say that explicitly when we want
output.

No, I cannot do `OUT="&11"` - I would have to use `eval` to make that
work.
2023-05-22 14:51:30 -07:00
Kubernetes Prow Robot
6aa4261405
Merge pull request #118119 from liggitt/grpc-gateway-v1
Mark grpc-gateway v1 as an unwanted dependency
2023-05-18 16:16:33 -07:00
Jordan Liggitt
aa11cc6969
Mark grpc-gateway v1 as an unwanted dependency 2023-05-18 17:41:13 -04:00
Kubernetes Prow Robot
6e8d234bf8
Merge pull request #118073 from jsafrane/support-podman
Support podman for building release images
2023-05-18 11:26:34 -07:00
Jan Safranek
b2eae2f92e Support podman for building release images
podman returns nozero exit code for `docker buildx`, because
it misses a subcommand.

`docker buildx version` should work both in podman and docker. Tested both
with docker-ce-20.10.18 + docker-buildx-plugin-0.10.2 and podman-4.5.0 +
podman-docker.
2023-05-18 14:44:26 +02:00
kerthcet
6b4251c0fd Remove statefulset from logcheck.conf
Signed-off-by: kerthcet <kerthcet@gmail.com>
2023-05-18 16:55:19 +08:00
Kubernetes Prow Robot
493fdbb782
Merge pull request #117998 from dims/try-protecting-coredns-from-being-oom-killed
[local-up-cluster] Update docker/containerd/runc versions and capture more logs
2023-05-17 10:36:35 -07:00
Davanum Srinivas
9346237712
Update docker/containerd/runc versions and capture more logs
- use apt to install fresh stuff
- print versions of the components
- throw on debug for docker log
- capture dmesg log
- bump kernel logging

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-05-17 12:38:52 -04:00