Commit Graph

9333 Commits

Author SHA1 Message Date
Kubernetes Prow Robot
6e0e9f382e
Merge pull request #109194 from pohly/log-tests
log tests
2022-06-10 03:07:46 -07:00
Kubernetes Prow Robot
2d7dcf928c
Merge pull request #109594 from linux-on-ibm-z/fastbuild_s390x
Add fast build support for s390x
2022-06-05 23:42:23 -07:00
Kubernetes Prow Robot
0c0b528ec4
Merge pull request #109516 from kaydxh/master
refactor(hack): use ${BASH_SOURCE[0]} to get script name
2022-06-03 09:30:44 -07:00
Manish Kumar
e9e8be304c etcd: Updated to v3.5.4 2022-06-01 07:52:46 +05:30
Davanum Srinivas
50bea1dad8
Move from k8s.gcr.io to registry.k8s.io
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-05-31 10:16:53 -04:00
Patrick Ohly
991d848e34 logcheck: enable helper check
This is in preparation of converting code to contextual logging.
2022-05-31 08:07:37 +02:00
Kubernetes Prow Robot
6e04ca634d
Merge pull request #109729 from MikeSpreitzer/wrap-weighted-histograms
Wrap weighted histograms
2022-05-12 12:32:32 -07:00
Patrick Ohly
1aa58532c8 test: enable unit tests under test/e2e
The test/e2e directory contains several unit tests that should run as part of
"make test":

./test/e2e/chaosmonkey/chaosmonkey_test.go
./test/e2e/storage/external/external_test.go
./test/e2e/storage/utils/utils_test.go
./test/e2e/framework/log_test.go
./test/e2e/framework/testfiles/testfiles_test.go
./test/e2e/framework/timer/timer_test.go
./test/e2e/framework/node/wait_test.go
./test/e2e/framework/pod/resource_test.go
./test/e2e/framework/config/config_test.go
./test/e2e/framework/ingress/ingress_utils_test.go
./test/e2e/framework/providers/gce/firewall_test.go

Because they were excluded by "./test/e2e/*", some of them became outdated.

./test/e2e/e2e_test.go is the only test that needs to be excluded because it is
the E2E test suite that depends on a functional cluster.
2022-05-11 11:48:58 +02:00
Mario Jason Braganza
066fd90f26
add verify-licenses.sh to the EXCLUDED_PATTERNS in make-rules/verify.sh 2022-05-06 19:03:03 +05:30
Kubernetes Prow Robot
73a07082d9
Merge pull request #109299 from Priyankasaggu11929/add-verify-licenses-hack-script
add verify-licenses.sh hack script (#108942)
2022-05-06 06:21:04 -07:00
Priyanka Saggu
31a5e8a027
add workaround fix for incorrect license URL 2022-05-06 13:19:24 +05:30
Kubernetes Prow Robot
5e9a6a256e
Merge pull request #109464 from liggitt/gomodule-install
Use module mode when building/installing
2022-05-05 16:28:52 -07:00
Mike Spreitzer
68d9249490 Add wrapper for TimingHistogram
Do not bother wrapping WeightedHistogram because it is not used
in k/k.
2022-05-05 14:21:21 -04:00
Kubernetes Prow Robot
99de67958d
Merge pull request #109798 from liggitt/psp
Remove PodSecurityPolicy admission plugin
2022-05-05 06:40:32 -07:00
Jordan Liggitt
6cdaecfe0a Build in hermetic module mode 2022-05-05 08:47:33 -04:00
Jordan Liggitt
2a10ca650d drop vendor from test targets 2022-05-05 08:47:33 -04:00
Jordan Liggitt
39f5c13510 drop vendor from go install paths 2022-05-05 08:47:33 -04:00
Jordan Liggitt
a44192b955 Remove PodSecurityPolicy cluster config 2022-05-04 16:00:56 -04:00
Jordan Liggitt
9e1064a26b Regenerate vendor 2022-05-04 10:27:41 -04:00
Jordan Liggitt
1176b7ca28 Update go.mod files to go1.18, update license vendor script 2022-05-04 10:22:27 -04:00
Kubernetes Prow Robot
366dcaa81c
Merge pull request #109606 from endocrimes/dani/cleanup-make-test-e2e-node
hack: make test-e2e-node: remove old project refs
2022-05-04 02:34:45 -07:00
Kubernetes Prow Robot
cbb164efe6
Merge pull request #109277 from MikeSpreitzer/add-weighted-histogram
Start drafting weighted and timing histograms
2022-05-03 19:30:31 -07:00
Mike Spreitzer
b4a40cd43e Draft weighted and timing histograms
The following investigation occurred during development.

Add TimingHistogram impl that shares lock with WeightedHistogram

Benchmarking and profiling shows that two layers of locking is
noticeably more expensive than one.

After adding this new alternative, I now get the following benchmark
results.

```
(base) mspreitz@mjs12 kubernetes % go test -benchmem -run=^$ -bench ^BenchmarkTimingHistogram$ k8s.io/component-base/metrics/prometheusextension
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogram-16    	22232037	        52.79 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	1.404s

(base) mspreitz@mjs12 kubernetes % go test -benchmem -run=^$ -bench ^BenchmarkTimingHistogram$ k8s.io/component-base/metrics/prometheusextension
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogram-16    	22190997	        54.50 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	1.435s
```

and

```
(base) mspreitz@mjs12 kubernetes % go test -benchmem -run=^$ -bench ^BenchmarkTimingHistogramDirect$ k8s.io/component-base/metrics/prometheusextension
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogramDirect-16    	28863244	        40.99 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	1.890s
(base) mspreitz@mjs12 kubernetes %
(base) mspreitz@mjs12 kubernetes %
(base) mspreitz@mjs12 kubernetes % go test -benchmem -run=^$ -bench ^BenchmarkTimingHistogramDirect$ k8s.io/component-base/metrics/prometheusextension
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogramDirect-16    	27994173	        40.37 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	1.384s
```

So the new implementation is roughly 20% faster than the original.

Add overlooked exception, rename timingHistogram to timingHistogramLayered

Use the direct (one mutex) style of TimingHistogram impl

This is about a 20% gain in CPU speed on my development machine, in
benchmarks without lock contention.  Following are two consecutive
trials.

(base) mspreitz@mjs12 prometheusextension % go test  -benchmem -run=^$ -bench Histogram .
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogramLayered-16    	21650905	        51.91 ns/op	       0 B/op	       0 allocs/op
BenchmarkTimingHistogramDirect-16     	29876860	        39.33 ns/op	       0 B/op	       0 allocs/op
BenchmarkWeightedHistogram-16         	49227044	        24.13 ns/op	       0 B/op	       0 allocs/op
BenchmarkHistogram-16                 	41063907	        28.82 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	5.432s

(base) mspreitz@mjs12 prometheusextension % go test  -benchmem -run=^$ -bench Histogram .
goos: darwin
goarch: amd64
pkg: k8s.io/component-base/metrics/prometheusextension
cpu: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
BenchmarkTimingHistogramLayered-16    	22483816	        51.72 ns/op	       0 B/op	       0 allocs/op
BenchmarkTimingHistogramDirect-16     	29697291	        39.39 ns/op	       0 B/op	       0 allocs/op
BenchmarkWeightedHistogram-16         	48919845	        24.03 ns/op	       0 B/op	       0 allocs/op
BenchmarkHistogram-16                 	41153044	        29.26 ns/op	       0 B/op	       0 allocs/op
PASS
ok  	k8s.io/component-base/metrics/prometheusextension	5.044s

Remove layered implementation of TimingHistogram
2022-04-28 17:36:06 -04:00
Danielle Lancashire
f1f45df2c1 hack: make test-e2e-node: remove old project refs
This commit cleans up references to the old kubernetes-node-e2e-images
project. In the process it removes the `LIST_IMAGES` mode as listing
large numbers of public cloud projects is not particularly useful, and
has been somewhat broken for a long period of time - as we defaulted
launching a VM to a different project than listing.
2022-04-22 00:59:25 +02:00
vitt-bagal
969ddfbd72 Add fast build support for s390x 2022-04-21 01:47:26 -07:00
kayxhding
33ce0cbe9c refactor(hack): use ${BASH_SOURCE[0]} to get script name 2022-04-16 23:58:13 +08:00
Kubernetes Prow Robot
10dcc6c5f4
Merge pull request #109484 from liggitt/go-min-version
Update min golang version to 1.18.1
2022-04-14 09:20:47 -07:00
Kubernetes Prow Robot
a8c582a765
Merge pull request #109312 from MadhavJivrajani/remove-sha1-godebug
hack/jenkins: Remove GODEBUG workaround for sha1 changes
2022-04-14 07:06:46 -07:00
Jordan Liggitt
f97bc825d5 Update min golang version to 1.18.1 2022-04-14 09:53:20 -04:00
Stephen Augustus
3f85937b11
etcd: Update to v3.5.3
Signed-off-by: Stephen Augustus <foo@auggie.dev>
2022-04-13 19:04:00 -04:00
Priyanka Saggu
0e92873ee5
update verify-licenses.sh to make it execute in a different git worktree 2022-04-13 21:00:56 +05:30
James Laverack
7d57d5c70d Revert "Introduce APIs to support multiple ClusterCIDRs (#108290)"
This reverts commit b9792a9dae.
2022-04-13 13:58:19 +01:00
Priyanka Saggu
84759deac5
add verify-licenses.sh hack script (kubernetes#108942) 2022-04-09 20:08:24 +05:30
Madhav Jivrajani
ae55bcda44 hack/jenkins: Remove GODEBUG workaround for sha1 changes
This commit undoes the GODEBUG=x509sha1=1 workaround.
The problem should be fixed in Go 1.18.1 now.

Signed-off-by: Madhav Jivrajani <madhav.jiv@gmail.com>
2022-04-05 20:41:19 +05:30
Jordan Liggitt
3e9cdf6193 Fix local-up-cluster for running only an API server 2022-04-03 22:28:30 -04:00
Jordan Liggitt
975bfaf8ba set parallelism in integration tests with GOMAXPROCS 2022-04-01 12:55:41 -04:00
Jordan Liggitt
ddd15e1d8c omit enums from static openapi snapshots used to generate clients 2022-03-31 12:31:47 -04:00
Sarvesh Rangnekar
b9792a9dae
Introduce APIs to support multiple ClusterCIDRs (#108290)
* Introduce networking/v1alpha1 api, ClusterCIDRConfig type

Introduce networking/v1alpha1 api group.

Add `ClusterCIDRConfig` type to networking/v1alpha1 api group, this type
will enable the NodeIPAM controller to support multiple ClusterCIDRs.

* Change ClusterCIDRConfig.NodeSelector type in api

* Fix review comments for API

* Update ClusterCIDRConfig API Spec

Introduce PerNodeHostBits field, remove PerNodeMaskSize
2022-03-30 19:39:00 -07:00
Kubernetes Prow Robot
c0e7b15c75
Merge pull request #109112 from dims/prune-junit-xml-files
Prune junit xml files to avoid issues with test grid.
2022-03-30 14:50:08 -07:00
Kubernetes Prow Robot
64c5ed3804
Merge pull request #109084 from dims/add-some-sudo-in-local-up-cluster
Add some sudo in local-up-cluster.sh
2022-03-30 10:58:35 -07:00
Davanum Srinivas
d20df79545
prune junit xml files in ci harness
Over time the size of our junit xml has exploded to the point where
test-grid fails to process them. We still have the original/full
*.stdout files from where the junit xml files are generated from so the
junit xml files need NOT have the fill/exact output for
processing/display. So let us prune the large messages with an
indicator that we have "[... clipped...]" some of the content so folks
can see that they have to consult the full *.stdout files.

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-30 12:58:43 -04:00
Davanum Srinivas
89b1accf4d
switch owner for CERT_DIR
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-29 20:04:33 -04:00
Davanum Srinivas
f7ad09c447
Switch to pause 3.7
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-29 15:36:38 -04:00
Davanum Srinivas
43bf01e080
bash verbose around admin-kube-aggregator.kubeconfig
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-28 18:08:16 -04:00
Davanum Srinivas
5b1086b897
Add some sudo in local-up-cluster.sh
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-28 16:57:05 -04:00
Davanum Srinivas
b1fa9e2deb
Turn down log level for etcd
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-03-27 15:21:28 -04:00
Kevin Delgado
fe3772890f add server-side validation support to kubectl 2022-03-26 03:45:13 +00:00
Kubernetes Prow Robot
d60df5ba04
Merge pull request #108159 from pohly/logcheck
logcheck update and golangci-lint integration
2022-03-24 18:37:50 -07:00
Alex Zielenski
11b3a18cca
Update kube-openapi (#108895)
* upgrade k8s.io/kube-openapi

* fix open-api v3 blank aggregator output

* use keys as API group

in ./hack/update-openapi-spec.sh

* fix import grouping

* update openapiv3 integration tests
2022-03-24 14:01:01 -07:00
Katrina Verey
44e63e8ff8
kubectl version should include bundled kustomize version 2022-03-24 13:31:57 -04:00