Commit Graph

9532 Commits

Author SHA1 Message Date
Tim Hockin
b201c08cea
Simplify find in codegen
The `find` tool has hard to comprehend syntax and does not consider
things excluded by .gitignore.  I keep tripping over this in my own
repos, where I have __stuff which gets found.

This converts update-codegen to use `git ls-files` in a seemingly
equivalent way (`-cmo --exclude-standard`).  I verified it finds the
same set of files as before.

This also drops some obsolete filtering.

Also hide grep errors for not-found files, which can happen if a file is
removed but git ls-files still knows it.

Re-running update-codegen shows no diffs.

This will make subsequent changes easier.
2023-01-21 11:22:39 -08:00
Tim Hockin
04c80d0a23
Simplify verify-codegen to use worktrees 2023-01-21 11:16:15 -08:00
Tim Hockin
7c262b901f
Set GOCACHE and GOMODCACHE
If these are not set, set them.  This ensures that any subsequent
scripts we call (which may call setup_env again) use the same values.
2023-01-21 11:16:14 -08:00
Tim Hockin
965d5d8608
Make boilerplate.py smarter about generated
Don't just grep for DO NOT EDIT - anchor it in something that looks like
a comment and alone on a line.

Also ignore __* dirs

Prevent it from triggering on update-generated-swagger-docs (hack, but
better than before)
2023-01-21 11:16:13 -08:00
Kubernetes Prow Robot
6b55f097bb
Merge pull request #114976 from kidddddddddddddddddddddd/python3
use python3 in hack
2023-01-19 07:24:47 -08:00
Tim Hockin
01e1da77e2
Fix kubelet-plugin-registration to add missing dir
include v1

This is far too manual for my tastes, which will be fixed subsequently.
2023-01-18 23:38:20 -08:00
Tim Hockin
4e48506245
Fix generated-pod-resources to add missing dir
include v1alpha1

This is too manual - will be fixed subsequently
2023-01-18 23:38:18 -08:00
Kubernetes Prow Robot
035271d89b
Merge pull request #115017 from mhmxs/conf-tmp-dir
Make tmp dir configurable and dynamic at local-up-cluster.sh
2023-01-18 19:02:45 -08:00
Richard Kovacs
17422ff5c1
Use proper tmp directory for update-openapi-spec.sh (#115106)
* Use proper tmp directory for update-openapi-spec.sh

* Use proper mktmp command in update-openapi-specs.sh
2023-01-18 16:06:33 -08:00
Richard Kovacs
bef16e817b Fix lint errors at local-up-cluster.sh 2023-01-18 12:20:33 +01:00
Richard Kovacs
89539e80dc Fix lint errors at local-up-cluster.sh 2023-01-18 11:15:38 +01:00
Richard Kovacs
be4b3c5abd Use proper mktmp command in local-up-cluster.sh 2023-01-18 10:58:41 +01:00
Jordan Liggitt
121088cb2a
bump honnef.co/go/tools to support go1.20 2023-01-17 10:42:55 -05:00
Kubernetes Prow Robot
3613ed04b6
Merge pull request #115079 from dims/update-to-newer-moby/ipvs-v1.1.0
Update to new release of moby/ipvs
2023-01-15 13:30:49 -08:00
Davanum Srinivas
d9b98bc36a
Update to new release of moby/ipvs
hack/pin-dependency.sh github.com/moby/ipvs v1.1.0

- go to a fixed tag for `vishvananda/netns`
- no more references to `pkg/errors`

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-01-14 16:13:24 -05:00
Alexander Zielenski
63f109e149 use --null instead of -Z in grep invocation
BSD grep has a different behavior from GNU grep with -Z.

--null has consistent behavior accross both implementations
2023-01-13 15:31:05 -08:00
Richard Kovacs
63982fc1fd Display generated config file locations on successful local-up-cluster.sh execution 2023-01-12 18:06:14 +01:00
Richard Kovacs
457537a211 Make tmp dir configurable and dynamic at local-up-cluster.sh 2023-01-12 14:57:38 +01:00
kidddddddddddddddddddddd
cb6a1886c0 use python3 in hack 2023-01-12 11:20:41 +08:00
David Porter
a0916996df Update hack/unwanted-dependencies.json
* Drop nvml since it is no longer used

Signed-off-by: David Porter <david@porter.me>
2023-01-11 16:07:29 -08:00
Olivier Lemasle
8b8e20fcdb Bump kube-openapi 2023-01-11 11:48:07 +01:00
Kubernetes Prow Robot
ef2ef15476
Merge pull request #114952 from liggitt/verify-vendor-tidy
Improve vendor verification works for each staging repo
2023-01-10 08:55:26 -08:00
Jordan Liggitt
94ae3cbc41
Improve vendor verification works for each staging repo 2023-01-10 09:30:47 -05:00
Kubernetes Prow Robot
d8b553cce8
Merge pull request #114769 from pohly/e2e-owners-pohly
test/OWNERS: add pohly as approver
2023-01-09 15:11:27 -08:00
Patrick Ohly
c6da602168 OWNERS: remove sig-testing-approvers
It's not used enough to add any real value. Instead, it obscures the real
ownership when someone looks at an OWNERS file where it is used.
2023-01-09 09:54:10 +01:00
Paco Xu
26ddc948e1 add archived dependencies into unwanted-dependencies.json 2023-01-09 16:14:39 +08:00
Kubernetes Prow Robot
d19f8f3162
Merge pull request #114858 from acpana/acpana/fix-verify-licenses
fix path for not approved licenses
2023-01-05 23:15:58 -08:00
Alex Pana
124fd62ad2
fix path for not approved licenses
Signed-off-by: Alex Pana <8968914+acpana@users.noreply.github.com>
2023-01-05 20:19:33 +00:00
Jordan Liggitt
b774c1fb1b
Fix verify-license cleanup 2023-01-05 09:40:52 -05:00
Jordan Liggitt
cafc791aab
Fix verify-licenses script 2023-01-04 15:45:41 -05:00
Stephen Kitt
f146b4287f
Licensing: skip modules with fewer subdirs than mods
This came up when updating go-oidc. After updating go-oidc (with its
dependency tree), cloud.google.com/go was no longer used as a package
import, but still listed in the module dependency graph; as a result,
"go mod vendor" no longer pulled in cloud.google.com/go itself, but
update-vendor-licenses.sh still wanted a license file for it since it
appeared in the list of modules.

This scenario is already supposed to be handled: when a module doesn't
contain any *files* as first-level content, if the number of
subdirectories it contains *equals* the number of submodules it
contains (excluding itself), the module is skipped. This fails for
cloud.google.com/go because several submodules are included in the
module dependency graph but aren't actually used, and therefore not
vendored.

Updating the test to check that the number of subdirectories is less
than or equal to the number of expected submodules fixes this.

The correct fix would be to process the submodules first, keeping a
note of which ones really have content, then check that the top-level
module only contains subdirectories corresponding to those modules;
but it's not clear to me that this is worth the effort (especially in
a shell script).

Signed-off-by: Stephen Kitt <skitt@redhat.com>
2023-01-03 16:48:35 +01:00
Kubernetes Prow Robot
7eb9a75bf9
Merge pull request #114710 from thockin/document_group-version-to-pkg-path
simplify group-version-to-pkg-path()
2022-12-27 13:41:28 -08:00
Kubernetes Prow Robot
24490fdd65
Merge pull request #114704 from thockin/codegen_safer_xargs
codegen: safer use of 'sort' and 'xargs'
2022-12-27 10:45:28 -08:00
Tim Hockin
77e41786a2
simplify group-version-to-pkg-path() 2022-12-27 10:34:44 -08:00
Kubernetes Prow Robot
e54e97294f
Merge pull request #114708 from thockin/verify_swagger_git_subtree
Make verify-generated-swagger-docs use worktree
2022-12-27 05:57:38 -08:00
Kubernetes Prow Robot
33e284fcd8
Merge pull request #114707 from thockin/verify_yamlfmt_git_subtree
Make verify-yamlfmt.sh use git worktree
2022-12-27 05:57:27 -08:00
Kubernetes Prow Robot
5e969c3568
Merge pull request #114706 from thockin/verify_mocks_git_subtree
Make verify-mocks.sh use git worktree
2022-12-26 22:01:27 -08:00
Tim Hockin
b5c5913db0
Make verify-generated-swagger-docs use worktree
Also move a function into these files that was only used in the one
place.
2022-12-26 17:17:33 -08:00
Tim Hockin
90e290e495
Make verify-yamlfmt.sh use git worktree 2022-12-26 17:14:58 -08:00
Tim Hockin
ff7ba89b1c
Make verify-mocks.sh use git worktree 2022-12-26 17:14:14 -08:00
Tim Hockin
db1f27896f
make update: Use a shell array instead of string 2022-12-26 16:24:16 -08:00
Tim Hockin
709dadb899
codegen: safer use of 'sort' and 'xargs'
`LC_ALL=C` is consistent regardless of locale

`xargs -0` is safe when filenames may have spaces
2022-12-26 16:08:59 -08:00
Patrick Ohly
1c66b708ec ginkgo-e2e.sh: remove deprecated --slow-spec-threshold
From the warning message that ginkgo now emits:

  --slow-spec-threshold is deprecated --slow-spec-threshold has been deprecated
  and will be removed in a future version of Ginkgo.  This feature has proved
  to be more noisy than useful.  You can use --poll-progress-after, instead, to
  get more actionable feedback about potentially slow specs and understand
  where they might be getting stuck.

We already use --poll-progress-after.
2022-12-21 07:55:07 +01:00
Patrick Ohly
6db4b741dd e2e: dump full report information
The Ginkgo CLI output no longer has the full output. We need the reports
generated by Ginkgo for that.
2022-12-21 07:55:07 +01:00
Patrick Ohly
460f796bb7 e2e: fix ginkgo parameter setup
This is a fix for 104aab81a4: because
the default was not set for E2E_TEST_DEBUG_TOOL, all parameters were always
also passed to the E2E suite.

That wasn't wrong for the parameters so far, but breaks when using something
like --output-dir which is only understood by the CLI.
2022-12-20 07:56:27 +01:00
Patrick Ohly
b39e56b475 e2e: fix ginkgo-e2e.sh with no arguments
If the script was called with no arguments, it passed "${@:-}" to the suite,
which expands to one empty argument. That's not right, "${@}" should be used
instead because it expands to nothing when empty.
2022-12-20 07:56:27 +01:00
Kubernetes Prow Robot
c6b75dac5b
Merge pull request #114204 from pacoxu/order-unwanted-deps
add github.com/mindprince/gonvml to unwanted dependencies
2022-12-12 11:43:56 -08:00
Kubernetes Prow Robot
92ec97149c
Merge pull request #114408 from liggitt/gorilla
Mark github.com/gorilla dependencies to avoid increasing use
2022-12-11 09:07:25 -08:00
Jordan Liggitt
cdebf3a64c
Mark github.com/gorilla dependencies to avoid increasing use 2022-12-10 23:54:13 -05:00
Patrick Ohly
df5d84ae81 e2e: accept context from Ginkgo
Every ginkgo callback should return immediately when a timeout occurs or the
test run manually gets aborted with CTRL-C. To do that, they must take a ctx
parameter and pass it through to all code which might block.

This is a first automated step towards that: the additional parameter got added
with

    sed -i 's/\(framework.ConformanceIt\|ginkgo.It\)\(.*\)func() {$/\1\2func(ctx context.Context) {/' \
        $(git grep -l -e framework.ConformanceIt -e ginkgo.It )
    $GOPATH/bin/goimports -w $(git status | grep modified: | sed -e 's/.* //')

log_test.go was left unchanged.
2022-12-10 19:50:18 +01:00