Commit Graph

887 Commits

Author SHA1 Message Date
Kubernetes Prow Robot
816e67ab9d
Merge pull request #97456 from claudiubelu/remove-busybox-helper
test images: Remove busybox-helper image
2021-01-28 08:21:34 -08:00
Claudiu Belu
bdaf849c0f test images: Remove busybox-helper image
We cannot have any RUN commands in the Windows stage when using docker buildx,
which is why we were using the busybox-helper image. The purpose of the image
was to contain a few things that we would obtain by running a few commands:

- symlinks for the busybox binary
- run vcredist_x64.exe which would also give us the vcruntime140.dll which is
  necessary for dig or httpd.

There are alternatives to the commands above that can be achieved in a Linux stage
as well:

- we can create the symlinks in a Linux stage with ln -s. Copying them over to
Windows will allow them to work just as well as if they were being copied over
from a Windows image. The 'Files\' prefix issue to the symlink target still persists.
- we can download the vcruntime140.dll directly, allowing us to skip the vcredist_x64.exe
  installation.
2021-01-27 04:22:38 -08:00
Carlos Panato
e76fc62258
[go1.15] Update to go1.15.7
Signed-off-by: Carlos Panato <ctadeu@gmail.com>
2021-01-27 11:43:01 +01:00
Kubernetes Prow Robot
fb276ce201
Merge pull request #98318 from dims/adding-dims-to-test/images-owners
Adding dims to test/images OWNERS file
2021-01-23 18:06:53 -08:00
Kubernetes Prow Robot
676079605d
Merge pull request #97789 from pacoxu/fix/gce-depre-version
metadata concealment: remove the legacy endpoints from the check
2021-01-23 10:41:39 -08:00
Kubernetes Prow Robot
ecb3a682b8
Merge pull request #98313 from claudiubelu/test-images/fixes-apparmor-loader
test images: Fixes apparmor-loader image
2021-01-23 01:51:39 -08:00
Davanum Srinivas
d9fdc68bae
Adding dims to test/images OWNERS file
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2021-01-22 13:17:54 -05:00
Claudiu Belu
cbeab55eb6
test images: Adds --progress=plain to docker buildx build
The default value for the progress is ``auto``, which will eat the output of RUN commands. This makes it a bit hard to debug when issues occur. Changing that option to ``plain`` will ensure that the output is properly kept.
2021-01-22 17:34:15 +02:00
Claudiu Belu
f56d832943 test images: Fixes apparmor-loader image
Currently, the image is not working properly because of the apparmor_parser giving this error:

Error relocating /sbin/apparmor_parser: secure_getenv: symbol not found

Updating musl to 1.1.20 or newer will fix this problem.
2021-01-22 15:25:47 +00:00
Kubernetes Prow Robot
88c652c154
Merge pull request #98227 from claudiubelu/test-images/metadata-concealment-fix
test images: Fixes metadata-concealment image building
2021-01-21 18:47:26 -08:00
Claudiu Belu
ab3bd32d22 test images: Fixes metadata-concealment image building
The metadata-concealment image does not have any BASEIMAGE file, which means
that the image will be built from scratch. In this case, there are a few
fixes that need to be made in the image-build.sh script.
2021-01-21 20:47:55 +00:00
Kubernetes Prow Robot
044bcb5f06
Merge pull request #98226 from claudiubelu/test-images/peer-finder-fix
test images: Prepend linux/ to peer-finder BASEIMAGEs
2021-01-21 12:01:11 -08:00
Kubernetes Prow Robot
6a161bf6d3
Merge pull request #98189 from claudiubelu/test-images/echoserver-windows
test images: Fixes echoserver image for Windows
2021-01-21 04:39:01 -08:00
pacoxu
5d6c41cfc9 metadata concealment: remove the legacy endpoints from the check, bump the image version
Signed-off-by: pacoxu <paco.xu@daocloud.io>
2021-01-21 07:58:45 +08:00
Claudiu Belu
483ed6a783 test images: Fixes echoserver image for Windows
The Windows echoserver image no longer relies on a helper image.
2021-01-20 14:48:07 +00:00
Claudiu Belu
8d565064ab test images: Prepend linux/ to peer-finder BASEIMAGEs
The BASEIMAGE entries should be formated as: OS/ARCH=image. The peer-finder
image BASEIMAGE file does not respect that format.
2021-01-20 13:43:19 +00:00
Kubernetes Prow Robot
7f87f5174a
Merge pull request #98190 from claudiubelu/test-images/trigger-jobs
test images: Minor changes to trigger postsubmit image building jobs
2021-01-19 20:35:58 -08:00
Ernest Wong
9af74a6be9
test images: bump BASEIMAGE of kitten and nautilus to agnhost 2.26
Signed-off-by: Ernest Wong <chuwon@microsoft.com>
2021-01-19 13:24:50 -05:00
Claudiu Belu
180b9527bd test images: Small changes to trigger image postsubmit jobs 2021-01-14 09:05:57 -08:00
Adelina Tuvenie
577b335d65
Update Dockerfile_windows
Change Dockerfile Copyright year. Reason: retrigger image build job.
2021-01-14 17:04:02 +02:00
Antonio Ojea
6176597b0d update agnhost readme 2021-01-14 09:58:14 +01:00
Claudiu Belu
38dea811cb test images: Minor changes to trigger postsubmit image building jobs
Some of these images didn't have any job run for them. Some of these
images previously failed due to an issue that has been addressed since.

Making a change into their image directory will spawn a postsubmit job
that will build that image.
2021-01-13 21:44:55 -08:00
Claudiu Belu
77ca485321
test images: Print docker version and docker buildx version
For debugging purposes, it should be useful to run ``docker version`` and ``docker buildx version`` in order to more easily check and verify issues encountered with the Image Builder.
2021-01-12 19:35:56 +02:00
Kubernetes Prow Robot
f1941c9c6d
Merge pull request #97046 from claudiubelu/test-images-2004
test images: Adds BASEIMAGE for windows/amd64/2004 and windows/amd64/20H2
2021-01-11 11:18:25 -08:00
Kubernetes Prow Robot
be839a4365
Merge pull request #97177 from pacoxu/cleanup/docker-20.10
cleanup: legacy 'ENV name value' syntax deprecated(Docker 20.10)
2021-01-08 20:01:04 -08:00
Kubernetes Prow Robot
781eb03b89
Merge pull request #96792 from aojea/promotev6image
e2e test regression image multiarch
2021-01-08 15:39:05 -08:00
Kubernetes Prow Robot
c6b3e72e0e
Merge pull request #97421 from claudiubelu/test-images-20h2
test images: Adds 20H2 to the windows_os_versions
2020-12-22 07:52:41 -08:00
Kubernetes Prow Robot
b10d82b93b
Merge pull request #97422 from claudiubelu/sample-apiserver-tty
test images: Allows sample-apiserver to be built without a TTY
2020-12-21 14:00:25 -08:00
Kubernetes Prow Robot
7da7d2084c
Merge pull request #96918 from aojea/agnhostbump
bump agnhost base image
2020-12-17 13:54:24 -08:00
Claudiu Belu
64934518fd test images: Allows sample-apiserver to be built without a TTY
Currently, the image's postsubmit job fails because of the docker run -t
in the image's Makefile. We don't need it in order to build the image.

Logs: https://prow.k8s.io/view/gcs/kubernetes-jenkins/logs/post-kubernetes-push-e2e-sample-apiserver-test-images/1331076845436669952
2020-12-17 13:02:19 -08:00
Claudiu Belu
31101408d3 test images: Adds 20H2 to the windows_os_versions
We are planing to test and support 20H2 release of Windows, thus,
we need to build test images for it as well. The busybox image already
has a BASEIMAGE entry for it, but we also need to add it to the image-util.sh's
windows_os_versions, so the OS Version can be properly included in the
manifest list.
2020-12-17 12:43:22 -08:00
Claudiu Belu
479f37e5e9 test images: Adds 20H2 to the windows_os_versions
We are planing to test and support 20H2 release of Windows, thus,
we need to build test images for it as well. The busybox image already
has a BASEIMAGE entry for it, but we also need to add it to the image-util.sh's
windows_os_versions, so the OS Version can be properly included in the
manifest list.
2020-12-17 19:03:01 +00:00
Claudiu Belu
6816b2e7e9 test images: Adds dockerhub images for mirroring
Dockerhub will introduce rate limiting in November, and a lot of E2E tests
are relying on the busybox image. It could potentially become an issue
causing jobs to fail because of this.

Ideally, we'd have the busybox image mirrored on gcr.io, but that could take
some time. Until then, we can just have the Image Builder mirror the image
for us in the staging registry and use that for tests until this issue is
solved. The busybox image should NOT be promoted out of staging.

During the sig-testing meeting, it was decided that we should do the same
for the other images are hosted on dockerhub.

Two different versions of httpd and nginx have to be built, and thus, the have
different folders. An ALIAS file was added to httpd-new and nginx-new in order
to keep the same image name.
2020-12-17 19:02:26 +00:00
Kubernetes Prow Robot
b9ce4ac212
Merge pull request #97346 from linux-on-ibm-z/issue-97318
Bump agnhost and nonewprivs versions
2020-12-16 19:19:08 -08:00
Rajas Kakodkar
902f4a9038 bump agnhost VERSION
Signed-off-by: Rajas Kakodkar <rajas.kakodkar@ibm.com>
2020-12-16 17:48:28 +00:00
Rajas Kakodkar
794080c8da bump VERSION
Signed-off-by: Rajas Kakodkar <rajas.kakodkar@ibm.com>
2020-12-16 07:36:31 +00:00
Rajas Kakodkar
7a82831255 bump VERSION
Signed-off-by: Rajas Kakodkar <rajas.kakodkar@ibm.com>
2020-12-16 07:35:59 +00:00
Claudiu Belu
f78aa177fa test images: Adds windows/amd64/20H2 BASEIMAGE 2020-12-15 16:35:01 +00:00
Kubernetes Prow Robot
84ba901b60
Merge pull request #97247 from claudiubelu/test-images/20h2-windows
test images: Adds 20H2 image to windows-servercore-cache
2020-12-14 14:02:10 -08:00
Claudiu Belu
5fd669db51 test images: Adds Windows 2004 and 20H2 base images for busybox
busybox is being used as a base image for a few other images, like
agnhost, so we need to update this image first.
2020-12-13 08:22:14 -08:00
Kubernetes Prow Robot
eecbdea3d6
Merge pull request #96462 from claudiubelu/test-images-multiarch
test images: Adds -p yes when calling register.sh
2020-12-11 15:01:27 -08:00
Claudiu Belu
77e0c55acd test images: Adds 20H2 image to windows-servercore-cache
The 20H2 image was released in the second half of the year, and
we are going to need images for testing the release.

The image tag can be found here:
https://hub.docker.com/_/microsoft-windows-servercore
2020-12-11 03:22:55 -08:00
Kubernetes Prow Robot
ee8983705a
Merge pull request #96679 from stmcginnis/appspot-cleanup
Remove stale analytics links from docs
2020-12-10 23:17:22 -08:00
pacoxu
75a2cc2cfd fix legacy 'ENV name value' syntax
Signed-off-by: pacoxu <paco.xu@daocloud.io>
2020-12-10 10:38:10 +08:00
Antonio Ojea
5e712b85a1 bump agnhost base image 2020-12-04 10:01:24 +01:00
Claudiu Belu
e2ca45ca0a test images: Adds windows/amd64/2004 BASEIMAGE 2020-12-03 15:31:09 +00:00
Claudiu Belu
b95891b1f0 test images: sets DOCKER_CLI_EXPERIMENTAL="enabled" globally 2020-12-01 15:10:39 +00:00
Claudiu Belu
ef530c12d6 test images: Adds -p yes when calling register.sh
Before creating and bootstrapping a docker buildx instance, we need to call
register.sh with the -p yes flag. Without this, the docker buildx will only
support linux/amd64 and linux/386 platforms, meaning that it will fail when
trying to build images for other architecture types.

Additionally, the builder has to have qemu and its qemu-* binaries installed
in order to properly build the images. The recently created image
gcr.io/k8s-testimages/gcb-docker-gcloud:v20201130-750d12f has those requirements met.
2020-12-01 15:10:39 +00:00
Stephen Augustus
2407a70cc7 [go1.15] Update to go1.15.5
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-11-23 20:49:56 -05:00
Antonio Ojea
782da4414a e2e test regression image multiarch
Signed-off-by: Antonio Ojea <aojea@redhat.com>
2020-11-22 10:46:38 +01:00
Sean McGinnis
be131457ef
Remove stale analytics links from docs
Many README files and other docs contained a link to a an appspot
tracking app that is no longer active. Following the links leads to an
error about Go 1.9 no longer being supported. Go 1.9 support was dropped
in appspot in 2019 and disabled June 2020.

This also resulted in a broken image link displaying when viewing these
files on GitHub. Since the app is no longer functioning, and since it
causes a potentially (but granted, minor) confusing error to display,
this just removes those links as I don't believe they are needed
anymore.

Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-11-18 07:04:48 -06:00
Kubernetes Prow Robot
58f82efe70
Merge pull request #95032 from claudiubelu/test-images/multiarch
test images: Removes -p yes flag from qemu-user-static script call
2020-11-06 12:24:29 -08:00
Claudiu Belu
5152919611 test images: Authenticate in order to push images
We cannot push images without being authenticated.
2020-11-04 23:22:30 -08:00
Claudiu Belu
54d0c1e1d2 test images: Removes -p yes flag from qemu-user-static script call
Currently, the Image Builder job is failing as it cannot build images
for other architecture types. This happens because the Image Builder image
does not have any of the expected qemu-* binaries in /usr/bin/ needed in order to
run qemu-binfmt-conf.sh with the -p yes flag, so that flag is removed.
2020-11-04 23:01:24 +00:00
Claudiu Belu
5de5ae6bd3 test images: sets HOME=/root in cloudbuild.yaml
The default cloudbuild has HOME=/builder/home and docker buildx is in /root/.docker/cli-plugins/docker-buildx

We need to set the Home to /root explicitly since we're using docker buildx
2020-11-03 22:19:18 -08:00
Claudiu Belu
cf838ca180 test images: set DOCKER_CLI_EXPERIMENTAL=enabled
docker buildx requires DOCKER_CLI_EXPERIMENTAL=enabled to be set
in order to be used.

This environment variable is not getting plumbed through from the
test/images/cloudbuild.yaml file, causing the docker buildx commands
to fail.
2020-11-04 14:23:44 +00:00
Kubernetes Prow Robot
17376e6aef
Merge pull request #92850 from tallclair/netexec
Enhance agnhost netexec for SSRF E2Es
2020-11-02 18:10:14 -08:00
Kubernetes Prow Robot
0dbfe2633e
Merge pull request #95781 from ii/porter-add-verbose-flag
Add verbose flag to porter so http method can be returned to client
2020-11-02 13:41:33 -08:00
Tim Allclair
c05a350b4f Update usage information for --http-override 2020-11-02 13:30:55 -08:00
Tim Allclair
354cb6ca91 Bump agnhost version 2020-11-02 13:30:55 -08:00
Tim Allclair
700006f2d9 Add override option to netexec 2020-11-02 13:30:22 -08:00
Tim Allclair
9156360234 Add a redirect handler to netexec 2020-11-02 13:30:22 -08:00
Tim Allclair
a15f5ea836 Add optional code to netexec echo endpoint 2020-11-02 13:30:22 -08:00
Stephen Heywood
f005b3a5f7 Add json-response flag to porter
Provides a response that includes a body and a method. This response
will enable a client (e2e test) to confirm that a proxy did not alter
the http method.
2020-10-30 14:48:16 +13:00
Kubernetes Prow Robot
0ec6602679
Merge pull request #77398 from claudiubelu/test-images/windows-support-part-2
test images: Adds Windows Container images support (part 2)
2020-10-26 06:19:02 -07:00
Kubernetes Prow Robot
82cc713b13
Merge pull request #95328 from aojea/conntrack_invalid
add ipv6 support to the image issue-74839
2020-10-22 22:16:16 -07:00
Rajas Kakodkar
0269e2d042 bump qemu version
Signed-off-by: Rajas Kakodkar <rajas.kakodkar@ibm.com>
2020-10-22 16:34:53 +00:00
Claudiu Belu
4dbb55fe85 test images: Adds Windows support (part 2)
Adds Windows support for most of the images.

Adds a README explaining the image building process, including the
Windows Container image building process.
2020-10-19 16:54:28 +00:00
Claudiu Belu
0d24b05434 test images: Switches to buildx
Currently, some of the E2E test images have Windows support, and one of the goals is for most of
them to have Windows support. For that, the Image Builder is currently building those Windows
container images using a few Windows Server nodes (for 1809, 1903, 1909) with Remote Docker
enabled which are hosted on an azure subscription dedicated for CNCF.

With this, the Windows nodes dependency is removed entirely, as the images can be also built with
docker buildx. One additional benefit to this is that adding new supported Windows OS versions
to the E2E test images manifest lists becomes a lot easier (we wouldn't have to create a new Windows
Server node that matches that new OS version, assign DNS name, update certificates, etc.), and it
also becomes easier for other people to build their own E2E windows test images.

However, some dependencies are still required to run on a Windows machine. To solve this, we can
just pull helper images: e2eteam/powershell-helper:6.2.7 and e2eteam/busybox-helper:1.29.0. Their
Dockerfiles and a Makefile for them has been included in this commit. If any change is required to
them, then a new image will be built and tagged under a different version, but they are pretty
straight-forward and shouldn't require changes.

However, there is a small concern when it comes to the build time: Windows servercore images are
very large (for example, mcr.microsoft.com/windows/servercore:ltsc2019 is 4.99GB uncompressed, and
about ~2 GB compressed - those images are already cached on the Windows Server builder nodes, so
this isn't an issue there), and we currently support 1809, 1903, and 1909 (soon to add 2004).
This can lead to build times that are too big.

We have changed the base image to nanoserver (uncompressed size: 250MB), but some images still
require some DLLs or some other dependencies that can be fetched from a servercore image.

A separate job has been defined that would build a scratch windows-servercore-cache image monthly,
and then we can just get those dependencies from this cache, which will be very small.
This would be preferred, as the Windows images update periodically, and those dependencies
could be updated as well.
2020-10-16 10:42:49 +00:00
Antonio Ojea
a0887285f5 add ipv6 support to the image issue-74839
Co-authored-by: Dan Winship <danwinship@redhat.com>
2020-10-07 18:30:47 +02:00
Kubernetes Prow Robot
3a7d7101c5
Merge pull request #94876 from linux-on-ibm-z/nonewprivs-s390x
Add s390x support for nonewprivs
2020-09-25 01:37:11 -07:00
Valerii Ponomarov
c55b6cdbb4 agnhost image: use actual DNS domain instead of hardcoded cluster.local
'agnhost' image uses hardcoded 'cluster.local' value for DNS domain.
It leads to failure of a bunch of HPA tests when test cluster is
configured to use custom DNS domain and there is no alias for
default 'cluster.local' one.
So, fix it by reusing it's own function for reading DNS domain suffixes.

Signed-off-by: Valerii Ponomarov <kiparis.kh@gmail.com>
2020-09-24 14:24:16 +03:00
Claudiu Belu
46c820e793 test images: uses nanoserver
Using Windows nanoserver container images as a base instead of the current
Windows servercore image will reduce the image size by about ~10x.

However, the nanoserver image lacks several things we need:
- netapi32.dll
- powershell
- certain powershell commands
- chocolatey cannot be used

When building the nanoserver images, we are going to use a Windows servercore helper,
in which we are going to install the necessary dependencies, and then copy them over
to our nanoserver image, including necessary DLLs.

Other notable changes include:
- switch from wget to curl (wget was a powershell alias).
- implement in code getting the DNS suffix list and DNS server list.
- reimplement getting file permissions for mounttest.
2020-09-21 04:53:44 -07:00
Kubernetes Prow Robot
73b4f09dce
Merge pull request #94777 from claudiubelu/test-images/echoserver-fix
test images: Fixes echoserver s390x image
2020-09-17 08:12:45 -07:00
Rajas Kakodkar
7566da7f81 Add support for s390x
Signed-off-by: Rajas Kakodkar <rajas.kakodkar@ibm.com>
2020-09-17 02:50:20 -07:00
Claudiu Belu
d663b07f7d test images: Fixes echoserver s390x image
When trying to build the s390x image, it would fail when running the apk
command with the following error:

ERROR: Unable to open root: Bad address
ERROR: Failed to open apk database: Bad address

This can be fixed by updating the third_party/multiarch/qemu-user-static/register/register.sh
and third_party/multiarch/qemu-user-static/register/qemu-binfmt-conf.sh scripts
and their usage to a newer version [1].

Additionally, the packages nginx-mod-http-lua and nginx-mod-http-lua-upstream
cannot be found in the regular http://dl-cdn.alpinelinux.org/alpine/v3.9/main/s390x/
repository, but we can use an older one [2].

[1] https://github.com/qemu/qemu/blob/master/scripts/qemu-binfmt-conf.sh
[2] http://dl-cdn.alpinelinux.org/alpine/v3.8/main
2020-09-17 09:34:40 +00:00
Kubernetes Prow Robot
aed5ffd195
Merge pull request #94449 from justaugustus/go115
[go1.15] Update to go1.15.2
2020-09-15 15:15:19 -07:00
Stephen Augustus
fc673df1e4 test/{images,utils/image}: Add justaugustus as reviewer
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-09-14 09:11:50 -04:00
Stephen Augustus
a4a98f440c [go1.15] Update to go1.15.2
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-09-11 13:15:12 -07:00
Kubernetes Prow Robot
5832c44dbf
Merge pull request #92988 from nikhita/cleanup-owners-test-images
test/images/pets: remove OWNERS to cleanup inactive members
2020-08-27 19:08:43 -07:00
Benjamin Elder
3e2cb2922b synchronize agnhost image / app version 2020-08-20 17:00:41 -07:00
Benjamin Elder
9d7a94263a track agnhost version in dependencies.yaml 2020-08-20 17:00:41 -07:00
Stephen Augustus
aa2bb18a2b [go1.15] Update to go1.15
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-08-12 14:19:59 -04:00
Stephen Augustus
ffcef48b83 [go1.15] Update to go1.15rc2
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-08-09 02:53:53 -04:00
Kubernetes Prow Robot
aec30be5b3
Merge pull request #93433 from dcbw/netexec-errors
agnhost/netexec: logging cleanup and print more verbose errors
2020-07-28 21:04:01 -07:00
Stephen Augustus
479249b3a3 [go1.15] dependencies.yaml: Update to go1.15rc1
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-07-25 16:45:02 -04:00
Dan Williams
31c563a46f agnhost/netexec: logging cleanup and print more verbose errors
There's currently no way to know whether an error is for SCTP or
UDP, for example:

Jul 24 09:55:54.469: INFO: netserver-0[e2e-nettest-3476].container[webserver].log
2020/07/24 09:53:52 Started UDP server
2020/07/24 09:53:52 Error occurred. error:protocol not supported

In this case the "Error occurred. error:protocol not supported" is
actually for the SCTP socket. Make that more apparent.
2020-07-24 14:40:58 -05:00
Stephen Augustus
90c223fa5c [VDF] Remove references to us.gcr.io/k8s-artifacts-prod
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-07-22 16:08:30 -04:00
Stephen Augustus
3bbcba9b84 Update Golang to v1.14.6
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-07-17 14:47:21 -04:00
Stephen Augustus
c4b6678757 Update Golang to v1.14.5
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-07-15 00:10:05 -04:00
Nikhita Raghunath
cb2fb92686 test/images/pets: remove OWNERS to cleanup inactive members
bprashanth hasn't be active since the release of v1.11. Removing them
from test/images/pets/OWNERS would leave mkumatag as the sole approver.

But mkumatag is also an approver for test/images/OWNERS so this commit
removes the test/images/pets/OWNERS completely.

Note: we should try to find more OWNERS for test/images/pets instead,
but this cleanup is a short term solution to avoid the bot suggesting
inactive members for reviews and approval.
2020-07-11 19:35:47 +05:30
Jeff Grafton
089a1af421 Move ixdy to emeritus 2020-07-06 10:39:56 -07:00
Kubernetes Prow Robot
efb56da4a5
Merge pull request #92665 from klueska/upstream-add-get-preferred-allocation-api
Add GetPreferredAllocation() call to the v1beta1 device plugin API
2020-07-03 20:31:16 -07:00
Kevin Klues
cbd405d85c Update existing tests in support of GetPreferredallocation() 2020-07-03 13:01:32 +00:00
Kubernetes Prow Robot
f7a13de36c
Merge pull request #92667 from liggitt/admission-warnings
Admission webhook warnings
2020-07-01 23:14:17 -07:00
Kubernetes Prow Robot
94e1c54735
Merge pull request #92655 from BenTheElder/cleanup-some-owners
Cleanup some owners
2020-07-01 23:14:08 -07:00
Jordan Liggitt
5eef60a00a Add warnings capability for admission webhooks 2020-07-01 12:14:06 -04:00
Kubernetes Prow Robot
3d912dd072
Merge pull request #76828 from claudiubelu/images/goarm-var
images: Adds GOARM to images' Makefiles
2020-07-01 07:10:18 -07:00
Kubernetes Prow Robot
9238fb1388
Merge pull request #90062 from claudiubelu/test-images/owner-files
test images: Adds OWNERS files for images
2020-06-28 01:08:14 -07:00
Benjamin Elder
3a531edbd1 rmmh is no longer active 2020-06-26 21:49:24 -07:00
Federico Paolinelli
7ff930b6c8 Bump up the agnhost version to reflect changes in https://github.com/kubernetes/kubernetes/pull/90797
There was an un-noticied conflict with 279ce5d89e (diff-75312865ef706f08787bf2987d761c13)

Signed-off-by: Federico Paolinelli <fpaoline@redhat.com>
2020-06-24 17:37:41 +02:00
Kubernetes Prow Robot
0072d8ae23
Merge pull request #90797 from fedepaol/sctpconnectporter
Add SCTP support to agnhost connect / porter commands.
2020-06-23 07:05:41 -07:00
Stephen Augustus
236ef23f46 deps: Update Golang to v1.14.4
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-06-22 18:46:51 -04:00
Kubernetes Prow Robot
0a91893126
Merge pull request #92119 from BenTheElder/agnhost-sync
agnhost sync
2020-06-20 00:14:39 -07:00
Benjamin Elder
279ce5d89e s/master/primary in agnhost guestbook test references & agnhost code
to do in follow-up: update the agnhost deployments and references to those when the new image is pushed
2020-06-19 12:23:16 -07:00
Federico Paolinelli
b8819b91a8 Add sctp support to agnhost connect / porter commands.
Signed-off-by: Federico Paolinelli <fpaoline@redhat.com>
2020-06-19 09:31:05 +02:00
Kubernetes Prow Robot
19d220073c
Merge pull request #92176 from claudiubelu/test-images/rebases-kitten-nautilus
test images: rebases the kitten and nautilus images
2020-06-16 19:24:31 -07:00
Benjamin Elder
d65a3b15bf update agnhost guestbook usage for s/slave/replica/ 2020-06-15 20:08:27 -07:00
Kubernetes Prow Robot
f66af1062d
Merge pull request #92106 from BenTheElder/bump-image
bump agnhost version to match fully
2020-06-13 00:34:22 -07:00
Kubernetes Prow Robot
0d82da429c
Merge pull request #90167 from claudiubelu/test-images/owner-files-part-3
test images: Adds OWNERS files for images (part 3)
2020-06-12 19:53:56 -07:00
Claudiu Belu
023282f1bd test images: rebases the kitten and nautilus images
The current kitten and nautilus images are depending on agnhost:2.14, which
has not been built, since the Image Promoter was not working at the time.
2020-06-12 16:46:18 -07:00
Benjamin Elder
c57e39f664 bump agnhost version to match fully 2020-06-12 15:44:15 -07:00
Claudiu Belu
30f529c57f test images: Adds --force-yes when installing jessie-dnsutils packages
Currently, the jessie-dnsutils image fails to build for arm64 arch with the following
error:

GPG error: http://archive.debian.org jessie Release: The following signatures were invalid: KEYEXPIRED 1587841717

We can bypass this issue by adding a --force-yes flag when installing the needed dnsutils.
2020-06-12 14:22:28 -07:00
Claudiu Belu
06ca9c8aab test images: Adds OWNERS files for images
Adds reviewers to the OWNERS files in the kubernetes/test/images folder.
The reviewers are added automatically, based on their contributions on
an image (>= 20% code churn).

Note that the code churn is taken into account for authors, and not committers.

Adds OWNERS files for: ipc-utils, node-perf, nonroot, regression-issue-74839,
resource-consumer, sample-device-plugin.
2020-06-12 11:49:16 -07:00
Kubernetes Prow Robot
4ea576e4f5
Merge pull request #87105 from BenTheElder/agnhost-replica
s/slave/replica in guestbook app
2020-06-11 10:48:56 -07:00
Kubernetes Prow Robot
b41b89a424
Merge pull request #91682 from claudiubelu/img-promoter/windows-certs
test images: Adds step for fetching Windows image builder certificates
2020-06-10 04:39:42 -07:00
Claudiu Belu
abe8bea529
Fixes test images cloudbuild.yaml secret fetching
Co-authored-by: Aaron Crickenberger <spiffxp@google.com>
2020-06-09 14:05:33 +03:00
Benjamin Elder
c8dce6d4b3 bump agnhost version 2020-06-08 16:38:09 -07:00
Benjamin Elder
f9851d929b s/slave/replica in guestbook app 2020-06-08 16:37:26 -07:00
Claudiu Belu
46df555ebe test images: Adds step for fetching Windows image builder certificates
The google cloud builder job is launched without the required Windows Image Builder nodes
certificates that are needed for authentication when building the Windows container images.

Adds a step in test/images/cloudbuild.yaml that fetches a secret containing the certificates.
2020-06-02 07:50:45 -07:00
Davanum Srinivas
07d88617e5
Run hack/update-vendor.sh
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-05-16 07:54:33 -04:00
Davanum Srinivas
442a69c3bd
switch over k/k to use klog v2
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-05-16 07:54:27 -04:00
Kubernetes Prow Robot
9188bbbdaa
Merge pull request #90990 from hasheddan/guestbook
Retry resolving TCP address in agnhost/guestbook
2020-05-13 15:59:24 -07:00
Stephen Augustus
b5117ae8b5 base-images: Update to kube-cross:v1.13.9-5
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-05-12 18:14:33 -04:00
hasheddan
921b76ceaa
Move getting IP address into retry loop for agnhost/guestbook
Removes the fatal error from getIP and moves it to
retry loop so that application will not immediately
crash on failure.

Signed-off-by: hasheddan <georgedanielmangum@gmail.com>
2020-05-12 13:55:17 -05:00
hasheddan
9081dfb68d
Improve error messages in agnhost/guestbook
This updates the error messages when registering a
node to be more explicit about what error occurred
and how long it will wait to retry.

Signed-off-by: hasheddan <georgedanielmangum@gmail.com>
2020-05-12 09:58:53 -05:00
hasheddan
0cacc44fc9
Retry resolving TCP address in agnhost/guestbook
Currently the guestbook application will fail if unable
to resolve TCP address on first attempt. If pod networking
is not setup when the application starts then it will be
unable to resolve, leading to frequent failures. This moves
the address resolution into the retry block so it will try
again if unsuccessful on first attempt.

Signed-off-by: hasheddan <georgedanielmangum@gmail.com>
2020-05-11 13:45:28 -05:00
Clayton Coleman
3c9959a5d4
netexec: Allow graceful shutdown testing from netexec
The current /exit method is not sufficient to test graceful shutdown
behaviors within Kube that allow services to remain available during
rolling restarts. Add support for `wait=DURATION` and
`timeout=DURATION` to the exit handler and wire that to the Go http
server's graceful termination.

With these methods netexec can be used in a pod to simulate graceful
shutdown by adding a preStop handler that hits the exit endpoint with
a timeout and wait period.
2020-05-07 09:18:27 -04:00
Jason Simmons
d0f19815d2 Updates agnhost image VERSION and README 2020-04-21 09:43:58 -04:00
Jason Simmons
c56d8df5e3 Adds HTTPS logic to agnhost netexec
The agnhost image used for testing has a `netexec` path which supports
two new flags, `--tls-cert-file` and `--tls-private-key-file`. If the
former is provided, the HTTP server will be upgraded to HTTPS, using the
certificate (and private key) provided.

By default, there are keys already mounted into the container at
`/localhost.crt` and `/localhost.key`, which contain PEM-encoded TLS
certs with IP SANs for `127.0.0.1` and `[::1]`.
2020-04-16 11:42:37 -04:00
Kubernetes Prow Robot
5ccc6e0142
Merge pull request #90166 from claudiubelu/test-images/owner-files-part-2
test images: Adds OWNERS files for images (part 2)
2020-04-15 11:36:42 -07:00
Kubernetes Prow Robot
a06d735829
Merge pull request #89152 from claudiubelu/image-promoter/reenable-windows
Image promoter: Reenable Windows test image building
2020-04-15 11:35:46 -07:00
Claudiu Belu
2321378fe5 test images: Adds OWNERS files for images (part 3)
Adds reviewers to the OWNERS files in the kubernetes/test/images folder.
The reviewers are added automatically, based on their contributions on
an image (>= 20% code churn).

Note that the code churn is taken into account for authors, and not committers.

Adds OWNERS files for: cuda-vector-add, nonewprivs, pets, redis, volume.
2020-04-14 05:26:22 -07:00
Claudiu Belu
2b5fb5366f test images: Adds OWNERS files for images (part 2)
Adds reviewers to the OWNERS files in the kubernetes/test/images folder.
The reviewers are added automatically, based on their contributions on
an image (>= 20% code churn).

Note that the code churn is taken into account for authors, and not committers.

Adds ONWERS files for: apparmor-loader, echoserver, jessie-dnsutils, metadata-concealment,
sample-apiserver.
2020-04-14 05:18:34 -07:00
Claudiu Belu
94ffe582e9 Image promoter: Reenable Windows test image building
The build times are a bit high for the image builder (~50 minutes), and it will a bit more
when Windows support will be added to the other test images. This commit changes the
machineType to N1_HIGHCPU_8.

Reenables Windows test image building. Added DOCKER_CERT_BASE_PATH (default value: $HOME),
which will contain the path where the certificates needed for Remote Docker Connection can
be found.

If a REMOTE_DOCKER_URL was not set for a particular OS version, exclude that image from the
manifest list. This fixes an issue where, if REMOTE_DOCKER_URL was not set for Windows Server 1909,
the Windows were completely excluded from the manifest list, including for Windows Server 1809
and 1903 which could have been built and pushed.

Sets "test-webserver" as the default CMD for kitten and nautilus. Since they are now based on
agnhost, they should be set to run test-webserver to maintain previous behaviour.

Bumps the agnhost version to 2.13, as 2.12 has already been promoted. 2.13 will contain
Windows support.

Adds Windows support for the kitten and nautilus images, so they can promoted together
with agnhost (they were not previously promoted).

Adds OWNERS files to: agnhost, busybox, kitten, nautilus.
2020-04-14 05:12:46 -07:00
Kubernetes Prow Robot
4bdb72ed11
Merge pull request #89113 from claudiubelu/test-images/fixes-and-cleanups
test images: Adds various fixes and cleanups to the image building process
2020-04-08 18:19:44 -07:00
Federico Paolinelli
e31f72e3a4 Bump agnhost version to 2.13, and bump up depending images.
Kitten / nautilus depend on agnhost.

Signed-off-by: Federico Paolinelli <fpaoline@redhat.com>
2020-04-03 13:00:23 -04:00
Kubernetes Prow Robot
2fd8debe9b
Merge pull request #87926 from fedepaol/agnostsctp
Preliminary SCTP connectivity tests
2020-04-02 02:12:24 -07:00
Stephen Augustus
b6179ac7b9 deps: Update to Golang 1.13.9
Signed-off-by: Stephen Augustus <saugustus@vmware.com>
Co-authored-by: Jeff Grafton <jgrafton@google.com>
2020-03-23 17:10:03 -04:00
Claudiu Belu
7389385a20 test images: Adds various fixes and cleanups to the image building process
Adds splitOsArch function to image-util.sh, which makes the script DRY-er.

When building a Windows test image, if REMOTE_DOCKER_URL is not set, skip the rest of the
building process for that image, which will save some time (no need to build binaries).

If a REMOTE_DOCKER_URL was not set for a particular OS version, exclude that image from the
manifest list. This fixes an issue where, if REMOTE_DOCKER_URL was not set for Windows Server 1909,
the Windows were completely excluded from the manifest list, including for Windows Server 1809
and 1903 which could have been built and pushed.

Sets "test-webserver" as the default CMD for kitten and nautilus. Since they are now based on
agnhost, they should be set to run test-webserver to maintain previous behaviour.
2020-03-14 15:18:10 -07:00
Dan Winship
55d3408211 agnhost: add SCTP support to netexec 2020-03-04 23:34:15 +01:00
Claudiu Belu
06062b15e9 test images: ARG instructions should be first
A few other Dockerfiles had the ARG duplicated as well.
2020-02-28 01:31:05 -08:00
Claudiu Belu
ce30d2d5c8 test images: Skip building manifest list if no image was pushed
For Windows-only images, if there is no image built / pushed, you cannot create
a manifest list.
2020-02-27 19:05:47 -08:00
Claudiu Belu
acf84351e4 test images: Rebases nautilus and kitten images
The current agnhost version is 2.12, 2.11 was not previously built as the
VERSION bumps merged one after the other, and the Image Promoter did not get to
build the 2.11 image.
2020-02-27 06:04:01 -08:00
Claudiu Belu
117cbda487 Image Promoter: Allows images to be pushed immediately after being built
In the current version, due to how make works, when building all the conformance
images (make all-push WHAT=all-conformance), ALL the images are being built first
before being pushed.

This PR will allow images to be built and pushed immediately afterwards, so the first
images that have been succesfully built are already pushed and promotable, even if
the the task failed on the last image, or it timed out.
2020-02-27 06:00:03 -08:00
Claudiu Belu
b6b60f7fa5 test images: Temporarely exclude Windows test images
A previous PR (#76838) introduced the ability to build and publish
Windows Test Images to kubernetes/test/images/image-util.sh.

Additionally, that PR also configured the Image Promoter to use a
few Windows Remote Docker build nodes to build the Windows Test Images,
however, there is a minor issue: the build container has a different $HOME
folder than expected (is: /builder/home, expected: /root - since it's the
root user), and the Remote Docker credentials are mounted in /root.

Because of that, image-build.sh cannot find the credentials it needs.
This will have to be properly fixed, but for now, we can just skip
the Windows image building part.
2020-02-26 22:51:26 -08:00
Kubernetes Prow Robot
f692f5cfcd
Merge pull request #88049 from mtaufen/provider-info-agnhost
Update agnhost to test OIDC validation of JWT tokens
2020-03-04 03:43:47 -08:00
Charles Eckman
5ceecd3ba3 Update agnhost to test OIDC validation of JWT tokens
Extends agnhost with the capability to validate a mounted token against
the API server's OIDC endpoints.

Co-authored-by: Michael Taufen <mtaufen@google.com>
2020-03-03 15:27:47 -08:00
Kubernetes Prow Robot
a5048219ee
Merge pull request #76838 from claudiubelu/test-images/windows-support
test images: Adds Windows Container images support (part 1)
2020-03-02 16:15:38 -08:00
ialidzhikov
e26fff5cbc Update to golang@1.13.8
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2020-02-27 09:27:48 +02:00
Stephen Augustus
e64169d6b5 build: Enable kube-cross push/pull from K8s Infra GCR
- Search/replace Google Infra kube-cross locations for K8s Infra
- Update kube-cross make targets
  - Don't attempt to pre-pull image (docker build --pull)
    This prevents CI failures when the image under test doesn't exist
    yet in the registry.
  - 'make all' now builds and pushes the kube-cross image
  - Allow 'TAG' to be specified via env var
  - Use 'KUBE_CROSS_VERSION' to represent the kube-cross version
  - Tag kube-cross images with both a kubernetes version
    ('git describe') and a kube-cross version
- Add a GCB (Google Cloud Build) config file (cloudbuild.yaml)

Signed-off-by: Stephen Augustus <saugustus@vmware.com>
2020-02-26 16:51:01 -05:00
Claudiu Belu
8cb84feef3 test images: Updates agnhost guestbook
A previous PR replaced the usage of Redis in the guestbook app test
with Agnhost. The replacement went well for Linux setups and Containers,
which is why the tests are green, but there is a network particularity on
Windows setups which won't allow the test to pass.

The issue was observed with another test hitting the same issue:
https://github.com/kubernetes/kubernetes/issues/83072

Here's exactly what happens during the test:

- frontend containers are created, having the /guestbook endpoint. Its main
  purpose is to forward the call to either agnhost-master (cmd=set), or
  agnhost-slave (cmd=get).
- agnhost-master container is created, having the /set endpoint, and the
  /register endpoint, through which the agnhost-slave containers would
  register to it. Its purpose is to propagate all data received through /set
  to its clients.
- agnhost-slave containers are created, having the /set and /get endpoints.
  They would register to agnhost-master, and then receive any and all updates
  from it, which was then served through the /get endpoint.

For simplicity, all 3 types have the same agnhost subcommand (agnhost guestbook), being
able to satisfy its given purpose. For this, HTTP servers were being used, including
for the /register endpoints. agnhost-master would send its /set updates as /set HTTP
requests. However, because of the issue listed above, agnhost-master did not receive
the client's IP, but rather the container host's IP, resulting in the request being
sent to the wrong destination.

This PR updates the agnhost guestbook subcommand. Now, the agnhost subscriber nodes will
send their own IP to the /register endpoint (/endpoint?host=myip).
2020-02-25 09:45:43 -08:00
Kubernetes Prow Robot
2e0760c659
Merge pull request #87611 from claudiubelu/test-images/updates-readme
test images: Adds Image Promoter details in the README
2020-02-21 18:30:48 -08:00
Claudiu Belu
91dc590cde test images: Adds building README
Adds a README explaining the image building process, including the
Windows Container image building process.
2020-02-21 02:11:26 -08:00
Claudiu Belu
b71fbdb364 Image Promoter: Adds Windows build nodes for Windows test images
We have added and enabled the Image Promoter on the k/k test images, which
will build the conformance images after a PR that affects kubernetes/test/images
merges.

We have added support for image-util.sh to handle external Windows Docker connections
in order to build Windows images.

This PR enables the Image Promoter to use some Windows nodes to build the necessary
Windows images.
2020-02-21 02:09:49 -08:00
Claudiu Belu
fe15a46939 test images: Use multiple Windows nodes to build images
In order to build Windows container images for multiple OS versions,
--isolation=hyperv is required. However, not all clouds / nodes supports
or have it enabled by default, which is why we're going to rely on
having multiple nodes to build the Windows images, until this issue
is addressed.
2020-02-21 02:09:49 -08:00
Claudiu Belu
3cdb7a89cb test images: Adds multiple Windows channels support
This commit adds support for building test images for multiple
Windows versions, as we have to support both LTS and SAC channels.

With this, the format for Windows images in the BASEIMAGE files is:

OS/ARCH/OS_VERSION

Also adds --isolation-hyperv to the Windows docker build command, making sure
that container images for multiple OS versions can be built using the same
Windows node.
2020-02-21 02:09:49 -08:00
Claudiu Belu
296464d968 test images: Adds Windows support (part 1)
Adds Windows support to the test/images/image-util.sh script.

A Windows node with Docker installed is required to build Windows images.
The connection URL to it must be set in the REMOTE_DOCKER_URL env variable.
Additionally, the authentication to the remote docker node is done through
certificates, which must be found in ~/.docker.

By default, the REMOTE_DOCKER_URL env variable is set to "" in the Makefile,
and because of it, the image-util.sh script will skip building and pushing
Windows images.

Added GOOS argument to the go build process in order to be able to build
Windows binaries. Additionally, the OS env variable was added to the images
Makefiles (default value is "linux") in order to maintain default behaviour.

Some images require a different Dockerfile for Windows images, since they
have different ways of installing dependencies. Because of this, if a image
needs to be built for Windows, it will first check for a Dockerfile_windows
file instead of the default one. If there isn't one, it means that the
same Dockerfile can be used for both Windows and Linux.

All Windows images will be based on the image
"mcr.microsoft.com/windows/servercore:ltsc2019". There are a couple of features
that are needed from this image, especially powershell.

Added busybox image for Windows. Most Windows images will be based on it, which
will help reduce the command line differences between Linux and Windows, but
not entirely.

Added Windows support for agnhost image.
2020-02-21 02:09:49 -08:00
Claudiu Belu
a4ceb143dd images: Changes the image naming template
Changes the image naming template from:

$REGISTRY/$image-$arch:$TAG

to

$REGISTRY/$image:$TAG-$os_name-$arch

The previous naming template would generate a plethora of images (Ai * N images,
where Ai is the number of OS/architectures for the image i and N is the number
of images), while the new naming template will reduce the number of images to N.

The new template also includes the OS name, as we plan to integrate Windows
images into the manifest lists as well.
2020-02-21 02:09:49 -08:00
Claudiu Belu
25b7a13864 images: Configurable BASEIMAGE hierarchy
When building images, their REGISTRY can be set to a custom
one, instead of the default "gcr.io/kubernetes-e2e-test-images" or
"us.gcr.io/k8s-artifacts-prod/e2e-test-images".
Some images are based on other images we're already building
(e.g.: kitten, nautilus), but their base images
are set in the default registry name, which can be undesirable.

This commit addresses this issue.
2020-02-21 02:09:49 -08:00
Claudiu Belu
efcdb929de images: Adds linux/ prefix to BASEIMAGE entries
Windows images will require other base images, and thus, we will need
to explicitly specify the OS type a base image is for in order to
avoid confusion or errors.
2020-02-21 02:09:49 -08:00
Claudiu Belu
22a5fbcfa9 test images: Bumps image versions
The way the images are built is going to be changed, and in order to avoid
overwritting and breaking the current images, the image versions are bumped.
2020-02-21 02:09:49 -08:00
Kubernetes Prow Robot
937008e3ac
Merge pull request #81226 from claudiubelu/tests/reduce-to-agnhost-part-4
tests: Replaces images used with agnhost (part 4)
2020-02-20 01:13:03 -08:00
Claudiu Belu
f7942290af tests: Replaces images used with agnhost (part 4)
Quite a few images are only used a few times in a few tests. Thus,
the images are being centralized into the agnhost image, reducing
the number of images that have to be pulled and used.

This PR replaces the usage of the following images with agnhost:

- resource-consumer-controller
- test-webserver
2020-02-18 16:29:49 -08:00
Benjamin Elder
becc4b7d57 remove unused manifest-tool rules 2020-02-13 14:58:26 -08:00
Mike Danese
3aa59f7f30 generated: run refactor 2020-02-07 18:16:47 -08:00
Kubernetes Prow Robot
9c1e124b15
Merge pull request #87823 from tallclair/test-tokens
Ensure testing credentials are labeled as such
2020-02-06 17:47:29 -08:00
Tim Allclair
9d3670f358 Ensure testing credentials are labeled as such 2020-02-04 10:36:05 -08:00
Chao Xu
6acc75b418 Only set admission review reponse patch type if the patch is not empty 2020-02-03 10:55:31 -08:00
Claudiu Belu
00cd8c8d92 test images: Adds Image Promoter details in the README
We have enabled the Image Promoter on the k/k test E2E images. This updates the
kubernetes/test/images/README.md file to include information about the images
it runs for, and how to promote the new image from the staging registry to the
regular one.

Cleans up some TODO items, since the Image Centralization Part 4 merged.
2020-02-03 00:13:06 -08:00
Kubernetes Prow Robot
11aa07e150
Merge pull request #87385 from krzysied/agnhost_webhook_sidecar
Agnhost webhook sidecar
2020-01-30 16:59:02 -08:00
Kubernetes Prow Robot
4ee00204ae
Merge pull request #87647 from claudiubelu/image-promoter/cleanup-manifest-list
Image Promoter: Cleans manifest list
2020-01-29 22:11:36 -08:00
Mike Danese
d55d6175f8 refactor 2020-01-29 08:50:45 -08:00
Krzysztof Siedlecki
3593fc69ab bumping agnhost version to 2.10 2020-01-27 11:59:03 +01:00
Krzysztof Siedlecki
dc5791b47a adding sidecar injecting webhook 2020-01-27 11:59:03 +01:00
Kubernetes Prow Robot
ca16ebfa49
Merge pull request #87106 from ialidzhikov/enh/golang@1.13.6
Update to golang@1.13.6
2020-01-15 21:21:15 -08:00
Kubernetes Prow Robot
b2c61fa8d3
Merge pull request #87162 from BenTheElder/image-push-dir
set test image cloudbuild directory
2020-01-14 17:22:47 -08:00
Kubernetes Prow Robot
2b9d0fd902
Merge pull request #87153 from mkumatag/multi-arch-nonroot
Multi arch for nonroot image
2020-01-14 17:22:36 -08:00
Benjamin Elder
e6234519e1 set test image cloudbuild directory 2020-01-13 11:38:19 -08:00
Manjunath A Kumatagi
f6d58ae3a9 Multi arch for nonroot image 2020-01-13 23:09:39 +05:30
Kubernetes Prow Robot
e265afa2cd
Merge pull request #81170 from claudiubelu/test-images/centralize-image-to-agnhost-part-4
Centralizes images into agnhost (part 4)
2020-01-13 09:37:38 -08:00
ialidzhikov
e1f7b16fa6 Update to golang@1.13.6
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2020-01-12 02:17:40 +02:00
Claudiu Belu
26ea420c0e Image Promoter: Cleans manifest list
The manifest list is stateful, which means that the same list will get amended
with each successive image published. That's unintended, and can lead to the
wrong image being pulled from the manifest list.

Resets the manifest list before amending new images into it.
2020-01-10 00:35:38 -08:00
Kubernetes Prow Robot
75a8715145
Merge pull request #84058 from claudiubelu/test-image-publishing
test images: Adds E2E test image automated build
2020-01-09 21:58:35 -08:00
Claudiu Belu
a3b90584a1 Image Promoter: Bump timeout limit
50 minutes are not enough for building all the conformance images.
Bumps the timeout limit to 90 minutes.
2020-01-07 21:31:47 -08:00
Claudiu Belu
30058c9d35 Image Promoter: Remove -it from docker command
It seems that the Image Promoter is running containers without the -t flag, which causes the error:

the input device is not a TTY

Removing the -it from the docker command in kubernetes/test/images/image-util.sh solves this.
2020-01-07 15:34:47 -08:00
Kubernetes Prow Robot
9dab44f23c
Merge pull request #86707 from ialidzhikov/enh/golang@1.13.5
Update to golang@1.13.5
2020-01-07 01:12:18 -08:00
Claudiu Belu
4c51eb9063 test images: Image Promoter fixes
Prior to the Image Centralization part 4 (https://github.com/kubernetes/kubernetes/pull/81170),
a PR merged that enables the Image Promoter to run on the k/k test images.

The Image Promoter currently only builds the Conformance-related images, but the
Image Centralization part 4 centralized some of those images into agnhost, so they
need to be removed from the conformance_images list.

Additionally, https://github.com/kubernetes/kubernetes/pull/81226 proposes mounttest-user
image to be removed, and RunAsUser to be used in tests instead.

The image used by the Image Promoter (gcr.io/k8s-testimages/gcb-docker-gcloud:v20190906-745fed4)
is based on busybox, and thus, the sed binary is actually busybox. image-util.sh calls
kube::util::ensure-gnu-sed several times, which ensures that a GNU sed binary exists
(it checks by greping GNU in its --help output). Obviously, it won't match the busybox sed
binary. But the sed usage in image-util.sh is fairly simple, and the busybox sed is sufficient.

Bumps image versions for: jessie-dnsutils, nonewprivs, resource-consumer, sample-apiserver. These
images are included in the conformance_images that are being built by the Image Promoter, so
we're bumping them just to make sure we're not breaking anything and cause all the CIs to fall.
We're going to bump the image versions used in tests in a subsequent PR. The image version was not
bumped for: agnhost, kitten, nautilus, as they were already bumped by the Image Centralization part 4
PR.
2020-01-06 09:08:51 -08:00
Claudiu Belu
31ea600b28 images: Adds GOARM to images' Makefiles
In order to build the image binaries, the GOARM variable is required,
but not all Makefiles have it defined, causing the make to fail on
those images.

This adds the require GOARM variable to the Makefiles in question.
2020-01-01 03:33:36 -08:00
ialidzhikov
f438def93d Update to golang@1.13.5
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2019-12-30 13:17:17 +02:00
Kubernetes Prow Robot
9b59ba4ef8
Merge pull request #81895 from praseodym/fix-staticcheck-test/images
Fix staticcheck failures for test/images
2019-12-30 00:09:39 -08:00
Claudiu Belu
72d66be439 test images: Adds E2E test image automated build
In order for the E2E test images to be automatically built and published
to the staging registry (from which they will be promoted to the regular
E2E test registry), the cloudbuild.yaml file has been added.

The file was added in conformance with [1].

Adds the ability to build all test images:

make -C test/images WHAT=all-images

[1] https://github.com/kubernetes/test-infra/blob/master/config/jobs/image-pushing/README.md
2019-12-28 09:15:03 -08:00
Jordan Liggitt
cad5de706a Build sample-apiserver image using kubernetes 1.17 / go 1.13 2019-12-16 11:06:11 -05:00
Mark Janssen
a634e254c1 Fix staticcheck failures for test/images
Errors from staticcheck:
test/images/agnhost/dns/common.go:79:6: func runCommand is unused (U1000)
test/images/agnhost/inclusterclient/main.go:75:16: using time.Tick leaks the underlying ticker, consider using it only in endless functions, tests and the main package, and use time.NewTicker here (SA1015)
test/images/agnhost/net/nat/closewait.go:41:5: var leakedConnection is unused (U1000)
test/images/agnhost/netexec/netexec.go:157:17: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:250:18: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:317:18: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:331:19: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:345:19: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:357:19: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:370:19: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:380:9: this value of err is never used (SA4006)
test/images/agnhost/netexec/netexec.go:381:17: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/netexec/netexec.go:386:17: printf-style function with dynamic format string and no further arguments should use print-style function instead (SA1006)
test/images/agnhost/pause/pause.go:43:23: syscall.SIGKILL cannot be trapped (did you mean syscall.SIGTERM?) (SA1016)
test/images/agnhost/serve-hostname/serve_hostname.go:125:15: the channel used with signal.Notify should be buffered (SA1017)
test/images/agnhost/webhook/patch_test.go:131:13: this value of err is never used (SA4006)
test/images/pets/peer-finder/peer-finder.go:155:6: this value of newPeers is never used (SA4006)
2019-12-15 22:34:27 +01:00
tanjunchen
8f4a262d61 fix 1-12 number urls 2019-11-21 11:17:46 +08:00
Kubernetes Prow Robot
c97d90546a
Merge pull request #84370 from AnitaNayak/anitanayak
Building peer-finder Image on s390x
2019-11-07 04:34:43 -08:00
Kubernetes Prow Robot
695c3061dd
Merge pull request #82809 from liggitt/go-1.13-no-modules
update to use go1.13.4
2019-11-06 17:02:43 -08:00
Jordan Liggitt
e3ff39ffa0 Update build to go1.13.4 2019-11-06 17:39:05 -05:00
Claudiu Belu
3247f0a814 tests: Fixes minor agnhost error 2019-11-05 15:21:58 -08:00
Kubernetes Prow Robot
2999b8bebb
Merge pull request #83055 from bclau/tests/agnhost-guestbook-app
tests: Adds guestbook app subcommand in agnhost
2019-11-04 15:28:10 -08:00
Kubernetes Prow Robot
7b6369c803
Merge pull request #84249 from odinuge/bump-shellcheck
Bump shellcheck to v0.7.0
2019-11-04 06:19:40 -08:00
Kubernetes Prow Robot
da5b90a8c3
Merge pull request #84045 from bclau/tests/agnhost-netexec-changes
tests: Extends agnhost netexec udp buffers
2019-10-30 18:23:36 -07:00
John Schnake
081b9f206d Adds some basic READMEs to some of the test images
Clarifies the use/purpose of some of the test images for easier
discovery/use in the future.
2019-10-25 11:33:41 -05:00
anitanayak
7dc3057d4d Building peer-finder on s390x 2019-10-25 09:03:47 -07:00
Claudiu Belu
8f099010a5 Centralizes images into agnhost (part 4)
Centralizes the following images into agnhost:

- dnsutils
- mounttest
- resource-consumer-controller
- test-webserver

Adds CoreDNS to agnhost image, which can be used in some DNS related tests (dnsmasq is Linux-only).

Adds Windows support to mounttest.

Bumps agnhost version to 2.9.
Bumps kitten version to 1.1.
Bumps nautilus version to 1.1.
2019-10-24 15:02:40 -07:00
Claudiu Belu
9dd79321e0 tests: Adds guestbook app subcommand in agnhost
The redis version has been bumped to version 5.0.5, but the maximum version supported on
Windows is 3.2. This can lead to failing tests, the output and behaviour can be different
(see #80516). In order to prevent such failures, the amount of times the Redis image is
used can be reduced.

This commit adds the guestbook subcommand to agnhost, which can be used to emulate the
Guestbook application created by the test "should create and stop a working application".

Bumps agnhost image VERSION.
2019-10-24 07:51:28 -07:00
Odin Ugedal
d467b8ea14
Fix shellcheck failures SC2128 2019-10-23 22:47:46 +02:00
Christoph Blecker
e570e3e88d
Update to use go1.12.12 2019-10-18 10:37:34 -07:00
Claudiu Belu
8880a4f74f tests: Extends agnhost netexec udp buffers
Currently, the UDP buffer sizes are set to 1024 bytes. Larger requests will not be
read entirely by the UDP handlers, which can lead to tests relying on this to fail.
2019-10-16 04:21:45 -07:00
Timothy St. Clair
97055841b1 Audit of test/* OWNERS files 2019-10-10 15:52:51 -05:00
Kubernetes Prow Robot
3db6d3abcf
Merge pull request #83551 from dims/move-external-facing-kubelet-apis-to-staging
Move external facing kubelet apis to staging
2019-10-10 13:41:36 -07:00
Davanum Srinivas
6ecc0f83af
update bazel BUILD files
Change-Id: Ia3917cec1453c0b22a958faf8c22bccd79242d14
2019-10-06 15:29:23 -04:00
Davanum Srinivas
d30c489c54
Move pkg/kubelet/pluginregistration and deviceplugin
Change-Id: I06adcb43bd278b430ffad2010869e1524c8cc4ff
2019-10-06 15:28:38 -04:00
tanjunchen
de3cf23414 remove the repeat word in documents 2019-10-06 23:32:01 +08:00
Christoph Blecker
15bba1feed
Update to use go1.12.10 2019-09-25 17:13:43 -07:00
Kubernetes Prow Robot
344054bf4a
Merge pull request #80742 from k-toyoda-pi/fix_shellcheck_image-util
Fix shellcheck failure in test/image/image-util.sh
2019-09-10 14:29:45 -07:00
Jordan Liggitt
0558e83867 Add /readyz endpoints to converter/webhook test image 2019-08-30 12:52:52 -04:00
toyoda
5563e20a56 fix shellcheck failure in test/image/image-util.sh 2019-08-28 13:56:44 +09:00
Kubernetes Prow Robot
bccf68b4ee
Merge pull request #81662 from bclau/test-images/documentation-update
test images: Adds README containing image building process
2019-08-27 00:53:08 -07:00
Guangming Wang
8ffba14ce4 Cleanup: fix typo in flag help message
Signed-off-by: Guangming Wang <guangming.wang@daocloud.io>
2019-08-22 22:58:18 +08:00
Kubernetes Prow Robot
b47f9a43fe
Merge pull request #81499 from chendave/apparmor
Initialize flags to support extra flags
2019-08-21 00:29:31 -07:00
Claudiu Belu
210d7622fb test images: Updates image building process README
Updates the README with the given suggestions.
2019-08-20 13:14:18 -07:00
Claudiu Belu
aade8f8591 test images: Adds README containing image building process
Adds tests/images/README.md, which contains information regarding
the image modification / building process.
2019-08-20 00:22:51 -07:00
Joe Betz
3f519b0ee2 Upgrade ConversionReview e2e test image to also support v1 2019-08-17 10:28:39 -07:00
Kubernetes Prow Robot
fb64b76036
Merge pull request #81008 from bclau/test-images/agnhost-enhancements
test images: Adds version and bind-tools to agnhost
2019-08-17 02:42:07 -07:00
Kubernetes Prow Robot
6b50f1ae38
Merge pull request #81514 from liggitt/agnhost-cleanup
Delete agnhost binary
2019-08-16 19:10:35 -07:00
Jordan Liggitt
8ae7696028
ignore agnhost binary 2019-08-16 10:54:44 -04:00
Jordan Liggitt
145882dfda
Delete agnhost binary 2019-08-16 10:21:25 -04:00
Dave Chen
129fa77aae Initialize flags to support extra flags
Signed-off-by: Dave Chen <dave.chen@arm.com>
2019-08-16 14:05:21 +08:00
Benjamin Elder
54c6744f8c update go to 1.12.9 2019-08-15 17:37:06 -07:00
Kubernetes Prow Robot
661e4d5b38
Merge pull request #81271 from jpbetz/webhok-agnhost-v1
Upgrade AdmissionReview e2e test image to also support v1
2019-08-14 23:12:32 -07:00
Joe Betz
4f7543e42a Upgrade AdmissionReview e2e test image to also support v1 2019-08-14 14:57:55 -07:00
Christoph Blecker
f2a4522be1
Update to go 1.12.8 2019-08-13 20:20:45 -07:00
Claudiu Belu
103498f538 test images: Adds version and bind-tools to agnhost
Adds bind-tools to the agnhost image. With this, dig will available
in the agnhost image, which can be used in DNS related tests.

Adds the --version flag to the agnhost binary, which will be useful for
debugging purposes (e.g.: when the image version does not match the binary
version).

Bumps version to 2.5.
2019-08-01 12:27:35 -07:00
Dave Chen
aba7e7597b doc: fix couple of issues for the doc of agnhost
- The code for google analytics is not well-formatted, which cause its not
rendered well and properly not work as expected.

- webhook v1beta1 is out, the `TODO` in the guide could be removed.

Signed-off-by: Dave Chen <dave.chen@arm.com>
2019-08-01 10:54:57 +08:00
Kubernetes Prow Robot
a1a8641eff
Merge pull request #80424 from chendave/doc
update guide to make the command works as expected
2019-07-30 05:33:31 -07:00
Dave Chen
5d268b9570 update guide to make the command works as expected
Signed-off-by: Dave Chen <dave.chen@arm.com>
2019-07-28 17:27:54 +08:00
Kubernetes Prow Robot
0f32f9ef0e
Merge pull request #77100 from chardch/add-driver-version
Emit the nvidia driver version in gpu e2e test
2019-07-27 00:49:57 -07:00
Kubernetes Prow Robot
de091d102f
Merge pull request #80053 from bclau/tests/fix-jessie-dnsutils
tests: Fixes jessie-dnsutils image build
2019-07-11 22:03:29 -07:00
Jintao Zhang
dfa46f8d47 Update to go 1.12.7
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
2019-07-12 07:16:25 +08:00
Kubernetes Prow Robot
25dc90aa8a
Merge pull request #79423 from danwinship/agnhost-connect
Add new agnhost subcommand for a networking test
2019-07-11 14:33:46 -07:00
Claudiu Belu
9ae1f41ca9 tests: Fixes jessie-dnsutils image build
Currently, the jessie-dnsutils image cannot be built for arm64, ppc64le, s390x,
as its mirrors has been moved to the archive.

This PR will replace its regular mirrors with the archive ones.
2019-07-10 14:38:36 -07:00
Kubernetes Prow Robot
3c09a870a4
Merge pull request #79692 from chendave/issue_79689
Address couple of issue on image build for ARM arch
2019-07-09 23:02:38 -07:00
Kubernetes Prow Robot
3c38115a32
Merge pull request #79045 from odinuge/file-perms
Fix file permissions for non executable files
2019-07-03 09:12:45 -07:00
Dave Chen
c60181317e Address couple of issue on image build for ARM arch
- `GOARM` should not be hardcoded
- `GOARM` needn't be set when the `ARCH` is not `arm`
- make it also possible to build binary within `agnhost` dir as well
- fix image build failure when the user is root

Signed-off-by: Dave Chen <dave.chen@arm.com>
2019-07-03 16:56:23 +08:00
Dan Winship
66b9611945 agnhost: add connect subcommand
This can be used by networking tests that need to distinguish
different connect errors.
2019-06-29 08:55:59 -04:00
Claudiu Belu
54be382552 tests: Clarifies agnhost's entrypoint-tester's usage
Some of the entrypoint-tester related tests overrides agnhost's default entrypoint
with agnhost-2, and this function's args will only contain the subcommand's
args (./agnhost entrypoint-tester these args), but we need to print *all* the
args, which is why os.Args should be printed instead.
2019-06-26 22:14:28 -07:00
Claudiu Belu
af5c0c9e09 Centralizes images into agnhost (part 3)
Centralizes the following images into agnhost:

- audit-proxy
- crd-conversion-webhook
- entrypoint-tester
- inclusterclient
- iperf
- porter
- serve-hostname
2019-06-26 22:14:28 -07:00
Kubernetes Prow Robot
8245461a8d
Merge pull request #79008 from jpbetz/fix-addlabel-mutation-example
Fix mutating webhook test image 'addlabel' to not clobber labels
2019-06-27 07:11:21 -07:00
Kubernetes Prow Robot
bd35a48815
Merge pull request #78958 from tao12345666333/go-1.12.6
Update to go 1.12.6
2019-06-19 18:37:00 -07:00