Commit Graph

1074 Commits

Author SHA1 Message Date
Wojciech Tyczynski
992f023f3c Check resource leaks only when needed 2016-08-16 16:12:46 +02:00
Jeff Grafton
7e51ee1ccd Install bc in the kubekins-test image
It is needed by the shell2junit script.
2016-08-12 16:42:53 -07:00
Kubernetes Submit Queue
16c71aad4a Merge pull request #30385 from david-mcmahon/fix-cache
Automatic merge from submit-queue

Get version from started.json.



<!-- Reviewable:start -->
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30385)
<!-- Reviewable:end -->
2016-08-12 10:54:20 -07:00
Kubernetes Submit Queue
d4691a76ec Merge pull request #27911 from jfrazelle/start-enable-golint
Automatic merge from submit-queue

Start verifying golint on a per-package basis as packages are fixed

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

```release-note
Added `golint` for pkg/security/podsecuritypolicy/capabilities` along with validation.
```


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

This is a POC to start enabling `golint` checks on a per-package basis, we did this on the docker project and it was a great way for new contributors to help and it benefits the project overall. All they have to do is add the package they fixed to the bash array in `hack/verify-golint.sh` and fix all the lint errors. 
Eventually when all the packages have been fixed we can change the function to `find_files`. Or something based off which files are changed in a patch set to verify `golint`.
Now I used this specific package as the POC because I wanted to show the downside of this changing the api of the package.
Most of the times this arose in docker/docker we decided that if someone wasn't importing their deps locally then it was their loss, but I'm not sure if you all will agree.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/27911)
<!-- Reviewable:end -->
2016-08-11 15:03:06 -07:00
Kubernetes Submit Queue
f5861b9e49 Merge pull request #30176 from dims/check-for-root-access
Automatic merge from submit-queue

Check for CAP_SYS_ADMIN in Kubelet

Comment from nsenter_mount.go header:
The Kubelet process must have CAP_SYS_ADMIN (required by nsenter); at
the present, this effectively means that the kubelet is running in a
privileged container.

Related to #26093

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30176)
<!-- Reviewable:end -->
2016-08-11 08:46:19 -07:00
Jess Frazelle
818cdaf9d3
add golint to test dockerfile
Signed-off-by: Jess Frazelle <me@jessfraz.com>
2016-08-10 16:46:19 -07:00
Erick Fejta
8ca5759bb0 Do not require --test_args to be set 2016-08-10 13:25:59 -07:00
David McMahon
c99a18e31c Get version from started.json. 2016-08-10 13:12:25 -07:00
gmarek
b30fbc138f Correctly pipe USE_KUBEMARK in e2e-runner 2016-08-10 10:42:52 +02:00
Kubernetes Submit Queue
853bfdcb7c Merge pull request #30324 from david-mcmahon/fix-cache
Automatic merge from submit-queue

Figure out where kubernetes is in the various scopes this is called from.

cc @spxtr
2016-08-09 18:59:31 -07:00
David McMahon
2a06a8f416 Figure out where kubernetes is in the various scopes this is called from. 2016-08-09 17:22:34 -07:00
Kubernetes Submit Queue
012eb941d6 Merge pull request #28575 from fejta/check-resources
Automatic merge from submit-queue

Move kubemark, skew, upgrade, leak logic into hack/e2e.go

And move out of the `e2e_runner.sh`
Also make `start-kubemark.sh` automatically find `kubernetes-server-linux-amd64.tar.gz` instead of depending on a `RUN_FROM_DISTRO` env var

@gmarek can you review the kubemark-related changes?
@zmerlynn are you the right person to review upgrade changes?

@spxtr take a look at the overall `e2e.go` changes.

This is for https://github.com/kubernetes/kubernetes/issues/21843 and https://github.com/kubernetes/test-infra/pull/250

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/28575)
<!-- Reviewable:end -->
2016-08-09 15:54:50 -07:00
Kubernetes Submit Queue
cdee52e5e7 Merge pull request #26790 from rmmh/bash-range
Automatic merge from submit-queue

Use bash ranges "{1..3}" instead of "$(seq 1 3)".




[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/26790)
<!-- Reviewable:end -->
2016-08-09 15:18:30 -07:00
Erick Fejta
7011d8826e Move kubemark, skew, upgrade, leak logic into hack/e2e.go 2016-08-09 14:04:19 -07:00
Davanum Srinivas
2616fc9cf5 Check for CAP_SYS_ADMIN in Kubelet
The Kubelet process must have CAP_SYS_ADMIN, which implies that
the kubelet process must be either running as root or in a privileged
container. Make this check early in the startup sequence and bail out
if necessary.

Related to #26093
2016-08-09 13:40:07 -04:00
Ryan Hitchman
5508e49ef5 Use bash ranges "{1..3}" instead of "$(seq 1 3)". 2016-08-08 16:23:39 -07:00
Kubernetes Submit Queue
24b852074c Merge pull request #29957 from david-mcmahon/jenkins-result-cache
Automatic merge from submit-queue

Add update_job_result_cache() to uploader for storing last 200 results in a single file.
2016-08-08 16:16:31 -07:00
David McMahon
cabcfb874e Add SET_NOMOCK_FLAG handling.
Pass thru KUBE_GCS_RELEASE_BUCKET (for federation yamls that change it).
2016-08-05 17:46:34 -07:00
David McMahon
8697254350 Add update_job_result_cache() to uploader for storing last 200 results in a single file. 2016-08-04 18:33:28 -07:00
Kubernetes Submit Queue
41abea5a96 Merge pull request #30053 from fejta/gke
Automatic merge from submit-queue

Set GOOGLE_APPLICATION_CREDENTIALS after activating

https://developers.google.com/identity/protocols/application-default-credentials

We should set this explicitly as https://golang.org/pkg/os/user/#User (which the oauth libraries use: [sdk.go] - [default.go] via [CreateGCECloud]) will ignore any `$HOME` overrides.

[CreateGCECloud]: fa95788e56/test/e2e/e2e.go (L75)
[sdk.go]: fa95788e56/vendor/golang.org/x/oauth2/google/sdk.go (L165)
[default.go]: fa95788e56/vendor/golang.org/x/oauth2/google/default.go (L101)

Mitigates https://github.com/kubernetes/kubernetes/issues/28514 and related to https://github.com/kubernetes/test-infra/issues/266
2016-08-04 11:23:53 -07:00
Kubernetes Submit Queue
3e5b40d9a5 Merge pull request #29947 from ixdy/go-bindata-cross-image
Automatic merge from submit-queue

Install go-bindata in cross-build image

Another follow-up to #25584.

We need `go-bindata` to create `test/e2e/generated`, and downloading it with `go get` at build time is painful for a variety of reasons. We can just include it in the cross-build image and not worry about it, especially as it updates very infrequently.

This fixes `hack/update-generated-protobuf.sh` as well.

cc @jayunit100 @soltysh
2016-08-04 06:03:29 -07:00
Erick Fejta
ffe611569d Set GOOGLE_APPLICATION_CREDENTIALS after activating 2016-08-03 23:24:31 -07:00
Kubernetes Submit Queue
b917ca0937 Merge pull request #29864 from wonderfly/correct-k8s-version
Automatic merge from submit-queue

e2e-runner: Fix the logic of pulling GCI builtin version of k8s

Apparently setting JENKINS_PUBLISHED_VERSION didn't work because it only worked
with `ci/latest`, `release/latest-1.3` or the like, whereas we wanted to pull
specific versions like `release/v1.3.3`. Added a function
`fetch_gci_version_tars` instead.

@spxtr Can you review? Hopefully this should get our QA tests passing.
2016-08-03 18:14:56 -07:00
Jeff Grafton
42d2aca7bb Download go-bindata in unit/verify/node e2e Jenkins builds 2016-08-03 13:23:41 -07:00
Erick Fejta
548780f05a Revert "Revert "Drop support for --gce-service-account, require activated creds"" 2016-08-02 20:34:02 -07:00
Kubernetes Submit Queue
31ff5d423d Merge pull request #29892 from david-mcmahon/jenkins2
Automatic merge from submit-queue

Clone kubernetes/release into something other than /release due to conflict with /release.

It looks like $WORKSPACE is the root of the kubernetes clone.  I think ideally we'd move that down a level and allow subdirectories of different repos.  I think this may become the norm as we split things up further as well.  What do you think and how should we proceed here?  @ixdy @spxtr
2016-08-02 16:24:07 -07:00
David McMahon
eceef16b9f Clone kubernetes/release into something other than /release due to conflict. 2016-08-02 13:02:39 -07:00
k8s-merge-robot
ca7ad6896b Merge pull request #29185 from soltysh/make_verify
Automatic merge from submit-queue

Fix make verify

@thockin this fixes `make verify` which was previously failing due to undefined `BRANCH` and `VERBOSE` variables, ptal
2016-08-02 01:53:44 -07:00
Daniel Wang
dee12cfb60 e2e-runner: Fix the logic of pulling GCI builtin version of k8s
Apparently setting JENKINS_PUBLISHED_VERSION didn't work because it only worked
with `ci/latest`, `release/latest-1.3` or the like, whereas we wanted to pull
specific versions like `release/v1.3.3`. Added a function
`fetch_gci_version_tars` instead.
2016-08-01 14:31:04 -07:00
Daniel Wang
e4cfb91bd9 e2e-runner: Remove quotes from jq output
Recent GCI e2e test failures suggest that the image name was double quoted when
passed to gcloud. E.g.,

```
09:59:51  - Invalid value for field
'resource.disks[0].initializeParams.sourceImage':
'https://www.googleapis.com/compute/v1/projects/container-vm-image-staging/global/images/"gci-base-53-8530-36-0"'.
The referenced image resource cannot be found.
```

The `-r`, or `--raw-output` option strips quotes from jq's output. With this
change, the output looks like:

```
+ export KUBE_GCE_MASTER_IMAGE=gci-base-54-8650-0-0  # Not quoted
```
2016-07-29 10:31:42 -07:00
Daniel Wang
081dfbbb73 Add support for GCI QA jobs
GCI QA jobs will run tests using GCI daily builds, and the kubernetes built into
the images. All QA jobs will set the `JENKINS_USE_GCI_VERSION` env var.
2016-07-26 13:33:45 -07:00
Maciej Szulik
2a2b46a105 Fix make verify 2016-07-25 15:34:00 +02:00
Wojciech Tyczynski
7ef2e946dc Fail Kubemark if tests fail with error. 2016-07-22 11:52:54 +02:00
Ryan Hitchman
0cb96b3614 Revert "Drop support for --gce-service-account, require activated creds" 2016-07-19 17:41:39 -07:00
k8s-merge-robot
8cf40ebe25 Merge pull request #29127 from jfrazelle/update-go-1.6.3
Automatic merge from submit-queue

update go to 1.6.3

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

```release-note
updated go version to 1.6.3
```
2016-07-19 06:17:58 -07:00
k8s-merge-robot
cbda93e23e Merge pull request #27898 from lavalamp/fixv
Automatic merge from submit-queue

Detect flakes in PR builder e2e runs

Won't be mergable until https://github.com/onsi/ginkgo/pull/261 is agreed upon and merged.

Tossing a PR here to get the e2e test to run on it.
2016-07-18 16:17:02 -07:00
Jess Frazelle
a333cf429a update go to 1.6.3
Signed-off-by: Jess Frazelle <me@jessfraz.com>
2016-07-18 16:29:46 -04:00
k8s-merge-robot
d08a722647 Merge pull request #28802 from fejta/service
Automatic merge from submit-queue

Drop support for --gce-service-account, require activated creds

Now that `gcloud auth activate-service-account` is in remove support in the test framework for default service accounts -- testing GCE/GKE now requires prior gcloud activation.
2016-07-18 12:08:03 -07:00
Daniel Smith
e91c5d048b run e2e with flake detection 2016-07-15 23:58:29 -07:00
k8s-merge-robot
36c07cc554 Merge pull request #27961 from maisem/os-distribution
Automatic merge from submit-queue

Splitting OS_DISTRIBUTION into NODE_OS_DISTRIBUTION and MASTER_OS_DISTRIBUTION

fixes #26183 
[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-15 14:11:47 -07:00
Maisem Ali
97f3f80833 Splitting OS_DISTRIBUTION into NODE_OS_DISTRIBUTION and
MASTER_OS_DISTRIBUTION.
2016-07-15 12:02:31 -07:00
k8s-merge-robot
4030afdfb1 Merge pull request #28922 from david-mcmahon/release-push
Automatic merge from submit-queue

Add RELEASE_INFRA_PUSH related code to support pushes from kubernetes/release.

ref #16529
2016-07-14 19:55:56 -07:00
David McMahon
ae18034920 Add RELEASE_INFRA_PUSH related code to support pushes from kubernetes/release. 2016-07-14 11:46:59 -07:00
Daniel Wang
f5d711a56c Update the image family used for GCI canary test images 2016-07-13 14:27:18 -07:00
Tim Hockin
1bd3918c15 Overhaul deps on generator tools
This forces a regeneration if the generation tools are rebuilt.

Also clean up Makefile a bit.
2016-07-12 21:52:54 -07:00
Tim Hockin
faeef5c4ae Use make as the main build tool
This allows us to start building real dependencies into Makefile.

Leave old hack/* scripts in place but advise to use 'make'.  There are a few
rules that call things like 'go run' or 'build/*' that I left as-is for now.
2016-07-12 21:52:00 -07:00
Erick Fejta
fe8578db80 Drop support for --gce-service-account, require activated creds 2016-07-11 14:47:04 -07:00
Erick Fejta
41a23d6521 Do not depend on metadata server for auth 2016-07-11 13:16:34 -07:00
Erick Fejta
3d30caf80c Inject service-account.json into test container 2016-07-11 09:27:15 -07:00
k8s-merge-robot
6eae13e0c4 Merge pull request #28133 from freehan/e2ejunit
Automatic merge from submit-queue

add junit recording in e2e runner

2nd part of #27825  

Injected junit recorder at a few places.
2016-07-09 01:55:07 -07:00