Commit Graph

103 Commits

Author SHA1 Message Date
Kenichi Omichi
48f1f74a51 Use ExpectNoError() for scalability and scheduling
The e2e test framework has ExpectNoError() for readable test code.
This replaces Expect(err).NotTo(HaveOccurred()) with it.
2019-05-15 20:19:25 +00:00
John Schnake
afc66a5487 Move scalability, upgrade, and common packages to framework/log
This is part of the transition to using framework/log instead
of the Logf inside the framework package. This will help with
import size/cycles when importing the framework or subpackages.
2019-05-04 12:45:15 -05:00
SataQiu
1405819049 fix golint failures of test/e2e/framework/framework.go 2019-04-08 15:11:37 +08:00
Kubernetes Prow Robot
79000d4ac5
Merge pull request #75783 from oomichi/golint-e2e-framework-m
Fix golint failures of e2e/framework/metrics_util.go
2019-04-05 11:51:21 -07:00
Kenichi Omichi
7af6ddd353 Fix golint failures of framework/metrics_util.go
This fixes golint failures of framework/metrics_util.go.

Cleanup:
- SaturationTime was only used in test/e2e/scalability/density.go.
  So this moves it into the e2e test.
- interestingClusterAutoscalerMetrics was not used in filterMetrics()
  so this removes the related code.
2019-04-02 16:25:16 +00:00
Andrew Sy Kim
4ac9feb7f9 test/e2e: replace legacy scheme with client-go scheme
Signed-off-by: Andrew Sy Kim <kiman@vmware.com>
2019-04-02 10:08:55 -04:00
Andrew Sy Kim
1470df7a05 remove usages of internal clientset in e2e framework
Signed-off-by: Andrew Sy Kim <kiman@vmware.com>
2019-03-28 21:13:40 -04:00
Chao Xu
1f2e2e61cf generated 2019-02-12 15:04:57 -08:00
Chao Xu
3f21ca029a changing imports 2019-02-12 10:06:04 -08:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
Shyam Jeedigunta
6cd03ab8ae Fix TLS config in load test clients 2019-01-29 16:24:53 -08:00
Shyam Jeedigunta
d477bd904c Leave slack for addon pods in node's capacity 2019-01-22 20:26:02 -08:00
Maciej Borsz
25c2440996 Add node notready/unreachable tolerations to load/density pods. 2018-12-14 12:16:51 +01:00
wojtekt
68bae382b1 Fix density test 2018-11-14 10:17:40 +01:00
Mike Danese
7613482623 scale test service account token projection in kubemark 2018-10-26 09:57:56 -07:00
Chris O'Haver
402266afde add dns pod memory constraint 2018-10-18 10:35:30 -04:00
Guoliang Wang
c2622dd9d8 Replace Parallelize with function ParallelizeUntil and formally deprecate the Parallelize 2018-10-05 17:56:56 +08:00
Shyam Jeedigunta
bf81201b43 Remove deprecated [Feature:Empty] test 2018-09-12 12:56:19 +02:00
Kubernetes Submit Queue
b61bb1f554
Merge pull request #67764 from shyamjvs/add-etcd-db-size-measurement
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Add etcd DB size monitoring in density test

/cc @wojtek-t 

fyi - @jpbetz @gyuho @kubernetes/sig-scalability-misc 

```release-note
NONE
```
2018-08-30 09:49:43 -07:00
Shyam Jeedigunta
203664933d Add etcd DB size monitoring in density test 2018-08-30 14:40:59 +02:00
Shyam Jeedigunta
e062e6396b Revert "Re-calibrate load test throughputs"
This reverts commit 2f7f6deef7.
2018-08-28 13:27:38 +02:00
Kubernetes Submit Queue
a11dcecac0
Merge pull request #67776 from shyamjvs/fix-load-test-throughput
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Re-calibrate load test throughputs

/cc @wojtek-t 

```release-note
NONE
```
2018-08-24 16:43:20 -07:00
Maciej Borsz
422917b30b
Revert "Parallelize RC deletion in density test" 2018-08-24 09:47:09 +02:00
Kubernetes Submit Queue
f61040d0e1
Merge pull request #67769 from shyamjvs/remove-second-scaling-round-in-load-test
Automatic merge from submit-queue (batch tested with PRs 67748, 67769). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove second round of scaling in load test

As it seems redundant to do this twice, not really adding much value. This should cut down ~1.5h in our 5k-node load tests, and helps a bit with https://github.com/kubernetes/test-infra/issues/8348.

/cc @wojtek-t 

```release-note
NONE
```
2018-08-23 09:20:04 -07:00
Shyam Jeedigunta
2f7f6deef7 Re-calibrate load test throughputs 2018-08-23 17:37:06 +02:00
Shyam Jeedigunta
17f427d7b3 Remove second round of scaling in load test 2018-08-23 14:41:23 +02:00
Shyam Jeedigunta
c07ecad613 Parallelize RC deletion in density test 2018-08-22 16:30:01 +02:00
Maciej Borsz
2632a6a619 Scalability tests: Increase sample size for pod startup latency measurement. 2018-08-03 12:24:43 +02:00
Shyam Jeedigunta
7250a5621a Fix expected pod creations/deletions estimate in load test 2018-07-31 15:58:23 +02:00
tanshanshan
af0fc11ded error in return value should be tested 2018-07-30 15:17:32 +08:00
Maciej Borsz
9df9c2e506 Modify resource constraints for master components.
The growth is caused by increasing --kube-api-qps in kube-scheduler.
2018-07-13 16:46:57 +02:00
Kubernetes Submit Queue
a8777c26fa
Merge pull request #64695 from krzysied/etcd_metrics
Automatic merge from submit-queue (batch tested with PRs 64695, 65982, 65908). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Collecting etcd metrics

**What this PR does / why we need it**:
Adding etcd metrics to performance test log.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
ref #64030

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2018-07-10 08:55:03 -07:00
Wojciech Tyczynski
9340bca14e
Revert "Make no. of services in load test configurable" 2018-06-29 11:33:14 +02:00
Jeff Grafton
23ceebac22 Run hack/update-bazel.sh 2018-06-22 16:22:57 -07:00
Kubernetes Submit Queue
5880db4a65
Merge pull request #65335 from shyamjvs/add-scheduler-profiling-to-testing
Automatic merge from submit-queue (batch tested with PRs 65339, 65343, 65324, 65335, 65367). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Introduce scheduler CPU/Memory profile-gathering in density test

This should help us get more reliable/realistic data for scheduler (from our real-cluster scalability tests).

/cc @wojtek-t 
fyi - @davidopp @bsalamat @misterikkit 

```release-note
NONE
```
2018-06-22 10:31:20 -07:00
Shyam Jeedigunta
0c787703f5 Introduce scheduler CPU/Memory profile-gathering in density test 2018-06-22 12:12:05 +02:00
Shyam Jeedigunta
457548ef7d Refactor profile-gatherer to work across all master components 2018-06-22 12:11:56 +02:00
Shyam Jeedigunta
a01dea5df0 Make no. of services in load test configurable 2018-06-19 14:23:04 +02:00
Shyam Jeedigunta
3768d8a9a3 Half the no. of endpoints in load test 2018-06-18 14:59:45 +02:00
Kubernetes Submit Queue
65a5e68147
Merge pull request #64521 from shyamjvs/compute-scheduler-throughput-avg
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Compute avg and quantiles of scheduler throughput in density test

Based on my comment here - https://github.com/kubernetes/kubernetes/pull/64266#issuecomment-393189953

/sig scheduling
/kind cleanup
/priority important-soon
/milestone v1.11
/cc @wojtek-t 

```release-note
NONE
```
2018-06-13 14:23:51 -07:00
Shyam Jeedigunta
979a8d73e1 Compute avg and quantiles of scheduler throughput in density test 2018-06-12 18:40:52 +02:00
Krzysztof Siedlecki
aa022310a4 Collecting etcd metrics 2018-06-04 16:23:08 +02:00
Kubernetes Submit Queue
a2d8636559
Merge pull request #64316 from krzysied/scheduling_latency_metric
Automatic merge from submit-queue (batch tested with PRs 63328, 64316, 64444, 64449, 64453). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Fixing scheduling latency metrics

**What this PR does / why we need it**:
Allows to measure and to display scheduling latency metrics during tests. Provides new functionality of resetting scheduler latency metrics.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #63493

**Special notes for your reviewer**:
E2eSchedulingLatency, SchedulingAlgorithmLatency, BindingLatency are now available 
as subtypes of OperationLatency.

**Release note**:

```release-note
NONE
```
2018-05-30 08:42:16 -07:00
Krzysztof Siedlecki
0e833bfc83 Fixing scheduling latency metrics 2018-05-30 11:20:12 +02:00
Shyam Jeedigunta
9ea33c604c Fix bug with scheduler throughput variable pass-by-value 2018-05-28 13:23:37 +02:00
Kubernetes Submit Queue
5f578f3385
Merge pull request #63979 from soltysh/drop_reapers
Automatic merge from submit-queue (batch tested with PRs 63859, 63979). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Drop reapers

/assign @deads2k @juanvallejo 

**Release note**:
```release-note
kubectl delete does not use reapers for removing objects anymore, but relies on server-side GC entirely
```
2018-05-26 00:32:11 -07:00
Maciej Szulik
383872615d
Remove kubectl reapers 2018-05-25 22:18:05 +02:00
Shyam Jeedigunta
f363f549c0 Measure scheduler throughput in density test 2018-05-25 14:49:11 +02:00
Mikhail Mazurskiy
5e8e570dbd
Use Dial with context 2018-05-19 08:14:37 +10:00
Kubernetes Submit Queue
7eb88f11d2
Merge pull request #59727 from wgliang/master.time
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

should use time.Since instead of time.Now().Sub

**What this PR does / why we need it**:
should use time.Since instead of time.Now().Sub

**Special notes for your reviewer**:
2018-05-10 20:29:40 -07:00