Commit Graph

419 Commits

Author SHA1 Message Date
Robert Baldyga
04a3ea1142
Merge pull request #471 from Ostrokrzew/huge
Tests for flushing huge cache
2020-11-26 13:22:48 +01:00
Karolina Rogowska
05ed83c6ae fix for RAIDs cleanup in prepare
Signed-off-by: Karolina Rogowska <karolina.rogowsky@gmail.com>
2020-11-25 16:29:02 +01:00
Adam Rutkowski
1d362ce584 Add settle to init script tests
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2020-11-17 19:22:29 -06:00
Slawomir Jankowski
7d1f8cfcee Fix clean reboot test
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
a36c1be8a0 In DI12h test, verify each job separately, right after job is done.
Verifying the whole workload at once generates failures in some DUT configurations.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
e5c8324398 Fix recovery tests
Methods receiving device as an argument, uses its system_path field, not full_path

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
cae2dd2ef5 Fix incremental load tests
Inactive statistics for particular modes:
WT      only dirty should be zero
WA, PT  all should be zero
WB, WO  only clean should be zero

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
f6ec36e49e Increase readability
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
a99da7fa85 Add 1-second pause after plugging device
sometimes test cannot find plugged device, because plug operation is too slow

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
0d6318461e Cast alru_params.activity_threshold.total_milliseconds() to int
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
607ad5d16c Use Time wrapper instead of timedelta
because `set_params_alru` uses method `total_milliseconds()`

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
1ce946239d Remove line which isn't in stderr output.
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Slawomir Jankowski
deb34f62d5 Use existing wrapper
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 14:06:55 +01:00
Robert Baldyga
dfd63abcb9
Merge pull request #365 from Ostrokrzew/consistency
Add test for checking outputs' consistency
2020-11-05 14:04:00 +01:00
Robert Baldyga
ab4665ba3e
Merge pull request #492 from Deixx/raid-ocl
Cleanup RAIDs, example test and RAID + udev test
2020-11-05 14:03:39 +01:00
Slawomir Jankowski
3424ef0199 Test for loading cache from conf in different mode
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-05 09:18:35 +01:00
Daniel Madej
cd8892f775 Security test for compilation flags
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-11-05 08:50:35 +01:00
Slawomir Jankowski
8c0faba498 Update CLI tests
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-03 11:27:31 +01:00
Slawomir Jankowski
dda319eb2f Test for flushing huge cache on raw device
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-02 12:18:23 +01:00
Slawomir Jankowski
6ceb194a46 Test for flushing huge cache with fs
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-11-02 12:17:43 +01:00
Jan Musial
45d0d36191 Fix handling of lazy_startup for cache
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-10-27 11:17:26 +01:00
Katarzyna Lapinska
85df47cddd Add trim tests using devices supporting and not supporting discards
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-10-21 09:33:23 +02:00
Robert Baldyga
96ce3131f6
Merge pull request #473 from Ostrokrzew/mem
Negative test for loading CAS module with lack of memory
2020-10-20 16:42:44 +02:00
Robert Baldyga
c844aa7b85
Merge pull request #476 from Ostrokrzew/discard
Test for handling discard request on huge CAS device
2020-10-20 16:35:11 +02:00
Robert Baldyga
2b4effe335
Merge pull request #548 from Deixx/kernel-params
Introduce CAS kernel module parameters configuration
2020-10-20 15:41:15 +02:00
Robert Baldyga
2188ca2e8c
Merge pull request #551 from imjfckm/enhance-casctl-settle-master
Make casctl settle wait for udev and add cores/start caches
2020-10-20 15:39:37 +02:00
Robert Baldyga
ec1d51825a
Merge pull request #541 from Ostrokrzew/initconfig
Update API for init config
2020-10-15 10:16:45 +02:00
Jan Musial
3ce173800f Make casctl settle wait for udev and add cores/start caches
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-10-14 14:27:06 +02:00
Jan Musial
9ed78b25f3 Fix init script test sometimes failing
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-10-13 14:07:22 +02:00
Daniel Madej
f3dd047917 Reload cas_cache if its params need to be changed
Before starting cache, the method checks if current kernel module params
are equal to configured (or default if configuration is default). If not
then kernel module is reloaded with proper parameters.

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-10-13 09:36:44 +02:00
Daniel Madej
2719804d38 Add class for cas_cache parameters configuration
Update test_framework

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-10-09 15:04:07 +02:00
Daniel Madej
59596a77ab Test CAS udev rules with RAID devices
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-10-09 12:30:51 +02:00
Daniel Madej
a61a1341ff Example test using RAID API
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-10-09 12:30:51 +02:00
Daniel Madej
087cad684e Cleanup RAIDs in prepare
Update test-framework

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2020-10-09 12:30:39 +02:00
Slawomir Jankowski
0917215f1a Update API for init config
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-10-01 14:56:02 +02:00
Slawomir Jankowski
bfce98d5ef Add new message
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-09-17 15:30:43 +02:00
Slawomir Jankowski
9237d26ee2 Test for handling discard request on huge CAS device
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-09-10 14:00:32 +02:00
Slawomir Jankowski
89ed080cfe Add test for checking cache and core statistics outputs' consistency
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-31 14:01:00 +02:00
Katarzyna Lapinska
6ac104c3b8 Rewrite IO class tests to use latest Test Framework API
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-28 12:43:07 +02:00
Katarzyna Lapinska
f30fcb1a02 Add clean shutdown data consistency test
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-26 11:43:48 +02:00
Robert Baldyga
960cf6e085
Merge pull request #479 from Ostrokrzew/core_rem
Add tests for a core removal when the other one is mounted
2020-08-26 11:02:25 +02:00
Robert Baldyga
89992e6ef8
Merge pull request #482 from Ostrokrzew/os_dependent
Add 'os_dependent' marker to tests with TF update
2020-08-26 11:02:02 +02:00
Robert Baldyga
ecebb52b46
Merge pull request #505 from Ostrokrzew/fix
Few fixes after recent changes
2020-08-26 10:59:53 +02:00
Robert Baldyga
e8fa4ca7fc
Merge pull request #506 from katlapinka/api-detach
Add detach command to test's API and fix for attach command
2020-08-26 10:57:02 +02:00
Robert Baldyga
8dc06a3904
Merge pull request #507 from katlapinka/test-attach-detach
Add stress test for attaching and detaching multiple core devices.
2020-08-26 10:56:19 +02:00
Katarzyna Lapinska
b876da96b6 Fix for checking if connection with DUT is active in teardown
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-25 12:44:23 +02:00
Katarzyna Lapinska
77499cc693 Add stress test for attaching and detaching multiple core devices.
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-24 13:15:49 +02:00
Katarzyna Lapinska
dfdbd9abbe Add detach command to test's API and fix for attach command
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-24 12:41:03 +02:00
Robert Baldyga
a769b9fe0b
Merge pull request #502 from katlapinka/reboot-prepare
Add reboot if executor can not connect to DUT in test prepare
2020-08-21 10:40:08 +02:00
Robert Baldyga
f12274eb24
Merge pull request #488 from katlapinka/trim-stress
Add trim stress test
2020-08-19 17:45:10 +02:00
Katarzyna Lapinska
c314aa294a Execute teardown after skip in test
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-19 16:14:55 +02:00
Slawomir Jankowski
7218f814aa Test for loading CAS kernel module with insufficient memory
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-19 16:13:09 +02:00
Slawomir Jankowski
77db7de4bc Fix test for casadm version
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-19 15:56:12 +02:00
Slawomir Jankowski
873be2bf3a Fix test for casadm help
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-19 15:56:12 +02:00
Robert Baldyga
ed0052f502
Merge pull request #486 from katlapinka/trim-eviction
Add test verifying if trim request does not cause eviction on CAS device
2020-08-19 15:48:03 +02:00
Robert Baldyga
fce22f9d19
Merge pull request #481 from Ostrokrzew/rename
Change duplicated name of test to avoid conflicts
2020-08-19 15:47:21 +02:00
Katarzyna Lapinska
0b455ada64 Add test verifying if trim request do not cause eviction on CAS device
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-17 14:30:08 +02:00
Katarzyna Lapinska
4a2ead3934 Add trim stress test
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-17 14:27:48 +02:00
Robert Baldyga
0c64a44cf5
Merge pull request #495 from Ostrokrzew/zero_meta
Swap formatting NVMe to metadata zeroing in functional tests CAS API
2020-08-17 10:47:57 +02:00
Katarzyna Lapinska
1714a9855c Add reboot if executor can not connect to DUT in test prepare
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-17 09:19:31 +02:00
Slawomir Jankowski
1f437a065f Fix adding core to cache with custom ID
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-13 13:56:11 +02:00
Slawomir Jankowski
13c8525448 Test for removing core when the other one is mounted
and core numeration is custom - each core ID starts with the same digit.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-13 13:55:46 +02:00
Slawomir Jankowski
b8e840ceab Test for removing core when the other one is mounted
and core numeration is automatic - each core ID starts with different digit.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-13 13:55:07 +02:00
Slawomir Jankowski
77ade8fda2 Change duplicated name of test to avoid conflicts
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-13 13:43:38 +02:00
Slawomir Jankowski
4b39811c43 Add 'os_dependent' marker to tests
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-12 15:39:03 +02:00
Robert Baldyga
f16077c4ff Update TF: random seed and test summary improvements
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2020-08-12 13:33:48 +02:00
Robert Baldyga
e7e1abd89b
Merge pull request #499 from imjfckm/fix-no-marks-tests
Fix TF breaking when no pytest marks present
2020-08-11 16:11:45 +02:00
Jan Musial
19781c95f7 Fix TF breaking when no pytest marks present
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-11 15:36:57 +02:00
Robert Baldyga
1ca64d03e7
Merge pull request #494 from mmichal10/test-purge-ioclass
Test purge ioclass
2020-08-11 14:50:53 +02:00
Michal Mielewczyk
12426cfd3a tests: test for stats after purge
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2020-08-11 07:16:36 -04:00
Jan Musial
31fda78be4 Use parametrizex in tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-11 13:05:15 +02:00
Jan Musial
d75c49aced Enable TF pair-testing parametrization
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-11 13:03:19 +02:00
Slawomir Jankowski
52fb80d7b4 Remove formatting NVMe from test's API
Add metadata zeroing to test's API

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-08-10 19:14:41 +02:00
Michal Mielewczyk
863947ddb8 test api: implement UsageStats arithmetic ops
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2020-08-10 10:30:36 -04:00
Jan Musial
ebd1c0075b Add switch for specifying buildtype in performance tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-06 14:01:30 +02:00
Jan Musial
46b8ec3c03 Performance test for 100% hit ratio
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-06 14:01:30 +02:00
Jan Musial
06322f6199 Add PerfContainer for storing performance results
Implement new package which primary goal is to collect and validate
performance metrics in managable way then dump them in JSON form for
further processing/storage.

Example usage:

container = PerfContainer()

container.insert_config_param("20.03.0000", ConfigParameter.CAS_VERSION)
container.insert_cache_metric(20000000, IOMetric.read_IOPS)

with open("perf.json", "w") as f:
    json.dump(container.to_serializable_dict(), f)

Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-08-06 14:01:30 +02:00
Robert Baldyga
3acc720cb0
Merge pull request #489 from robertbaldyga/tests-fix-cas-version-parsing
tests: Fix CAS version parsing
2020-08-05 21:54:59 +02:00
Robert Baldyga
11892d56a9 tests: Fix CAS version parsing
As CAS version format changed to custom one, we need to parse it
in non-default way.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2020-08-05 15:19:29 +02:00
Katarzyna Lapinska
fdf095ea15 Remove partitions from disk after unmounting them
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-08-05 12:00:44 +02:00
Robert Baldyga
6ef7195950
Merge pull request #460 from katlapinka/init-tests
Add init test with different runlevels and test for management device status
2020-07-27 18:35:36 +02:00
Robert Baldyga
5baa34ab41
Merge pull request #419 from Ostrokrzew/ex_conf
Update 'example_config' after changes in TF
2020-07-27 18:35:09 +02:00
Robert Baldyga
124037cf55
Merge pull request #324 from Ostrokrzew/signal
Tests for FLUSH and FUA signals
2020-07-27 18:33:37 +02:00
Slawomir Jankowski
93ace7d520 Check for FLUSH and FUA signals sent to multilevel cache in lazy-write modes
Add test for checking for logs of requests insyslog from OpenCAS
when SCSI_DEBUG module is base-level core device in multilevel cache.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-07-21 10:28:56 +02:00
Slawomir Jankowski
c01956d0e1 Check for FLUSH and FUA signals sent to cache device in lazy-write modes
Add test for checking for logs of requests insyslog from OpenCAS
when SCSI_DEBUG module is cache device.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-07-21 10:28:56 +02:00
Slawomir Jankowski
153eb19c9b Check for FLUSH and FUA signals sent to core device in lazy-write modes
Add test for checking for logs of requests in syslog from OpenCAS
when SCSI_DEBUG module is core device.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-07-21 10:28:56 +02:00
Katarzyna Lapinska
fb8860bf39 Initialize tests cleanup
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-07-15 12:57:03 +02:00
Katarzyna Lapinska
6be612be78 Add init test with different runlevels and test for management device status
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-07-14 13:55:55 +02:00
Robert Baldyga
94dda3a7d5
Merge pull request #442 from katlapinka/stress-dirty-shutdown
Add new stress dirty shutdown test
2020-07-14 13:47:49 +02:00
Slawomir Jankowski
5bc85049a2 Update 'example_config' after changes in TF
Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2020-07-13 12:10:38 +02:00
Robert Baldyga
cfb915867a
Merge pull request #449 from katlapinka/dev-capabilities
Add test for devices' capabilities
2020-07-12 09:28:15 +02:00
Robert Baldyga
885ca70699
Merge pull request #456 from imjfckm/fix-force-reinstall
Change force-reinstall test option to behave properly
2020-07-12 09:28:01 +02:00
Robert Baldyga
9c6a4a393c
Merge pull request #321 from Ostrokrzew/wb
Lazy-writes modes tests
2020-07-07 08:54:58 +02:00
Katarzyna Lapinska
b13403a9b9 Add test for devices' capabilities
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-07-07 08:40:07 +02:00
Jan Musial
711aa2fe47 Change force-reinstall test option to behave properly
Signed-off-by: Jan Musial <jan.musial@intel.com>
2020-07-03 11:53:31 +02:00
Katarzyna Lapinska
5aa1ca7d48 Add missing import to long DI tests 2020-06-29 14:36:02 +02:00
Michal Rakowski
4c3a07c13b tests: add cache start trim test
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2020-06-25 12:12:51 +02:00
Michal Rakowski
23aea2b7cc Test framework update & conftest fixup
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2020-06-24 14:40:15 +02:00
Katarzyna Lapinska
aeae7c9765 Add test for checking the ability of CAS to start cache instances upon system boot after dirty shutdown during IO workloads
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-06-22 16:49:49 +02:00
Katarzyna Lapinska
be288d2fac Kill existing fsck process to be able to manage partitions in test prepare
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
2020-06-17 09:03:45 +02:00