Commit Graph

590 Commits

Author SHA1 Message Date
Daniel Madej
5c16010061 Data Integrity test with device unplugged during IO
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2022-03-03 12:56:33 +01:00
Michal Mielewczyk
293ee7e100 test api: add exp obj to cache conf stats section
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-03-03 12:13:56 +01:00
Karolina Rogowska
6f4398cdea
Merge pull request #1066 from Deixx/insert-error
Fix insert error tests
2022-03-02 12:50:58 +01:00
Michal Mielewczyk
d44254586f tests: use greater file in recovery tests
To prevent flushing all dirty cache lines before the power shutdown, create
bigger file.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-02-25 14:36:13 +01:00
Karolina Rogowska
d706619187 cas api: add casadm commands for standby cache
Signed-off-by: Piotr Debski <piotr.debski@intel.com>
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2022-02-23 00:36:18 +01:00
Michał Mielewczyk
2cc7c96305
Merge pull request #1068 from mmichal10/fix-trim-test
tests: fix trim eviction test
2022-02-22 11:56:30 +01:00
Michal Mielewczyk
6a33024304 tests: fix trim eviction test
Instead of creating a test file twice (once with `direct` flag and once with
`sync` flag), prepare it only once (with `sync` flag). Additionally allow
classifier to settle after the IO.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-02-21 09:14:43 +01:00
Karolina Rogowska
05b6922a74
Merge pull request #1067 from mmichal10/fix-flushing-test
tests: allow the flushing thread to flush
2022-02-18 15:43:03 +01:00
Karolina Rogowska
12f7355316
Merge pull request #1064 from Deixx/is-it-a-fix
Stopping unplugged cache - changed behavior
2022-02-18 15:10:44 +01:00
Michal Mielewczyk
2f5afff8f2 tests: allow the flushing thread to flush
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-02-18 12:28:53 +01:00
Karolina Rogowska
583af2e229
Merge pull request #1056 from karolinavelkaja/ioclass_id_as_condition_test_fix
fix for test_ioclass_id_as_condition - adding 1s delay before io
2022-02-18 11:27:09 +01:00
Daniel Madej
e18946d1b9 Fix insert error tests
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2022-02-17 16:36:34 +01:00
Robert Baldyga
3787957bdf
Merge pull request #1062 from mmichal10/fix-ioclass-tests
Fix ioclass tests
2022-02-17 15:16:09 +01:00
Robert Baldyga
9424df4e2b
Merge pull request #972 from Deixx/multidut
Multidut execution and example
2022-02-17 13:27:29 +01:00
Michal Mielewczyk
8ff5dcb364 tests: delay in directory based ioclass test
After setting directory based IO classification rule and creating the directory
sleep for a few seconds to allow the classifier to settle.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-02-17 09:21:39 +01:00
Karolina Rogowska
ddf1339adb fix for test_ioclass_id_as_condition
need to add delay before io - CAS not being able to resolve directory to inode so quickly
https://github.com/Open-CAS/open-cas-linux/issues/1046

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2022-02-16 15:51:30 +01:00
Michal Mielewczyk
6ad0562b53 tests: more robust verififaction in ioclass tests
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2022-02-16 08:15:17 +01:00
Daniel Madej
82b8d0d323 Stopping unplugged cache - changed behavior
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2022-02-15 12:34:00 +01:00
Daniel Madej
baac399c43 Test updates addressing test fail false positives
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2022-02-15 11:48:05 +01:00
Jan Musial
a65e4b7ea9 Add cache_start helper function tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2022-02-10 12:06:37 +01:00
Jan Musial
48725bb653 Fix cache_id usage in smoke tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2022-02-10 12:06:37 +01:00
Jan Musial
16b64a97f2 Update CLI message in tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2022-02-10 12:06:37 +01:00
Jan Musial
65b51a4ba7 Update tests for standby load
Signed-off-by: Jan Musial <jan.musial@intel.com>
2022-02-10 12:06:37 +01:00
Jan Musial
504966fdfa Un-hide tests not executed because of naming collisions
Signed-off-by: Jan Musial <jan.musial@intel.com>
2022-02-10 12:06:37 +01:00
Robert Baldyga
b263dec467
Merge pull request #1038 from karolinavelkaja/seq_cutoff_multi_core_test_2variants
test_seq_cutoff_multi_core improved to has 2 variants
2022-02-02 12:57:25 +01:00
Karolina Rogowska
851cd2c940 test_seq_cutoff_multi_core improved to has 2 variants
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2022-01-14 14:59:37 +01:00
Robert Baldyga
63bab9584c Redesign failover standby management
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2022-01-05 16:17:52 +01:00
Robert Baldyga
dc75d76087 Update metadata corruption smoke tests for flapping
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2022-01-04 19:33:12 +01:00
Daniel Madej
7ab8423b55 Send actual output to CmdException
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-11-08 11:27:52 +01:00
Slawomir Jankowski
0b299b7d96 Fix interruption tests
Add helper functions and use them in interruption tests.
Fix tests descriptions and messages.
Update test according to current behaviour of cache mode switching.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
2021-11-08 11:27:45 +01:00
Daniel Madej
6ad8f7b13b Example test for multidut execution
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-10-29 13:06:39 +02:00
Daniel Madej
b8bdbac21c Multidut execution enablement
Allow providing multiple --dut-config entries for a test
Store configured duts in TestRun.duts
Run setup for all provided duts
Save dut specific data to a dut object
On pytest collect display a list of tests with required no of duts
Create separate folders for logs per dut

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-10-29 13:06:02 +02:00
Rafal Stefanowski
acec05060d Fix license
Change license to BSD-3-Clause

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2021-10-28 12:46:42 +02:00
Adam Rutkowski
4e9ee56b78
Merge pull request #973 from jfckm/remove-tf
Remove references to test-framework
2021-10-22 14:10:15 +02:00
Rafal Stefanowski
4bae7269ce Add 'failover' to smoke-test's dictionary
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2021-10-22 11:23:18 +02:00
Jan Musial
bba0e5aa56 Remove test-framework submodule
Signed-off-by: Jan Musial <jan.musial@intel.com>
2021-10-22 09:03:26 +02:00
Robert Baldyga
86c7a9f5ae
Merge pull request #964 from karolinavelkaja/metadata_mode_cleanup
Cleanup: removing 'metadata_mode' leftovers
2021-10-01 12:56:26 +02:00
Robert Baldyga
464cf141c0
Merge pull request #966 from karolinavelkaja/udev_test_imports_fix
Fixing imports in test_udev
2021-10-01 12:55:57 +02:00
Robert Baldyga
02b7abc263
Merge pull request #965 from karolinavelkaja/get_core_info_reader
Using DictReader for getting core info from 'list caches' command output
2021-09-29 00:16:03 +02:00
Karolina Rogowska
2b245a7177 Update error message for stopping cache
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-09-27 15:59:17 +02:00
Karolina Rogowska
67d0729355 Fixing imports in test_udev
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-09-27 15:49:30 +02:00
Karolina Rogowska
5951e5996f Using DictReader for getting core info from 'list caches' command output
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-09-27 15:44:28 +02:00
Karolina Rogowska
f057eba2cb Removing 'metadata_mode' leftovers
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-09-27 15:35:44 +02:00
Robert Baldyga
a13ddfbfa8
Merge pull request #790 from karolinavelkaja/zero_metadata_test
Adding new test for '--zero-metadata' command
2021-09-14 07:57:00 +02:00
Robert Baldyga
99973df8b5
Merge pull request #586 from karolinavelkaja/fault_injection_many_cores_raid_as_cache_test
Adding test 'test_many_cores_raid_as_cache'
2021-09-13 22:19:59 +02:00
Robert Baldyga
c191bcca18
Merge pull request #723 from karolinavelkaja/new_file_lvm_common
add supporting methods for lvm tests in new file
2021-09-10 09:46:55 +02:00
Robert Baldyga
4b084ea082
Merge pull request #932 from karolinavelkaja/stop_all_caches_refactor
cosmetic changes for exception logging in stop_all_caches()
2021-09-10 09:16:31 +02:00
Robert Baldyga
4c7661623a
Merge pull request #936 from Deixx/api-remove-inactive
Remove inactive commands tests and API update
2021-09-10 09:16:18 +02:00
Robert Baldyga
c2cf92b770
Merge pull request #941 from Deixx/clean-cleaning
Moved tests from acp_params.py to test_acp.py
2021-09-10 09:16:06 +02:00
klapinsk
d4b3f26241 Remove inactive commands tests and API update
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-09-08 13:03:57 +02:00
Robert Baldyga
dbf5b9d7c2
Merge pull request #935 from Deixx/test-io-class-info
[test] Slightly more detailed info in a reclassification test
2021-09-01 09:47:04 +02:00
Daniel Madej
ffa7eb0b19 Moved tests from acp_params.py to test_acp.py
Minor fixes in test_alru.py

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-08-31 08:05:26 +02:00
Daniel Madej
662ec9fca8 Remove 'metadata mode' from test API
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-08-30 14:28:18 +02:00
Karolina Rogowska
2d68150eeb Adding test case 'test_many_cores_raid_as_cache'
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-26 15:22:50 +02:00
Karolina Rogowska
ba9bd29cb8 Adding new test for '--zero-metadata' command
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-26 14:17:22 +02:00
Robert Baldyga
8389e22243
Merge pull request #928 from oshchirs/move_cas_log_configuration
Add CAS log dump to extra logs
2021-08-26 10:27:21 +02:00
Oleksandr Shchirskyi
8a3da66736 Change test-framework version
Signed-off-by: Oleksandr Shchirskyi <oleksand.shchirskyi@intel.com>
2021-08-26 10:03:09 +02:00
Daniel Madej
f00d10dee9 [test] Slightly more detailed info in a reclassification test
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-08-23 16:43:35 +02:00
Oleksandr Shchirskyi
daae3f7439 Move extra logs definition to dut_config
Signed-off-by: Oleksandr Shchirskyi <oleksand.shchirskyi@intel.com>
2021-08-23 12:38:32 +02:00
Karolina Rogowska
249e0a5a7e cosmetic changes for exception logging in stop_all_caches()
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-20 15:44:32 +02:00
Robert Baldyga
1c506bfa8a
Merge pull request #898 from karolinavelkaja/cleanup_framework_eviction_policy
cleanup framework - eviction policy
2021-08-20 10:21:32 +02:00
Robert Baldyga
9dd49e2964
Merge pull request #918 from Deixx/test-seq-workload-change
Limit workload for large cores in seq cutoff test
2021-08-20 10:21:22 +02:00
Robert Baldyga
fb766a686d
Merge pull request #901 from karolinavelkaja/concurrent_flushes_test_fix
test_concurrent_flushes - use HDD disk as a core
2021-08-20 10:20:54 +02:00
Oleksandr Shchirskyi
19f03bc4e6 Add CAS log dump to extra logs
Commit 51a8fca8872808c0809ef715c9b6a8d19b9310f3 in test-framework
adds possibility to specify extra logs to dump.
Move CAS log to this extra logs, as it's project specific logs not
related to generic test framework

Signed-off-by: Oleksandr Shchirskyi <oleksand.shchirskyi@intel.com>
2021-08-19 16:13:00 +02:00
Karolina Rogowska
31e2adc95f add supporting methods for lvm tests in new file
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-12 15:28:15 +02:00
Robert Baldyga
c968285d9f Remove upgrade-in-flight feature
Due to changes in Linux kernel this feature is not working anymore.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2021-08-11 20:33:16 +02:00
Daniel Madej
b6f33e733b Limit workload for large cores in seq cutoff test
So far the test was writing data equal in size to the core size.
With xTB cores this results in a very long execution time.

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2021-08-11 11:23:08 +02:00
Robert Baldyga
5afc8af0e8
Merge pull request #899 from karolinavelkaja/cli_messages_update_and_tests
update cli messages and tests accordingly
2021-08-09 20:46:37 +02:00
Robert Baldyga
284ec95abf
Merge pull request #902 from karolinavelkaja/io_engines_test_fix
test_io_engines fix - remove rbd io engine from io engine parameters
2021-08-09 11:07:33 +02:00
Karolina Rogowska
ec9a7ca19c update cli messages and tests accordingly
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-05 15:49:27 +02:00
Karolina Rogowska
31c8d7866a test_io_engines fix - remove rbd io engine from io engine parameters
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-08-05 14:14:53 +02:00
Karolina Rogowska
1d24c62f0e test_concurrent_flushes - use HDD disk as a core
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-07-28 16:02:03 +02:00
Karolina Rogowska
beb36f045c cleanup framework - eviction policy
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-07-28 14:08:10 +02:00
Jan Musial
2b6954a978 Fix lba classification test
Signed-off-by: Jan Musial <jan.musial@intel.com>
2021-07-28 09:57:57 +02:00
Michal Mielewczyk
70c44c84ef tests: verify if disk serial is valid
Check whether disk serial number matches the one given in dut config file

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2021-07-01 15:44:21 +02:00
Michal Mielewczyk
cdf0940292 test api: Remove eviction from cache config stats
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2021-07-01 15:44:21 +02:00
Robert Baldyga
cb69102f9f
Merge pull request #781 from karolinavelkaja/soft_hot_plug_test_longer_io
longer io in test_soft_hot_plug_device
2021-06-22 08:59:49 +02:00
Robert Baldyga
6c3fc4d3c5
Merge pull request #736 from karolinavelkaja/example_test_fix_for_warning
fix warning in example_test.py
2021-06-22 08:59:34 +02:00
Adam Rutkowski
7aa883dbd3 OCF update (removed configurable eviction policy)
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2021-06-21 22:56:51 +02:00
Katarzyna Łapińska
619a1ce6a2
Merge pull request #820 from karolinavelkaja/init_status_test_fix
improve test_initialize_status
2021-05-24 14:21:41 +02:00
Katarzyna Łapińska
47ab2162e2
Merge pull request #810 from katlapinka/recovery-test-fixes
Count md5sum of tmp files in recovery tests before reboot
2021-05-24 14:21:05 +02:00
Katarzyna Łapińska
1efac24c79
Merge pull request #818 from karolinavelkaja/trim_test_improvement
improve test_trim_device_discard_support
2021-05-24 14:20:30 +02:00
Karolina Rogowska
dc6ff508ed improve test_initialize_status
- add some time for CAS management device to show up before checking its presence

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-05-11 15:15:42 +02:00
Karolina Rogowska
3e7c51a2fc improve test_ioclass_file_size
- add sync and drop caches after 'dd' commands

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-05-11 15:04:01 +02:00
Karolina Rogowska
dd83fcb7e7 improve test_trim_device_discard_support
- adding more time for discards monitoring

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-05-11 14:56:18 +02:00
Katarzyna Łapińska
d32a8b0f88
Merge pull request #774 from karolinavelkaja/fix_ioclass_pid_test
test fix: test_ioclass_pid
2021-05-10 15:29:01 +02:00
Katarzyna Łapińska
7bd370428d
Merge pull request #775 from karolinavelkaja/fix_ioclass_eviction_priority_test
test fix: test_ioclass_eviction_priority
2021-05-10 15:27:15 +02:00
Katarzyna Łapińska
c9938d1e4c
Merge pull request #773 from katlapinka/test-fixes
Scope minor tests fixes
2021-05-10 13:56:13 +02:00
Katarzyna Łapińska
dd65a4fe7c
Merge pull request #635 from katlapinka/trim-test-fix
Device not supporting discards instead of random HDD in test checking discards support
2021-04-30 14:48:59 +02:00
klapinsk
5b722b3a07 Scope tests fixes
Signed-off-by: klapinsk <katarzyna.lapinska@intel.com>
2021-04-30 14:46:52 +02:00
klapinsk
28ae17e23b Count md5sum of tmp files in recovery tests before reboot
Signed-off-by: klapinsk <katarzyna.lapinska@intel.com>
2021-04-28 15:16:42 +02:00
Michal Mielewczyk
3503d81d9b tests: fix trim eviction test
Consider IO to metadata as vaild

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2021-04-28 09:51:18 +02:00
Robert Baldyga
c46c638e2e
Merge pull request #802 from arutk/stop_error_handling
Properly handle flush error in cache stop
2021-04-15 18:11:47 +02:00
Adam Rutkowski
2a9a77edac Change cache stopping in recovery tests
It is required to stop cache with "--flush=no" when
cache device is detached.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2021-04-15 18:15:55 -05:00
Jan Musial
12ddcceb98 Update test-framework
Signed-off-by: Jan Musial <jan.musial@intel.com>
2021-04-15 09:32:50 +02:00
Karolina Rogowska
4a274ff010 longer io in test_soft_hot_plug_device
Fix for problem: io ended before core disappeared from the system after unplug so then were no errors counted/detected.

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-04-01 14:45:20 +02:00
Karolina Rogowska
5f59376ea9 test fix: test_ioclass_eviction_priority
Using workload path per each io class

Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-03-31 20:25:15 +02:00
Karolina Rogowska
ade2384290 test fix: test_ioclass_pid
Signed-off-by: Karolina Rogowska <karolina.rogowska@intel.com>
2021-03-30 16:48:20 +02:00
Robert Baldyga
d220aad77b test: Extend seq cutoff test to validate promotion count
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2021-03-23 07:55:46 +01:00
Robert Baldyga
ff4dca4622 Add sequential cutoff promotion count to test API
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2021-03-23 07:55:46 +01:00