Commit Graph

962 Commits

Author SHA1 Message Date
Robert Baldyga
9286c0eae7
Merge pull request #168 from Deixx/effective-ioclass
Test for determining effective io class
2019-12-27 12:24:35 +01:00
Daniel Madej
02e19e466c Test for determining effective io class
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-12-23 13:51:09 +01:00
Slawomir_Jankowski
40c91426ba Add fault injection tests
Try load cache with core device already mounted.
OpenCAS prevents stop when partition is mounted.
Check if used in one CAS instance core device can be added to second CAS instance.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
2019-12-23 12:00:38 +01:00
Slawomir_Jankowski
4c77a7a4ff Test update
Update test after separating functions from this test to other files.
Add 'dut_config' to .gitignore.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
2019-12-23 12:00:38 +01:00
Sławomir Jankowski
8356174d80
Merge pull request #236 from rafalste/tests_cache_mode_switching
Add tests for dynamic cache mode switching
2019-12-23 11:59:49 +01:00
Ostrokrzew
b6028a8787 Minor fixes in CAS API
Add casting to int in few cleaning policy params.
Fix few typos.
Add equation overload in cleaning policy params' classes.

Signed-off-by: Ostrokrzew <ostrokrzew@protonmail.com>
2019-12-23 11:47:13 +01:00
Rafal Stefanowski
d0f19af99a Add tests for dynamic cache mode switching
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-20 16:38:10 +01:00
Jan Musiał
662129aa40
Merge pull request #226 from katlapinka/incremental-load-tests
Add incremental load tests
2019-12-20 13:30:55 +01:00
Katarzyna Łapińska
e6135fcd5e
Merge pull request #234 from katlapinka/corepool-tests
Add incremental load tests with core pool
2019-12-20 11:01:09 +01:00
Katarzyna Lapinska
844411864f Add incremental load tests with core pool 2019-12-20 10:13:25 +01:00
Michal Rakowski
135863e744
Merge pull request #235 from katlapinka/add-detached-core
Enable try-add method in CAS test-framework API
2019-12-20 09:54:03 +01:00
Katarzyna Lapinska
3ebf3fb913 Add incremental load tests 2019-12-19 14:24:19 +01:00
Michal Rakowski
b755bb9121
Merge pull request #246 from katlapinka/prepare-fix
Small prepare fixes: remove dm devices and move setting default init config
2019-12-19 12:50:49 +01:00
Daniel Madej
c51866989f
Merge pull request #224 from katlapinka/cli-msg-validate
Add API to validate CAS CLI messages
2019-12-19 12:32:09 +01:00
Katarzyna Lapinska
24d9bc9448 Small prepare fixes: remove dm devices and move setting default init config 2019-12-19 11:55:03 +01:00
Michal Rakowski
2f26307ee7 Add functional tests for sequential cut-off
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-12-19 11:49:05 +01:00
Katarzyna Lapinska
ad90a69284 Enable try-add method in CAS test-framework API 2019-12-19 07:55:06 +01:00
Jan Musial
3ab388e9fe Add test for errors on cache inserts
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
d9074c1950 Add cleanup of DM in conftest
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
62d7c96957 Fixes for CLI tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
3908ab261b Minor fixes in CAS API
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 15:02:52 +01:00
Daniel Madej
9cabf06ed4
Merge pull request #242 from rafalste/fix_api_minor_issues
Fix minor issues in API
2019-12-18 14:15:09 +01:00
Rafal Stefanowski
b6d9892499 Add string representation for cleaning policy
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:17:27 +01:00
Rafal Stefanowski
a9f74d43a2 Fix Time class output
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:17:06 +01:00
Rafal Stefanowski
b1c90bf574 Fix typo in casadm_parser.py
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:16:27 +01:00
Jan Musiał
743de9a438
Merge pull request #225 from katlapinka/cas-api-plug-and-cache-params
Adapt CAS API to handle disk plugging and fix for setting clean…
2019-12-18 09:01:45 +01:00
Katarzyna Lapinska
bc9fb51482 Add API to validate CAS CLI messages 2019-12-18 09:00:37 +01:00
Rafal Stefanowski
b1e653a61c Add string representation for cache mode
When relating to CacheMode enum, returned value was for example "CacheMode.WT"
which doesn't look very pretty in logs or output.

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-16 11:13:35 +01:00
Katarzyna Lapinska
70955c1274 Adapt CAS API to handle disk plugging and fix for setting cleaning/cutoff params 2019-12-13 09:14:09 +01:00
Adam Rutkowski
da7005c1f9
Merge pull request #220 from rafalste/fix_tests_for_new_stats_api
Fix tests to use new statistics API
2019-12-11 16:32:34 +01:00
Robert Baldyga
7fb9d1008e
Merge pull request #218 from rafalste/stats_api
Add new statistics API
2019-12-11 16:24:29 +01:00
Rafal Stefanowski
1899b1e853 Add new statistics API
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-11 16:00:03 +01:00
Marcin Dziegielewski
3d06a8191a Add two new tests - data integrity 12h.
Submodule update.

Signed-off-by: Marcin Dziegielewski <marcin.dziegielewski@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-12-10 18:38:50 +01:00
Jan Musiał
9c7b485cef
Merge pull request #207 from rafalste/tests_fault_injection
Add fault injection tests (same ID, remove IO)
2019-12-10 15:36:33 +01:00
Rafal Stefanowski
017ec7196a Fix tests to use new statistics API
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-10 15:06:54 +01:00
Katarzyna Łapińska
60200e9fb8
Merge pull request #203 from robertbaldyga/dont-copy-results
tests: Don't copy previous results to DUT during CAS installation
2019-12-03 09:00:35 +01:00
Rafal Stefanowski
c168244fa6 Fix attribute reference
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-02 14:35:08 +01:00
Katarzyna Łapińska
c5af20daee
Merge pull request #185 from Deixx/test-fixes
Test fixes
2019-11-29 15:10:12 +01:00
Robert Baldyga
a53846953c Use TestRun.makereport()
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-29 13:04:25 +01:00
Robert Baldyga
263f3137da Raise exception instead of using TestRun.exception()
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-29 13:04:25 +01:00
Rafal Stefanowski
f68d34b3ad Add fault injection tests (same ID, remove IO)
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-29 10:44:07 +01:00
Rafal Stefanowski
923015ed1e Improve handling of process killing
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-28 11:50:44 +01:00
Daniel Madej
695d9a688f Changes after review
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
830bcfd1b0 Test for exporting current IO class configuration to a file
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
ca115949ad Create IoClass class for rule management
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
c1872c3365 Update test-framework version
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Robert Baldyga
c1a82dd5ff tests: Don't copy previous results to DUT during CAS installation
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 13:42:25 +01:00
Robert Baldyga
913be2c7b8 tests: Don't use log before it's created
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 13:10:01 +01:00
Robert Baldyga
6e1770804b tests: Add missing import pytests in conftest.py
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 12:46:38 +01:00
Michał Mielewczyk
e70a807839
Merge pull request #200 from robertbaldyga/fix-exceptions
tests: Handle pytest test state properly
2019-11-27 11:11:31 +01:00
Robert Baldyga
116d13364b tests: Handle pytest test state properly
- Log information about test fail in case of exception.
- Skip teardown in case of test skip (setup is skipped by default).

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 10:42:25 +01:00
Katarzyna Łapińska
e46cd24892
Merge pull request #196 from rafalste/fix_indent
Fix CacheConfig class indentation issue
2019-11-26 09:27:00 +01:00
Michał Mielewczyk
43a4a92821
Merge pull request #195 from rafalste/flush_handling
tests: Improve flush handling during cache mode change
2019-11-25 16:53:51 +01:00
Rafal Stefanowski
66c695bd1e Fix CacheConfig class indentation issue
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-25 16:53:07 +01:00
Rafal Stefanowski
901fc402fd tests: Improve flush handling during cache mode change
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-25 09:27:59 +01:00
Michal Mielewczyk
be438dbe7c Extend example dut config wih 'allow_disk_autoselect' option.
By setting 'allow_disk_autoselect: True' user grants to framework permission
to autodiscover and override DUT's disks.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-11-20 22:09:40 -05:00
Michal Mielewczyk
9c31e15d48 Override DUT's disks in conftest.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-11-20 22:07:19 -05:00
Michal Rakowski
2203a46319 tests: add basic sequential cut off tests 2019-11-21 12:24:37 +01:00
Michal Rakowski
56b9ec1794 tests: sequential cut off related methods fixup
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-11-20 07:52:06 +01:00
Michał Mielewczyk
ac59a8f746
Merge pull request #183 from robertbaldyga/test-guidelines
tests: Introduce test writing guidelines
2019-11-19 09:00:44 +01:00
Jan Musiał
126615add1
Merge pull request #184 from katlapinka/improve-error-handling
Improve error handling and exception messages
2019-11-18 13:57:49 +01:00
Jan Musial
df1ba933de Update tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-11-18 09:18:05 +01:00
Katarzyna Lapinska
783daba8d4 Improve error handling and exception messages 2019-11-14 10:47:57 +01:00
Daniel Madej
235def1ec5 Remove logging objects
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
252f7104ca Fix - core and cache could use the same device
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
ccfc7001dc casadm returns Stats object instead of dict
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
034fa9b61c Use CmdException for casadm outputs
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:55:22 +01:00
Robert Baldyga
17241575d5 tests: Introduce test writing guidelines
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-08 17:30:19 +01:00
Katarzyna Lapinska
11352a6d21 Add stress tests without I/O 2019-11-07 17:04:34 +01:00
Robert Baldyga
4da68f426d tests: Update example using new utils
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-07 10:43:10 +01:00
Michał Mielewczyk
07d8fdbf01
Merge pull request #177 from katlapinka/opencas-plugin-as-singleton
Make opencas plugin as singleton class
2019-11-06 11:44:44 +01:00
Michał Mielewczyk
343d041160
Merge pull request #176 from robertbaldyga/config-type-field
tests: Add field 'type' to example dut config
2019-11-06 11:38:58 +01:00
Katarzyna Lapinska
eedb4ded7c Make opencas plugin as singleton class 2019-11-06 08:32:29 +01:00
Robert Baldyga
fe5dd80c0c tests: Don't call base_prepare() in tests
The base_prepare() function is now called automatically during test
setup so there is no longer need to call it from each test manually.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-05 18:54:02 +01:00
Michał Mielewczyk
5d643a48d8
Merge pull request #172 from robertbaldyga/update-installer
tests: Update installer
2019-11-05 14:49:39 +01:00
Robert Baldyga
7dd5a6fc12 tests: Remove unused adoptions
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 14:46:36 +01:00
Robert Baldyga
01cd284a48 Update installer to use local repository
As tests are now part of OCL repository, we prefer to always
run tests from local repository version on the same version
of OCL, so instead of cloning OCL from GitHub we just copy
local repository to DUT.

This also simplifies running remote tests in development
environment without need to push work-in-progress commits
to GitHub or installing OCL manually on DUT.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 14:46:36 +01:00
Katarzyna Lapinska
291ea908aa Destroy Log instance at the end of teardown method 2019-11-04 13:30:29 +01:00
Robert Baldyga
46c532e570 Unify quotes in exaple_dut_config.yml
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 11:13:54 +01:00
Robert Baldyga
ba63619d51 tests: Add field 'type' to example dut config
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 11:11:41 +01:00
Katarzyna Łapińska
00df533d15
Merge pull request #175 from robertbaldyga/fix-git-utils
tests: Fix git utils
2019-11-04 09:01:13 +01:00
Robert Baldyga
2a982aaf7e tests: Fix git utils
Return appropriate information instead of entire commit diff.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-31 14:58:29 +01:00
Katarzyna Lapinska
63937439b4 Add cache config and fix for cas modules names 2019-10-31 13:41:01 +01:00
Robert Baldyga
e4a31f51a5 Set working dir
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 16:15:54 +01:00
Robert Baldyga
fdf72785c7 Set repo_dir
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 16:00:24 +01:00
Robert Baldyga
c98b7e1bb3 Use git utils from cas API
Test framework does no longer provide git_utils, so we switch
to local implementation.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 10:30:14 +01:00
Robert Baldyga
2c080dd8ca Loosen cache disk type requirements for simple cli tests
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 14:42:27 +01:00
Robert Baldyga
ba9876ed52 Simplify waiting for connection
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 10:19:13 +01:00
Robert Baldyga
b65ff40bf0 Use "require_disk" mark
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 10:19:13 +01:00
Robert Baldyga
6bcc95d0cd Remove redundant call of base_prepare()
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 08:53:18 +01:00
Robert Baldyga
d5c39c8108 Append test-framework path before first imports from framework
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 08:53:18 +01:00
Katarzyna Lapinska
35d52caf74 Enable logging mechanism and example of logger usage in one test 2019-10-28 13:19:00 +01:00
Michał Mielewczyk
06b3e69c0f
Merge pull request #159 from robertbaldyga/update-readme-tests
Update Readme - installation and running tests
2019-10-21 15:02:39 +02:00
Robert Baldyga
4f1988cf87 Add .gitignore for functional tests
Ignore changes in plugins/ directory. This directory is for user plugins
which should not be added to Open CAS Linux repository.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-21 13:02:08 +02:00
Robert Baldyga
97738ac916 Make local test execution the default
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-21 12:32:50 +02:00
Robert Baldyga
4fb82abeca Move OCL tests from test-framework repository
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-18 15:27:21 +02:00
Rafal Stefanowski
b8a3cc7660 Add promotion policy smoke tests
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-10-01 15:40:04 +02:00
Jan Musial
c4a3d51fba Add utils tests for PP
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-09-20 13:40:44 +02:00
Jan Musial
86ccc817a6 Fix tests after moving to python3
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-09-20 13:40:44 +02:00
Michal Mielewczyk
f18e6ea152 Add 'nhit' keyword to spelling test dictionary.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-09-19 11:16:06 -04:00
Rafal Stefanowski
1ff7054323 Fix typo in smoke_test framework
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-09-19 13:04:56 +02:00
Michal Rakowski
8d80ef5aef smoke_tests: Fio test fixup
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-08-26 11:52:39 +02:00
Slawomir_Jankowski
91efcc528b Smoke tests update
**cache_suspend 03**: added 'if' statement to recognize nvme disk and pass test correctly;
**init_script 03**: added '--force' option to start cache with 'casadm' command.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
2019-08-22 11:24:34 +02:00
Michal Mielewczyk
5ff092eddb Extend smoke tests set
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-07-15 06:32:10 -04:00
Michal Mielewczyk
b8453d39e6 smoke tests: adapt existing tests to new metadata detection behavior.
In some tests start have to be performed with force flag.

Added new cache mode to dictionary.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-07-10 06:38:22 -04:00
Jan Musial
920720777f Add metadata corruption tests
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-06-26 12:15:10 +02:00
Kamil Lepek
f8bcca8f09 Remove date from smoke tests log directory
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
2019-06-24 13:03:46 +02:00
Michal Mielewczyk
569453f82d Added fio integrity test for different cache modes and cache line sizes.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-06-19 00:02:50 -04:00
Adam Rutkowski
cef2f89a87 Extend BVT tests to cover WO cache mode
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2019-06-13 15:54:51 -04:00
Jan Musial
aa0f3c078a Add tests for opencas.py
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-05-28 17:56:15 +02:00
Michal Rakowski
347644ad59 Basic WLTH-ioclass tests added
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-05-24 14:33:29 +02:00
Michal Mielewczyk
e7f6becf88 Added framework for smoke tests and few basic tests.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-04-15 11:51:19 -04:00