Michal Rakowski
b755bb9121
Merge pull request #246 from katlapinka/prepare-fix
...
Small prepare fixes: remove dm devices and move setting default init config
2019-12-19 12:50:49 +01:00
Daniel Madej
c51866989f
Merge pull request #224 from katlapinka/cli-msg-validate
...
Add API to validate CAS CLI messages
2019-12-19 12:32:09 +01:00
Katarzyna Lapinska
24d9bc9448
Small prepare fixes: remove dm devices and move setting default init config
2019-12-19 11:55:03 +01:00
Michal Rakowski
2f26307ee7
Add functional tests for sequential cut-off
...
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-12-19 11:49:05 +01:00
Katarzyna Lapinska
ad90a69284
Enable try-add method in CAS test-framework API
2019-12-19 07:55:06 +01:00
Jan Musial
3ab388e9fe
Add test for errors on cache inserts
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
d9074c1950
Add cleanup of DM in conftest
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
62d7c96957
Fixes for CLI tests
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 16:35:54 +01:00
Jan Musial
3908ab261b
Minor fixes in CAS API
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-12-18 15:02:52 +01:00
Daniel Madej
9cabf06ed4
Merge pull request #242 from rafalste/fix_api_minor_issues
...
Fix minor issues in API
2019-12-18 14:15:09 +01:00
Rafal Stefanowski
b6d9892499
Add string representation for cleaning policy
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:17:27 +01:00
Rafal Stefanowski
a9f74d43a2
Fix Time class output
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:17:06 +01:00
Rafal Stefanowski
b1c90bf574
Fix typo in casadm_parser.py
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-18 10:16:27 +01:00
Jan Musiał
743de9a438
Merge pull request #225 from katlapinka/cas-api-plug-and-cache-params
...
Adapt CAS API to handle disk plugging and fix for setting clean…
2019-12-18 09:01:45 +01:00
Katarzyna Lapinska
bc9fb51482
Add API to validate CAS CLI messages
2019-12-18 09:00:37 +01:00
Rafal Stefanowski
b1e653a61c
Add string representation for cache mode
...
When relating to CacheMode enum, returned value was for example "CacheMode.WT"
which doesn't look very pretty in logs or output.
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-16 11:13:35 +01:00
Katarzyna Lapinska
70955c1274
Adapt CAS API to handle disk plugging and fix for setting cleaning/cutoff params
2019-12-13 09:14:09 +01:00
Adam Rutkowski
da7005c1f9
Merge pull request #220 from rafalste/fix_tests_for_new_stats_api
...
Fix tests to use new statistics API
2019-12-11 16:32:34 +01:00
Robert Baldyga
7fb9d1008e
Merge pull request #218 from rafalste/stats_api
...
Add new statistics API
2019-12-11 16:24:29 +01:00
Rafal Stefanowski
1899b1e853
Add new statistics API
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-11 16:00:03 +01:00
Marcin Dziegielewski
3d06a8191a
Add two new tests - data integrity 12h.
...
Submodule update.
Signed-off-by: Marcin Dziegielewski <marcin.dziegielewski@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-12-10 18:38:50 +01:00
Jan Musiał
9c7b485cef
Merge pull request #207 from rafalste/tests_fault_injection
...
Add fault injection tests (same ID, remove IO)
2019-12-10 15:36:33 +01:00
Rafal Stefanowski
017ec7196a
Fix tests to use new statistics API
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-10 15:06:54 +01:00
Katarzyna Łapińska
60200e9fb8
Merge pull request #203 from robertbaldyga/dont-copy-results
...
tests: Don't copy previous results to DUT during CAS installation
2019-12-03 09:00:35 +01:00
Rafal Stefanowski
c168244fa6
Fix attribute reference
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-12-02 14:35:08 +01:00
Katarzyna Łapińska
c5af20daee
Merge pull request #185 from Deixx/test-fixes
...
Test fixes
2019-11-29 15:10:12 +01:00
Robert Baldyga
a53846953c
Use TestRun.makereport()
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-29 13:04:25 +01:00
Robert Baldyga
263f3137da
Raise exception instead of using TestRun.exception()
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-29 13:04:25 +01:00
Rafal Stefanowski
f68d34b3ad
Add fault injection tests (same ID, remove IO)
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-29 10:44:07 +01:00
Rafal Stefanowski
923015ed1e
Improve handling of process killing
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-28 11:50:44 +01:00
Daniel Madej
695d9a688f
Changes after review
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
830bcfd1b0
Test for exporting current IO class configuration to a file
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
ca115949ad
Create IoClass class for rule management
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Daniel Madej
c1872c3365
Update test-framework version
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-27 15:27:48 +01:00
Robert Baldyga
c1a82dd5ff
tests: Don't copy previous results to DUT during CAS installation
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 13:42:25 +01:00
Robert Baldyga
913be2c7b8
tests: Don't use log before it's created
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 13:10:01 +01:00
Robert Baldyga
6e1770804b
tests: Add missing import pytests in conftest.py
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 12:46:38 +01:00
Michał Mielewczyk
e70a807839
Merge pull request #200 from robertbaldyga/fix-exceptions
...
tests: Handle pytest test state properly
2019-11-27 11:11:31 +01:00
Robert Baldyga
116d13364b
tests: Handle pytest test state properly
...
- Log information about test fail in case of exception.
- Skip teardown in case of test skip (setup is skipped by default).
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-27 10:42:25 +01:00
Katarzyna Łapińska
e46cd24892
Merge pull request #196 from rafalste/fix_indent
...
Fix CacheConfig class indentation issue
2019-11-26 09:27:00 +01:00
Michał Mielewczyk
43a4a92821
Merge pull request #195 from rafalste/flush_handling
...
tests: Improve flush handling during cache mode change
2019-11-25 16:53:51 +01:00
Rafal Stefanowski
66c695bd1e
Fix CacheConfig class indentation issue
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-25 16:53:07 +01:00
Rafal Stefanowski
901fc402fd
tests: Improve flush handling during cache mode change
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-11-25 09:27:59 +01:00
Michal Mielewczyk
be438dbe7c
Extend example dut config wih 'allow_disk_autoselect' option.
...
By setting 'allow_disk_autoselect: True' user grants to framework permission
to autodiscover and override DUT's disks.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-11-20 22:09:40 -05:00
Michal Mielewczyk
9c31e15d48
Override DUT's disks in conftest.
...
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-11-20 22:07:19 -05:00
Michal Rakowski
2203a46319
tests: add basic sequential cut off tests
2019-11-21 12:24:37 +01:00
Michal Rakowski
56b9ec1794
tests: sequential cut off related methods fixup
...
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-11-20 07:52:06 +01:00
Michał Mielewczyk
ac59a8f746
Merge pull request #183 from robertbaldyga/test-guidelines
...
tests: Introduce test writing guidelines
2019-11-19 09:00:44 +01:00
Jan Musiał
126615add1
Merge pull request #184 from katlapinka/improve-error-handling
...
Improve error handling and exception messages
2019-11-18 13:57:49 +01:00
Jan Musial
df1ba933de
Update tests
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-11-18 09:18:05 +01:00
Katarzyna Lapinska
783daba8d4
Improve error handling and exception messages
2019-11-14 10:47:57 +01:00
Daniel Madej
235def1ec5
Remove logging objects
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
252f7104ca
Fix - core and cache could use the same device
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
ccfc7001dc
casadm returns Stats object instead of dict
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:56:15 +01:00
Daniel Madej
034fa9b61c
Use CmdException for casadm outputs
...
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
2019-11-12 18:55:22 +01:00
Robert Baldyga
17241575d5
tests: Introduce test writing guidelines
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-08 17:30:19 +01:00
Katarzyna Lapinska
11352a6d21
Add stress tests without I/O
2019-11-07 17:04:34 +01:00
Robert Baldyga
4da68f426d
tests: Update example using new utils
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-07 10:43:10 +01:00
Michał Mielewczyk
07d8fdbf01
Merge pull request #177 from katlapinka/opencas-plugin-as-singleton
...
Make opencas plugin as singleton class
2019-11-06 11:44:44 +01:00
Michał Mielewczyk
343d041160
Merge pull request #176 from robertbaldyga/config-type-field
...
tests: Add field 'type' to example dut config
2019-11-06 11:38:58 +01:00
Katarzyna Lapinska
eedb4ded7c
Make opencas plugin as singleton class
2019-11-06 08:32:29 +01:00
Robert Baldyga
fe5dd80c0c
tests: Don't call base_prepare() in tests
...
The base_prepare() function is now called automatically during test
setup so there is no longer need to call it from each test manually.
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-05 18:54:02 +01:00
Michał Mielewczyk
5d643a48d8
Merge pull request #172 from robertbaldyga/update-installer
...
tests: Update installer
2019-11-05 14:49:39 +01:00
Robert Baldyga
7dd5a6fc12
tests: Remove unused adoptions
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 14:46:36 +01:00
Robert Baldyga
01cd284a48
Update installer to use local repository
...
As tests are now part of OCL repository, we prefer to always
run tests from local repository version on the same version
of OCL, so instead of cloning OCL from GitHub we just copy
local repository to DUT.
This also simplifies running remote tests in development
environment without need to push work-in-progress commits
to GitHub or installing OCL manually on DUT.
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 14:46:36 +01:00
Katarzyna Lapinska
291ea908aa
Destroy Log instance at the end of teardown method
2019-11-04 13:30:29 +01:00
Robert Baldyga
46c532e570
Unify quotes in exaple_dut_config.yml
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 11:13:54 +01:00
Robert Baldyga
ba63619d51
tests: Add field 'type' to example dut config
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-11-04 11:11:41 +01:00
Katarzyna Łapińska
00df533d15
Merge pull request #175 from robertbaldyga/fix-git-utils
...
tests: Fix git utils
2019-11-04 09:01:13 +01:00
Robert Baldyga
2a982aaf7e
tests: Fix git utils
...
Return appropriate information instead of entire commit diff.
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-31 14:58:29 +01:00
Katarzyna Lapinska
63937439b4
Add cache config and fix for cas modules names
2019-10-31 13:41:01 +01:00
Robert Baldyga
e4a31f51a5
Set working dir
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 16:15:54 +01:00
Robert Baldyga
fdf72785c7
Set repo_dir
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 16:00:24 +01:00
Robert Baldyga
c98b7e1bb3
Use git utils from cas API
...
Test framework does no longer provide git_utils, so we switch
to local implementation.
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-30 10:30:14 +01:00
Robert Baldyga
2c080dd8ca
Loosen cache disk type requirements for simple cli tests
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 14:42:27 +01:00
Robert Baldyga
ba9876ed52
Simplify waiting for connection
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 10:19:13 +01:00
Robert Baldyga
b65ff40bf0
Use "require_disk" mark
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 10:19:13 +01:00
Robert Baldyga
6bcc95d0cd
Remove redundant call of base_prepare()
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 08:53:18 +01:00
Robert Baldyga
d5c39c8108
Append test-framework path before first imports from framework
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-29 08:53:18 +01:00
Katarzyna Lapinska
35d52caf74
Enable logging mechanism and example of logger usage in one test
2019-10-28 13:19:00 +01:00
Michał Mielewczyk
06b3e69c0f
Merge pull request #159 from robertbaldyga/update-readme-tests
...
Update Readme - installation and running tests
2019-10-21 15:02:39 +02:00
Robert Baldyga
4f1988cf87
Add .gitignore for functional tests
...
Ignore changes in plugins/ directory. This directory is for user plugins
which should not be added to Open CAS Linux repository.
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-21 13:02:08 +02:00
Robert Baldyga
97738ac916
Make local test execution the default
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-21 12:32:50 +02:00
Robert Baldyga
4fb82abeca
Move OCL tests from test-framework repository
...
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
2019-10-18 15:27:21 +02:00
Rafal Stefanowski
b8a3cc7660
Add promotion policy smoke tests
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-10-01 15:40:04 +02:00
Jan Musial
c4a3d51fba
Add utils tests for PP
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-09-20 13:40:44 +02:00
Jan Musial
86ccc817a6
Fix tests after moving to python3
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-09-20 13:40:44 +02:00
Michal Mielewczyk
f18e6ea152
Add 'nhit' keyword to spelling test dictionary.
...
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-09-19 11:16:06 -04:00
Rafal Stefanowski
1ff7054323
Fix typo in smoke_test framework
...
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
2019-09-19 13:04:56 +02:00
Michal Rakowski
8d80ef5aef
smoke_tests: Fio test fixup
...
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-08-26 11:52:39 +02:00
Slawomir_Jankowski
91efcc528b
Smoke tests update
...
**cache_suspend 03**: added 'if' statement to recognize nvme disk and pass test correctly;
**init_script 03**: added '--force' option to start cache with 'casadm' command.
Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
2019-08-22 11:24:34 +02:00
Michal Mielewczyk
5ff092eddb
Extend smoke tests set
...
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-07-15 06:32:10 -04:00
Michal Mielewczyk
b8453d39e6
smoke tests: adapt existing tests to new metadata detection behavior.
...
In some tests start have to be performed with force flag.
Added new cache mode to dictionary.
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-07-10 06:38:22 -04:00
Jan Musial
920720777f
Add metadata corruption tests
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-06-26 12:15:10 +02:00
Kamil Lepek
f8bcca8f09
Remove date from smoke tests log directory
...
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
2019-06-24 13:03:46 +02:00
Michal Mielewczyk
569453f82d
Added fio integrity test for different cache modes and cache line sizes.
...
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-06-19 00:02:50 -04:00
Adam Rutkowski
cef2f89a87
Extend BVT tests to cover WO cache mode
...
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
2019-06-13 15:54:51 -04:00
Jan Musial
aa0f3c078a
Add tests for opencas.py
...
Signed-off-by: Jan Musial <jan.musial@intel.com>
2019-05-28 17:56:15 +02:00
Michal Rakowski
347644ad59
Basic WLTH-ioclass tests added
...
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
2019-05-24 14:33:29 +02:00
Michal Mielewczyk
e7f6becf88
Added framework for smoke tests and few basic tests.
...
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
2019-04-15 11:51:19 -04:00