github/ocf
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,316 Commits 1 Branch 1 Tag 4.1 MiB
c7144decf8
Commit Graph

273 Commits

Author SHA1 Message Date
Michal Mielewczyk
080e13a071 pyocf: valid ranges for ioclass config values 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
06edc48717 pyocf: remove min_size from ioclass config 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
95d756de91 Remove ioclass min_size from public API 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
5c053ad964 pyocf: security test for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
73d6fb33de pyocf: api for setting core seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
9aebf57efa pyocf: valid ranges for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
d909698790 pyocf: fix acp security test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
482861423b pyocf: security test for acp params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
43ff4aae5f pyocf: security test for alru params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
92f67c65f0 pyocf: valid ranges for cleaning policy params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 07:56:38 -05:00
Slawomir Jankowski
eeda1f3f0f Unify type of dirty_for in info structs 
Reformat function that calculates how long cache/core is dirty
Update `dirty_for` types in functional tests

Values stored in info structs fields (both in cache and core structs)
are unsigned 64-bits ints but `dirty_for`s were unsigned 32-bits ints.

Use existing function to transform returned value to seconds.
Replace seconds stored in metadata with seconds.
Replacement was done if old value of replaced field was equal to zero.
Acquiring monotonic high precission timestamp is potentially
slow and it makes sense to compare the field's value
to zero before calling atomic function.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
 2021-02-25 14:51:53 +01:00
Adam Rutkowski
9ff0fd5320 Cacheline concurrency deadlock detection test in UT 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-24 17:29:52 -06:00
Robert Baldyga
75baec5aa5
Merge pull request #456 from arutk/aalru 
Relax LRU list ordering to minimize list updates
 2021-02-18 13:48:54 +01:00
Michal Mielewczyk
83f142c987 Functional test for overflown pinned ioclass 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-16 07:07:01 -05:00
Adam Rutkowski
10c3c3de36 Renaming hash bucket locking functions 
1. new abbreviated previx: ocf_hb (HB stands for hash bucket)
2. clear distinction between functions requiring caller to
   hold metadata shared global lock ("naked") vs the ones
   which acquire global lock on its own ("prot" for protected)
3. clear distinction between hash bucket locking functions
   accepting hash bucket id ("id"), core line and lba ("cline")
   and entire request ("req").

Resulting naming scheme:
ocf_hb_(id/cline/req)_(prot/naked)_(lock/unlock/trylock)_(rd/wr)

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-12 18:08:15 -06:00
Robert Baldyga
d03ea719cd
Merge pull request #451 from arutk/exact_evict_count 
only request evict size equal to request unmapped count
 2021-02-11 10:47:12 +01:00
Adam Rutkowski
1908707a3d LRU list unit tests 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 16:23:01 -06:00
Adam Rutkowski
4276d65e5a unit tests for new eviction order 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 12:51:39 -06:00
Adam Rutkowski
5538a5a95d Only request evict size equal to request unmapped count 
Removing the logic for oportunistic partition overflow
reduction by evicting more cachelines than actually
required by the request being serviced.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 11:11:15 -06:00
Robert Baldyga
3543f5c5cc
Merge pull request #443 from rafalste/update_copyright 
Update copyright statements (2021)
 2021-02-03 11:59:39 +01:00
Michal Mielewczyk
3a7b55c4c2 Don't evict on hit 
If request is hit, simply try to acquire cachelines instead of verifying
whether target partition's size is not exceeded.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-01-29 17:15:32 -05:00
Rafal Stefanowski
6ed4cf8a24 Update copyright statements (2021) 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-01-21 13:17:34 +01:00
Robert Baldyga
dd508c595f
Merge pull request #430 from rafalste/fix_attach_load_paths 
Create separate pipelines and paths for cache attach/load scenarios
 2020-12-23 16:51:37 +01:00
Robert Baldyga
69e388a10f
Merge pull request #372 from arutk/wo_test_enhancements 
Extend WO engine functional tests
 2020-12-23 16:51:16 +01:00
Rafal Stefanowski
57d4aaf7c9 Return error status from ocf_freelist_init 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:43:46 +01:00
Rafal Stefanowski
88b97df16d Fix pipeline attach/load paths 
Create separate pipelines for cache attach and load scenarios.

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:31:49 +01:00
Michal Mielewczyk
2206b2fdef pyocf: cache attach test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
5c2a5c5e79 pyocf: add cache detach api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
93318696cd pyocf: ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
76148de310 Unit tests for mapping 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
418303eee8 UT for occupancy per ioclass utils 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Adam Rutkowski
680074eebc Add build requirements to unit tests readme 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:28 +01:00
Adam Rutkowski
d52083a445 unit tests for lru iterator 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:27 +01:00
Robert Baldyga
8b03271626 rbtree: Introduce list find callback 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-11-10 13:21:14 +01:00
root
934ea045fe Cover all read paths with read data integrity test logic 
Extending read test to run in all cachemodes.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
fef9d94a10 Rename WO data integrity test to "read" data integrity 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
62497cabee Extend WO engine funcional tests 
1. Adjust test to work with multiple cache lines
2. Extend test workset to cover larger I/O

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Robert Baldyga
4f80cde9dd
Merge pull request #382 from mmichal10/tree-ut 
ut: tests for rb tree
 2020-10-20 14:38:53 +02:00
Robert Baldyga
9a23787c6b
Merge pull request #406 from arutk/flush2 
Propagate I/O flags (e.g. FUA) to metadata flush I/O
 2020-10-06 12:49:22 +02:00
Adam Rutkowski
2b1c74ee86 Add test to check whether flush is sent after mngmt op 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:23 +02:00
Adam Rutkowski
693c07b865 pyocf: fix cache save method 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:14 +02:00
Adam Rutkowski
c7417b29fc pyocf: test for io flags propagation to bottom volumes 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-29 18:25:34 +02:00
Michal Mielewczyk
9b8ac42e0f ut: tests for rb tree 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-07-15 10:37:01 -04:00
Robert Baldyga
1c9312842a
Merge pull request #369 from rafalste/copyright_update 
Update copyright statements
 2020-05-06 12:42:10 +02:00
Rafal Stefanowski
38e7e19290 Update copyright statements 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-04-28 13:37:54 +02:00
Michal Rakowski
0f85a73669 pyocf: test_eviction fixup 
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
 2020-04-24 15:34:59 +02:00
Robert Baldyga
188559416c
Merge pull request #354 from robertbaldyga/multistream-seq-cutoff 
Introduce multi-stream seqential cutoff
 2020-04-22 15:35:42 +02:00
Jan Musial
9a8eb7ed90 Basic test for multistream seq cutoff 
Signed-off-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
93a0d9554c Implement API for setting seq cutoff threshold 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
e4b11b6933 Add context to OcfCompletion 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
52962402fe Extend Size class to enable arithmetics 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Robert Baldyga
a9c36477d2 Fix deadlock on concurrent flush at the same cache 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-03 18:09:35 +02:00
Robert Baldyga
f7d191b765 ut: Add cache allocation & do little cleanup 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-03-23 12:38:43 +01:00
Robert Baldyga
c295a4f670 ut: Add .gitignore 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-03-23 12:33:12 +01:00
Jan Musial
e5aff609d9 Add test for huge cache 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-01-21 15:29:24 +01:00
Robert Baldyga
ce28c71475
Merge pull request #326 from Ostrokrzew/upstream 
Change error code
 2020-01-10 13:38:18 +01:00
Kamil Lepek
5828a7d0ae Added codecov badge to README, added coverage files to .gitignore 2020-01-09 10:54:59 +01:00
Michal Rakowski
bc866e5f9a pyocf: fix security mngmt_start_fuzzy test 2020-01-08 14:06:54 +01:00
Kamil Lepek
0d6660d4f3 Enable code coverage tracking in pyocf 2020-01-08 11:02:07 +01:00
Ostrokrzew
3fca309e51 Change error code and add new 
Change 'OCF_ERR_START_CACHE_FAIL' to 'OCF_ERR_NO_MEM' while CAS fails in case of memory lack on device.
Add new error code for case, when device doesn't satisfy CAS requirements - 'OCF_ERR_INVAL_CACHE_DEV'.
Use 'OCF_ERR_INVAL_CACHE_DEV' in code.
Update error code match in test.
closes #317 issue

Signed-off-by: Ostrokrzew <slawomir.jankowski@intel.com>
 2020-01-02 09:34:24 +01:00
Robert Baldyga
2ca8dcd73e ut: Replace deprecated 'commands' module with 'subprocess' 
The 'commands' modules has been removed in python 3.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-12-10 17:39:17 +01:00
Robert Baldyga
1525e85805 Add global random seed config 
This is needed to make fuzzy tests work with xdist as each
xdist gateway expects to receive the same set of parameter
values, which for random generators may be achieved only by
providing globally shared seed.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
b9b39fdb46 Add more fine-grained fixtures for fuzzy tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
ab1df71476 Make random generator API fluent 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 14:36:31 +02:00
Katarzyna Lapinska
219ccf360c Add new negative io tests and raising error when failed to create io 
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
 2019-10-02 20:35:25 +02:00
Robert Baldyga
58403f2cd4 Test with io aligned to sector size 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-02 19:46:28 +02:00
Michal Rakowski
74954667a2
Merge pull request #308 from arutk/fix_hash_bucket_lock_iter 
Fix hash bucket lock iter
 2019-10-02 17:22:12 +02:00
Adam Rutkowski
a3f3a79f75 unit test: extend hash bucket locking test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-10-02 18:43:46 -04:00
Michał Mielewczyk
1ef67ec4b2
Merge pull request #305 from KamilLepek/remove_sec_test 
Remove redundant security test (id has been removed for cache in ocf)
 2019-10-02 14:58:17 +02:00
Kamil Lepek
fe0d663c25 Remove redundant security test (id has been removed for cache in ocf) 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-10-02 14:06:06 +02:00
Slawomir_Jankowski
717b8aa259 UT prapare update 
**CMake lists**: link Zlib;
include libs for UT during compilation.
**prapare script**: add path to regular ocf_env files;
ignore 'memcpy' functions when copied to wrappers.
**cleaning policy**: update of some functions for proper use of atomics.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:28:27 +02:00
Slawomir_Jankowski
5d0a6fa05a UT cleanup and path update 
**run tests script**: cleanup before UT starts;
usage of regular ocf_env files by symlinks.
**tests conifg**: add path to regular ocf_env files.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:26:38 +02:00
Slawomir_Jankowski
e248c68846 Delete duplicates 
Delete unnecessary duplicated ocf_env files from UT directory.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:25:26 +02:00
Slawomir_Jankowski
0696ec1f9c Aesthetic changes 
Aesthetic changes, typos fix and delete recursive inclusions.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:24:16 +02:00
Michał Mielewczyk
e02821d399
Merge pull request #302 from Deixx/empty-cache-name 
Recognize empty string as an incorrect cache name
 2019-10-01 13:19:20 +02:00
Daniel Madej
35d71e14f3 Recognize empty string as an incorrect cache name 
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-10-01 12:55:46 +02:00
Adam Rutkowski
5113542c7f
Merge pull request #297 from mmichal10/pp-params-in-sb 
Store PP config params in cache superblock.
 2019-10-01 12:32:15 +02:00
Michal Mielewczyk
e16d4e6dda Initialize promotion policy on cache attach. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-10-01 06:11:53 -04:00
Robert Baldyga
29f0f33502 tests: functional: Add pretty random generators 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-01 09:49:02 +02:00
Slawomir_Jankowski
cdf0caf704 **ocf_mngt.h**: In core name change 
pointer type to array which is 32 characters long;
**core.py**: Add missing import and modify class' field type
to keep consistency;
**ocf_mngt_core**: Remove local variable 'name';
remove env_vmalloc for 'name' - isn't no longer needed;
remove initialization 'name' - as above;
remove env_vfree for context->cfg.name - variable isn't no allocated
in memory;
check if cfg->name exists;
change label in goto from deleted err_name to the closest err_pipeline.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-09-30 15:55:33 +02:00
Michal Mielewczyk
dfc55538ce Store PP config params in cache superblock. 
It allows to modify and retrieve particular PP params event if it isn't active
and store values between cache stop and load.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-27 10:55:58 -04:00
Robert Baldyga
6a0fb109e8 test_eviction: Use new_io() method with proper arguments 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-09-27 12:08:11 +02:00
Michal Mielewczyk
d332c9d97f New ocf error code in test framework. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-25 03:54:33 -04:00
Adam Rutkowski
938795e081 Unit tests for hash bucket locks ordering 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-20 17:21:00 -04:00
Jan Musial
21a3945a3c Fix PP tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-20 14:56:32 +02:00
Michał Mielewczyk
9d41c94827
Merge pull request #264 from KamilLepek/new_sec 
Negative tests for promotion policy
 2019-09-19 12:45:09 +02:00
Jan Musial
6b1d1754db Fix secure erase tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-19 10:10:20 +02:00
Kamil Lepek
71d8c8d698 Negative tests for promotion policy 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-09-18 17:59:40 +02:00
Kamil Lepek
daae1b915d Fix for security tests need of name param when creating multiple cores 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-09-18 11:12:58 +02:00
Michał Mielewczyk
0391fc17b7
Merge pull request #255 from imjfckm/pp-tests 
Add promotion policies functional tests
 2019-09-16 09:34:16 +02:00
Michal Mielewczyk
5042c5fc43 pyocf: adapt tests to new inactive cores stats. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-16 02:49:42 -04:00
Jan Musial
9c51ca4e97 Tests for promotion policy 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-11 10:31:14 +02:00
Michal Rakowski
29c1c7f9e8
Merge pull request #253 from mmichal10/stats-refactor 
Stats builder for ioclasses
 2019-09-10 14:56:26 +02:00
Michal Mielewczyk
5f357272d1 pyocf: adjust pyocf to new core stats api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-10 08:01:09 -04:00
Adam Rutkowski
0c31cc62d0 Freelist test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-09 16:19:52 -04:00
Adam Rutkowski
964ba85467 unit tests: improve test logs content 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-09 16:19:52 -04:00
Robert Bałdyga
5fd239d2bb
Merge pull request #245 from imjfckm/switching-pp 
Switching mechanism for promotion policies
 2019-08-30 11:35:16 +02:00
Adam Rutkowski
63c71ec6df pytest: basic cache recovery test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-08-29 17:06:26 -04:00
Jan Musial
a1d3cf0c4d Switching mechanism for promotion policies 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-08-29 13:24:26 +02:00
Michal Rakowski
e3a20c0da0
Merge pull request #239 from imjfckm/pp-implementation 
nhit promotion policy implementation
 2019-08-27 12:42:03 +02:00