github/ocf
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
983 Commits 1 Branch 1 Tag 4.1 MiB
81fc7ab5c5
Commit Graph

229 Commits

Author SHA1 Message Date
Adam Rutkowski
81fc7ab5c5 Parallel eviction 
Eviction changes allowing to evict (remap) cachelines while
holding hash bucket write lock instead of global metadata
write lock.

As eviction (replacement) is now tightly coupled with request,
each request uses eviction size equal to number of its
unmapped cachelines.

Evicting without global metadata write lock is possible
thanks to the fact that remaping is always performed
while exclusively holding cacheline (read or write) lock.
So for a cacheline on LRU list we acquire cacheline lock,
safely resolve hash and consequently write-lock hash bucket.
Since cacheline lock is acquired under hash bucket (everywhere
except for new eviction implementation), we are certain that
noone acquires cacheline lock behind our back. Concurrent
eviction threads are eliminated by holding eviction list
lock for the duration of critial locking operations.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-03-05 11:20:47 +01:00
Robert Baldyga
ac9bd5b094
Merge pull request #453 from arutk/no_cl_gl_lock 
Skip cacheline concurrency global lock in fast path
 2021-03-04 12:33:50 +01:00
Michal Mielewczyk
3a26bc56cd pyocf: improve test logging 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
7f862c3080 pyocf: improve random string generator 
Set of random characters may be exteded with a custom list.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
a81be31dd4 pyocf: default range for int16 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
c4a2dc4cad pyocf: security tests for ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
fa556247d7 pyocf: change encoding of ioclass name 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
080e13a071 pyocf: valid ranges for ioclass config values 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
06edc48717 pyocf: remove min_size from ioclass config 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
95d756de91 Remove ioclass min_size from public API 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
5c053ad964 pyocf: security test for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
73d6fb33de pyocf: api for setting core seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
9aebf57efa pyocf: valid ranges for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
d909698790 pyocf: fix acp security test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
482861423b pyocf: security test for acp params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
43ff4aae5f pyocf: security test for alru params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
92f67c65f0 pyocf: valid ranges for cleaning policy params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 07:56:38 -05:00
Adam Rutkowski
9ff0fd5320 Cacheline concurrency deadlock detection test in UT 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-24 17:29:52 -06:00
Robert Baldyga
75baec5aa5
Merge pull request #456 from arutk/aalru 
Relax LRU list ordering to minimize list updates
 2021-02-18 13:48:54 +01:00
Michal Mielewczyk
83f142c987 Functional test for overflown pinned ioclass 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-16 07:07:01 -05:00
Adam Rutkowski
10c3c3de36 Renaming hash bucket locking functions 
1. new abbreviated previx: ocf_hb (HB stands for hash bucket)
2. clear distinction between functions requiring caller to
   hold metadata shared global lock ("naked") vs the ones
   which acquire global lock on its own ("prot" for protected)
3. clear distinction between hash bucket locking functions
   accepting hash bucket id ("id"), core line and lba ("cline")
   and entire request ("req").

Resulting naming scheme:
ocf_hb_(id/cline/req)_(prot/naked)_(lock/unlock/trylock)_(rd/wr)

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-12 18:08:15 -06:00
Robert Baldyga
d03ea719cd
Merge pull request #451 from arutk/exact_evict_count 
only request evict size equal to request unmapped count
 2021-02-11 10:47:12 +01:00
Adam Rutkowski
1908707a3d LRU list unit tests 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 16:23:01 -06:00
Adam Rutkowski
4276d65e5a unit tests for new eviction order 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 12:51:39 -06:00
Adam Rutkowski
5538a5a95d Only request evict size equal to request unmapped count 
Removing the logic for oportunistic partition overflow
reduction by evicting more cachelines than actually
required by the request being serviced.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 11:11:15 -06:00
Robert Baldyga
3543f5c5cc
Merge pull request #443 from rafalste/update_copyright 
Update copyright statements (2021)
 2021-02-03 11:59:39 +01:00
Michal Mielewczyk
3a7b55c4c2 Don't evict on hit 
If request is hit, simply try to acquire cachelines instead of verifying
whether target partition's size is not exceeded.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-01-29 17:15:32 -05:00
Rafal Stefanowski
6ed4cf8a24 Update copyright statements (2021) 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-01-21 13:17:34 +01:00
Robert Baldyga
dd508c595f
Merge pull request #430 from rafalste/fix_attach_load_paths 
Create separate pipelines and paths for cache attach/load scenarios
 2020-12-23 16:51:37 +01:00
Robert Baldyga
69e388a10f
Merge pull request #372 from arutk/wo_test_enhancements 
Extend WO engine functional tests
 2020-12-23 16:51:16 +01:00
Rafal Stefanowski
57d4aaf7c9 Return error status from ocf_freelist_init 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:43:46 +01:00
Rafal Stefanowski
88b97df16d Fix pipeline attach/load paths 
Create separate pipelines for cache attach and load scenarios.

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:31:49 +01:00
Michal Mielewczyk
2206b2fdef pyocf: cache attach test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
5c2a5c5e79 pyocf: add cache detach api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
93318696cd pyocf: ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
76148de310 Unit tests for mapping 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
418303eee8 UT for occupancy per ioclass utils 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Adam Rutkowski
680074eebc Add build requirements to unit tests readme 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:28 +01:00
Adam Rutkowski
d52083a445 unit tests for lru iterator 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:27 +01:00
Robert Baldyga
8b03271626 rbtree: Introduce list find callback 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-11-10 13:21:14 +01:00
root
934ea045fe Cover all read paths with read data integrity test logic 
Extending read test to run in all cachemodes.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
fef9d94a10 Rename WO data integrity test to "read" data integrity 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
62497cabee Extend WO engine funcional tests 
1. Adjust test to work with multiple cache lines
2. Extend test workset to cover larger I/O

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Robert Baldyga
4f80cde9dd
Merge pull request #382 from mmichal10/tree-ut 
ut: tests for rb tree
 2020-10-20 14:38:53 +02:00
Robert Baldyga
9a23787c6b
Merge pull request #406 from arutk/flush2 
Propagate I/O flags (e.g. FUA) to metadata flush I/O
 2020-10-06 12:49:22 +02:00
Adam Rutkowski
2b1c74ee86 Add test to check whether flush is sent after mngmt op 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:23 +02:00
Adam Rutkowski
693c07b865 pyocf: fix cache save method 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:14 +02:00
Adam Rutkowski
c7417b29fc pyocf: test for io flags propagation to bottom volumes 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-29 18:25:34 +02:00
Michal Mielewczyk
9b8ac42e0f ut: tests for rb tree 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-07-15 10:37:01 -04:00
Robert Baldyga
1c9312842a
Merge pull request #369 from rafalste/copyright_update 
Update copyright statements
 2020-05-06 12:42:10 +02:00