github/ocf
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,728 Commits 1 Branch 1 Tag 4.1 MiB
d892e3b0d5
Commit Graph

446 Commits

Author SHA1 Message Date
Adam Rutkowski
4f217b91a5 Remove partition list 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-06-18 12:19:08 +02:00
Adam Rutkowski
87f834c793 Move common user and freelist partition data to a new struct 
New structure ocf_part is added to contain all the data common for both
user partitions and freelist partition: part_runtime and part_id.
ocf_user_part now contains ocf_part structure as well as pointer to
cleaning partition runtime metadata (moved out from part_runtime) and
user partition config (no change here).

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-06-18 12:07:10 +02:00
Kozlowski Mateusz
367fcbfe4e Update debug prints and methods 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-06-16 13:48:37 +02:00
Kozlowski Mateusz
c17b587444 Update cache line concurrency unit tests 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-06-16 13:48:37 +02:00
Kozlowski Mateusz
ce316cc67c Change alock API to include slow/fast lock callbacks 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-06-16 13:48:35 +02:00
Adam Rutkowski
f589341c9a remove metadata updater 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-06-15 10:25:05 +02:00
Jan Musial
9f1df6e380 Update pyOCF and tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2021-05-26 07:57:37 +02:00
Michal Mielewczyk
d5ae764175 pyocf: fix valid seq cutoff threshold range 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-04-15 11:09:26 +02:00
Michal Mielewczyk
0bfa9ed870 pyocf: Seq-cutoff promotion count security tests 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-04-14 15:40:29 +02:00
Michal Mielewczyk
8e0bb49493 functional test for eviction between cores 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-04-01 18:01:28 -05:00
Kozlowski Mateusz
3f9af8bd82 Update pyocf types to new field order 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-03-26 08:57:04 +01:00
Michal Mielewczyk
92a5ddd524 ut framework: don't mock env functions 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-19 16:08:27 +01:00
Michal Mielewczyk
0d3f3cde14 Return error when modifying default ioclass rule 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-19 16:06:23 +01:00
Robert Baldyga
8020e7fd67
Merge pull request #457 from Ostrokrzew/false_stats 
Fix broken 'dirty_for' stats
 2021-03-18 10:24:02 +01:00
Michał Mielewczyk
d2b5de7970
Merge pull request #448 from robertbaldyga/perqueue-seq-cutoff 
Per-queue multi-stream sequential cutoff
 2021-03-05 14:38:21 +01:00
Adam Rutkowski
81fc7ab5c5 Parallel eviction 
Eviction changes allowing to evict (remap) cachelines while
holding hash bucket write lock instead of global metadata
write lock.

As eviction (replacement) is now tightly coupled with request,
each request uses eviction size equal to number of its
unmapped cachelines.

Evicting without global metadata write lock is possible
thanks to the fact that remaping is always performed
while exclusively holding cacheline (read or write) lock.
So for a cacheline on LRU list we acquire cacheline lock,
safely resolve hash and consequently write-lock hash bucket.
Since cacheline lock is acquired under hash bucket (everywhere
except for new eviction implementation), we are certain that
noone acquires cacheline lock behind our back. Concurrent
eviction threads are eliminated by holding eviction list
lock for the duration of critial locking operations.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-03-05 11:20:47 +01:00
Robert Baldyga
9352c881ab tests: Update sequential cutoff tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-03-04 16:38:31 +01:00
Robert Baldyga
ac9bd5b094
Merge pull request #453 from arutk/no_cl_gl_lock 
Skip cacheline concurrency global lock in fast path
 2021-03-04 12:33:50 +01:00
Michal Mielewczyk
3a26bc56cd pyocf: improve test logging 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
7f862c3080 pyocf: improve random string generator 
Set of random characters may be exteded with a custom list.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
a81be31dd4 pyocf: default range for int16 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
c4a2dc4cad pyocf: security tests for ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
fa556247d7 pyocf: change encoding of ioclass name 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
080e13a071 pyocf: valid ranges for ioclass config values 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
06edc48717 pyocf: remove min_size from ioclass config 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
95d756de91 Remove ioclass min_size from public API 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
5c053ad964 pyocf: security test for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
73d6fb33de pyocf: api for setting core seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
9aebf57efa pyocf: valid ranges for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
d909698790 pyocf: fix acp security test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
482861423b pyocf: security test for acp params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
43ff4aae5f pyocf: security test for alru params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
92f67c65f0 pyocf: valid ranges for cleaning policy params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 07:56:38 -05:00
Slawomir Jankowski
eeda1f3f0f Unify type of dirty_for in info structs 
Reformat function that calculates how long cache/core is dirty
Update `dirty_for` types in functional tests

Values stored in info structs fields (both in cache and core structs)
are unsigned 64-bits ints but `dirty_for`s were unsigned 32-bits ints.

Use existing function to transform returned value to seconds.
Replace seconds stored in metadata with seconds.
Replacement was done if old value of replaced field was equal to zero.
Acquiring monotonic high precission timestamp is potentially
slow and it makes sense to compare the field's value
to zero before calling atomic function.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
 2021-02-25 14:51:53 +01:00
Adam Rutkowski
9ff0fd5320 Cacheline concurrency deadlock detection test in UT 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-24 17:29:52 -06:00
Robert Baldyga
75baec5aa5
Merge pull request #456 from arutk/aalru 
Relax LRU list ordering to minimize list updates
 2021-02-18 13:48:54 +01:00
Michal Mielewczyk
83f142c987 Functional test for overflown pinned ioclass 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-16 07:07:01 -05:00
Adam Rutkowski
10c3c3de36 Renaming hash bucket locking functions 
1. new abbreviated previx: ocf_hb (HB stands for hash bucket)
2. clear distinction between functions requiring caller to
   hold metadata shared global lock ("naked") vs the ones
   which acquire global lock on its own ("prot" for protected)
3. clear distinction between hash bucket locking functions
   accepting hash bucket id ("id"), core line and lba ("cline")
   and entire request ("req").

Resulting naming scheme:
ocf_hb_(id/cline/req)_(prot/naked)_(lock/unlock/trylock)_(rd/wr)

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-12 18:08:15 -06:00
Robert Baldyga
d03ea719cd
Merge pull request #451 from arutk/exact_evict_count 
only request evict size equal to request unmapped count
 2021-02-11 10:47:12 +01:00
Adam Rutkowski
1908707a3d LRU list unit tests 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 16:23:01 -06:00
Adam Rutkowski
4276d65e5a unit tests for new eviction order 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 12:51:39 -06:00
Adam Rutkowski
5538a5a95d Only request evict size equal to request unmapped count 
Removing the logic for oportunistic partition overflow
reduction by evicting more cachelines than actually
required by the request being serviced.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-02-09 11:11:15 -06:00
Robert Baldyga
3543f5c5cc
Merge pull request #443 from rafalste/update_copyright 
Update copyright statements (2021)
 2021-02-03 11:59:39 +01:00
Michal Mielewczyk
3a7b55c4c2 Don't evict on hit 
If request is hit, simply try to acquire cachelines instead of verifying
whether target partition's size is not exceeded.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-01-29 17:15:32 -05:00
Rafal Stefanowski
6ed4cf8a24 Update copyright statements (2021) 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-01-21 13:17:34 +01:00
Robert Baldyga
dd508c595f
Merge pull request #430 from rafalste/fix_attach_load_paths 
Create separate pipelines and paths for cache attach/load scenarios
 2020-12-23 16:51:37 +01:00
Robert Baldyga
69e388a10f
Merge pull request #372 from arutk/wo_test_enhancements 
Extend WO engine functional tests
 2020-12-23 16:51:16 +01:00
Rafal Stefanowski
57d4aaf7c9 Return error status from ocf_freelist_init 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:43:46 +01:00
Rafal Stefanowski
88b97df16d Fix pipeline attach/load paths 
Create separate pipelines for cache attach and load scenarios.

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:31:49 +01:00
Michal Mielewczyk
2206b2fdef pyocf: cache attach test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
5c2a5c5e79 pyocf: add cache detach api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
93318696cd pyocf: ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
76148de310 Unit tests for mapping 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
418303eee8 UT for occupancy per ioclass utils 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Adam Rutkowski
680074eebc Add build requirements to unit tests readme 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:28 +01:00
Adam Rutkowski
d52083a445 unit tests for lru iterator 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-12-17 14:35:27 +01:00
Robert Baldyga
8b03271626 rbtree: Introduce list find callback 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-11-10 13:21:14 +01:00
root
934ea045fe Cover all read paths with read data integrity test logic 
Extending read test to run in all cachemodes.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
fef9d94a10 Rename WO data integrity test to "read" data integrity 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
62497cabee Extend WO engine funcional tests 
1. Adjust test to work with multiple cache lines
2. Extend test workset to cover larger I/O

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Robert Baldyga
4f80cde9dd
Merge pull request #382 from mmichal10/tree-ut 
ut: tests for rb tree
 2020-10-20 14:38:53 +02:00
Robert Baldyga
9a23787c6b
Merge pull request #406 from arutk/flush2 
Propagate I/O flags (e.g. FUA) to metadata flush I/O
 2020-10-06 12:49:22 +02:00
Adam Rutkowski
2b1c74ee86 Add test to check whether flush is sent after mngmt op 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:23 +02:00
Adam Rutkowski
693c07b865 pyocf: fix cache save method 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:14 +02:00
Adam Rutkowski
c7417b29fc pyocf: test for io flags propagation to bottom volumes 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-29 18:25:34 +02:00
Michal Mielewczyk
9b8ac42e0f ut: tests for rb tree 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-07-15 10:37:01 -04:00
Robert Baldyga
1c9312842a
Merge pull request #369 from rafalste/copyright_update 
Update copyright statements
 2020-05-06 12:42:10 +02:00
Rafal Stefanowski
38e7e19290 Update copyright statements 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-04-28 13:37:54 +02:00
Michal Rakowski
0f85a73669 pyocf: test_eviction fixup 
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
 2020-04-24 15:34:59 +02:00
Robert Baldyga
188559416c
Merge pull request #354 from robertbaldyga/multistream-seq-cutoff 
Introduce multi-stream seqential cutoff
 2020-04-22 15:35:42 +02:00
Jan Musial
9a8eb7ed90 Basic test for multistream seq cutoff 
Signed-off-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
93a0d9554c Implement API for setting seq cutoff threshold 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
e4b11b6933 Add context to OcfCompletion 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
52962402fe Extend Size class to enable arithmetics 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Robert Baldyga
a9c36477d2 Fix deadlock on concurrent flush at the same cache 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-03 18:09:35 +02:00
Robert Baldyga
f7d191b765 ut: Add cache allocation & do little cleanup 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-03-23 12:38:43 +01:00
Robert Baldyga
c295a4f670 ut: Add .gitignore 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-03-23 12:33:12 +01:00
Jan Musial
e5aff609d9 Add test for huge cache 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-01-21 15:29:24 +01:00
Robert Baldyga
ce28c71475
Merge pull request #326 from Ostrokrzew/upstream 
Change error code
 2020-01-10 13:38:18 +01:00
Kamil Lepek
5828a7d0ae Added codecov badge to README, added coverage files to .gitignore 2020-01-09 10:54:59 +01:00
Michal Rakowski
bc866e5f9a pyocf: fix security mngmt_start_fuzzy test 2020-01-08 14:06:54 +01:00
Kamil Lepek
0d6660d4f3 Enable code coverage tracking in pyocf 2020-01-08 11:02:07 +01:00
Ostrokrzew
3fca309e51 Change error code and add new 
Change 'OCF_ERR_START_CACHE_FAIL' to 'OCF_ERR_NO_MEM' while CAS fails in case of memory lack on device.
Add new error code for case, when device doesn't satisfy CAS requirements - 'OCF_ERR_INVAL_CACHE_DEV'.
Use 'OCF_ERR_INVAL_CACHE_DEV' in code.
Update error code match in test.
closes #317 issue

Signed-off-by: Ostrokrzew <slawomir.jankowski@intel.com>
 2020-01-02 09:34:24 +01:00
Robert Baldyga
2ca8dcd73e ut: Replace deprecated 'commands' module with 'subprocess' 
The 'commands' modules has been removed in python 3.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-12-10 17:39:17 +01:00
Robert Baldyga
1525e85805 Add global random seed config 
This is needed to make fuzzy tests work with xdist as each
xdist gateway expects to receive the same set of parameter
values, which for random generators may be achieved only by
providing globally shared seed.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
b9b39fdb46 Add more fine-grained fixtures for fuzzy tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
ab1df71476 Make random generator API fluent 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 14:36:31 +02:00
Katarzyna Lapinska
219ccf360c Add new negative io tests and raising error when failed to create io 
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
 2019-10-02 20:35:25 +02:00
Robert Baldyga
58403f2cd4 Test with io aligned to sector size 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-02 19:46:28 +02:00
Michal Rakowski
74954667a2
Merge pull request #308 from arutk/fix_hash_bucket_lock_iter 
Fix hash bucket lock iter
 2019-10-02 17:22:12 +02:00
Adam Rutkowski
a3f3a79f75 unit test: extend hash bucket locking test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-10-02 18:43:46 -04:00
Michał Mielewczyk
1ef67ec4b2
Merge pull request #305 from KamilLepek/remove_sec_test 
Remove redundant security test (id has been removed for cache in ocf)
 2019-10-02 14:58:17 +02:00
Kamil Lepek
fe0d663c25 Remove redundant security test (id has been removed for cache in ocf) 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-10-02 14:06:06 +02:00
Slawomir_Jankowski
717b8aa259 UT prapare update 
**CMake lists**: link Zlib;
include libs for UT during compilation.
**prapare script**: add path to regular ocf_env files;
ignore 'memcpy' functions when copied to wrappers.
**cleaning policy**: update of some functions for proper use of atomics.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:28:27 +02:00
Slawomir_Jankowski
5d0a6fa05a UT cleanup and path update 
**run tests script**: cleanup before UT starts;
usage of regular ocf_env files by symlinks.
**tests conifg**: add path to regular ocf_env files.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:26:38 +02:00
Slawomir_Jankowski
e248c68846 Delete duplicates 
Delete unnecessary duplicated ocf_env files from UT directory.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:25:26 +02:00
Slawomir_Jankowski
0696ec1f9c Aesthetic changes 
Aesthetic changes, typos fix and delete recursive inclusions.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-10-01 14:24:16 +02:00
Michał Mielewczyk
e02821d399
Merge pull request #302 from Deixx/empty-cache-name 
Recognize empty string as an incorrect cache name
 2019-10-01 13:19:20 +02:00
Daniel Madej
35d71e14f3 Recognize empty string as an incorrect cache name 
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-10-01 12:55:46 +02:00
Adam Rutkowski
5113542c7f
Merge pull request #297 from mmichal10/pp-params-in-sb 
Store PP config params in cache superblock.
 2019-10-01 12:32:15 +02:00
Michal Mielewczyk
e16d4e6dda Initialize promotion policy on cache attach. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-10-01 06:11:53 -04:00
Robert Baldyga
29f0f33502 tests: functional: Add pretty random generators 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-01 09:49:02 +02:00
Slawomir_Jankowski
cdf0caf704 **ocf_mngt.h**: In core name change 
pointer type to array which is 32 characters long;
**core.py**: Add missing import and modify class' field type
to keep consistency;
**ocf_mngt_core**: Remove local variable 'name';
remove env_vmalloc for 'name' - isn't no longer needed;
remove initialization 'name' - as above;
remove env_vfree for context->cfg.name - variable isn't no allocated
in memory;
check if cfg->name exists;
change label in goto from deleted err_name to the closest err_pipeline.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-09-30 15:55:33 +02:00
Michal Mielewczyk
dfc55538ce Store PP config params in cache superblock. 
It allows to modify and retrieve particular PP params event if it isn't active
and store values between cache stop and load.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-27 10:55:58 -04:00
Robert Baldyga
6a0fb109e8 test_eviction: Use new_io() method with proper arguments 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-09-27 12:08:11 +02:00
Michal Mielewczyk
d332c9d97f New ocf error code in test framework. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-25 03:54:33 -04:00
Adam Rutkowski
938795e081 Unit tests for hash bucket locks ordering 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-20 17:21:00 -04:00
Jan Musial
21a3945a3c Fix PP tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-20 14:56:32 +02:00
Michał Mielewczyk
9d41c94827
Merge pull request #264 from KamilLepek/new_sec 
Negative tests for promotion policy
 2019-09-19 12:45:09 +02:00
Jan Musial
6b1d1754db Fix secure erase tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-19 10:10:20 +02:00
Kamil Lepek
71d8c8d698 Negative tests for promotion policy 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-09-18 17:59:40 +02:00
Kamil Lepek
daae1b915d Fix for security tests need of name param when creating multiple cores 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-09-18 11:12:58 +02:00
Michał Mielewczyk
0391fc17b7
Merge pull request #255 from imjfckm/pp-tests 
Add promotion policies functional tests
 2019-09-16 09:34:16 +02:00
Michal Mielewczyk
5042c5fc43 pyocf: adapt tests to new inactive cores stats. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-16 02:49:42 -04:00
Jan Musial
9c51ca4e97 Tests for promotion policy 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-09-11 10:31:14 +02:00
Michal Rakowski
29c1c7f9e8
Merge pull request #253 from mmichal10/stats-refactor 
Stats builder for ioclasses
 2019-09-10 14:56:26 +02:00
Michal Mielewczyk
5f357272d1 pyocf: adjust pyocf to new core stats api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-10 08:01:09 -04:00
Adam Rutkowski
0c31cc62d0 Freelist test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-09 16:19:52 -04:00
Adam Rutkowski
964ba85467 unit tests: improve test logs content 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-09-09 16:19:52 -04:00
Robert Bałdyga
5fd239d2bb
Merge pull request #245 from imjfckm/switching-pp 
Switching mechanism for promotion policies
 2019-08-30 11:35:16 +02:00
Adam Rutkowski
63c71ec6df pytest: basic cache recovery test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-08-29 17:06:26 -04:00
Jan Musial
a1d3cf0c4d Switching mechanism for promotion policies 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-08-29 13:24:26 +02:00
Michal Rakowski
e3a20c0da0
Merge pull request #239 from imjfckm/pp-implementation 
nhit promotion policy implementation
 2019-08-27 12:42:03 +02:00
Jan Musial
62a0ccdd9f nhit promotion policy implementation 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-08-22 13:34:38 +02:00
Michal Mielewczyk
03590c880d pyocf: store cache name for newly initialized cache in array. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-08-20 03:31:32 -04:00
Robert Baldyga
1815b784ad pyocf: Fix tests to send io aligned to sector size 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-08-13 10:33:21 +02:00
Slawomir_Jankowski
679bc38770 OCF Cleanup 
**ocf_env**: deleting unused functions from main file

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-08-09 14:45:29 +02:00
Michal Mielewczyk
0d37d14a36 pyocf: additional filed in volume type properties 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-08-05 06:39:27 -04:00
Michał Mielewczyk
7f7e8bcdf5
Merge pull request #197 from arutk/wo_test_2 
pytest: control cacheline insertion order in WO tests
 2019-07-31 09:21:03 +02:00
Jan Musiał
6514f778d5
Merge pull request #199 from KamilLepek/evict 
Eviction test for request bigger than cache
 2019-07-30 12:05:56 +02:00
Robert Baldyga
37396e7f1b Remove core id - update tests 2019-07-30 09:26:26 +02:00
Robert Baldyga
a32ca74519 Remove cache id - test update 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-30 09:26:26 +02:00
Robert Baldyga
b73b2857dd Unique core name - test update 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-29 17:37:48 +02:00
Robert Baldyga
9853814252 Unique cache name - test update 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-29 17:37:48 +02:00
Robert Baldyga
6928db4a98 tests: functional: Remove non-existing field from CoreConfig 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-29 15:08:44 +02:00
Kamil Łepek
05be67a72b
Merge pull request #220 from arutk/metadata_offset_hash 
New hash function formula
 2019-07-29 13:03:04 +02:00
Adam Rutkowski
9b8815935a Unit test for hashing function 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-07-29 13:24:25 -04:00
Adam Rutkowski
494861c994 Rename cache_concurrency to cache_line_concurrency 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-07-24 15:32:12 -04:00
Jan Musiał
1fd1a6fe17
Merge pull request #209 from arutk/stop_no_queue 
Allow to stop cache without management queue
 2019-07-23 13:51:21 +02:00
Jan Musiał
232f0cd8d7
Merge pull request #216 from robertbaldyga/io-and-req-in-single-allocation 
Allocate io and req in single allocation
 2019-07-23 11:40:30 +02:00
Jan Musial
917cbd859a Add promotion policy API and use it in I/O path 
Promotion policy is supposed to perform ALRU noise filtering by
eliminating one-hit wonders being added to cache and polluting it.

Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-07-19 13:52:00 +02:00
Robert Baldyga
2efd563df1 Merge new_io and configure - update tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-17 10:31:23 +02:00
Robert Baldyga
1454b75c0f ocf_io_internal - update tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-07-17 10:31:23 +02:00
Adam Rutkowski
af4727675a pytest: simple start stop without mngmt queue test 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-07-08 18:26:35 -04:00
Michal Mielewczyk
0c8bc4cec5 pyocf: add new error OCF error code to test framework 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-07-08 09:23:32 -04:00
Adam Rutkowski
6fb1a697a4
Merge pull request #211 from mmichal10/fix-unit-test 
Prevent warpping ocf_mngt_cache_mode_has_lazy_write() in UT.
 2019-06-28 08:21:05 -04:00
Michal Mielewczyk
3005b6b5b5 Prevent warpping ocf_mngt_cache_mode_has_lazy_write() in UT. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-06-28 07:39:24 -04:00
Kamil Lepek
824009abfc Eviction test for request bigger than cache 
Added a test which checks if eviction is triggered upon writing to cache with request bigger than cache size.
IO should go directly to core and eviction should not occur.

Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-28 09:43:32 +02:00
Daniel Madej
647601c514
Merge pull request #208 from KamilLepek/unregister_volume_fix 
Removed wrong status check during unregister_volume_type in pyocf.
 2019-06-27 14:58:06 +02:00
Daniel Madej
83d9ec7c98
Merge pull request #198 from KamilLepek/fix_xfail 
Fix wb xfailed test, update exported obj md5
 2019-06-27 14:51:58 +02:00
Kamil Lepek
27de628013 Removed wrong status check during unregister_volume_type in pyocf. 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-26 15:07:19 +02:00
Adam Rutkowski
c89b982933 pytest: control cacheline insertion order in WO tests 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-18 18:25:46 -04:00
Michał Mielewczyk
0d1011f65b
Merge pull request #195 from KamilLepek/fix 
Pyocf minor api fixes
 2019-06-18 16:30:23 +02:00
Kamil Lepek
bdfd086d81 Fix wb xfailed test, update exported obj md5 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-18 15:46:15 +02:00
Kamil Lepek
70142eef7f Pyocf minor api fixes 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-14 18:15:22 +02:00
Adam Rutkowski
34a5b8e882
Merge pull request #187 from KamilLepek/config 
Create config which excludes tests marked as "long" and security tests by default
 2019-06-14 11:23:36 -04:00
Kamil Lepek
e52d34c1c8 Adapt all python code to PEP8 style standards 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-13 17:55:41 +02:00
Adam Rutkowski
4a548d26cf functional tests: only send sector-aligned IO 
... to satisfy OCF assumptions.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-12 12:07:02 -04:00
Adam Rutkowski
31ab2b3fe6 pyocf: add sector size logic to Size class 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-12 12:07:02 -04:00
Adam Rutkowski
641fba1708 Functional tests for WO cache mode 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-12 12:07:02 -04:00
Adam Rutkowski
a6312eb8aa Update management tests for WO (Write-only) cache mode 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-12 12:07:02 -04:00
Adam Rutkowski
7b7d65e092 pyocf: fix setting data offset in IO 
When setting data in IO, the offset should be stored in
IO itself, not data object.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-06-12 12:07:01 -04:00
Kamil Lepek
d416d166f2 Create config which excludes tests marked as "long" and security tests by default 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-06-10 13:04:49 +02:00
Michal Mielewczyk
3e2ee7a7c8 UT framerwok: Auto generating wrap functions 
Test code have to contain wraps only for those functions, which are used by
test itself. Empty wraps are generated automatically by UT framework.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-06-06 08:20:25 -04:00
Michal Mielewczyk
e6bedb692c Unified management functions prefix. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-06-05 09:31:59 -04:00
Michal Rakowski
9f4536c6e3 Error codes in IO path changed to OCF-specific 
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
 2019-06-05 09:10:54 +02:00
Robert Baldyga
711de86bff Associate core metadata with core object 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-28 14:49:59 +02:00
Robert Baldyga
46ae8b2ff1 Remove unused OCF_ERR_CACHE_IN_USE error code 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-28 11:20:48 +02:00
Robert Baldyga
8a82be339f Introduce asynchronous cache lock 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-28 11:20:48 +02:00
Robert Baldyga
bdcd4df0ef Remove utils_device.h 
Move core mngt related code to ocf_mngt_core.c

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-27 17:00:39 +02:00
Robert Baldyga
7de56940a4 Move ocf_request from utils 
ocf_request has always been first class citizen in OCF,
so lets place it along with another essential objects.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-27 15:51:27 +02:00
Robert Baldyga
ab2fc6d3c3 Rename utils_allocator to utils_realloc 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-27 13:10:17 +02:00
Michał Mielewczyk
b1321edf69
Merge pull request #170 from robertbaldyga/convert-ut-to-python3 
Convert UT scripts to python3
 2019-05-27 09:58:26 +02:00
Jan Musiał
93a06686a7
Merge pull request #165 from robertbaldyga/ctx-get-put 
Give ocf_ctx get/put semantics
 2019-05-24 14:29:04 +02:00
Robert Baldyga
a671a28282 Convert UT scripts to python3 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-24 10:13:50 +02:00
Robert Baldyga
c903d13ad2 Give ocf_ctx get/put semantics 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-23 15:50:10 +02:00
Michał Mielewczyk
16a01d7698
Merge pull request #157 from KamilLepek/management 
Added a few management tests (changing configuration)
 2019-05-22 16:20:16 +02:00
Kamil Lepek
54c0e48fce Pyocf test checking if default values are correct 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-05-22 16:09:02 +02:00
Kamil Lepek
ecd492e562 Added a few management tests (changing configuration after start and checking statistics) 
Fixed core/cache stats pyocf API

Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-05-22 15:34:07 +02:00
Kamil Lepek
827a115fa9 Gather all unit tests logs in single directory 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-05-17 11:35:33 +02:00
Daniel Madej
3da9059e50
Merge pull request #143 from imjfckm/master 
Fix loading of cache in pyocf
 2019-05-17 10:59:04 +02:00
Kamil Lepek
382c31a8e0 Save unit tests output to file 
Seperate output of different script stages

Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-05-16 10:26:02 +02:00
Jan Musial
991bcf3491 Fix loading of cache in pyocf 
Flush/load metadata paths are heavily dependend on Data behaving
correctly in terms of seeks/position and that needed to be fixed.

Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-05-10 15:34:23 +02:00
Michal Mielewczyk
7165bc16c3 Add kick function for cleaner 
ocf_kick_cleaner() allows to perfom cleaning immediately.

Nop cleaning policy now returns new 'OCF_CLEANER_DISABLE' macro which indicates
that cleaing shouldn't be performed. To enable it back, ocf_kick_cleaner()
should be called.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-05-10 08:09:56 -04:00
Robert Bałdyga
1c9fe96663
Merge pull request #133 from arutk/ajrutkow_async_counters 
Extended reference counting
 2019-05-08 14:23:50 +02:00
Adam Rutkowski
1e812b4eaf Unit tests for reference counter utility 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-05-07 12:40:06 -04:00
Robert Baldyga
7b88aac56f Remove "interruption" argument from flush() functions 
As non-interruptible flushes are no longer triggered from OCF
internals, we can get rid of "interruption" argument and let
adapters handle it themselves.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-05-07 17:23:19 +02:00
Adam Rutkowski
c8e6b96ece pyocf: remove put from cache stop to match get count 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-05-06 19:37:51 -04:00
Adam Rutkowski
2485584487 Remove obsolete ocf_cache_wait_for_io_finish from pyocf 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-05-06 19:37:51 -04:00
Adam Rutkowski
84f5454b29 Update unit tests to work with extedned ref counters 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-05-06 19:37:51 -04:00
Adam Rutkowski
93c8932a17 pyocf: fix management queue stop/put 
Queue is stopped when reference counter drops to 0, so no need to
manually stop management queue after cache stop - simple put is
enough.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-04-25 13:21:25 -04:00
Katarzyna Łapińska
bf879c4b09
Merge pull request #113 from Deixx/tests_start_stop 
pyocf tests for start/stop
 2019-04-23 12:10:17 +02:00
Adam Rutkowski
e11edcacd8 Rename makefile ENV* variables to OCF_ENV* 
'ENV' variable is set and used by OS utilities  on some Linux
distros, interfering with OCF build system. Renaming ENV and
other ENV* variables to OCF_ENV* to avoid conflicts.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-04-20 16:54:04 +02:00
Daniel Madej
1aa5e99173 Pyocf tests for start/stop 
Tests for starting cache and checking if mode works properly
Tests for stopping cache
Negative and stress tests

Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-04-18 17:00:14 +02:00
Adam Rutkowski
79cb39e273
Merge pull request #129 from imjfckm/master 
Fix cores volumes dropping before close
 2019-04-18 09:41:33 -04:00
Jan Musial
be88300071 Fix cores volumes dropping before close 
* Add references to Cores in Cache, ctx holds caches, caches hold cores,
  everything gets cleaned up nicely

* GC in Python seems to be a bit lazy, if we want to run CI on
  low-memory machines we need to make sure it does run in between tests
  'cause we don't want no huge Volumes hanging around for long

Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-18 14:11:59 +02:00
Daniel Madej
99c448aae6
Merge pull request #124 from katlapinka/security_config 
Security tests for start cache command
 2019-04-18 14:07:32 +02:00
Kamil Łepek
92837ec2f3
Merge pull request #119 from Deixx/tests_neg_io 
Negative tests for IO path
 2019-04-18 14:06:15 +02:00
klapinsk
f9eab4c749 Security tests for start cache command 2019-04-18 13:43:27 +02:00
Daniel Madej
876294f603 Negative tests for IO path 
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-04-18 12:58:02 +02:00
Jan Musial
75c3948f6d Secure erase tests 
Implement simple secure erase tests. Perform IO that will trigger
copying of Data buffers and make sure OCF calls secure erase on them.

Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-18 12:51:59 +02:00
Michał Mielewczyk
d4e929140e
Merge pull request #127 from arutk/pytest_wait_io 
pyocf: wait for pending I/O before cache stop
 2019-04-18 09:21:50 +02:00
Katarzyna Łapińska
c80ca4a9a8
Merge pull request #122 from KamilLepek/security_tests 
Add security fuzzy tests and improve pyocf api
 2019-04-18 07:33:11 +02:00
Adam Rutkowski
d607402f2b pyocf: wait for pending I/O before cache stop 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-04-17 18:12:56 -04:00
Michal Mielewczyk
5e52ac4ef2 Rename 'printf' field name in logger ops to 'print'. 
Due the aggresive security checks in compiler 'printf' might be substituded with
'__printf_chk'. However it does not differentiate whether substituted string is
library function call whether field in structure.

By renaming field we prevent it to be unintentionally subustituted by the
preprocessor.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-04-17 11:37:47 -04:00
Kamil Lepek
d55195ecf5 Add security fuzzy tests and improve pyocf api 
Fuzzy tests added for:
changing cache mode
attaching cache device with fuzzed cache line size
setting cleaning policy
setting alru params
setting acp params
setting seq cut off policy per cache
setting seq cut off policy per core
 2019-04-17 12:46:25 +02:00
Kamil Łepek
00c434fb66
Merge pull request #115 from imjfckm/leaks 
Fix leaky tests
 2019-04-16 10:20:56 +02:00
Jan Musial
003d6505aa Fix leaky tests 
Fix some instance tracking to prevent Python-side objects from leaking
buffers.
Also, reduce min size of Cache instance (real minimum should be around ~~19MiB,
but we need to make it more deterministic and 20 MiB seems to be reasonable).

Still some stuff left to do, but it needs more investigation and, for
now, this should suffice just to enable some form of CI.

Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-16 09:55:02 +02:00
Kamil Lepek
465e9acd2c Add randomizers for ctypes and string in pyocf 2019-04-16 09:51:02 +02:00
Kamil Lepek
5ceb69e9c8 Added cache mode change in pyocf and basic test 2019-04-11 10:57:25 +02:00
Daniel Madej
f9c22262fb
Merge pull request #109 from KamilLepek/add_remove 
Pyocf add/remove tests
 2019-04-10 15:02:22 +02:00
Jan Musial
db46a9decb Stop using mgmt queue for IO in pyocf 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-10 11:25:39 +02:00
Kamil Lepek
c453bddc28 Pyocf add/remove tests 2019-04-09 10:17:39 +02:00
Daniel Madej
1fa52e84a8 Extract cache.flush() method from cache.stop() 
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-04-04 11:13:45 +02:00
Jan Musial
be773a45af Add remove_core fcn 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-04 10:58:29 +02:00
Daniel Madej
d9d4f2fab1
Merge pull request #99 from katlapinka/ini 
Ini
 2019-04-04 10:50:39 +02:00
klapinsk
a8780655e2 *.ini files added 2019-04-04 10:29:20 +02:00
Jan Musial
753ab00331 Fix core_new_io 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-03 15:48:14 +02:00
Jan Musial
59178eef01 Make libocf.so loading CWD independent 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-03 12:28:15 +02:00
Jan Musial
545d5b8aac Make pyocf work with async API 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-04-03 11:13:27 +02:00
Adam Rutkowski
e06082c4a3 Treat warnings as errors in tests/build/Makefile 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2019-04-01 12:38:43 -04:00
Robert Baldyga
6cd84476f6 Handle metadata asynchronously 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-03-26 12:49:23 +01:00
Robert Baldyga
72b6f35f52 Implement asynchronous save, add core and remove core 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-03-21 09:03:59 +01:00
Robert Baldyga
23b0a32aec Parametrize pipeline steps 
This allows to reuse same step functions giving them different parameters
on each step.

Additionally move pipeline to utils, to make it accessible to other
subsystems of OCF (e.g. metadata).

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-03-20 17:06:56 +01:00
Robert Baldyga
91e0345b78 Implement asynchronous attach, load, detach and stop 
NOTE: This is still not the real asynchronism. Metadata interfaces
are still not fully asynchronous.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-03-18 15:06:57 +01:00
Robert Baldyga
c5df82f2cb Make management API asynchronous 
NOTE: This patch only changes API that pretends to be asynchronous.
Most of management operations are still performed synchronously.
The real asynchronism will be introduced in the next patches.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-03-12 10:33:26 +01:00
Michal Mielewczyk
d06f376627 Alru cleaning policy improvement 
Instead of calling flush separatly for each IO class, it is called after
collecting number of dirty cache lines defined by user or after iterating
through all IO classes.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-03-11 04:08:16 -04:00
Michal Rakowski
e5227cef89 Implement pyocf adapter with sample OCF test 
PyOCF is a tool written with testing OCF functionality in mind.
It is a Python3 (3.6 version required) package which wraps OCF
by providing Python objects in place of OCF objects (volumes, queues,
etc). Thin layer of translation between OCF objects and PyOCF objects
enables using customized behaviors for OCF primitives by subclassing
PyOCF classes.

This initial version implements only WT and WI modes and single,
synchronously operating Queue.

TO DO:

  - Queues/Cleaner/MetadataUpdater implemented as Python threads
  - Loading of caches from PyOCF Volumes (fix bugs in OCF)
  - Make sure it works multi-threaded for more sophisticated tests

Co-authored-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2019-03-07 12:48:40 +01:00
Robert Baldyga
9b9b965b55 Add cache locking functions in trylock variant 
- Add cache trylock and read trylock functions.
- Introduce new error code -OCF_ERR_NO_LOCK.
- Change trylock functions in env to return this code in case of
  lock contention.

[ENV CHANGES REQUIRED]
Following functions should return 0 on success or -OCF_ERR_NO_LOCK
in case of lock contention:
- env_mutex_trylock()
- env_rwsem_up_read_trylock()
- env_rwsem_up_write_trylock()

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-03-01 17:31:32 +01:00
Michal Mielewczyk
e53944d472 Dynamic I/O queue management 
- Queue allocation is now separated from starting cache.
- Queue can be created and destroyed in runtime.
- All queue ops accept queue handle instead of queue id.
- Cache stores queues as list instead of array.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-02-26 17:36:19 +01:00
Robert Baldyga
404b976109 Make cleaner asynchronous 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-02-19 16:10:24 +01:00
Robert Baldyga
97300b1137 Rename "data object" to "volume" 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-02-08 14:13:05 +01:00
Michal Mielewczyk
2dfd6248c9 Configure all io classes at once. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-01-28 08:51:26 -05:00
Michal Mielewczyk
5e97795630 Fixed script for generating UT templates 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-01-24 05:16:16 -05:00
Robert Baldyga
6860cdbd2c Reorganize context ops 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-01-22 13:14:35 +01:00
Robert Baldyga
03c2f142b3 Cache lock cleanup and API improvements 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-01-21 13:46:28 +01:00
Kamil Łepek
92b2fa362e Refactor tests directory 
Signed-off-by: Kamil Łepek <kamil.lepek94@gmail.com>
 2019-01-18 03:12:49 -06:00
Robert Baldyga
f933246dba Introduce basic OCF build test with posix environment 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-01-16 14:10:29 +01:00
Robert Baldyga
ad10d58a2c Update posix environment 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-01-15 09:41:33 +01:00
Michal Rakowski
ad3467ddd4 Added Makefile for ocf lib to be used in functional tests 
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
 2019-01-08 12:58:28 +01:00
Robert Baldyga
4be6761a18 Core data object 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-01-04 08:33:34 +01:00
Mariusz Barczak
15ed5b4450 OCF provides own macros for MIN, MAX, and DIV_ROUND_UP 
Signed-off-by: Mariusz Barczak <mariusz.barczak@intel.com>
 2018-12-13 10:59:23 -05:00
Robert Baldyga
db92083432 Unify req naming convention (rq -> req) 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2018-12-12 13:36:34 +01:00
wolszews
0cb11b0d3c Remove OCF prefix 2018-12-06 16:04:30 +01:00
Michal Mielewczyk
35ae74e3fa Fix existing unit tests 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2018-12-06 06:30:50 -05:00
Robert Baldyga
a8e1ce8cc5 Initial commit 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2018-11-29 15:14:21 +01:00