github/ocf
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,452 Commits 1 Branch 1 Tag 4.1 MiB
77380d6579
Commit Graph

244 Commits

Author SHA1 Message Date
Jan Musial
8f47cfa5bf Make multiple pyocf loggers viable 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Jan Musial
441e3c20d7 Clean-up pyocf c-python shared objects instance tracking 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Jan Musial
4c9d4fe24e Fix pyocf Ctx ownership 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Robert Baldyga
da59a1c9aa
Merge pull request #634 from arutk/mopft_21.12 
pyocf: management operation power failure tests
 2022-02-14 14:10:52 +01:00
Robert Baldyga
49abe816ce
Merge pull request #649 from pdebski21/1023 
fix for issue #1023
 2022-02-07 16:17:14 +01:00
Piotr Debski
9b980d3f22 fix for issue #1023 
Better error for core size mismatch during activation/load

adding pyocf test for new error code

Signed-off-by: Piotr Debski <piotr.debski@intel.com>
 2022-01-25 05:18:16 +01:00
Adam Rutkowski
a97bc61010 pyocf: mark most surprise shutdown tests as long 
.. to skip by default

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:42:42 +01:00
Adam Rutkowski
2b7a249143 pyocf: document custom markers in pytest.ini 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:42:42 +01:00
Adam Rutkowski
ae240f5aa8 pyocf: test update to handle zeroed metadata in attach 
With atomic superblock commit during cache attach, it is possible
that power failure interrupts attach operation at a point where
neither new or old superblock is present - right after the superblock
is cleared.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:41:04 +01:00
Adam Rutkowski
366d89a9c4 pyocf: management operation power failure handling tests 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:40:44 +01:00
Adam Rutkowski
ce0bbc260e pycof: explicitly free Volume::_uuid_ dictionary 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
7f60aa0dd6 pyocf: fix error handling in Cache::stop() 
Write error in cache stop means the instance was in fact stopped.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
ed5185e870 pyocf: make io class config more usable 
Unify field param names and include io class id in info struct.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
5fe217d96f pyocf: set proper OCF error codes in Volume 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
c43059a4cf pyocf: add get_bytes() function to Volume and Data 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
683174c78f pyocf: add option to load cache without openning cores 
... this is useful to workaround current pyocf limitations and
load cache with manual core insertion

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:33 +01:00
Adam Rutkowski
58dac85f7b pyocf: add ocf_core_get_uuid() wrapper 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 17:35:29 +01:00
Adam Rutkowski
c7144decf8 pyocf: extend error volume capabilities 
Adding option to
1. inject error based on I/O number
2. arm/disarm error injection for easier testing

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 16:40:54 +01:00
Adam Rutkowski
cf72664c2c pyocf: fix cache device config 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-01-13 16:40:54 +01:00
Piotr Debski
609a22cfda added ERROR code for superblock mismatch 
Signed-off-by: Piotr Debski <piotr.debski@intel.com>
 2022-01-08 23:06:10 +01:00
Robert Baldyga
716b5751d6 Redesign failover standby API 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-12-29 20:31:40 +01:00
Robert Baldyga
cac5869406
Merge pull request #603 from robertbaldyga/metadata-flapping 
Introduce flapping of metadata config sections
 2021-12-15 17:11:15 +01:00
Robert Baldyga
98cb9bff70 pyocf: Use bigger cache device size in tests 
As amount of fixed size metadata allocated by OCF grows, we need to adjust
test to not try to start cache on device that is too small.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-12-15 15:30:34 +01:00
Robert Baldyga
6d1a5c733e pyocf: Add missing error codes 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-12-13 15:58:59 +01:00
Rafal Stefanowski
decfc8dea6 Remove executable bit from Makefile 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-11-24 17:01:03 +01:00
Rafal Stefanowski
f22da1cde7 Fix license 
Change license to BSD-3-Clause

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-10-28 13:08:50 +02:00
Michal Mielewczyk
ad536d9ad9 pyocf: fix cache attach config struct 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
Signed-off-by: ajrutkow <adam.j.rutkowski@intel.com>
 2021-10-08 16:04:14 +02:00
Robert Baldyga
7d43aae3a0 pyocf: Add new error codes 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-09-06 20:44:40 +02:00
Michal Mielewczyk
a072e071e2 Remove metadata updated from security tests 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-07-29 09:51:29 +02:00
Michal Mielewczyk
1620c544a1 pyocf: update cleaning policy switching test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-07-27 15:44:33 +02:00
Kozlowski Mateusz
f494448f97 Align structures to cacheline 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-07-08 12:46:39 +02:00
Michal Mielewczyk
98d2ce0264 pyocf: test for removing dirty core 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-06-28 17:40:49 +02:00
Adam Rutkowski
88e04a4204 Remove eviction policy abstraction 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-06-18 12:19:08 +02:00
Adam Rutkowski
f589341c9a remove metadata updater 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-06-15 10:25:05 +02:00
Jan Musial
9f1df6e380 Update pyOCF and tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2021-05-26 07:57:37 +02:00
Michal Mielewczyk
d5ae764175 pyocf: fix valid seq cutoff threshold range 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-04-15 11:09:26 +02:00
Michal Mielewczyk
0bfa9ed870 pyocf: Seq-cutoff promotion count security tests 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-04-14 15:40:29 +02:00
Michal Mielewczyk
8e0bb49493 functional test for eviction between cores 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2021-04-01 18:01:28 -05:00
Kozlowski Mateusz
3f9af8bd82 Update pyocf types to new field order 
Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com>
 2021-03-26 08:57:04 +01:00
Robert Baldyga
8020e7fd67
Merge pull request #457 from Ostrokrzew/false_stats 
Fix broken 'dirty_for' stats
 2021-03-18 10:24:02 +01:00
Robert Baldyga
9352c881ab tests: Update sequential cutoff tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2021-03-04 16:38:31 +01:00
Michal Mielewczyk
3a26bc56cd pyocf: improve test logging 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
7f862c3080 pyocf: improve random string generator 
Set of random characters may be exteded with a custom list.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
a81be31dd4 pyocf: default range for int16 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
c4a2dc4cad pyocf: security tests for ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 18:37:58 +01:00
Michal Mielewczyk
fa556247d7 pyocf: change encoding of ioclass name 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
080e13a071 pyocf: valid ranges for ioclass config values 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
06edc48717 pyocf: remove min_size from ioclass config 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-03-02 14:46:57 +01:00
Michal Mielewczyk
5c053ad964 pyocf: security test for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
73d6fb33de pyocf: api for setting core seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
9aebf57efa pyocf: valid ranges for seq cutoff threshold 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
d909698790 pyocf: fix acp security test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
482861423b pyocf: security test for acp params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
43ff4aae5f pyocf: security test for alru params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 08:24:41 -05:00
Michal Mielewczyk
92f67c65f0 pyocf: valid ranges for cleaning policy params 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-26 07:56:38 -05:00
Slawomir Jankowski
eeda1f3f0f Unify type of dirty_for in info structs 
Reformat function that calculates how long cache/core is dirty
Update `dirty_for` types in functional tests

Values stored in info structs fields (both in cache and core structs)
are unsigned 64-bits ints but `dirty_for`s were unsigned 32-bits ints.

Use existing function to transform returned value to seconds.
Replace seconds stored in metadata with seconds.
Replacement was done if old value of replaced field was equal to zero.
Acquiring monotonic high precission timestamp is potentially
slow and it makes sense to compare the field's value
to zero before calling atomic function.

Signed-off-by: Slawomir Jankowski <slawomir.jankowski@intel.com>
 2021-02-25 14:51:53 +01:00
Michal Mielewczyk
83f142c987 Functional test for overflown pinned ioclass 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2021-02-16 07:07:01 -05:00
Rafal Stefanowski
6ed4cf8a24 Update copyright statements (2021) 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2021-01-21 13:17:34 +01:00
Robert Baldyga
dd508c595f
Merge pull request #430 from rafalste/fix_attach_load_paths 
Create separate pipelines and paths for cache attach/load scenarios
 2020-12-23 16:51:37 +01:00
Robert Baldyga
69e388a10f
Merge pull request #372 from arutk/wo_test_enhancements 
Extend WO engine functional tests
 2020-12-23 16:51:16 +01:00
Rafal Stefanowski
88b97df16d Fix pipeline attach/load paths 
Create separate pipelines for cache attach and load scenarios.

Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-12-23 16:31:49 +01:00
Michal Mielewczyk
2206b2fdef pyocf: cache attach test 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
5c2a5c5e79 pyocf: add cache detach api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
Michal Mielewczyk
93318696cd pyocf: ioclass api 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2020-12-21 08:23:34 -05:00
root
934ea045fe Cover all read paths with read data integrity test logic 
Extending read test to run in all cachemodes.

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
fef9d94a10 Rename WO data integrity test to "read" data integrity 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Adam Rutkowski
62497cabee Extend WO engine funcional tests 
1. Adjust test to work with multiple cache lines
2. Extend test workset to cover larger I/O

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-11-06 14:43:53 -06:00
Robert Baldyga
9a23787c6b
Merge pull request #406 from arutk/flush2 
Propagate I/O flags (e.g. FUA) to metadata flush I/O
 2020-10-06 12:49:22 +02:00
Adam Rutkowski
2b1c74ee86 Add test to check whether flush is sent after mngmt op 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:23 +02:00
Adam Rutkowski
693c07b865 pyocf: fix cache save method 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-30 10:40:14 +02:00
Adam Rutkowski
c7417b29fc pyocf: test for io flags propagation to bottom volumes 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2020-09-29 18:25:34 +02:00
Robert Baldyga
1c9312842a
Merge pull request #369 from rafalste/copyright_update 
Update copyright statements
 2020-05-06 12:42:10 +02:00
Rafal Stefanowski
38e7e19290 Update copyright statements 
Signed-off-by: Rafal Stefanowski <rafal.stefanowski@intel.com>
 2020-04-28 13:37:54 +02:00
Michal Rakowski
0f85a73669 pyocf: test_eviction fixup 
Signed-off-by: Michal Rakowski <michal.rakowski@intel.com>
 2020-04-24 15:34:59 +02:00
Robert Baldyga
188559416c
Merge pull request #354 from robertbaldyga/multistream-seq-cutoff 
Introduce multi-stream seqential cutoff
 2020-04-22 15:35:42 +02:00
Jan Musial
9a8eb7ed90 Basic test for multistream seq cutoff 
Signed-off-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
93a0d9554c Implement API for setting seq cutoff threshold 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
e4b11b6933 Add context to OcfCompletion 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Jan Musial
52962402fe Extend Size class to enable arithmetics 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-04-22 13:30:42 +02:00
Robert Baldyga
a9c36477d2 Fix deadlock on concurrent flush at the same cache 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2020-04-03 18:09:35 +02:00
Jan Musial
e5aff609d9 Add test for huge cache 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2020-01-21 15:29:24 +01:00
Robert Baldyga
ce28c71475
Merge pull request #326 from Ostrokrzew/upstream 
Change error code
 2020-01-10 13:38:18 +01:00
Kamil Lepek
5828a7d0ae Added codecov badge to README, added coverage files to .gitignore 2020-01-09 10:54:59 +01:00
Michal Rakowski
bc866e5f9a pyocf: fix security mngmt_start_fuzzy test 2020-01-08 14:06:54 +01:00
Kamil Lepek
0d6660d4f3 Enable code coverage tracking in pyocf 2020-01-08 11:02:07 +01:00
Ostrokrzew
3fca309e51 Change error code and add new 
Change 'OCF_ERR_START_CACHE_FAIL' to 'OCF_ERR_NO_MEM' while CAS fails in case of memory lack on device.
Add new error code for case, when device doesn't satisfy CAS requirements - 'OCF_ERR_INVAL_CACHE_DEV'.
Use 'OCF_ERR_INVAL_CACHE_DEV' in code.
Update error code match in test.
closes #317 issue

Signed-off-by: Ostrokrzew <slawomir.jankowski@intel.com>
 2020-01-02 09:34:24 +01:00
Robert Baldyga
1525e85805 Add global random seed config 
This is needed to make fuzzy tests work with xdist as each
xdist gateway expects to receive the same set of parameter
values, which for random generators may be achieved only by
providing globally shared seed.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
b9b39fdb46 Add more fine-grained fixtures for fuzzy tests 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 16:31:05 +02:00
Robert Baldyga
ab1df71476 Make random generator API fluent 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-03 14:36:31 +02:00
Katarzyna Lapinska
219ccf360c Add new negative io tests and raising error when failed to create io 
Signed-off-by: Katarzyna Lapinska <katarzyna.lapinska@intel.com>
 2019-10-02 20:35:25 +02:00
Robert Baldyga
58403f2cd4 Test with io aligned to sector size 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-02 19:46:28 +02:00
Kamil Lepek
fe0d663c25 Remove redundant security test (id has been removed for cache in ocf) 
Signed-off-by: Kamil Lepek <kamil.lepek94@gmail.com>
 2019-10-02 14:06:06 +02:00
Michał Mielewczyk
e02821d399
Merge pull request #302 from Deixx/empty-cache-name 
Recognize empty string as an incorrect cache name
 2019-10-01 13:19:20 +02:00
Daniel Madej
35d71e14f3 Recognize empty string as an incorrect cache name 
Signed-off-by: Daniel Madej <daniel.madej@intel.com>
 2019-10-01 12:55:46 +02:00
Adam Rutkowski
5113542c7f
Merge pull request #297 from mmichal10/pp-params-in-sb 
Store PP config params in cache superblock.
 2019-10-01 12:32:15 +02:00
Michal Mielewczyk
e16d4e6dda Initialize promotion policy on cache attach. 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-10-01 06:11:53 -04:00
Robert Baldyga
29f0f33502 tests: functional: Add pretty random generators 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-10-01 09:49:02 +02:00
Slawomir_Jankowski
cdf0caf704 **ocf_mngt.h**: In core name change 
pointer type to array which is 32 characters long;
**core.py**: Add missing import and modify class' field type
to keep consistency;
**ocf_mngt_core**: Remove local variable 'name';
remove env_vmalloc for 'name' - isn't no longer needed;
remove initialization 'name' - as above;
remove env_vfree for context->cfg.name - variable isn't no allocated
in memory;
check if cfg->name exists;
change label in goto from deleted err_name to the closest err_pipeline.

Signed-off-by: Slawomir_Jankowski <slawomir.jankowski@intel.com>
 2019-09-30 15:55:33 +02:00
Michal Mielewczyk
dfc55538ce Store PP config params in cache superblock. 
It allows to modify and retrieve particular PP params event if it isn't active
and store values between cache stop and load.

Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2019-09-27 10:55:58 -04:00
Robert Baldyga
6a0fb109e8 test_eviction: Use new_io() method with proper arguments 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2019-09-27 12:08:11 +02:00