github/ocf
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,398 Commits 1 Branch 1 Tag 4.1 MiB
d5b2c65a39
Commit Graph

1398 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Baldyga
d5b2c65a39 Remove "metadata_layout" parameter of the cache 
This feature is replaced with LRU list shuffling.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-03-07 17:48:25 +01:00
Robert Baldyga
9a956f59cd
Merge pull request #654 from Open-CAS/fix-flapping-merge 
Porting fix-flapping patches from v21.6.4 by arutk
 2022-03-05 01:31:23 +01:00
Adam Rutkowski
689c44c76b Remove ocf_metadata_probe_cores() implementation 
This function must be fixed to work with metadata flapping. Until then
mark as not supported

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
Signed-off-by: Krzysztof Majzerowicz-Jaszcz <krzysztof.majzerowicz-jaszcz@intel.com>
 2022-03-04 19:13:40 +01:00
Adam Rutkowski
866bba72bf Explicitly validate superblock after load 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>

Additional changes - load sb recovery CRC check

Signed-off-by: Krzysztof Majzerowicz-Jaszcz <krzysztof.majzerowicz-jaszcz@intel.com>
 2022-03-04 19:12:51 +01:00
Robert Baldyga
90ff4afcda Check superblock CRC before it is used 
Superblock can be used during load of other sections, so we need to check
its CRC before other sections are loaded.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
Signed-off-by: Krzysztof Majzerowicz-Jaszcz <krzysztof.majzerowicz-jaszcz@intel.com>
 2022-03-04 19:12:08 +01:00
Krzysztof Majzerowicz-Jaszcz
06f2140090 Removing ocf_metadata_sb_crc_recovery 
Removing ocf_metadata_sb_crc_recovery - not used

Signed-off-by: Krzysztof Majzerowicz-Jaszcz <krzysztof.majzerowicz-jaszcz@intel.com>
 2022-03-04 19:10:47 +01:00
Robert Baldyga
1cce6bf24b
Merge pull request #664 from robertbaldyga/improve-bf 
Extend BF queue protection to cache device queue
 2022-03-04 18:50:43 +01:00
Robert Baldyga
73f3b73f0f
Merge pull request #663 from pdebski21/1023_xfail 
Test for load with changed core size
 2022-03-02 21:03:00 +01:00
Robert Baldyga
45cc56f40d Extend BF queue protection to cache device queue 
So far the only resource protected by backfill queue blocking was internal
OCF request queue. Move unblock to backfill io completion to protect also
queue of underlying cache device.

Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-03-02 20:59:51 +01:00
Robert Baldyga
b94518130a
Merge pull request #588 from arutk/rio-io-tester 
Rio - I/O exerciser for pyocf
 2022-03-01 14:07:04 +01:00
Robert Baldyga
87d71f319e
Merge pull request #662 from jfckm/fix-invalid-message-try-add 
Fix message when try-adding already opened core
 2022-03-01 14:06:30 +01:00
Robert Baldyga
765d1c5d77 rio: fix size comparison in 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-02-24 15:02:46 +01:00
Jan Musial
cd0551e72e Use rio in promotion policy tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 14:56:09 +01:00
Adam Rutkowski
a6d8bd0470 rio: accept queue list in Rio constructor 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 14:56:09 +01:00
Adam Rutkowski
372b1f1e1c remove unnecessary callback decorator in rio 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-02-24 14:56:09 +01:00
Adam Rutkowski
9baf9a3876 rio: convert Size to bytes for extent calculation 
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-02-24 14:56:09 +01:00
Jan Musial
9360e55851 Update basic pyOCF tests to use rio 
Signed-off-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-02-24 14:56:09 +01:00
Adam Rutkowski
17eddab094 pyocf: queue settle functionality 
Queue settle is a mechanism to wait for all OCF processing
on a given queue to finish.

In some tests simply waiting for I/O to finish is not enough. Most
notably some statistics are potentially incremented after user triggered
I/O is finished. This is due to asynchronous nature of I/O operations
and OCF approach to statistics update, where only eventual consistency
is guaranteed without explicit mechanism available to query whether
the final state is reached yet. However it is fully in the adapter power
to determine this, as OCF executes in context of API calls from the
adapter (like I/O submission, ocf_queue_run, ocf_cleaner_run, management
operations) and I/O completion callbacks. Queue settle is a mechanism to
assure ocf_queue_run is not being executed by the thread associated with
a queue.

With queue settle mechanism it is straightforward for the adapter to
wait for cache statistics to reach fixed values:
1. wait for all I/O to OCF to finish
2. settle all I/O queues
3. make sure background cleaner is not active

Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-02-24 14:56:09 +01:00
Jan Musial
41732090ae Implement rio io tester for pyocf 
rio stands for Rigid IO tester and is a simple mechanism for testing
OCF cache IO.

Signed-off-by: Jan Musial <jan.musial@intel.com>
Signed-off-by: Adam Rutkowski <adam.j.rutkowski@intel.com>
 2022-02-24 14:56:09 +01:00
Jan Musial
96124ca87a Enable Size comparisons in pyocf 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 14:56:09 +01:00
Adam Rutkowski
021e7e87ad
Merge pull request #559 from jfckm/pyocf-loading 
Make loading in pyocf viable
 2022-02-24 14:08:09 +01:00
Jan Musial
9fcc7bfbb7 Use new capabilities in surprise shutdown tests 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
5d31dd87d0 Test for open_cores load 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
973a474b37 Make open_cores load viable by adding getter for cores 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
53d2c5a197 Fix test_start_stop_noqueue 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
bfee654770 Add wrapper for cache_config_set_default 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
6f1080d6a8 Add missing include in ocf_volume.h 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
2038c3aa68 Add basic load test with core reattachment and cleanup structures 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Jan Musial
30fe2eb783 Handle try_add core adding mode 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-24 12:27:10 +01:00
Adam Rutkowski
6a1d5f2ad6
Merge pull request #583 from jfckm/multiple-pyocf-ctx 
Support multiple PyOcf ctx instances plus leak fixes
 2022-02-23 14:28:47 +01:00
Piotr Debski
08907dae5d test for load with changed core size 
removing xfail mark and update core oprations after merged ocf patch

Signed-off-by: Piotr Debski <piotr.debski@intel.com>
 2022-02-18 23:15:47 +01:00
Robert Baldyga
b65ca6233b
Merge pull request #661 from mmichal10/check-id-on-actiavte 
Verify cache id duing the activate
 2022-02-18 15:41:01 +01:00
Jan Musial
e0cd0a4882 Fix message when try-adding already opened core 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-18 12:54:13 +01:00
Michal Mielewczyk
116676c18d Verify cache id duing the activate 
Signed-off-by: Michal Mielewczyk <michal.mielewczyk@intel.com>
 2022-02-17 15:02:03 +01:00
Jan Musial
1273e9ddfe Fix leaking Volumes and OcfCtx's 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Jan Musial
8f47cfa5bf Make multiple pyocf loggers viable 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Jan Musial
441e3c20d7 Clean-up pyocf c-python shared objects instance tracking 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Jan Musial
4c9d4fe24e Fix pyocf Ctx ownership 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-16 07:06:05 +01:00
Robert Baldyga
da59a1c9aa
Merge pull request #634 from arutk/mopft_21.12 
pyocf: management operation power failure tests
 2022-02-14 14:10:52 +01:00
Robert Baldyga
6af8d20cee
Merge pull request #655 from hammerg/linux_stdarg_h 
Fix compilation error regarding stdarg.h file
 2022-02-07 16:28:25 +01:00
Robert Baldyga
49abe816ce
Merge pull request #649 from pdebski21/1023 
fix for issue #1023
 2022-02-07 16:17:14 +01:00
Robert Baldyga
d53047b5f9
Merge pull request #657 from robertbaldyga/standby-remove-runtime-recovery 
Remove runtime recovery in standby mode
 2022-02-07 15:56:59 +01:00
Gal Hammer
3da29e5f3b Fix compilation error regarding stdarg.h file 
Linux includes its own stdarg.h file since version 5.15. This change
allows ocf library to compile as part of a kernel module.

Signed-off-by: Gal Hammer <gal.hammer@huawei.com>
Signed-off-by: Shai Fultheim <shai.fultheim@huawei.com>
 2022-02-07 15:10:01 +02:00
Robert Baldyga
76684ed8a9
Merge pull request #642 from robertbaldyga/parallelize 
Parallelize metadata initialization
 2022-02-07 13:53:45 +01:00
Robert Baldyga
e30fd48338
Merge pull request #656 from jfckm/extend-metadata-probe 
Include cache mode and cache line size in metadata probe
 2022-02-04 13:01:10 +01:00
Jan Musial
8522b0b6e6 Include cache mode and cache line size in metadata probe 
Signed-off-by: Jan Musial <jan.musial@intel.com>
 2022-02-04 08:15:05 +01:00
Robert Baldyga
c176daeec1
Merge pull request #640 from pdebski21/superblock_mismatch 
added error code for superblock mismatch
 2022-02-03 15:30:03 +01:00
Robert Baldyga
805ea14529 Remove runtime recovery in standby mode 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-02-01 03:11:50 +01:00
Robert Baldyga
6a665ea6b1 Shuffle entries within freelists 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-01-31 06:59:28 +01:00
Robert Baldyga
53f6cffe7f tests: Add unit tests for bisect generator 
Signed-off-by: Robert Baldyga <robert.baldyga@intel.com>
 2022-01-31 06:59:28 +01:00