Commit Graph

133224 Commits

Author SHA1 Message Date
Casey Bodley
77558ef2c4
Merge pull request #47422 from adamemerson/wip-coroutine-cleaver
rgw: Break Full and Incremental sync out into their own classes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-17 10:00:04 -04:00
Yingxin
b578d2ecb6
Merge pull request #47491 from cyx1231st/wip-seastore-fix-return-future
crimson/os/seastore/transaction_manager: return future when enoent

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-17 16:39:22 +08:00
Ronen Friedman
f8a0ca5d25
Merge pull request #46855 from ronen-fr/wip-rf-pg-updates
osd/scrub: Scrubbing PGs now periodically update their stats

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-08-17 11:18:25 +03:00
Yingxin
c1f6beda7c
Merge pull request #47553 from cyx1231st/wip-seastore-cleanup-reclaim
crimson/os/seastore: cleanups to gc reclaim

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Zhang Song <zhangsong325@gmail.com>
2022-08-17 16:11:46 +08:00
Venky Shankar
cd38fe3c85
Merge pull request #47477 from mchangir/doc-clarify-start-time-in-snap-schedule
doc/cephfs: note regarding start time time zone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-17 12:36:10 +05:30
Venky Shankar
df5bef054a
Merge pull request #47099 from joscollin/wip-B56537-wrong-rsp-wsp-values
cephfs-top: fix the rsp/wsp display

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-17 11:14:21 +05:30
Adam King
042ca579c2
Merge pull request #47365 from adk3798/explicit-host-no-schedule
mgr/cephadm: fix handling of draining hosts with explicit placement specs

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-16 14:35:16 -04:00
Adam King
efcab49ea2
Merge pull request #47529 from hookak/container-args
cephadm: Remove duplicated process args in promtail and loki

Reviewed-by: Adam King <adking@redhat.com>
2022-08-16 14:32:03 -04:00
Adam King
b4ec87db95
Merge pull request #47545 from adk3798/grafana-password
mgr/cephadm: set dashboard grafana-api-password when user provides one

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-08-16 14:27:37 -04:00
Ronen Friedman
c50c20fd19 osd/scrub: PGs that are scrubbing now update stats periodically
Added periodic calls to all PGs for which the OSD is the primary,
asking for a scrub statistics update.

This allows operator queries (e.g. 'pg dump pgs') to present
up-to-date scrub duration, "scrub is blocked" duration, etc'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-16 17:19:21 +03:00
Adam King
e3d4c7707e
Merge pull request #47565 from adk3798/unit-test-runtime
mgr/cephadm: mock CephadmHttpServer run in unit tests

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-16 08:50:10 -04:00
Milind Changire
5d281e9b88 doc/cephfs: note regarding start time time zone
Fixes: https://tracker.ceph.com/issues/56730
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-08-16 17:51:37 +05:30
Nizamudeen A
c7778d3328
Merge pull request #47119 from rhcs-dashboard/image-refs-bug
mgr/dashboard: fix _rbd_image_refs caching

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-16 17:29:05 +05:30
Kefu Chai
23b2e983ae
Merge pull request #47609 from cbodley/wip-install-deps-rhel
install-deps: remove outdated rhel8 devtool packages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-16 19:19:07 +08:00
Ilya Dryomov
61df853f8c
Merge pull request #45628 from PepperJo/comparev_and_writev_v7
librbd: add compare-and-write compare length limit, remove sector size restriction

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-16 11:53:05 +02:00
Kefu Chai
3e37ee6e56
Merge pull request #47617 from tchaikov/wip-cmake-jsonnet
cmake: set $PATH for tests using jsonnet tools

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
2022-08-16 16:59:43 +08:00
Yingxin
601f7be038
Merge pull request #47618 from xxhdx1985126/wip-journal-move
crimson/os/seastore/journal: move bufferlists to reduce the amount of memory copies

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-16 12:51:23 +08:00
Xuehan Xu
a531b76775 crimson/os/seastore/journal: move bufferlists to reduce the amount of memory copies
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-16 10:58:37 +08:00
Kefu Chai
4a3afcf277 cmake: set $PATH for tests using jsonnet tools
otherwise they would not able to find executables installed into
${CMAKE_CURRENT_BINARY_DIR}.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-16 10:53:29 +08:00
Kefu Chai
7e309f3a1f
Merge pull request #47594 from tchaikov/wip-cmake-win32
cmake: enforce gcc-10 for win32 port

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-16 09:45:54 +08:00
jinhong.kim
6141d207cb
cephadm: Remove duplicated process args in promtail and loki(config.file)
Signed-off-by: jinhong.kim <jinhong.kim0@navercorp.com>
2022-08-16 09:48:23 +09:00
Casey Bodley
e856368f03
Merge pull request #47612 from cbodley/wip-rgw-revert-lua-filter
Revert "rgw/lua: allow read access to object data"

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-08-15 16:22:44 -04:00
Casey Bodley
ec3b0025ce Revert "rgw/lua: allow read access to object data"
This reverts commit f4501f6970.

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-08-15 14:51:55 -04:00
Casey Bodley
2568428ecd
Merge pull request #47564 from cbodley/wip-build-disable-motr
build: temporarily disable WITH_RADOSGW_MOTR in make check

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-15 14:48:16 -04:00
Casey Bodley
d55598b329 install-deps: remove outdated rhel8 devtool packages
these were accidentally resurrected in 65b1a13139

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-08-15 13:25:52 -04:00
Adam King
a898f4f696
Merge pull request #47513 from Dazul/cephadm-allow-multiple-vips-keepalived
Cephadm: Allow multiple virtual IP addresses for keepalived and haproxy

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-08-15 13:24:57 -04:00
Adam King
2f2daaeb83
Merge pull request #47539 from guits/fix-zap-msg-cephadm
cephadm: fix incorrect warning

Reviewed-by: Adam King <adking@redhat.com>
2022-08-15 13:14:39 -04:00
Adam King
4150633b41
Merge pull request #47562 from guits/c-v-fix_ceph_device
cephadm/ceph-volume: fix rm-cluster --zap

Reviewed-by: Adam King <adking@redhat.com>
2022-08-15 13:11:33 -04:00
Yuval Lifshitz
ad51b94ab4
Merge pull request #46550 from yuvalif/wip-yuval-lua-filter
rgw/lua: allow access to object data

reviwed-by: cbodley, anthonyeleven
2022-08-15 19:57:09 +03:00
Yuval Lifshitz
3369413f6a
Merge pull request #47420 from yuvalif/wip-yuval-remove-metadata-entry
rgw: remove metadata entry when remote fetch reply with ENOENT

reviewed-by: cbodley
2022-08-15 19:55:36 +03:00
Daniel Gryniewicz
f0150fa933
Merge pull request #47362 from dang/wip-dang-zipper-cleanup
RGW - Zipper - Init cleanup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-15 12:35:01 -04:00
Yuval Lifshitz
718027922e
Merge pull request #47010 from yuvalif/wip-yuval-fix-lua-post-ctx
rgw/lua: post request context does not work

reviewed-by: cbodley, zenomri
2022-08-15 19:31:34 +03:00
Yuval Lifshitz
538566a8a1
Merge pull request #46304 from yuvalif/wip-yuval-fix-53810
rgw/lua: don't create the script manager per request

reviewed-by: cbodley, dang, mkogan1
2022-08-15 19:30:11 +03:00
Casey Bodley
4322dea2ff
Merge pull request #47411 from linuxbox2/wip-56997
rgwlc/sync: avoid calling merge-and-store-attrs from remove_bucket_co…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-08-15 12:25:24 -04:00
Ilya Dryomov
093e823745 test/librbd: various fixups for compare-and-write test cases
- missing EILSEQ asserts in IO and IOWithIOHint
- AioCompletion leak in CompareTooSmall and WriteTooSmall
- skip StripeUnitUnaligned and TooLarge on the PWL cache as it wasn't
  limited by the 512-byte sector limit before and isn't limited by the
  stripe unit limit now

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-15 09:44:09 +02:00
Ilya Dryomov
35f3ccb687 librbd/cache/pwl: adjust compare-and-write compare substringing
cmp_bl can no longer be shorter than read_bl (i.e. image extent).
This is caught very early at the API level, see commit af96e6dae3
("librbd: make C++ cmp&write semantics equal to C API").

However, cmp_bl can still be longer than read_bl and in that case
it should be capped by the image extent length.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-15 09:44:09 +02:00
Ilya Dryomov
ec0fc71cdb librbd: discard cache state if compare-and-write writes to disk
Otherwise this is obviously broken with rbd_cache_policy = writeback or
rbd_cache_policy = writethrough as the write is done on the OSD, beneath
ObjectCacher.  This went unnoticed because the original (and so far the
only known) compare-and-write user, tcmu-runner rbd driver, disables the
cache altogether.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-15 09:44:09 +02:00
Kefu Chai
6cdec0cdfe cmake: enforce gcc-10 for win32 port
we only have GCC-10 targeting MinGW at the time of writing, and it
is good enough for compiling the Winows port.

so let's relax the requirement to enable the windows build.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-15 15:24:15 +08:00
Kefu Chai
3f4ccb1582
Merge pull request #47402 from NitzanMordhai/wip-nitzan-crimson-rbd-cls-watcher-list
crimson/osd: Port rgw watcher list

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-15 15:12:54 +08:00
Yingxin
adc4e8ace5
Merge pull request #47552 from myoungwon/wip-fix-seastore-trm-test
test/crimson/seastore: unittest-transaction-manager fixes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:41:26 +08:00
Yingxin Cheng
e9cbed2c4d crimson/os/seastore/transaction_manager: don't return invalid extent in get_extents_if_live()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
9d0305d1e2 crimson/os/seastore/async_cleaner: cleanup and add logs to gc trim
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
ec2c48343a crimson/os/seastore: document how get_extents_if_live deals with extents split
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
a8deede8bc crimson/os/seastore/transaction_manager: cleanups to get_extents_if_live
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
f1c1a5fc1c crimson/os/seastore/async_cleaner: cleanup, introduce do_gc_reclaim()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
b84c4bc453 crimson/os/seastore/async_cleaner: move retrieve_backref_extents_in_range to weak transaction
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
4ed5b25667 crimson/os/seastore/async_cleaner: cleanup gc_reclaim_space()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
Yingxin Cheng
d041427a6c crimson/os/seastore/async_cleaner: use weak transaction to get backref mappings
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-15 11:34:51 +08:00
zdover23
ff09049cdd
Merge pull request #47580 from zdover23/wip-doc-2022-08-14-rados-operations-operating-prompt-update
doc/rados/operations: add prompts to operating.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-15 10:15:23 +10:00
Ilya Dryomov
b34ecdc838
Merge pull request #47570 from idryomov/wip-57107
rbd: find_action() should sort actions first

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-08-14 12:22:41 +02:00