1
0
mirror of https://github.com/ceph/ceph synced 2025-04-01 23:02:17 +00:00
Commit Graph

116578 Commits

Author SHA1 Message Date
Josh Durgin
8a2f2d82f4
Merge pull request from sunnyku/wip-f33-pyfix
do_cmake.sh: use python-3.9 with fedora version 33

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-10-30 08:15:59 -07:00
Jason Dillaman
0cd14ccff2
Merge pull request from trociny/wip-47827
mgr/rbd_support: create mirror snapshots asynchronously

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-30 09:40:10 -04:00
Yuval Lifshitz
e96331fdab rgw/lua: use lua exceptions instead of ceph_asserts
also use lua assert() in uni tests instead of print()
fix bug when accessing user id in an ACL grant

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-30 14:50:51 +02:00
Lenz Grimmer
21b24e0247
Merge pull request from rhcs-dashboard/datatable_click_prevent
mgr/dashboard: Prevent table items from getting selected while expanding

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-30 09:55:47 +01:00
Lenz Grimmer
587a84049b
Merge pull request from Codom/master
mgr/dashboard: Added Versioning to the REST API

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-30 09:50:05 +01:00
Yuval Lifshitz
eaf48d1a3a rgw/lua: allow setting metadata via lua
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-30 10:40:06 +02:00
Kefu Chai
d162c00c66
Merge pull request from tchaikov/wip-zbd
rpm,cmake: s/WITH_LIBZBD/WITH_ZBD/ and enable ZBD on demand

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-10-30 11:17:56 +08:00
Kefu Chai
92300bb747
Merge pull request from tchaikov/wip-crimson-gtest
crimson/gtest_seastar: do not keep a copy of argv

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2020-10-30 10:25:49 +08:00
Kefu Chai
2cdbbd1212
Merge pull request from tchaikov/wip-cmake-alienstore
cmake: build bluestore-tp before crimson-alienstore

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2020-10-30 10:25:06 +08:00
Kefu Chai
75c7a792e6
Merge pull request from tchaikov/wip-wunused-variable
osd/osd_types: mark unused variable [[maybe_unused]]

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-30 10:24:11 +08:00
Xiubo Li
f482b8ca79 rbd-nbd: reexpand the conf meta in child process
Fixed: https://tracker.ceph.com/issues/48046
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-29 22:05:16 -04:00
Xiubo Li
61a4b8c670 qa: for the latest kclient it will also return EIO
Fixes: https://tracker.ceph.com/issues/45100
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-29 21:30:36 -04:00
Jason Dillaman
190534ae08
Merge pull request from trociny/wip-48020
mgr/rbd_support: store global schedule without localized prefix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 20:58:44 -04:00
Jason Dillaman
54329691c0
Merge pull request from trociny/wip-rbd-finisher-cancel
librbd: relax requirements on finisher canceled callback

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 20:58:13 -04:00
Mykola Golub
08151a191f mgr/rbd_support: create mirror snapshots asynchronously
To scale up with number of images.

Fixes: https://tracker.ceph.com/issues/47827
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
13ce488d7a pybind/rbd: add async mirror image get mode and info methods
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
fd5e642cd7 librbd: add missing declaration of rbd_aio_mirror_image_get_mode
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
b27db87c03 pybind/rbd: add image async open and close methods
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Jason Dillaman
352dec753e librbd: refresh full global config when applying metadata
The ConfigProxy contains a point-in-time copy of the global config
that is dynamically updated in CephContext::_conf. Upon an image
refresh, pull the latest version of the global config from the
CephContext and apply it to the config stored within the ImageCtx.

Fixes: https://tracker.ceph.com/issues/48035
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 14:15:05 -04:00
Jason Dillaman
d47c180477 common/config_proxy: added 'get_config_values' method
Expose the ability to retrieve the ConfigValues from an existing
ConfigProxy object. When combined with the newly exposed
'set_config_values' method, it will allow the safe bulk-updating
of configuration options. This also removes the original private
static version of 'get_config_values'.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 14:14:38 -04:00
Samuel Just
08c54e4ec2
Merge pull request from tchaikov/wip-osd-scheduler-move
osd/scheduler: rely on copy ellision to move return val

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
2020-10-29 10:56:44 -07:00
Casey Bodley
897f96eef1
Merge pull request from nickjanus/issue-45193
rgw-admin: fixes BucketInfo for missing buckets

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-10-29 12:00:52 -04:00
Yuval Lifshitz
f454b2a628
Merge pull request from batrick/rgw-lua-fixes
rgw: lua refactor
2020-10-29 17:56:46 +02:00
lixiaoy1
33b961e9a1 rbd/tool: add image-cache invalidate
Add an rbd command image-cache invalidate to discard RWL cache.

Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-10-29 23:33:10 +08:00
lixiaoy1
da33733fcd librbd/internal: update invalidate_cache
Except invalidating object cache, invalidate image writeback cache.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-29 23:33:10 +08:00
lixiaoy1
3d5b89e85b librbd/cache: discard writeback cache
Add an interface in ImageCache to discard writeback cache.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-29 23:33:10 +08:00
Mykola Golub
d1571ed274 pybind/rbd: async API for creating mirror snapshots
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 15:14:38 +00:00
Mykola Golub
d8468ec7e4 librbd: async API for creating mirror snapshots
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 15:14:38 +00:00
Jason Dillaman
94fcf109f2 common/config_proxy: expose the 'set_config_values' method
This method was previously only available for seastart builds, but
librbd will also use it to control the timing of updates to the global
config.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 09:54:42 -04:00
Mykola Golub
5e10672e4e
Merge pull request from dillaman/wip-48032
qa/workunits/rbd: fix permission issue when removing mirror peer

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-10-29 15:48:35 +02:00
Volker Theile
65a6a1759b mgr/dashboard: Fix property name in orchestrator status response
The response of the 'status' endpoint of the 'orchestrator' controller contains the property 'description' instead of 'message' as this is done by other 'status' endpoints.

Fixes: https://tracker.ceph.com/issues/47926

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-10-29 14:29:34 +01:00
Kefu Chai
4cc179ff08
Merge pull request from tchaikov/wip-crimson-os-cleanup
crimson/os: fix couple issues reported by clang

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2020-10-29 19:59:08 +08:00
Matt Benjamin
64f15c838b
Merge pull request from pritha-srivastava/wip-rgw-sts-expire-session-token
rgw/sts: adding code for "aws:TokenIssueTime" to be used
2020-10-29 07:58:10 -04:00
Matt Benjamin
133f26325d
Merge pull request from pritha-srivastava/wip-sts-role-min-duration
rgw/sts: Adding a configurable rgw_sts_min_session_duration
2020-10-29 07:57:50 -04:00
Kefu Chai
755c0e7f8b osd/scheduler: rely on copy ellision to move return val
C++14 enforces copy ellision in this case.

also silences warning of

src/osd/scheduler/mClockScheduler.cc:122:21: warning: redundant move in return statement [-Wredundant-move]
  122 |     return std::move(ret);
      |            ~~~~~~~~~^~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 18:51:38 +08:00
Kefu Chai
f9f9270d75 osd/osd_types: mark unused variable [[maybe_unused]]
silences warning like:

rc/osd/osd_types.h:5482:18: warning: unused variable '_' [-Wunused-variable]
     auto [iter, _] = ref_delta.try_emplace(hoid, 0);
                  ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 18:36:13 +08:00
Kefu Chai
5bde7842f8 crimson/os/seastore/.../lba_btree_node_impl: put "{" at a new line
so the function body is not cluttered with the function signature.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 18:30:10 +08:00
Kefu Chai
90e2ed8cbe crimson/os/seastore/.../lba_btree_node_impl: use plain seastar::future in lookup_range()
otherwise GCC enters a dead loop when compiling this method.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 18:30:10 +08:00
Kefu Chai
688b95798b crimson/common: drop variadic future support from errorator
this allows us to bump up Seastar_API_LEVEL to 6 which completely ditch
variadic future from Seastar.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 18:30:10 +08:00
Ilsoo Byun
5a94be030b rgw: keep syncstopped flag when copying bucket shard headers
Fixes: https://tracker.ceph.com/issues/48037

Signed-off-by: Ilsoo Byun <ilsoobyun@linecorp.com>
2020-10-29 18:27:47 +09:00
Kefu Chai
76fe6fc32c cmake: build bluestore-tp before crimson-alienstore
to address the FTBFS of

src/os/bluestore/BlueStore.cc:52:10: fatal error: tracing/bluestore.h: No such file or directory
   52 | #include "tracing/bluestore.h"
      |          ^~~~~~~~~~~~~~~~~~~~~
compilation terminated.

tracing/bluestore.h is created by the "bluestore-tp" target, there
is a good chance that we build crimson when WITH_LTTNG is enabled,
let's ensure that tracing/bluestore.h is ready before compiling
alienstore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 17:21:06 +08:00
Kefu Chai
7736aaf32f crimson/os: capture local bindings using capture variable list
structured binding does not define variables, and the implicit
capture-by-copy `=` does not help in this case, we have to define a
capture with an initializer to create a *variable* enclosed by
the closure explicitly.

this address the error like:

src/crimson/os/seastore/segment_cleaner.cc:315:5: error: reference to local binding 'addr' declared in enclosing lambda expression
                  addr);
                  ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 16:32:26 +08:00
Kefu Chai
e29f6e84d7 crimson/os: do not move temporay variable
copy ellision ensures that copy ctor is not called in this case

silences warning like:

mson/os/seastore/lba_manager/btree/lba_btree_node_impl.cc:262:5: warning: moving a temporary object prevents copy elision [-Wpessimizing-move]
    std::move(begin()),
    ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 16:32:26 +08:00
Kefu Chai
6498d97a0e crimson/os: do not capture unused variable
silences warning like:

btree/extentmap_btree_node.h💯8: warning: lambda capture 'this' is not used [-Wunused-lambda-capture]
      [this, ec, len] (auto &extents) {
       ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 16:32:25 +08:00
Kefu Chai
f3f688c48f
Merge pull request from tchaikov/wip-seastar
seastar: pick up changes to colocate libc allocator and seastar alloc…

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-10-29 15:21:41 +08:00
Kefu Chai
897fe53951 crimson/gtest_seastar: consume argv before passing them to seastar
so we can pass gtest options to the test without annoying seastar app.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 15:00:41 +08:00
Kefu Chai
0df04e602b crimson/gtest_seastar: do not keep a copy of argv
argv is always available in the whole life cycle of the application, so
there is no need to keep a copy of it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 14:04:51 +08:00
Kefu Chai
4cd2b00d2a seastar: pick up changes to colocate libc allocator and seastar allocator
this allows us to use seastar's builtin allocator along with the libc
allocator used by alien threads.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-29 13:59:41 +08:00
Changcheng Liu
497b4d6f72 cmake: remove yasm since it's been replaced by nasm
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-29 12:36:20 +08:00
Changcheng Liu
58a946ca06 cmake: use nasm to replace yasm to build isa-l
1. use nasm to replace yasm to build isa-l
2. use the defined MACRO for nasm to replace all the defined MACRO for
   yasm

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-29 12:36:08 +08:00