Commit Graph

122580 Commits

Author SHA1 Message Date
Sage Weil
6029a0e256 common: add osd_memory_target_autotune
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-12 11:02:34 -04:00
Sage Weil
4a8182a606 mgr/cephadm: report memory usage, request (limit) in 'orch ps'
Fill in from {osd,mon}_memory_target if no container limit is set.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-12 11:02:34 -04:00
Sage Weil
eb3c38577a doc/cephadm/host-management: document _admin group
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-12 11:01:23 -04:00
Sage Weil
3ad3f06d2c mgr/orchestrator: fix help formatting
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-04 13:36:00 -04:00
zdover23
462c121653
Merge pull request #40502 from zdover23/wip-doc-podman-version-octopus-note-2021-30-Mar
doc/cephadm: add podman version note to install

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-04-30 05:53:58 +10:00
Ernesto Puerta
381685f17f
Merge pull request #40072 from wornet-mwo/dashboard--grafana-hostname-corrections
mgr/dashboard: Fixed name clash when hostname similar to another

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2021-04-29 19:40:57 +02:00
Kefu Chai
9e3aa76f4a
Merge pull request #41040 from tchaikov/wip-doc-mds-conf
doc/cephfs/mds-config-ref: render options using confval directive

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-30 00:33:41 +08:00
Mark Kogan
48ce5bb6c3
Merge pull request #41028 from mkogan1/wip-rgw-tracker-50467
rgw: fix segfault related to explicit object manifest handling
2021-04-29 18:48:54 +03:00
Ernesto Puerta
b0c0815e9d
Merge pull request #41083 from rhcs-dashboard/fix-50580-master
mgr/dashboard: OSDs placement text is unreadable

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-29 17:42:38 +02:00
Kefu Chai
a64b623537
Merge pull request #41082 from tchaikov/wip-50558
os/bluestore: Revert" Optimizing the lock of bluestore writing process"

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-04-29 22:59:02 +08:00
Kefu Chai
4fa8b4aa53
Merge pull request #41064 from petrutlucian94/win_at_removedir
include: define AT_REMOVEDIR on Windows

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-29 22:58:16 +08:00
Kefu Chai
59624b0fd9
Merge pull request #41038 from tchaikov/wip-cmake-liburing
cmake: pass "CC" using configure when building liburing

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2021-04-29 22:20:09 +08:00
Aashish Sharma
543b02436f mgr/dashboard:OSDs placement text is unreadable
While displaying the host pattern in the OSDs placement tab, it gets splited with semi-colons. Also adjusted the column size of Container Image ID and Placement columns.

Fixes: https://tracker.ceph.com/issues/50580
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-04-29 19:26:17 +05:30
Kefu Chai
2627f3204e os/bluestore: Revert" Optimizing the lock of bluestore writing process"
This reverts commit e80d3f7a891af99ba0d4cfe99e5530016ca867ac.

Fixes: https://tracker.ceph.com/issues/50571
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-29 20:03:33 +08:00
Ilya Dryomov
defea709f4
Merge pull request #40493 from CongMinYin/fix-rwl-fragment
librbd/cache/pwl: Fix pmem cache fragment issue

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 09:35:21 +02:00
Yin Congmin
b53392a153 librbd/cache/pwl: Fix pmem cache fragment issue
I/O may hang due to pmem cache fragment issue when blocks are diffrent
in size. Call pmdk API(pmemobj_defrag) to solve.

Fixes: https://tracker.ceph.com/issues/49879

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-04-29 22:12:31 +08:00
Sage Weil
e216c1ee11 Merge PR #41072 into master
* refs/pull/41072/head:
	doc/releases/nautilus: fix a braino in 14.2.20 release note

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-28 18:42:49 -04:00
Sage Weil
f8e872ce2f Merge PR #40924 into master
* refs/pull/40924/head:
	mgr/cephadm: check hostname resolution before adding host
	cephadm: provide a way to checkhost connection without /etc/hosts passed the shell
	doc/cephadm: remove /etc/hosts from list of hostname resoltion methods

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-28 14:27:07 -04:00
Josh Durgin
0e273e6760
Merge pull request #40593 from ideepika/wip-new-testing-params
qa/config/rados: add dispatch delay testing params

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sam Just <sjust@redhat.com>
2021-04-28 11:26:58 -07:00
Sage Weil
75480f52e4 Merge PR #40941 into master
* refs/pull/40941/head:
	qa/suites/rados/cephadm/smoke-roleless: test client-keyring
	qa/tasks/cephadm.py: adjust client.admin key mode; place on all hosts
	cephadm: distribute client.admin keyring+conf to label:_admin on bootstrap
	doc/cephadm: document the default 'admin' label
	mgr/cephadm: 'ceph orch client-keyring ...' commands to manage keyring files
	mgr/cephadm: reimplement ceph.conf pushing
	mgr/cephadm: use _write_remote_file for ceph.conf
	mgr/cephadm: _write_remote_file helper
	mgr/cephadm: add placementspec for which hosts get ceph.conf

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-28 14:26:35 -04:00
Sage Weil
428d3df588 Merge PR #40943 into master
* refs/pull/40943/head:
	mgr/cephadm: skip ok-to-stop for mons in upgrade if < 3 mons
	mgr/cephadm: don't allow upgrade start with less than 2 mgrs

Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-04-28 14:26:07 -04:00
Sage Weil
1b70eed088 Merge PR #41049 into master
* refs/pull/41049/head:
	cephadm: re-assimilate user provided conf after mgr created

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-28 14:25:30 -04:00
Sage Weil
22f785e186 Merge PR #41055 into master
* refs/pull/41055/head:
	cephadm: allow several public networks be matched

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-28 14:24:10 -04:00
Kefu Chai
e027864990
Merge pull request #41059 from tchaikov/wip-crimson-clang-cleanup
crimson: clean up issues spotted by the clang compiler

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-29 00:18:26 +08:00
Ilya Dryomov
9ff450340b doc/releases/nautilus: fix a braino in 14.2.20 release note
Setting auth_expose_insecure_global_id_reclaim to false disables the
"disconnect right after authentication" behavior, not the warning.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-28 18:02:53 +02:00
Kefu Chai
bdd322a2d3
Merge pull request #41063 from tchaikov/wip-rgw-move
rgw/rgw_rest_sts: return local variable w/o std::move()

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-28 23:35:06 +08:00
zdover23
477ce08323
Merge pull request #41067 from zdover23/wip-doc-crismon-misspelling-fix-2021-Apr-28
doc/crimson: s/Crismon/Crimson/

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-29 00:11:55 +10:00
Zac Dover
3043aaaa8a doc/cephadm: add podman version note to install
This PR adds a note to the cephadm installation
guide that informs users that only podman version
2.0.0 and higher work with Ceph, with the
exception of podman version 2.2.1, which does
not work with Ceph. There is also a note regarding
kubic stable 3.0.1 working, but only with newer
kernels.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-29 00:08:18 +10:00
zdover23
4e67878cb9
Merge pull request #41048 from zdover23/wip-doc-rados-config-cluster-names-2021-Apr-27
doc/rados: rename "Running Multiple Clusters"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-28 23:28:15 +10:00
Zac Dover
f904078344 doc/crimson: s/Crismon/Crimson/
This misspelling occurred twice in this
document.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-28 23:26:09 +10:00
Kefu Chai
d4eb4c067f crimson/os/seastore: do not capture unused variable
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
a56f89ddc1 crimson/common: do not capture unused variable
this change silences the warning from clang, like:

 ../src/crimson/common/interruptible_future.h:276:8: warning: lambda capture 'this' is not used [-Wunused-lambda-capture]
       [this, func=std::move(func),
        ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
7288dd20d1 crimson/os/seastore: mark final class "final"
this change silences warning like:

 ../src/crimson/os/seastore/onode_manager/staged-fltree/fltree_onode_manager.h:80:18: warning: class with destructor marked 'final' cannot be inherited from [-Wfinal-dtor-non-final-class]
   ~FLTreeOnode() final {}
                  ^
 ../src/crimson/os/seastore/onode_manager/staged-fltree/fltree_onode_manager.h:13:8: note: mark 'crimson::os::seastore::onode::FLTreeOnode' as 'final' to silence this warning
 struct FLTreeOnode : Onode, Value {
        ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
8e85261b80 test/crimson/seastore: do not put braces around scalar initializer
this change silences the warning from clang like:

src/test/crimson/seastore/onode_tree/test_value.h:152:12: warning: braces around scalar initializer [-Wbraced-scalar-init]
     return {static_cast<value_size_t>(size - sizeof(value_header_t))};
            ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
bdc5b14743 crimson/os/seastore: do not reference non-template with template
this change addresses the build failure with clang:

src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_accessor.h:352:29: error: 'encode_split' following the 'template' keyword does not refer to a template
    test_recorder->template encode_split(split_at, read().p_start());
                   ~~~~~~~~ ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
e69e3dae03 crimson/os/seastore: do not capture label using &
structured binding does not define variables. unlike GCC, Clang does
not allow this. this change address following build failures with clang:

../src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.cc:210:24:
note: 'result' declared here
      auto &[complete, result] = ret;
                       ^
../src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.cc:214:6:
error: reference to local binding 'complete' declared in enclosing
lambda expression
            complete = biter == eiter;
            ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Zac Dover
87a1ae7a44 doc/rados: rename "Running Multiple Clusters"
This PR corrects a title so that the title
more accurately describes the content in the
section it names.

Fixes: https://tracker.ceph.com/issues/50517 (partially)
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-28 22:45:30 +10:00
Lucian Petrut
4aab6e3c79 include: define AT_REMOVEDIR on Windows
The AT_REMOVEDIR flag is used by a recent change [1] but isn't
defined on Windows.

This commit will add the missing definition. Note that it won't be
passed to OS functions, only being used at the CephFS level.

[1] https://github.com/ceph/ceph/pull/40810

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2021-04-28 12:20:46 +00:00
Kefu Chai
60daa38935 rgw/rgw_rest_sts: return local variable w/o std::move()
in C++17, the C++ standard ensures that the return value in this case
can be optimized with copy elision, adding std::move() is not necessary,
and prevents copy elision from happening.

this change also silences the warning of:

../src/rgw/rgw_rest_sts.cc: In member function 'std::unique_ptr<rgw::sal::RGWOIDCProvider> rgw::auth::sts::WebTokenEngine::get_provider(const DoutPrefixProvider*, const string&, const string&) const':
../src/rgw/rgw_rest_sts.cc:92:19: warning: moving a local object in a return statement prevents copy elision [-Wpessimizing-move]
   92 |   return std::move(provider);
      |          ~~~~~~~~~^~~~~~~~~~
../src/rgw/rgw_rest_sts.cc:92:19: note: remove 'std::move' call

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:16:01 +08:00
Stanislav Datskevych
cdd7d20b35 cephadm: allow several public networks be matched
Fixes: https://tracker.ceph.com/issues/50548
Signed-off-by: Stanislav Datskevych <me@nek0.net>
2021-04-28 12:39:21 +02:00
Yingxin Cheng
636ab08f26 cmake: bump to PMDK v1.10
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-04-28 17:31:41 +08:00
Sébastien Han
502409c966
Merge pull request #41032 from leseb/raw-list-json
ceph-volume: fix "device" output
2021-04-28 09:00:34 +02:00
Kefu Chai
d30875269e
Merge pull request #41002 from strenuous-life/wip-cephadm-daemon-restart-mgr-loop
mgr/cephadm: The command of 'ceph orch daemon restart mgr.xxx' may ca…

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-28 14:23:28 +08:00
Kefu Chai
49499f3cf5
Merge pull request #41009 from tchaikov/wip-mon-cleanup
mon/OSDMonitor: let OSDMonitor::_get_pending_crush() return

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-28 12:47:45 +08:00
Kefu Chai
a2ed53a7fa doc/_ext/ceph_confval: print "false" default values
before this change, we check the exisitence of default value of an
option using "if default", but this is wrong. what if "default" is an
empty string or a numeric value of 0, or just False?

after this change, its exisitence is checked using "if default is
defined", so all "false" default values are rendered as well.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 10:39:12 +08:00
Sage Weil
e41931d042 qa/suites/rados/cephadm/smoke-roleless: test client-keyring
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-27 18:29:50 -04:00
Sage Weil
b0dcaf2cfa qa/tasks/cephadm.py: adjust client.admin key mode; place on all hosts
Except during upgrades, since it is not supported there.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-27 18:29:50 -04:00
Sage Weil
08d21ccc94 cephadm: distribute client.admin keyring+conf to label:_admin on bootstrap
If we are placing ceph.conf in /etc/ceph (the default), tell the cluster
to continue doing this going forward to hosts with the '_admin' label.

This doesn't induce the user to add the admin label to other hosts too,
unfortunately--e probably want them to add the admin label to other mons,
for instance--but it is a start.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-27 18:29:49 -04:00
Adam King
adc8a9c0a8 cephadm: re-assimilate user provided conf after mgr created
Fixes: https://tracker.ceph.com/issues/50544

Signed-off-by: Adam King <adking@redhat.com>
2021-04-27 14:54:04 -04:00
Kefu Chai
f7294bca9d
Merge pull request #41046 from rzarzynski/wip-crimson-monc-auth_reply
crimson/monc: fix use-after-free around Connection::do_auth_single().

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-28 02:02:32 +08:00