Commit Graph

127080 Commits

Author SHA1 Message Date
Sebastian Wagner
5e25b19cc7
doc/cephadm: move service-management to services/index.rst
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-27 12:20:02 +02:00
Sebastian Wagner
10012acb3e
Merge pull request #43160 from sebastian-philipp/doc-spec-networks
doc/cephadm: Add networks to spec documentation 

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-09-27 12:19:17 +02:00
Nathan Cutler
1a3a1b0958 rpm: enable system_pmdk bcond for SUSE builds
ecb8d2cae2 disabled the system_pmdk bcond for all
build targets based on the fact that pmdk 1.10 was not available on any of them.

Now that openSUSE Tumbleweed ships pmdk 1.11, we re-enable the system_pmdk bcond
to fix the master build for openSUSE Tumbleweed.

Since openSUSE Tumbleweed is the *only* SUSE build target master supports, there
is no need for greater granularity in the distro conditional here.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2021-09-27 12:05:45 +02:00
Guillaume Abrioux
5a4f29de7a cephadm/iscsi: fix a typo
This commit fixes a typo in the comment of unit.run of iscsi service.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2021-09-27 09:58:39 +02:00
Venky Shankar
e425e083d6
Merge pull request #43276 from lxbsz/fix_typo
mds: fix typo in the comments and log when setting new loner

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-09-27 12:00:11 +05:30
taodd
5ca30f396b msg/async/ProtocolV2: Set the recv_stamp at the beginning of receiving a message instead of after receiving.
Fixes: https://tracker.ceph.com/issues/52739
Signed-off-by: dongdong tao <dongdong.tao@canonical.com>
2021-09-27 14:27:13 +08:00
Samuel Just
a35d1eff1d
Merge pull request #43301 from athanatos/sjust/wip-seastore-fixes-2021-09-24
crimson/os/seastore/.../btree_range_pin: fix is_parent_of

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-26 22:04:18 -07:00
Brad Hubbard
e7a8d094bc
Merge pull request #43291 from badone/wip-missing-hostname-dependency
rpm, debian: We depend on 'hostname'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-27 14:21:14 +10:00
Brad Hubbard
cf932436c8 rpm, debian: Add hostname as a "make check" dependency
test_hostname.cc depends on the hostname binary.

Fixes: https://tracker.ceph.com/issues/52695

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2021-09-27 11:03:55 +10:00
Ronen Friedman
1a2329c46b
Merge pull request #43191 from ronen-fr/wip-rf-scrub-locations
osd/scrub: collecting scrub-related files into a separate directory

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-09-26 20:33:49 +03:00
Kefu Chai
48c044b618
Merge pull request #43304 from inspur-wyq/wip-doc-3
doc/rbd/rbd-windows.rst: fix typos

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-26 21:55:57 +08:00
Ronen Friedman
7248f12768 osd/scrub: collecting scrub-related files into a separate directory
Cleaning src/osd from scrub implementation files. Triggered by:
- the matching Crimson scrub structure;
- the proliferation of scrub related code files (inc. in coming PRs);

scrubber_common.h, which defines the scrubber's interface, remains
in src/osd.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-09-26 13:42:54 +00:00
Ronen Friedman
c98b0bced3
Merge pull request #40984 from ronen-fr/wip-ronenf-scrub-sched
osd/scrub: extracting scrub scheduling code from OSD.cc

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-26 14:59:49 +03:00
Ilya Dryomov
6de678890b
Merge pull request #43220 from idryomov/wip-keyring-resolve-error
auth,mon: don't log "unable to find a keyring" error when key is given

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-26 12:09:43 +02:00
Ilya Dryomov
60e5539976
Merge pull request #43207 from idryomov/wip-full-try-regressions
librados,neorados,librbd: fix FULL_TRY handling regressions

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2021-09-26 12:07:06 +02:00
Ernesto Puerta
357f79ff2e
mgr/dashboard: replace string version with class
* APIVersion:
  * Moved to a separate file
  * Added doctests
  * Added sentinel values:
    * DEFAULT = 1.0
    * EXPERIMENTAL = 0.1
    * NONE = 0.0
  * Added to_mime_type() helper method
* Controllers.__init__:
  * Added type hints
  * Replaced string versions with APIVersions
* Feedback controller:
  * Replaced with EXPERIMENTAL (probably it should be NONE)

Fixes: https://tracker.ceph.com/issues/52480
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-09-25 13:47:06 +02:00
Ronen Friedman
6f2b4d3dd2 osd: fix the truncation of an int by int division
The 'r' coeff calculated in OSD::tick() was always 0.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-09-25 11:42:56 +00:00
Ronen Friedman
11f94b3dd7 osd: add a missing comma in a list of strings
One of OSD::get_tracked_conf_keys() keys was missing
a terminating ','

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-09-25 09:13:09 +00:00
Ilya Dryomov
75824a113b
Merge pull request #43228 from idryomov/wip-rbd-mirror-snapshot-rx-only
rbd-mirror: unbreak one-way snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-09-25 10:58:17 +02:00
Xiubo Li
2724043bae mds: fix the set loner log
Once here the current loner has already been dropped if there has,
and the get_wanted_loner() is the new loner it trying to set to.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-09-25 16:57:18 +08:00
Xiubo Li
3a98cce6ca mds: fix typo in the comments
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-09-25 16:54:03 +08:00
Samuel Just
49affebfa5 crimson/os/seastore/.../btree_range_pin: fix is_parent_of
The LBA tree implementation only requires that the start addr of
a logical extent be contained within the leaf range.  It's entirely
possible for the end of a logical extent to extend past the end addr
of the containing leaf node.

Fixes: https://tracker.ceph.com/issues/52709
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-09-24 18:26:09 -07:00
Samuel Just
ac7e44de95 crimson/os/seastore/transaction_manager: whitespace cleanup submit_transaction_direct
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-09-24 17:11:10 -07:00
Sage Weil
14367571fc osdc/Objecter: return EIO for new linger ops
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-24 12:25:13 -04:00
Sage Weil
f1c495b7a2 osdc/Objecter: return EIO for existing ops and linger ops
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-24 12:25:13 -04:00
Sage Weil
45ffdda221 osdc/Objecter: return EIO for new ops
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-24 12:25:13 -04:00
Sage Weil
2756dacc74 osd,mon: add EIO pool flag
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-24 12:25:13 -04:00
Ilya Dryomov
803e03d629
Merge pull request #43282 from Madhu-1/csi-ceph-conf
doc/rbd/rbd-kubernetes: add ceph.conf configmap

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-24 18:04:20 +02:00
Sebastian Wagner
4adcde2a5b
Merge pull request #43294 from badone/wip-run-tox-python-common-timedelta-fix
mgr/dashboard: More robust handling of timedelta() representation

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-24 17:36:57 +02:00
Casey Bodley
80026d3af3
Merge pull request #41931 from pritha-srivastava/wip-rgw-sts-51219
rgw/sts: code for returning an error when an IAM policy

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2021-09-24 11:04:36 -04:00
Madhu Rajanna
4f48612c2c doc/rbd/rbd-kubernetes: add ceph.conf configmap
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-09-24 16:44:46 +02:00
Sage Weil
0d0a25aa92 Merge PR #42384 into master
* refs/pull/42384/head:
	mgr/cephadm: kick serve loop if new metadata makes all hosts metadata up to date
	mgr/cephadm: fix upgrade to version with agent
	mgr/cephadm: delay actions on agent daemons if root cert not created
	mgr/cephadm: handle making certs when we have hostname but no address
	mgr/cephadm: make agent certs compatible with OpenSSL hostname and ip checks
	mgr/cephadm: offline host handling improvements for agent
	mgr/cephadm: handle use_agent being turned on and off
	mgr/cephadm: better handling of offline hosts with agent
	mgr/cephadm: convert networks from set to list + don't reset con on down agent hosts
	mgr/cephadm: add ceph volume to metadata agent reports
	mgr/cephadm: implement 2-way ssl in mgr -> MgrListener comm line
	cephadm: allow mgr listener to handle variable length json strings
	mgr/cephadm: cephadm agent 2.0

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-24 10:36:41 -04:00
Sebastian Wagner
fcd9e4e4fe
Merge pull request #43298 from sebastian-philipp/cephadm-check_time_sync-mock
cephadm: TestCheckHost: also mock check_time_sync 

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2021-09-24 15:48:40 +02:00
Avan Thakkar
88a8732215 mgr/dashboard: make modified API endpoints backward compatible
Fixes: https://tracker.ceph.com/issues/52480
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Introducing APIVersion class to handle versioning for API-endpints and making
them backward compatible.
2021-09-24 18:48:35 +05:30
Adam King
d4b070e033 mgr/cephadm: kick serve loop if new metadata makes all hosts metadata up to date
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
e2643798a9 mgr/cephadm: fix upgrade to version with agent
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
64c2a0326c mgr/cephadm: delay actions on agent daemons if root cert not created
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
90ccfdff24 mgr/cephadm: handle making certs when we have hostname but no address
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
d0900bf0c0 mgr/cephadm: make agent certs compatible with OpenSSL hostname and ip checks
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
f0139dd983 mgr/cephadm: offline host handling improvements for agent
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
c8b41564cd mgr/cephadm: handle use_agent being turned on and off
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
f15e1ec255 mgr/cephadm: better handling of offline hosts with agent
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
c35375948e mgr/cephadm: convert networks from set to list + don't reset con on down agent hosts
networks needs to be list so they can be encoded in  a json string
resetting con on the hosts where agent isn't reporting (possibly offline hosts)

Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
eeb18384c3 mgr/cephadm: add ceph volume to metadata agent reports
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
d7072d87ec mgr/cephadm: implement 2-way ssl in mgr -> MgrListener comm line
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:51 -04:00
Adam King
be72463d03 cephadm: allow mgr listener to handle variable length json strings
Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:50 -04:00
Adam King
78983ad0d0 mgr/cephadm: cephadm agent 2.0
Creates an http endpoint in mgr/cephadm to receive
http requests and an agent that can be deployed on
each host that will gather metadata on the host and
send it to the mgr/cephadm http endpoint. Should save the
cephadm mgr module a lot of time it would have to spend
repeatedly ssh-ing into each host to gather the metadata
and help performance on larger clusters.

Fixes: https://tracker.ceph.com/issues/51004

Signed-off-by: Adam King <adking@redhat.com>
2021-09-24 07:23:50 -04:00
Sebastian Wagner
767564864f
cephadm: Fix TestMaintenance trying to list /var/lib/ceph
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-24 12:55:03 +02:00
Sebastian Wagner
fc9d9b3914
cephadm: TestCheckHost: also mock check_time_sync
Fixes: https://tracker.ceph.com/issues/52722

```
TestCheckHost.test_container_engine fails at cephadm:5834: Error cephadm.Error: No time synchronization is active
```

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-24 12:47:04 +02:00
Ilya Dryomov
366e9c51a8 qa/suites/rbd: test case for one-way snapshot-based mirroring
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-24 12:30:14 +02:00