Commit Graph

109889 Commits

Author SHA1 Message Date
Nathan Cutler
30585f44de pybind/mgr/*: fix config_notify handling of default values
After 5ace82e65c was merged, I found
three more instances of the code being patched.

The commit message of 5ace82e65c was/is:

"The default values are handled by mgr_module.py's _get_module_option();
the or here means that we break any non-true (0, false, none) value and
override it with the default."

Fixes: 5ace82e65c
Fixes: https://tracker.ceph.com/issues/43746
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-03-24 11:17:43 +01:00
Kiefer Chang
933df97cab
qa/tasks/mgr/dashboard/test_health: update mdsmap schema
Fixes: https://tracker.ceph.com/issues/44725
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-24 18:14:05 +08:00
Nathan Cutler
500ae6d8ad script/ceph-backport.sh: bump version number
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-03-24 10:36:59 +01:00
Nathan Cutler
6f8129f4da script/ceph-backport.sh: set target_branch in API case
When we falling back to the GitHub API to determine the milestone
number, we were not initializing target_branch, so the script was
broken for octopus backports.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-03-24 10:36:57 +01:00
Abhishek Lekshmanan
dc7cf3fe89 doc: add changelog for octopus release
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-03-24 10:29:23 +01:00
simon gao
53ba9089d8 qa : add case to test cephfs-meta-injection
Signed-off-by: simon gao <simon29rock@gmail.com>
2020-03-24 16:39:02 +08:00
simon gao
199af3257f crimson:fix issue when compile libcrimson-common.a
Signed-off-by: simon gao <simon29rock@gmail.com>
2020-03-24 16:39:02 +08:00
simon gao
974b37a45d tool: add cephfs-meta-injection to show and amend info of inode
Signed-off-by: simon gao <simon29rock@gmail.com>
2020-03-24 16:39:01 +08:00
Kefu Chai
3f5a801d97
Merge pull request #34108 from mgfritch/cephadm-optional-config-keyring
cephadm: init config and keyring with None

Tested-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-24 14:03:12 +08:00
Kefu Chai
596565d6e7
Merge pull request #34101 from s1eke/master
doc: Fix some link errors about ceph-deploy

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-24 14:00:29 +08:00
Kefu Chai
4bd9ddfe20 test/msgr: print out informative messages to stdout
they should not goto stderr

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-24 13:45:24 +08:00
Kiefer Chang
079c9fd771 mgr/orch: allow list daemons by service_name
Services like rgw and mds are differentiated by service_name. For
example: mds.xyz vs. mds.abc. With current interface, we can't list all
daemons belonged to mds.xyz only. Add service_name as a new argument to
filter daemons by it.

Fixes: https://tracker.ceph.com/issues/44541
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-24 13:07:26 +08:00
Haomai Wang
beedd6d804 kv/RocksDBStore: using PinnableSlice to avoid extra value copy
Signed-off-by: Haomai Wang <haomai@xsky.com>
2020-03-24 12:59:29 +08:00
Kefu Chai
3a638841f9
Merge pull request #34103 from yanghonggang/perf-msgr-client
test/msgr/perf_msgr_client.cc: fix misleading total op num

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-24 12:46:55 +08:00
Yan, Zheng
ca0978a892
Merge pull request #33753 from ukernel/wip-44448
mds: fix 'if there is lock cache on dir' check
2020-03-24 10:07:36 +08:00
Sage Weil
01015f8ca3 debian: add ceph-grafana-dashboards package
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 20:13:19 -05:00
Sage Weil
f1b516d1bf ceph.spec: put prometheus alerts in vendor-neutral location
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 20:13:18 -05:00
Sage Weil
b1463998bd mgr/cephadm: include prom alerts, if present in the container
The prometheus config already looks in/etc/prometheus/alerting/*, so drop
this file into position.

Note that the file is currently only present in SUSE builds, so that needs
to be fixed still.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 20:13:08 -05:00
Sage Weil
895b856aee Merge remote-tracking branch 'gh/octopus' 2020-03-23 20:09:41 -05:00
Sage Weil
53037187c4 Merge PR #34100 into octopus
* refs/pull/34100/head:
	doc/cephadm: notes on status/stability
	doc/cephadm: some troubleshooting tips

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-23 20:01:12 -05:00
Sage Weil
e85f2410e7 Merge PR #34115 into octopus
* refs/pull/34115/head:
	doc/releases/octopus: drop stray line
	doc/releases/octopus: note about repository locations
	doc/releases: include octopus in index
	doc/install/get-packages: update package install instructions
	doc/releases/octopus: final notes

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2020-03-23 20:00:58 -05:00
Sage Weil
04e0b9c2f8 Merge PR #34126 into master
* refs/pull/34126/head:
	qa/*/osd-backfill-recovery-log.sh: flush_pg_stats before checking log length

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-23 13:55:16 -05:00
Sage Weil
78acb68c01 doc/releases/octopus: drop stray line
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 13:54:12 -05:00
Sage Weil
7e71b19b3e doc/releases/octopus: note about repository locations
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 13:53:32 -05:00
Sage Weil
821d8908c4 doc/releases: include octopus in index
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 13:53:32 -05:00
Jenkins Build Slave User
dc6a0b5c3c 15.2.0 2020-03-23 17:47:45 +00:00
Sage Weil
41bc82f284 doc/install/get-packages: update package install instructions
- include cephadm method
- update to include new version URLs

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 12:40:19 -05:00
Sage Weil
659684bfb1 Merge PR #34119 into octopus
* refs/pull/34119/head:
	doc: update octopus release notes for rgw

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2020-03-23 12:38:24 -05:00
Sage Weil
5dabfc0b73 Merge PR #34122 into octopus
* refs/pull/34122/head:
	cephadm: default to v15 tag for octopus

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-23 12:38:12 -05:00
Nathan Cutler
7a4855849c script/ceph-backport.sh: update for octopus
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-03-23 16:49:36 +01:00
Neha
cfebec1b12 qa/*/osd-backfill-recovery-log.sh: flush_pg_stats before checking log length
It is possible for the pg dump to not be the latest when we check for newprimary
in _common_test(). This is because mgr_stats_period is 5 seconds, and we may not
have fetched the latest stats just yet. This causes the test to look at the same
stats before and after wait_for_clean.

Fixes: https://tracker.ceph.com/issues/43807 (2)
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-03-23 15:37:12 +00:00
Sage Weil
24acf825d2 cephadm: default to v15 tag for octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 10:34:16 -05:00
Casey Bodley
37c3406eb8 doc: update octopus release notes for rgw
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 984f3ff7e0)
2020-03-23 10:00:31 -05:00
Sage Weil
9daa451795 Merge PR #34028 into master
* refs/pull/34028/head:
	doc: update octopus release notes for rgw

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2020-03-23 09:59:21 -05:00
Mykola Golub
99287a1e55 pybind/rbd: ensure image is open before permitting operations
Fixes: https://tracker.ceph.com/issues/44610
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-03-23 14:28:30 +00:00
Sebastian Wagner
c840dd2204 mgr/cephadm: Add example to run when debugging ssh failures
```
$ ceph orch host add foobar
Error ENOENT: Failed to connect to foobar (foobar).  Check that the host is reachable and accepts connections using the cephadm SSH key
you may want to run:
> ssh -F =(ceph cephadm get-ssh-config) -i =(ceph config-key get mgr/cephadm/ssh_identity_key) rook@foobar
$  ssh -F =(ceph cephadm get-ssh-config) -i =(ceph config-key get mgr/cephadm/ssh_identity_key) rook@foobar
ssh: Could not resolve hostname foobar: Temporary failure in name resolution
```

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-23 14:48:29 +01:00
Sage Weil
de20c7bc61 Merge PR #34105 into master
* refs/pull/34105/head:
	Merge PR #34042 into octopus
	Merge PR #33959 into octopus
	Merge PR #34067 into octopus
	mgr/DaemonServer: add explicit check that acting matches for merge
	Merge pull request #34040 from dillaman/wip-44396-partial-fix
	Merge PR #34098 into octopus
	mgr/rook: list rgw services
	mgr/rook: tolerate timestamps that are None
	mgr/orch: add 'subcluster' property to RGWSpec
	mgr/rook: do not create radosgw pools
	mgr/rook: refactor apply/add for rgw
	Merge PR #34082 into octopus
	Merge PR #34068 into octopus
	cephadm: relabel /etc/ganesha mount
	Merge PR #34046 into octopus
	Merge PR #34092 into octopus
	Merge pull request #33719 from ukernel/wip-44416
	rbd-mirror: leader watcher should not cancel get locker if locker is invalid
	rbd-mirror: snapshot sync request needs to check for interruption
	librbd: request exclusive lock when moving to trash
	rbd-mirror: basic integration with sync throttling
	rbd-mirror: don't prematurely finish snapshot replay loop
	rbd-mirror: pass InstanceWatcher to snapshot Replayer
	doc/releases/octopus.rst: add note about ec recovery below min_size
	mgr/cephadm: configure rgw_frontends for rgw service
	cephadm: switch grafana image to the ceph repo
	Merge PR #34034 into octopus
	qa/suites/rados/cephadm/upgrade: update starting version
	Merge PR #33540 into octopus
	Merge PR #34023 into octopus
	Merge PR #34044 into octopus
	Merge PR #34030 into octopus
	doc/orchestrator: update rgw creation
	mgr/cephadm: clean up client.crash.* container_image settings after upgrade
	cephadm: make add-repo --release and --version independent
	cephadm: env over last used
	mgr/orch: accept port and ssl flags to 'apply rgw'
	mgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'
	cephadm: fall back to default for infer_image
	cephadm: remove outdated check
	cephadm: consolidate default image logic
	remove ceph_test_rados_watch_notify
	python-common/ceph/deployment/service_spec: add ssl to RGWSpec
	cephadm: only infer image for shell, run, inspect-image, pull, ceph-volume
	mgr/test_orchestrator: fix service filtering when using dummy data
	mgr/dashboard: fix adding/removing host errors
	mgr/rook: fix 'orch ps' for osds
	qa: fix all the fsx.sh-invoking yaml files to install dependencies
	mds: pass proper MutationImpl::LockOp to Locker::wrlock_start()

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-23 08:24:06 -05:00
Sage Weil
8d0e6f99f3 doc/releases/octopus: final notes
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 08:20:57 -05:00
Sage Weil
cf73c06184 doc/cephadm: notes on status/stability
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-23 07:55:16 -05:00
Lenz Grimmer
4a4b737cbe
Merge pull request #33741 from ricardoasmarques/iscsi-password-msg
mgr/dashboard: Improve iSCSI CHAP message

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-23 13:47:41 +01:00
Lenz Grimmer
b819847556
Merge pull request #34063 from s0nea/wip-dashboard-crush-rule-suite
mgr/dashboard: add crush rule test suite

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-23 13:11:50 +01:00
Lenz Grimmer
e45d96d23e
Merge pull request #34113 from s0nea/wip-dashboard-orch-docu-link
mgr/dashboard: correct Orchestrator documentation link

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-23 13:07:17 +01:00
Tatjana Dehler
6e91edb287 mgr/dashboard: correct Orchestrator documentation link
Fixes: https://tracker.ceph.com/issues/44708
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-03-23 11:45:53 +01:00
Kefu Chai
5132d9851d
Merge pull request #34104 from tchaikov/crimson-admin-close
crimson/admin: do not reset connected_sock before closing

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-03-23 17:10:40 +08:00
Kefu Chai
5305cfbc43
Merge pull request #33909 from cyx1231st/wip-seastar-msgr-fix-reset
crimson: misc fixes for writes to multiple-osd cluster

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-23 17:05:57 +08:00
Yingxin Cheng
d78cbb3ebd crimson/net: add critical info logs to track and debug racing
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-03-23 13:00:23 +08:00
Yingxin Cheng
e202069f09 crimson/net: fix incorrect SocketConnection::print()
The informaction about SocketConnection::side and
SocketConnection::ephemeral_port are not up-to-date in the log, because
they are not moved with Socket during connection replacement. They are
actually socket-level information.

Also take the chance to reorder Socket members.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-03-23 13:00:23 +08:00
Yingxin Cheng
373e16499e crimson/osd: make send_heartbeat() atomic
The item in Heartbeat:peers could be removed/re-added during the
asynchronous operation.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-03-23 13:00:15 +08:00
Kefu Chai
d6ead8b9ad
Merge pull request #32171 from rosinL/wip-ec-isla-aarch64
erasure-code: enable isa-l EC for aarch64 platform

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-23 12:46:39 +08:00
Jacek Suchenia
ad4d790a35 mgr: ceph_pg_* metrics contains last value instead of sum all of them
During evaluation of pool stats metrics contains last reported value instead of sum

Fixes: https://tracker.ceph.com/issues/44590
Signed-off-by: Jacek Suchenia <jacek.suchenia@gmail.com>
2020-03-23 11:02:47 +08:00