Commit Graph

100344 Commits

Author SHA1 Message Date
Xiao Guodong
1959fee90a cephfs: avoid map been inserted by mistake
if map client_caps has not key client, client_caps[client] will insert key client with null value into the map.

Fixes: https://tracker.ceph.com/issues/40939
Signed-off-by: XiaoGuoDong2019 <xiaogd@inspur.com>
2019-07-26 10:27:54 +08:00
Mark Nelson
f7376c0754
Merge pull request #28597 from markhpc/wip-bs-ind-cache
os/bluestore: Refactor Bluestore Caches
2019-07-25 20:48:19 -05:00
Yan, Zheng
6e9e3757be mds: execute PurgeQueue on_error handler in finisher
Fix: https://tracker.ceph.com/issues/40695
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-07-26 09:36:53 +08:00
Sage Weil
9ecfc55ead Merge PR #28847 into master
* refs/pull/28847/head:
	doc/mgr/telemetry: update
	mgr/telemetry: move contact info to an 'ident' channel
	mgr/telemetry: accept channel list to 'telemetry show'
	mgr/telemetry: always generate new report for 'telemetry show'
	mgr/telemetry: add 'device' channel and call out to devicehealth module
	mgr/telemetry: add telemetry channel 'device'
	mgr/telemetry: add separate channels

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-25 20:15:17 -05:00
Sage Weil
34c741efbf Merge PR #29130 into master
* refs/pull/29130/head:
	os/bluestore: Reduce unnecessary wakeups.
	os/bluestore: Reduce unnecessary wakeups.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-25 20:14:59 -05:00
Sage Weil
d87d271d41 Merge PR #29221 into master
* refs/pull/29221/head:
	mon/OSDMonitor: do not clobber pending xinfo during boot
	osd/OSDMap: add is_dead() helper
	mon/OSDMonitor: 'osd down ... --definitely-dead'
	osd: send MOSDMarkMeDead when we are marked down
	mon/OSDMonitor: implement MOSDMarkMeDead handling
	mon/OSDMonitor: set dead_epoch for immediate failure (ECONNREFUSED)
	osd/OSDMap: add dead_epoch to xinfo

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-25 20:14:46 -05:00
Sage Weil
b41dea60a3 Merge PR #29323 into master
* refs/pull/29323/head:
	rocksdb: enable rocksdb_rmrange=true by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-25 20:14:01 -05:00
Patrick Donnelly
67f81c7214
Merge PR #29300 into master
* refs/pull/29300/head:
	doc: fix youtube channel url
	doc: fix urls in posix.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:19:24 -07:00
Patrick Donnelly
09b905a450
Merge PR #28874 into master
* refs/pull/28874/head:
	ceph-mds: dump all info of ceph_file_layout, InodeStoreBase, frag_info_t, inode_t

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:13:57 -07:00
Patrick Donnelly
2adf929f80
Merge PR #29103 into master
* refs/pull/29103/head:
	mgr/volumes: add `ceph fs subvolumegroup getpath` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:12:31 -07:00
Patrick Donnelly
aba6e6d76e
Merge PR #29166 into master
* refs/pull/29166/head:
	mds: Reorganize class members in Capability header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:10:51 -07:00
Patrick Donnelly
7d32369cab
Merge PR #29149 into master
* refs/pull/29149/head:
	cephfs-shell: Fix flake8 E302 blank line error
	cephfs-shell: Fix flake8 indentation error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:07:48 -07:00
Patrick Donnelly
fe1abce20b
Merge PR #28860 into master
* refs/pull/28860/head:
	mds: Move scalar type initializations of CDir data members to its header
	mds: Reorganize class members in CDir header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:05:19 -07:00
Patrick Donnelly
19c724c1d6
qa: wait for MDS to come back after removing it
Fixes: http://tracker.ceph.com/issues/40967
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 14:42:34 -07:00
Sage Weil
7f89617b64 mon/OSDMonitor: do not clobber pending xinfo during boot
If we have a pending xinfo change and also process a boot message, we
should not throw out the pending xinfo change.

This triggers when you mark an osd down and it sends both a MOSDMarkMeDead
and a new MOSDBoot message in quick succession: the first message sets
dead_epoch but the boot message processing clobbers it.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Sage Weil
b75e17159b osd/OSDMap: add is_dead() helper
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Sage Weil
095ddc3ede mon/OSDMonitor: 'osd down ... --definitely-dead'
Like 'osd down', but we also set dead_epoch.  Should only be used if we
know the process/host is already completely dead and unresponsive.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Jason Dillaman
ea0a9adc88
Merge pull request #29036 from mikechristie/rbd-nbd-add-nl-resize
rbd-nbd: add nl resize

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-25 16:06:47 -04:00
Patrick Donnelly
2d47f3ebf8
Merge PR #28955 into master
* refs/pull/28955/head:
	doc: Update mount CephFS index

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 11:01:27 -07:00
Sage Weil
3968d564c5 Merge PR #29111 into master
* refs/pull/29111/head:
	qa/mgr/progress: Update the test suite for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-25 12:44:24 -05:00
Sage Weil
091ef61ff8 osd: send MOSDMarkMeDead when we are marked down
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 12:24:25 -05:00
Sage Weil
82bd0ba939 mon/OSDMonitor: implement MOSDMarkMeDead handling
Allow updates to the dead_epoch in osd_xinfo, so that the OSD can inform
us that they know they are down (as of a particular epoch).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 12:24:25 -05:00
Sage Weil
e82bd5136a mgr/telemetry: obscure entity_name with a salt
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 12:20:52 -05:00
Jason Dillaman
9bdc376c55 pybind/mgr: handle duplicate rbd task commands
The 'ceph' CLI will duplicate commands within teuthology to test
the MONs idempotency. This shouldn't be required for the MGR module,
but we can keep a fixed set of completed tests to handle this
possible command replay.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 12:58:55 -04:00
Tiago Melo
fa58414d96 script/ceph-backport.sh: Allow to set component label
ceph-backport.sh will now read the 'component' from a environment variable.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-07-25 16:33:53 +00:00
Varsha Rao
4c0b2ac887 mds: Move inline functions with loops or switch statements to CInode.cc
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-25 12:08:22 -04:00
Varsha Rao
2ef2bf6e82 mds: Reorganize class members in CInode header
Fixes: https://tracker.ceph.com/issues/40787
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-25 12:07:49 -04:00
Sage Weil
9fd65934de doc/mgr/telemetry: update
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 10:47:07 -05:00
Sage Weil
35c273c9c3 mgr/telemetry: move contact info to an 'ident' channel
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 10:46:55 -05:00
Sage Weil
07cc88431a rocksdb: enable rocksdb_rmrange=true by default
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 10:10:02 -05:00
Kefu Chai
b3abfe4812
Merge pull request #29117 from tchaikov/wip-mgr-set_health_checks-unicode
mgr: check for unicode passed to "set_health_checks()"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-25 23:03:00 +08:00
Sage Weil
ed1f8b98d3 Merge PR #29320 into master
* refs/pull/29320/head:
	os/bluestore: remove unused arg to _get_deferred_op()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-25 09:52:33 -05:00
Yuri Weinstein
633a3fa8ae
Merge pull request #29282 from yuriw/wip-yuriw-upgrade-rwg-splits-master
qa/tests: added rgw into upgrade sequence to improve coverage - splits
2019-07-25 07:16:24 -07:00
Sage Weil
58d02762ad os/bluestore: remove unused arg to _get_deferred_op()
Fixes: http://tracker.ceph.com/issues/40918
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 09:13:25 -05:00
Jason Dillaman
63a8f6c2c3 qa: test case for new rbd background tasks
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:37 -04:00
Jason Dillaman
e87aff5a90 pybind/mgr: rbd tasks now provide a dict to the progress events
This dict will include an origin key fixed to 'rbd_support' as well
as pool and image references.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:37 -04:00
Jason Dillaman
b99ae27d49 pybind/mgr: mark progress events as failed if an error occurs
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:37 -04:00
Jason Dillaman
d78ddaabdf pybind/mgr: support marking progress events as failed
The failed events can also include a failure message to indicate
the reason for the failure.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:37 -04:00
Jason Dillaman
b7a826df9f pybind/mgr: new 'rbd task' background task management
Fixes: http://tracker.ceph.com/issues/40621
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:37 -04:00
Jason Dillaman
2e85381665 pybind/rbd: new OperationCanceled exception
This allows the error to be directly caught instead of attempting
to parse the OSError.errno

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:58:36 -04:00
Ricardo Dias
f57cdf46ef
monmaptool: added --addv option to usage description
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-25 13:48:16 +01:00
Jason Dillaman
6dc8249c7b pybind/rbd: flatten, remove, trash_remove, migration progress callback
This callback can be used to track progress and also to attempt to cancel
the operation while it's in-progress by returning a negative error code
from the callback.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-25 08:25:03 -04:00
Rafael Quintero
30def4146e mgr/dashboard: Write E2E test to verify that Configuration has editing functionality
Fixes: https://tracker.ceph.com/issues/40803

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-07-25 07:25:32 -04:00
Tim Serong
1af7c08a96 mgr/deepsea: return ganesha and iscsi endpoint URLs
This updates describe_service() to include nfs and iscsi services
(deepsea internally refers to these as "ganesha" and "igw" roles).
Additionally, if deepsea sets any of container_id, service, version,
rados_config_location, service_url, status or status_desc, these will
come through now too.

This relies on https://github.com/SUSE/DeepSea/pull/1606 for the new
functionality, but if run against an older version of deepsea, it will
continue to operate as it did before, it just won't include
rados_config_location or service_url data.

I've also updated the caching in describe_service() so that if the
cache needs filling, it just requests all services from DeepSea, caches
everything, then does filtering on the results.  Previously, if the
cache was empty and only one service type was requested, the cache
would then *only* include that service and no other items, so subsequent
requests for different service types would return nothing until the
cache expired.

Fixes: https://tracker.ceph.com/issues/39095
Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-25 20:32:50 +10:00
Tim Serong
d5e320ae54 mgr/orchestrator: add --refresh to ceph orchestrator service ls
`ceph orchestrator device ls` already supports --refresh to force
a reload, we should support this for `ceph orchestrator service ls`
as well.

Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-25 20:32:50 +10:00
Tim Serong
e2bebee712 mgr/orchestrator: allow listing iscsi services
Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-25 20:32:50 +10:00
alfonsomthd
55744ef51a mgr/dashboard: RGW bucket creation when no placement target received
Fixes: https://tracker.ceph.com/issues/40567
Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-07-25 11:42:57 +02:00
Xiao Guodong
648730c602 cephfs: fix a memory leak
use a smart pointer instead of using 'new' to resolve a memory leak .

Fixes: https://tracker.ceph.com/issues/40936
Signed-off-by: XiaoGuoDong2019 <xiaogd@inspur.com>
2019-07-25 17:41:02 +08:00
songweibin
0c706687e5 src/test: s/strcpy/strncpy
fix klocwork issues:
function 'strcpy' does not check buffer boundaries but outputs to buffer 'watcher.addr' of fixed size (256)

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-07-25 15:21:43 +08:00
alfonsomthd
6a9095f2c6 mgr/dashboard: run e2e tests against prod build (jenkins job)
Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-07-25 08:40:49 +02:00