Commit Graph

100205 Commits

Author SHA1 Message Date
Sage Weil
1f7d00f286 Merge PR #29239 into master
* refs/pull/29239/head:
	qa/tasks/ceph_manager.py: always use self.logger

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-27 08:00:16 -05:00
Sage Weil
3ca1699ca6 Merge PR #29305 into master
* refs/pull/29305/head:
	mgr: Reduce logging noise when handling commands

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:58 -05:00
Sage Weil
a939876754 Merge PR #29307 into master
* refs/pull/29307/head:
	monmaptool: added --addv option to usage description

Reviewed-by: João Eduardo Luís <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:45 -05:00
Sage Weil
c16284d6af Merge PR #29316 into master
* refs/pull/29316/head:
	common,tools: make sure the destination buffer can handle the size of the string
	src/tools: initialize variables before the goto statement
	src/mount: check before dereference buf
	src/crush: check before dereference out2
	src/test: s/strcpy/strncpy

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:30 -05:00
Sage Weil
e9cfa8f182 Merge PR #29358 into master
* refs/pull/29358/head:
	mgr/telemetry: salt osd ids too

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-27 07:59:17 -05:00
Mykola Golub
05b6923e48
Merge pull request #29054 from dillaman/wip-40621
mgr/rbd_support: support scheduling long-running background operations

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-27 09:32:35 +03:00
Kefu Chai
db20513eb6
Merge pull request #29361 from tchaikov/wip-qa-osd-pause
qa: fixes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-27 10:26:43 +08:00
Patrick Donnelly
14e7e518e0
Merge PR #28685 into master
* refs/pull/28685/head:
	client: more precise CEPH_CLIENT_CAPS_PENDING_CAPSNAP
	client: unify kicking cap flushes and kicking snapcap flushes
	client: define helper function that sends flushsnap message
	client: cleanup tracking of early kicked flushing caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:18:13 -07:00
Patrick Donnelly
02eace72e2
Merge PR #28793 into master
* refs/pull/28793/head:
	qa/cephfs: make run_shell() accept args as str too
	qa/vstart_runner.py: ignores when source and destination are same
	test_cephfs_shell: add a test for cd with arguments
	test_cephfs_shell: add a test for cd with no arguments
	test_cephfs_shell: group test methods
	test_cephfs_shell: add a new method to return script output
	test_cephfs_shell: allow running CephFS shell script
	cephfs-shell: cd with no args shouldn't print an error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:15:19 -07:00
Patrick Donnelly
088e00a6e9
Merge PR #29064 into master
* refs/pull/29064/head:
	mds: execute PurgeQueue on_error handler in finisher

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:13:59 -07:00
Patrick Donnelly
a68dd73a0e
Merge PR #29302 into master
* refs/pull/29302/head:
	cephfs: fix a memory leak

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:13:08 -07:00
Patrick Donnelly
511cf15c57
Merge PR #29066 into master
* refs/pull/29066/head:
	mds: Move inline functions with loops or switch statements to CInode.cc
	mds: Reorganize class members in CInode header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:12:19 -07:00
Patrick Donnelly
200e3fb5cc
Merge PR #29336 into master
* refs/pull/29336/head:
	qa: wait for MDS to come back after removing it

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-26 15:09:14 -07:00
Casey Bodley
6fb258c691
Merge pull request #29359 from jmunhoz/wip-msite-az-tests
rgw: az: add archive zone tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-26 15:29:55 -04:00
Kefu Chai
d6170e70b6 mgr/dashboard/qa: add more fields to report
to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-27 01:50:33 +08:00
Kefu Chai
0a8c11d172 qa/suites/rados/rest/mgr-restful: whitelist OSDMAP_FLAGS
`rest/test-restful.sh` calls `test_mgr_rest_api.py`, which in turn
calls

```
    ('patch',  '/config/osd', {'pause': True}),
```

and rest module translates it to `ceph osd set key=pause`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-27 01:29:05 +08:00
Javier M. Mellid
2e92b48a32 rgw: az: add archive zone tests
Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2019-07-26 17:53:20 +02:00
Sage Weil
107ab12f02 mgr/telemetry: salt osd ids too
Better to fully obfuscate here.

This has a nice side-effect of assigning entity names that are *globally*
unique across the full telemetry data set, since the salts are unique and
sha1 is (sufficiently) collision-free.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-26 10:17:22 -05:00
Sage Weil
a4e8eb922f Merge PR #29330 into master
* refs/pull/29330/head:
	mgr/telemetry: obscure entity_name with a salt

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-26 07:32:30 -05:00
Sebastian Wagner
ca830c95a6 mgr: Reduce logging noise when handling commands
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-26 14:06:35 +02:00
Ricardo Marques
db4e11b34f
Merge pull request #29237 from adk3798/usertest
mgr/dashboard: RGW user E2E Tests

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-07-26 12:53:04 +01:00
Ricardo Marques
02bc599f3f
Merge pull request #29192 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/lodash-4.17.13
build(deps): bump lodash from 4.17.11 to 4.17.13 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-26 12:41:33 +01:00
Jason Dillaman
7ccf0b3229 pybind/mgr: don't log exception when cannot find RBD task by id
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-26 07:01:59 -04:00
Ricardo Marques
1043154123
Merge pull request #29198 from rhcs-dashboard/e2e-ci
mgr/dashboard: run e2e tests against prod build (jenkins job)

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-26 11:22:00 +01:00
Ricardo Marques
0bcbcb9d01
Merge pull request #29280 from rhcs-dashboard/bucket-tests
mgr/dashboard: RGW bucket creation when no placement target received

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-07-26 10:39:14 +01:00
songweibin
5e8c412e63 common,tools: make sure the destination buffer can handle the size of the string
fix klocwork issues:
Width is not specified for 's' conversion specifier.
This can result in an overflow of the buffer
provided in argument 3 of a call to 'sscanf'

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-07-26 14:27:02 +08:00
songweibin
1428c6e447 src/tools: initialize variables before the goto statement
CID 172143 (#15 of 15): Branch past initialization (PW.BRANCH_PAST_INITIALIZATION)
1. branch_past_initialization:
2. name_at_decl_position: variable "oid" (declared at line 220)
3. name_at_decl_position: variable "exkeys" (declared at line 241)
4. name_at_decl_position: variable "exvals" (declared at line 242)
5. name_at_decl_position: variable "safe" (declared at line 278)

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-07-26 14:27:02 +08:00
songweibin
b737cc4248 src/mount: check before dereference buf
CID 180671 (#1 of 1): Dereference null return value (NULL_RETURNS)

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-07-26 14:27:02 +08:00
songweibin
e027012117 src/crush: check before dereference out2
CID 174874 (#2 of 2): Dereference after null check (FORWARD_NULL)
30. var_deref_op: Dereference null pointer out2.

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-07-26 14:27:02 +08:00
Kefu Chai
d5ed1eaa1b
Merge pull request #29264 from rjfd/wip-dashboard-fix-qa-rbd
mgr/dashboard: qa: fix RBD test when matching error strings

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-26 14:25:35 +08:00
Mark Nelson
f7376c0754
Merge pull request #28597 from markhpc/wip-bs-ind-cache
os/bluestore: Refactor Bluestore Caches
2019-07-25 20:48:19 -05:00
Yan, Zheng
6e9e3757be mds: execute PurgeQueue on_error handler in finisher
Fix: https://tracker.ceph.com/issues/40695
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-07-26 09:36:53 +08:00
Sage Weil
9ecfc55ead Merge PR #28847 into master
* refs/pull/28847/head:
	doc/mgr/telemetry: update
	mgr/telemetry: move contact info to an 'ident' channel
	mgr/telemetry: accept channel list to 'telemetry show'
	mgr/telemetry: always generate new report for 'telemetry show'
	mgr/telemetry: add 'device' channel and call out to devicehealth module
	mgr/telemetry: add telemetry channel 'device'
	mgr/telemetry: add separate channels

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-25 20:15:17 -05:00
Sage Weil
34c741efbf Merge PR #29130 into master
* refs/pull/29130/head:
	os/bluestore: Reduce unnecessary wakeups.
	os/bluestore: Reduce unnecessary wakeups.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-25 20:14:59 -05:00
Sage Weil
d87d271d41 Merge PR #29221 into master
* refs/pull/29221/head:
	mon/OSDMonitor: do not clobber pending xinfo during boot
	osd/OSDMap: add is_dead() helper
	mon/OSDMonitor: 'osd down ... --definitely-dead'
	osd: send MOSDMarkMeDead when we are marked down
	mon/OSDMonitor: implement MOSDMarkMeDead handling
	mon/OSDMonitor: set dead_epoch for immediate failure (ECONNREFUSED)
	osd/OSDMap: add dead_epoch to xinfo

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-25 20:14:46 -05:00
Sage Weil
b41dea60a3 Merge PR #29323 into master
* refs/pull/29323/head:
	rocksdb: enable rocksdb_rmrange=true by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-25 20:14:01 -05:00
Patrick Donnelly
67f81c7214
Merge PR #29300 into master
* refs/pull/29300/head:
	doc: fix youtube channel url
	doc: fix urls in posix.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:19:24 -07:00
Patrick Donnelly
09b905a450
Merge PR #28874 into master
* refs/pull/28874/head:
	ceph-mds: dump all info of ceph_file_layout, InodeStoreBase, frag_info_t, inode_t

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:13:57 -07:00
Patrick Donnelly
2adf929f80
Merge PR #29103 into master
* refs/pull/29103/head:
	mgr/volumes: add `ceph fs subvolumegroup getpath` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:12:31 -07:00
Patrick Donnelly
aba6e6d76e
Merge PR #29166 into master
* refs/pull/29166/head:
	mds: Reorganize class members in Capability header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:10:51 -07:00
Patrick Donnelly
7d32369cab
Merge PR #29149 into master
* refs/pull/29149/head:
	cephfs-shell: Fix flake8 E302 blank line error
	cephfs-shell: Fix flake8 indentation error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:07:48 -07:00
Patrick Donnelly
fe1abce20b
Merge PR #28860 into master
* refs/pull/28860/head:
	mds: Move scalar type initializations of CDir data members to its header
	mds: Reorganize class members in CDir header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:05:19 -07:00
Patrick Donnelly
19c724c1d6
qa: wait for MDS to come back after removing it
Fixes: http://tracker.ceph.com/issues/40967
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 14:42:34 -07:00
Sage Weil
7f89617b64 mon/OSDMonitor: do not clobber pending xinfo during boot
If we have a pending xinfo change and also process a boot message, we
should not throw out the pending xinfo change.

This triggers when you mark an osd down and it sends both a MOSDMarkMeDead
and a new MOSDBoot message in quick succession: the first message sets
dead_epoch but the boot message processing clobbers it.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Sage Weil
b75e17159b osd/OSDMap: add is_dead() helper
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Sage Weil
095ddc3ede mon/OSDMonitor: 'osd down ... --definitely-dead'
Like 'osd down', but we also set dead_epoch.  Should only be used if we
know the process/host is already completely dead and unresponsive.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 15:55:35 -05:00
Jason Dillaman
ea0a9adc88
Merge pull request #29036 from mikechristie/rbd-nbd-add-nl-resize
rbd-nbd: add nl resize

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-25 16:06:47 -04:00
Patrick Donnelly
2d47f3ebf8
Merge PR #28955 into master
* refs/pull/28955/head:
	doc: Update mount CephFS index

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 11:01:27 -07:00
Sage Weil
3968d564c5 Merge PR #29111 into master
* refs/pull/29111/head:
	qa/mgr/progress: Update the test suite for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-25 12:44:24 -05:00
Sage Weil
091ef61ff8 osd: send MOSDMarkMeDead when we are marked down
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 12:24:25 -05:00