Commit Graph

90734 Commits

Author SHA1 Message Date
Tiago Melo
8256e82ece mgr/dashboard: Add html linter and fix lint errors
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-26 12:01:24 +01:00
Yan, Zheng
f39e9aa573 msg: clear message middle when clearing encoded message buffer
Otherwise it may trigger ceph_assert(middle.length() == 0) in
Message::encode()

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-09-26 18:58:16 +08:00
Willem Jan Withagen
0654099d4b common: fix missing include boost/noncopyable.hpp
Clang complains:
```
In file included from /home/jenkins/workspace/ceph-master/src/osd/ReplicatedBackend.cc:15:
In file included from /home/jenkins/workspace/ceph-master/src/osd/ReplicatedBackend.h:18:
In file included from /home/jenkins/workspace/ceph-master/src/osd/PGBackend.h:27:
In file included from /home/jenkins/workspace/ceph-master/src/osd/PGTransaction.h:25:
/home/jenkins/workspace/ceph-master/src/common/inline_variant.h:88:64: error: expected class name
struct generic_visitor : boost::static_visitor<Result>, boost::noncopyable
                                                               ^
1 error generated.
gmake[2]: *** [src/osd/CMakeFiles/osd.dir/build.make:141: src/osd/CMakeFiles/osd.dir/ReplicatedBackend.cc.o] Error 1
gmake[2]: *** Waiting for unfinished jobs....
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-09-26 10:30:57 +02:00
Patrick Donnelly
9a01c3ae10
Merge PR #24203 into master
* refs/pull/24203/head:
	ceph-fuse: add to selinux profile

Reviewed-by: Boris Ranto <branto@redhat.com>
2018-09-25 16:01:36 -07:00
Yehuda Sadeh
84fa9d4ae0
Merge pull request #24221 from cbodley/wip-36034
rgw multisite: uses local DataChangesLog to track active buckets for trim

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 15:02:01 -07:00
Yehuda Sadeh
008316a127
Merge pull request #23988 from cbodley/wip-35851
rgw: dont access rgw_http_req_data::client of canceled request

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 13:43:17 -07:00
Casey Bodley
99279f7246
Merge pull request #23986 from cbodley/wip-35715
rgw: fix leak of curl handle on shutdown

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:40:52 -04:00
Casey Bodley
8622d8a241
Merge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup
qa/rgw: reduce number of multisite log shards

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:39:51 -04:00
Yehuda Sadeh
d32d0d7f45
Merge pull request #23987 from cbodley/wip-35812
rgw: RGWAsyncGetBucketInstanceInfo does not access coroutine memory

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 13:20:59 -07:00
Jason Dillaman
5c317aef31 qa/tasks/rbd_mirror_thrash: let daemon gracefully shut down if possible
Otherwise, try to capture a core dump to discover what was blocking the
shutdown process.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:59 -04:00
Jason Dillaman
dca9e3e252 qa/workunits/rbd: wait max 2 hrs for all stress images to sync
Sporadically the rbd-mirror fsx stress test would fail due to very
slow sync times due to overloaded clusters. Attempt to wait for all
images to be replicated before proceeding with the comparison.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:59 -04:00
Jason Dillaman
d04a7679c0 qa/workunits/rbd: exclude rbd-mirror sync-point snaps from comparison
This is a temporary workaround to tracker ticket issue #36185

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:25 -04:00
Alfredo Deza
ead3c7e7d1 ceph-volume tests.util verify new blkid API calls
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-25 15:27:47 -04:00
Alfredo Deza
3a000e4c2b
Merge pull request #24274 from ceph/wip-batch-report-fix
ceph-volume: fix journal and filestore data size in `lvm batch --report`
2018-09-25 15:26:04 -04:00
Alfredo Deza
dbde6a5b61 ceph-volume util.disk expand blkid's API calls
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-25 15:25:13 -04:00
Andrew Schoen
0f60d00032
Merge pull request #24251 from alfredodeza/wip-rm27210
ceph-volume custom cluster names fail on filestore trigger

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-25 13:13:50 -05:00
Andrew Schoen
a81386123e ceph-volume: only run ceph-common once during tests
Using import_role we can have just one play and avoid rerunning
ceph-common over and over again in daemon specific plays.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-25 12:09:15 -05:00
Patrick Donnelly
5cdf9c3380
Merge PR #24020 into master
* refs/pull/24020/head:
	*: set missing CLOEXEC on opened fds
	msg: set O_NONBLOCK on file status flags

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-25 09:20:22 -07:00
Patrick Donnelly
2277c11711
Merge PR #24163 into master
* refs/pull/24163/head:
	mds/MDCache: fix mds internal op missing events time

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-25 07:47:04 -07:00
Patrick Donnelly
7bcab914bb
Merge PR #24252 into master
* refs/pull/24252/head:
	qa: cleanup workunit dir for each unit
	qa: use sudo to cleanup workspace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 07:36:16 -07:00
Patrick Donnelly
6e028f3322
Merge PR #24232 into master
* refs/pull/24232/head:
	githubmap: update contributors

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-25 07:16:20 -07:00
Tiago Melo
1eeaa5016b mgr/dashboard: Add UI for RBD Trash Purge
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
11067e0686 mgr/dashboard: Add UI for RBD Trash Delete
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
1ae1aa249c mgr/dashboard: Add UI for RBD Trash Restore
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
d6eda3b71d mgr/dashboard: Add UI for RBD Trash List
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
31361a5e0d mgr/dashboard: Add UI for RBD Trash Move
Fixes: http://tracker.ceph.com/issues/24272

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
6bb951b1bf mgr/dashboard: Add RBD Trash endpoints
Fixes: http://tracker.ceph.com/issues/24272

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Tiago Melo
55a3902e6d mgr/dashboard: Replace current delete icons with "fa-times"
This will allow us to better differentiate a actual delete from a move to trash.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-25 14:02:58 +01:00
Jason Dillaman
27832e2781 qa/workunits/rbd: image compare should print byte offset of any deltas
This will assist in debugging any mirroring issues.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 08:45:08 -04:00
Jason Dillaman
4ebcbc769c
Merge pull request #24248 from dillaman/wip-rbd-iscsi-docs
doc: ceph-iscsi-api ports should not be public facing

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-09-25 08:36:31 -04:00
Kefu Chai
bb9158debb common/ceph_mutex: add dummy mutex for WITH_SEASTAR
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-25 20:09:04 +08:00
Joao Eduardo Luis
0dd8b8f81a mgr/dashboard: no side-effects on failed user creation
Read operations go first, operations with side-effects go last.
Otherwise, something like

1) create user A with non-existent role R1; fails due to R1 DNE
2) create user B with existent role R2; success

will result in both A and B being created; B will have a R2 assigned, A
will have no roles.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-09-25 12:31:03 +01:00
Nathan Cutler
c46c890d02 qa: add test that builds example librados programs
Fixes: http://tracker.ceph.com/issues/15100
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-09-25 13:18:04 +02:00
Sage Weil
a29103e894 Merge PR #24226 into master
* refs/pull/24226/head:
	osd/PG: fix not_ready_to_merge behavior for merge target

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-24 23:14:15 -05:00
Patrick Donnelly
08166e8d5a
Merge PR #24194 into master
* refs/pull/24194/head:
	mds: fix mds damaged due to unexpected journal length

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-09-24 15:01:52 -07:00
Patrick Donnelly
92f498fa28
Merge PR #24170 into master
* refs/pull/24170/head:
	libcephfs: expose CEPH_SETATTR_MTIME_NOW and CEPH_SETATTR_ATIME_NOW

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-09-24 14:50:04 -07:00
Patrick Donnelly
0dd623c8aa
Merge PR #23187 into master
* refs/pull/23187/head:
	test: make rank argument mandatory when running journal_tool
	cephfs-journal-tool: make "--rank" argument mandatory
	cephfs-journal-tool: pass local arg vector for Journal actions
	cephfs-journal-tool: dump to per rank output file wherever necessary

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 14:46:14 -07:00
Patrick Donnelly
51b27b7e3d
Merge PR #23530 into master
* refs/pull/23530/head:
	qa/vstart_runner: fix daemons list
	PendingReleaseNotes: note multifs support in libcephfs
	test/cephfs: add pybind test for mount_root
	pybind/cephfs: enable passing filesystem name to mount
	libcephfs: add ceph_select_filesystem
	common: add doc strings to client_mds_namespace
	client: allow passing fs name to mount()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Conflicts:
    PendingReleaseNotes
2018-09-24 14:42:13 -07:00
Andrew Schoen
eed244473d ceph-volume: fail fast during tests
This also rsyncs the ceph-volume code to the testing vms before
a ceph.conf is generated because ceph-volume is needed now for this
to figure out the number of osds when you're using 'lvm batch'.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-24 16:41:37 -05:00
Patrick Donnelly
b536ca8a52
Merge PR #24125 into master
* refs/pull/24125/head:
	mon: fix fs add_data_pool setting wrong pool metadata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 14:40:34 -07:00
Patrick Donnelly
c0ba741a6e
Merge PR #24158 into master
* refs/pull/24158/head:
	cephfs: remove vestiges of mds deactivate

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2018-09-24 14:39:45 -07:00
Andrew Schoen
a5e8bc97e7 ceph-volume: when using batch --report return journal/data size as ints
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-24 16:37:35 -05:00
Sage Weil
0ae5e9a480 Merge PR #24234 into master
* refs/pull/24234/head:
	qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml: skip parents test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:15:52 -05:00
Alfredo Deza
96e29adf72 ceph-volume tests/functional update dmcrypt test playbooks to use --cluster
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 15:21:09 -04:00
Jason Dillaman
3e8f16b484 qa/suites/rbd: increase librbd debug level for mirror-thrash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
157a03f8fd librbd: improve debug logging for create/clone state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
9edcd77a83 rbd-mirror: always send image RPC messages via cluster
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
4bafa00c98 rbd-mirror: permit better tracking between image replayer and bootstrap
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
f80ba2e6a4 rbd-mirror: re-generate new image id upon collision
Fixes: http://tracker.ceph.com/issues/24139
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
5148164af8 librbd: create image should return unique error code on id collision
The image id is composed of the librados global instance id and a random
number. For long-lived clients that create multiple images (basically
only rbd-mirror daemon), it's more likely to hit a collision.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00