Commit Graph

90685 Commits

Author SHA1 Message Date
Mykola Golub
925273d270
Merge pull request #24293 from dillaman/wip-36220
librbd: object copy state machine might dereference a deleted object

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-27 09:02:00 +03:00
Kefu Chai
fb1a75c6c1
Merge pull request #22659 from theanalyst/cmake-pybind-ssl
build: mgr: check for python's ssl version linkage

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-27 10:55:16 +08:00
Nathan Cutler
0e4c765a00
Merge pull request #24243 from smithfarm/wip-bci-rate-limit
tools: backport-create-issue: rate-limit to avoid seeming like a spammer

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-09-27 00:18:49 +02:00
Nathan Cutler
a38af571c2
Merge pull request #23131 from smithfarm/wip-15100
qa: add test that builds example librados programs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
2018-09-27 00:17:48 +02:00
Jason Dillaman
1a9c3be2ce librbd: object copy state machine might dereference a deleted object
Fixes: http://tracker.ceph.com/issues/36220
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-26 15:58:23 -04:00
Mykola Golub
78881934c0
Merge pull request #22043 from dillaman/wip-24139
rbd-mirror: bootstrap needs to handle local image id collision

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-26 22:49:02 +03:00
Mykola Golub
9ff70326da
Merge pull request #24253 from dillaman/wip-24516
librbd: potential object map race with copyup state machine

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-26 22:48:29 +03:00
Yuri Weinstein
3c89ae73c8
Merge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not
rgw: policy: fix NotAction, NotPricipal, NotResource does not take effect

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-09-26 09:02:36 -07:00
Yuri Weinstein
0fd7413b79
Merge pull request #24062 from nrdmn/fix-quota
rgw: fix max-size in radosgw-admin and REST Admin API

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-09-26 09:00:26 -07:00
Yuri Weinstein
a303596bb9
Merge pull request #24177 from cbodley/wip-24595
rgw: apply quota config to users created via external auth

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-09-26 08:59:51 -07:00
Kefu Chai
aa56412be5
Merge pull request #24199 from aclamk/fio-rados-manual
test/fio: Added tips for compilation of fio with 'rados' engine.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-09-26 21:57:18 +08:00
Lenz Grimmer
2be394ab6f
Merge pull request #24273 from tspmelo/wip-html-linter
mgr/dashboard: Add html-linter

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-26 15:45:52 +02:00
Casey Bodley
8ff2ecaa83
Merge pull request #23534 from cbodley/wip-26897
rgw multisite: enforce spawn_window for data full sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-26 09:28:30 -04:00
Jason Dillaman
1e874403bf librbd: keep IO blocked until after snapshot object map created
The IO was being unblocked before object map was created, allowing
a potential copyup request to fail to update a still-to-be-created
object map.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-26 08:34:33 -04:00
Jason Dillaman
5a1cb46987 librbd: do not invalidate object map if update races with copyup
The copyup state machine needs to iterate over all object maps to update
the existence for the object. If an snapshot is being removed concurrently,
it's possible to invalidate the object map for the image.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-26 08:34:32 -04:00
Tiago Melo
00ab84abaf mgr/dashboard: Update frontend linting scripts and documentation
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-26 12:15:43 +01:00
Tiago Melo
8256e82ece mgr/dashboard: Add html linter and fix lint errors
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-09-26 12:01:24 +01:00
Patrick Donnelly
9a01c3ae10
Merge PR #24203 into master
* refs/pull/24203/head:
	ceph-fuse: add to selinux profile

Reviewed-by: Boris Ranto <branto@redhat.com>
2018-09-25 16:01:36 -07:00
Yehuda Sadeh
84fa9d4ae0
Merge pull request #24221 from cbodley/wip-36034
rgw multisite: uses local DataChangesLog to track active buckets for trim

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 15:02:01 -07:00
Yehuda Sadeh
008316a127
Merge pull request #23988 from cbodley/wip-35851
rgw: dont access rgw_http_req_data::client of canceled request

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 13:43:17 -07:00
Casey Bodley
99279f7246
Merge pull request #23986 from cbodley/wip-35715
rgw: fix leak of curl handle on shutdown

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:40:52 -04:00
Casey Bodley
8622d8a241
Merge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup
qa/rgw: reduce number of multisite log shards

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:39:51 -04:00
Yehuda Sadeh
d32d0d7f45
Merge pull request #23987 from cbodley/wip-35812
rgw: RGWAsyncGetBucketInstanceInfo does not access coroutine memory

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 13:20:59 -07:00
Jason Dillaman
5c317aef31 qa/tasks/rbd_mirror_thrash: let daemon gracefully shut down if possible
Otherwise, try to capture a core dump to discover what was blocking the
shutdown process.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:59 -04:00
Jason Dillaman
dca9e3e252 qa/workunits/rbd: wait max 2 hrs for all stress images to sync
Sporadically the rbd-mirror fsx stress test would fail due to very
slow sync times due to overloaded clusters. Attempt to wait for all
images to be replicated before proceeding with the comparison.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:59 -04:00
Jason Dillaman
d04a7679c0 qa/workunits/rbd: exclude rbd-mirror sync-point snaps from comparison
This is a temporary workaround to tracker ticket issue #36185

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 16:08:25 -04:00
Alfredo Deza
3a000e4c2b
Merge pull request #24274 from ceph/wip-batch-report-fix
ceph-volume: fix journal and filestore data size in `lvm batch --report`
2018-09-25 15:26:04 -04:00
Andrew Schoen
0f60d00032
Merge pull request #24251 from alfredodeza/wip-rm27210
ceph-volume custom cluster names fail on filestore trigger

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-25 13:13:50 -05:00
Andrew Schoen
a81386123e ceph-volume: only run ceph-common once during tests
Using import_role we can have just one play and avoid rerunning
ceph-common over and over again in daemon specific plays.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-25 12:09:15 -05:00
Patrick Donnelly
5cdf9c3380
Merge PR #24020 into master
* refs/pull/24020/head:
	*: set missing CLOEXEC on opened fds
	msg: set O_NONBLOCK on file status flags

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-25 09:20:22 -07:00
Patrick Donnelly
2277c11711
Merge PR #24163 into master
* refs/pull/24163/head:
	mds/MDCache: fix mds internal op missing events time

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-25 07:47:04 -07:00
Patrick Donnelly
7bcab914bb
Merge PR #24252 into master
* refs/pull/24252/head:
	qa: cleanup workunit dir for each unit
	qa: use sudo to cleanup workspace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 07:36:16 -07:00
Patrick Donnelly
6e028f3322
Merge PR #24232 into master
* refs/pull/24232/head:
	githubmap: update contributors

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-25 07:16:20 -07:00
Jason Dillaman
27832e2781 qa/workunits/rbd: image compare should print byte offset of any deltas
This will assist in debugging any mirroring issues.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-25 08:45:08 -04:00
Jason Dillaman
4ebcbc769c
Merge pull request #24248 from dillaman/wip-rbd-iscsi-docs
doc: ceph-iscsi-api ports should not be public facing

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-09-25 08:36:31 -04:00
Nathan Cutler
c46c890d02 qa: add test that builds example librados programs
Fixes: http://tracker.ceph.com/issues/15100
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-09-25 13:18:04 +02:00
Sage Weil
a29103e894 Merge PR #24226 into master
* refs/pull/24226/head:
	osd/PG: fix not_ready_to_merge behavior for merge target

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-24 23:14:15 -05:00
Patrick Donnelly
08166e8d5a
Merge PR #24194 into master
* refs/pull/24194/head:
	mds: fix mds damaged due to unexpected journal length

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-09-24 15:01:52 -07:00
Patrick Donnelly
92f498fa28
Merge PR #24170 into master
* refs/pull/24170/head:
	libcephfs: expose CEPH_SETATTR_MTIME_NOW and CEPH_SETATTR_ATIME_NOW

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-09-24 14:50:04 -07:00
Patrick Donnelly
0dd623c8aa
Merge PR #23187 into master
* refs/pull/23187/head:
	test: make rank argument mandatory when running journal_tool
	cephfs-journal-tool: make "--rank" argument mandatory
	cephfs-journal-tool: pass local arg vector for Journal actions
	cephfs-journal-tool: dump to per rank output file wherever necessary

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 14:46:14 -07:00
Patrick Donnelly
51b27b7e3d
Merge PR #23530 into master
* refs/pull/23530/head:
	qa/vstart_runner: fix daemons list
	PendingReleaseNotes: note multifs support in libcephfs
	test/cephfs: add pybind test for mount_root
	pybind/cephfs: enable passing filesystem name to mount
	libcephfs: add ceph_select_filesystem
	common: add doc strings to client_mds_namespace
	client: allow passing fs name to mount()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Conflicts:
    PendingReleaseNotes
2018-09-24 14:42:13 -07:00
Andrew Schoen
eed244473d ceph-volume: fail fast during tests
This also rsyncs the ceph-volume code to the testing vms before
a ceph.conf is generated because ceph-volume is needed now for this
to figure out the number of osds when you're using 'lvm batch'.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-24 16:41:37 -05:00
Patrick Donnelly
b536ca8a52
Merge PR #24125 into master
* refs/pull/24125/head:
	mon: fix fs add_data_pool setting wrong pool metadata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 14:40:34 -07:00
Patrick Donnelly
c0ba741a6e
Merge PR #24158 into master
* refs/pull/24158/head:
	cephfs: remove vestiges of mds deactivate

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2018-09-24 14:39:45 -07:00
Andrew Schoen
a5e8bc97e7 ceph-volume: when using batch --report return journal/data size as ints
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-24 16:37:35 -05:00
Sage Weil
0ae5e9a480 Merge PR #24234 into master
* refs/pull/24234/head:
	qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml: skip parents test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:15:52 -05:00
Alfredo Deza
96e29adf72 ceph-volume tests/functional update dmcrypt test playbooks to use --cluster
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 15:21:09 -04:00
Jason Dillaman
3e8f16b484 qa/suites/rbd: increase librbd debug level for mirror-thrash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
157a03f8fd librbd: improve debug logging for create/clone state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
9edcd77a83 rbd-mirror: always send image RPC messages via cluster
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00