Commit Graph

100279 Commits

Author SHA1 Message Date
Marcus Watts
3ba7be8d1a rgw: making implicit_tenants backwards compatible.
In jewel, "rgw keystone implicit tenants" only applied to swift. As of
luminous), this option applies to s3 also.
Sites that used this feature with jewel now have outstanding data that
depends on the old behavior.

The fix here is to expand "rgw keystone implicit tenants" so that it
can be set to any of "none", "all", "s3" or "swift" (also 0=false=none,
1=true=all).  When set to "s3" or "swift", the actual id lookup
is also partitioned.

Formerly "rgw keystone implicit tenants" was a legacy opt.
This change converts it to the new style of option,
including support for dynamically changing it.

Fixes: http://tracker.ceph.com/issues/24348

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2019-07-30 13:49:20 +05:30
Sebastian Wagner
475159ec73
Merge pull request #28915 from sebastian-philipp/python-common-package-2
python-common:  Python common package

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-30 09:31:34 +02:00
Sebastian Wagner
3999238081
Merge pull request #27336 from SUSE/wip-orchestrator-deepsea-iscsi-ganesha
mgr/deepsea: return ganesha and iscsi endpoint URLs

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-30 09:13:25 +02:00
Jan Fajerski
60fe6eac74
Merge pull request #29387 from ceph/wip-ceph-volume-tests-no-dashboard
ceph-volume: when testing disable the dashboard
2019-07-30 08:23:59 +02:00
Kefu Chai
3169da7a1a
Merge pull request #29347 from smithfarm/wip-40974
rpm: improve ceph-mgr plugin package summaries

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-30 12:46:37 +08:00
Kefu Chai
bcd4ed6724
Merge pull request #29346 from smithfarm/wip-40973
rpm: fdupes in SUSE builds to conform with packaging guidelines

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-30 12:44:32 +08:00
Kefu Chai
227d1e9486
Merge pull request #29367 from tchaikov/wip-doc-crush-rule
doc/rados/operations: crush_rule is a name

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-07-30 09:28:08 +08:00
Kefu Chai
d59090afe0
Merge pull request #29368 from tchaikov/wip-40618
qa/tasks/mgr/test_progress.py: s/ev/new_event/

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-30 09:27:29 +08:00
Patrick Donnelly
3f3189b4d4
Merge PR #28804 into master
* refs/pull/28804/head:
	mds: delay exporting directory whose pin value exceeds max rank id

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-29 14:53:28 -07:00
Patrick Donnelly
ecf49c0820
Merge PR #29339 into master
* refs/pull/29339/head:
	client: don't report any vxattrs to listxattr

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
2019-07-29 14:49:29 -07:00
Patrick Donnelly
7cec28542e
Merge PR #29304 into master
* refs/pull/29304/head:
	cephfs: avoid map been inserted by mistake

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-29 14:47:03 -07:00
Patrick Donnelly
7b59c02c87
Merge PR #29321 into master
* refs/pull/29321/head:
	Client: unlink dentry for inode with llref=0

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-07-29 14:45:44 -07:00
Andrew Schoen
7b7ff0d530 ceph-volume: when testing disable the dashboard
ceph-ansible has started enabling the dashboard by
default as of https://github.com/ceph/ceph-ansible/pull/4268

Disabling the dashboard gets us around needing to run
the grafana_server role which is required for the dashboard
and not needed for ceph-volume functional tests.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2019-07-29 15:25:19 -05:00
Patrick Donnelly
618c3576c0
Merge PR #29338 into master
* refs/pull/29338/head:
	qa: ignore expected MDS_CLIENT_LATE_RELEASE warning

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-07-29 13:10:02 -07:00
Patrick Donnelly
2a82081f77
Merge PR #28825 into master
* refs/pull/28825/head:
	qa: wait for kernel client death
	qa: use hard_reset to reboot kclient

Reviewed-by: David Galloway <dgallowa@redhat.com>
2019-07-29 13:08:29 -07:00
Patrick Donnelly
65ee02da75
Merge PR #29374 into master
* refs/pull/29374/head:
	cephfs-shell: Fix flake8 line too long error
	cephfs-shell: Fix flake8 line break after binary operator error
	cephfs-shell: Fix flake8 continuation line over-indented for hanging indent error
	cephfs-shell: Fix flake8 missing whitespace around arithmetic operator error
	cephfs-shell: Fix multiple spaces after ':' flake8 error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-29 10:37:15 -07:00
Casey Bodley
2c242ed58f
Merge pull request #27780 from theanalyst/cls-timeindex-denc
cls: add timeindex types to ceph-dencoder

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-29 11:37:15 -04:00
Ricardo Dias
fa2508e215
Merge pull request #29182 from dcasier/mgr-dashboard-ganesha-fix-cephfs-name
mgr/dashboard: ganesha: Specify the name of the filesystem (create_path)

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-07-29 16:03:06 +01:00
Ricardo Marques
9479700df5
Merge pull request #29138 from Reperator/dashboard-pw-hash
mgr/dashboard: support setting password hashes

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-29 15:29:41 +01:00
Varsha Rao
98f369150c cephfs-shell: Fix flake8 line too long error
https://tracker.ceph.com/issues/40992
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-29 17:15:35 +05:30
Varsha Rao
e8367831c0 cephfs-shell: Fix flake8 line break after binary operator error
Fixes: https://tracker.ceph.com/issues/40992
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-29 17:15:35 +05:30
Varsha Rao
1e22b1e8d0 cephfs-shell: Fix flake8 continuation line over-indented for hanging indent error
Fixes: https://tracker.ceph.com/issues/40992
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-29 17:15:35 +05:30
Varsha Rao
d036bb6030 cephfs-shell: Fix flake8 missing whitespace around arithmetic operator error
Fixes: https://tracker.ceph.com/issues/40992
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-29 17:15:35 +05:30
Varsha Rao
49e6a1e394 cephfs-shell: Fix multiple spaces after ':' flake8 error
Fixes: https://tracker.ceph.com/issues/40992
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-29 17:15:35 +05:30
Ricardo Marques
28a1e3cf79
Merge pull request #29272 from votdev/issue_40925
mgr/dashboard: Various UI issues related to CephFS

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-29 11:24:11 +01:00
Ricardo Marques
572d29c69e
Merge pull request #29216 from rafaelquint/configtest
mgr/dashboard: E2E test to verify Configuration editing functionality

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-29 11:09:04 +01:00
Ricardo Marques
29ceac2a8d
Merge pull request #29324 from adk3798/typepages
mgr/dashboard: Explicitly type page variables

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-29 11:01:16 +01:00
Ricardo Dias
a48f72032e
Merge pull request #29371 from bk201/wip-40971
mgr/dashboard: fix MDS counter chart is not displayed

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-07-29 10:52:56 +01:00
Kefu Chai
9c9576cefd
Merge pull request #29341 from zhangbingyi1/master
test/librados: avoid residual crush rule after test case execution

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-29 11:54:39 +08:00
Kiefer Chang
8fef417d33
mgr/dashboard: fix MDS counter chart is not displayed
Unit of timetamp for performance counters is changed to nanoseconds [1].
Adapt this for CephFS MDS performance counters in backend.

[1]: https://github.com/ceph/ceph/pull/28882

Fixes: https://tracker.ceph.com/issues/40971

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-07-29 11:30:50 +08:00
root
5567214094 test/librados: avoid residual crush rule after test case execution
Fixes: http://tracker.ceph.com/issues/40970
Signed-off-by: Bingyi Zhang <zhangbingyi@umcloud.com>
2019-07-29 11:10:25 +08:00
Kefu Chai
8304966778
Merge pull request #29348 from myoungwon/fix-wrong-class
osd: fix wrong arguments when dropping refcount

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-28 22:52:40 +08:00
Kefu Chai
d02a7c4039
Merge pull request #29345 from majianpeng/bluestore-flush-waiter
os/bluestore: avoid unnecessary notify.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-28 22:51:00 +08:00
Kefu Chai
c4d88bad79
Merge pull request #29126 from xiexingguo/wip-clamp-ratio-to-0
mgr/progress: clamp pg recovery ratio to 0

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-28 22:49:54 +08:00
Kefu Chai
b871d9118e
Merge pull request #28012 from rouming/bootstrap-after-setuid
global/global_init: do first transport connection after setuid()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-28 22:36:45 +08:00
Kefu Chai
07d9b3d11a
Merge pull request #27985 from ifed01/wip-ifed-slow-omaps
tools/ceph-objectstore-tool: introduce list-slow-omap command.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-28 22:35:56 +08:00
Kefu Chai
9b4dbf0749 qa/tasks/mgr/test_progress.py: s/ev/new_event/
as a follow-up fix for 5604ba4e

Fixes: http://tracker.ceph.com/issues/40618
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-28 19:32:24 +08:00
Kefu Chai
3ed3de6c96 doc/rados/operations: crush_rule is a name
like
```
ceph osd pool set <pool-name> crush_rule <rule-name>
```
where `<rule-name>` is a string instead of a number.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-27 21:35:39 +08:00
Sage Weil
0b3f6a1710 Merge PR #29238 into master
* refs/pull/29238/head:
	os/bluestore: it's better to erase spanning blob only once

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-27 08:00:38 -05:00
Sage Weil
1f7d00f286 Merge PR #29239 into master
* refs/pull/29239/head:
	qa/tasks/ceph_manager.py: always use self.logger

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-27 08:00:16 -05:00
Sage Weil
3ca1699ca6 Merge PR #29305 into master
* refs/pull/29305/head:
	mgr: Reduce logging noise when handling commands

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:58 -05:00
Sage Weil
a939876754 Merge PR #29307 into master
* refs/pull/29307/head:
	monmaptool: added --addv option to usage description

Reviewed-by: João Eduardo Luís <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:45 -05:00
Sage Weil
c16284d6af Merge PR #29316 into master
* refs/pull/29316/head:
	common,tools: make sure the destination buffer can handle the size of the string
	src/tools: initialize variables before the goto statement
	src/mount: check before dereference buf
	src/crush: check before dereference out2
	src/test: s/strcpy/strncpy

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-27 07:59:30 -05:00
Sage Weil
e9cfa8f182 Merge PR #29358 into master
* refs/pull/29358/head:
	mgr/telemetry: salt osd ids too

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-27 07:59:17 -05:00
Mykola Golub
05b6923e48
Merge pull request #29054 from dillaman/wip-40621
mgr/rbd_support: support scheduling long-running background operations

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-27 09:32:35 +03:00
Kefu Chai
db20513eb6
Merge pull request #29361 from tchaikov/wip-qa-osd-pause
qa: fixes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-27 10:26:43 +08:00
Patrick Donnelly
6b83f43ba0
qa: wait for kernel client death
After sending the reboot command, we need to wait briefly for it to be
rebooted so that the kernel client doesn't voluntarily give up its Fb
cap.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:34:17 -07:00
Patrick Donnelly
b75544be86
qa: use hard_reset to reboot kclient
power_off may allow the mounts to gracefully unmount. We don't want this if the
kclient is stuck or we desire the client to "disappear" and come back.

Fixes: http://tracker.ceph.com/issues/37681
Depends-on: https://github.com/ceph/teuthology/pull/1296
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:34:00 -07:00
Patrick Donnelly
14e7e518e0
Merge PR #28685 into master
* refs/pull/28685/head:
	client: more precise CEPH_CLIENT_CAPS_PENDING_CAPSNAP
	client: unify kicking cap flushes and kicking snapcap flushes
	client: define helper function that sends flushsnap message
	client: cleanup tracking of early kicked flushing caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:18:13 -07:00
Patrick Donnelly
02eace72e2
Merge PR #28793 into master
* refs/pull/28793/head:
	qa/cephfs: make run_shell() accept args as str too
	qa/vstart_runner.py: ignores when source and destination are same
	test_cephfs_shell: add a test for cd with arguments
	test_cephfs_shell: add a test for cd with no arguments
	test_cephfs_shell: group test methods
	test_cephfs_shell: add a new method to return script output
	test_cephfs_shell: allow running CephFS shell script
	cephfs-shell: cd with no args shouldn't print an error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:15:19 -07:00