Commit Graph

86798 Commits

Author SHA1 Message Date
Casey Bodley
7cb50b495b qa/rgw: disable testing on ec-cache pools
Fixes: http://tracker.ceph.com/issues/23965

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-21 13:29:01 -04:00
Sage Weil
c7ca50231a Merge PR #22064 into master
* refs/pull/22064/head:
	os/bluestore: fix signed/unsigned mismatch warning during building

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 11:31:54 -05:00
Sage Weil
9860f53416 Merge PR #22091 into master
* refs/pull/22091/head:
	crush: update choose_args on bucket removal
	crush: update choose_args on bucket removal, resize, or position mismatch
	crush: create weight-set on demand when doing a choose-args reweight
	test/cli/crushtool: use straw2 buckets for choose-args test
	crush: weight_set_size -> weight_set_positions

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-05-21 08:41:00 -05:00
Sage Weil
ea205e1cbb Merge PR #21540 into wip-sage-testing-20180521.120735
* refs/pull/21540/head:
	tests/crypto: print compile warning when NSS is unavailable.
	tests/crypto: add tests for the no-bl encrypt/decrypt, part 2.
	tests/crypto: add tests for the no-bl encrypt/decrypt.
	auth: use OpenSSL for CryptoAESKeyHandler's no-bl encrypt/decrypt.
	auth: extend CryptoKey with no-bl encrypt/decrypt.
	auth: CryptoAESKeyHandler switches from NSS to OpenSSL.
	auth: the outbuf of AES should be multiple of block size
	auth: cache the PK11Context for CryptoAESKeyHandler
2018-05-21 07:07:59 -05:00
Sage Weil
1d684921e4 Merge PR #21973 into wip-sage-testing-20180521.120735
* refs/pull/21973/head:
	pybind/ceph_argparse.py: show usage on fully matched cmd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 07:07:53 -05:00
Sage Weil
19226d7e18 Merge PR #21985 into wip-sage-testing-20180521.120735
* refs/pull/21985/head:
	common: partially revert 95fc248 to make get_process_name work

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 07:07:48 -05:00
Sage Weil
9ded63e418 Merge PR #21994 into wip-sage-testing-20180521.120735
* refs/pull/21994/head:
	os/bluefs/BlueFS: cleanup code.

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-05-21 07:07:44 -05:00
Kefu Chai
59f5349c43
Merge pull request #22103 from tchaikov/wip-qa-test_envlibrados_for_rocksdb
qa/workunits/rados/test_envlibrados_for_rocksdb: install g++ not g++-4.7

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 19:36:57 +08:00
Kefu Chai
28d4d640fc
Merge pull request #22084 from liewegas/wip-fix-fop
osd/PrimaryLogPG: fix try_flush_mark_clean write contention case

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 16:40:41 +08:00
Mykola Golub
ff20920675
Merge pull request #22072 from dillaman/wip-24165
librbd: prevent the use of internal feature bits from external users

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-05-21 10:00:15 +03:00
Kefu Chai
2b904ae202 buffer.h: avoid using c++14 features
so we dont't need to force librados client to move to C++14 or up.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-21 13:28:23 +08:00
Kefu Chai
f8d47223e2 qa/workunits/rados/test_envlibrados_for_rocksdb: use cmake not make
* so we just rely on a single build system instead of two of them, the
  other place we use cmake is cmake/modules/BuildRockDB.cmake.
* disable gflags when building rocksdb, it's optional and does not help
  in the sense of testing librados support.
* disable prompts when installing on debian, to silence warnings like:
  debconf: unable to initialize frontend: Dialog
* drop --force-yes option, as it is deprecated, and is replaced with
  --allow-downgrades, --allow-remove-essential,
  --allow-change-held-packages,  but none of them apply in our case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-21 13:28:23 +08:00
Sage Weil
7f04b17234
Merge pull request #21982 from tchaikov/mgr-brag
mgr/telemetry: Add Ceph Telemetry module to send reports back to project
2018-05-20 21:34:12 -05:00
Sage Weil
ec418e0910 Merge PR #21847 into wip-sage-testing-20180521.023125
* refs/pull/21847/head:
	log: disk write coalescing

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-20 21:31:34 -05:00
Sage Weil
47dffc53d6
Merge pull request #22063 from liewegas/wip-unit-spaces
include/types: space between number and units

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-20 21:26:03 -05:00
Sage Weil
c7ac6169ff
Merge pull request #22042 from liewegas/wip-rm-pool-race
ceph_test_rados_api_misc: remove obsolete LibRadosMiscPool.PoolCreationRace

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-05-20 21:24:37 -05:00
Sage Weil
a5d30ad2ab
Merge pull request #22106 from liewegas/wip-rados-distros
qa/suites/rados/thrash-old-clients: only centos and 16.04
2018-05-20 21:23:48 -05:00
Patrick Donnelly
af129d1419
Merge PR #21997 into master
* refs/pull/21997/head:
	mds: broadcast quota to relevant clients when quota is explicitly set

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-05-20 16:52:40 -07:00
Patrick Donnelly
ca40b1c49c
Merge PR #22001 into master
* refs/pull/22001/head:
	client: avoid freeing inode when it contains TX buffer heads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-20 16:52:35 -07:00
Patrick Donnelly
c58158421e
Merge PR #22023 into master
* refs/pull/22023/head:
	messages: print quota info in MClientQuota msg

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-20 16:52:30 -07:00
Patrick Donnelly
ad55214d3b
Merge PR #22045 into master
* refs/pull/22045/head:
	client: cleanup Cap init

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-20 16:52:25 -07:00
Patrick Donnelly
72db4a2b27
Merge PR #22080 into master
* refs/pull/22080/head:
	client: fix issue of revoking non-auth caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-20 16:52:20 -07:00
Sage Weil
a75ffcd17c crush: update choose_args on bucket removal
The specific bug I see is that a bucket no longer exists but its
choose_args still does.  However, I'm also taking the opportunity to
verify that the choose_args agrees with the bucket sizes and position
counts everywhere else, too.  Check for

- ids or weight_sets for buckets that don't exist or aren't straw2
- weight_set_positions that don't match the choose_args
  - don't fix this, just warn.  i'm not sure how it would happen.  :/
- weight_set sizes that don't match the bucket size

Fixes: http://tracker.ceph.com/issues/24167
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-20 10:20:28 -05:00
Sage Weil
dd46ae1006 qa/suites/rados/thrash-old-clients: only centos and 16.04
We don't have old client builds for the newer distros.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-20 09:38:02 -05:00
Kefu Chai
5ceee88989
Merge pull request #21961 from ceph/wip-cd-ovh-vol
qa/tests: fix volume size when running in ovh

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-20 18:35:35 +08:00
Kefu Chai
fd1ab7d4d0
Merge pull request #22098 from liewegas/wip-24180
mon/LogMonitor: call no_reply() on ignored log message

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-20 17:40:17 +08:00
Kefu Chai
63a35625a3 qa/workunits/rados/test_envlibrados_for_rocksdb: install g++ not g++-4.7
since fog now deploys ubuntu 18.04 where g++-4.7 is not available
anymore, so g++ is good enough.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-20 16:35:27 +08:00
Sage Weil
fbf0e10af0
Merge pull request #22092 from liewegas/wip-mimic-upgrades
qa/suites/upgrade/luminous-x: a few fixes
2018-05-19 12:34:52 -05:00
Yan, Zheng
0edab5fcc3
Merge pull request #21941 from ukernel/wip-24053
mds: reply session reject for open request from blacklisted client
2018-05-19 17:07:40 +08:00
Yan, Zheng
e7d0b41dea qa/tasks/cephfs: add timeout parameter to kclient umount_wait
Just make caller happy. there is no easy way to support timeout.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/24053
2018-05-19 17:06:19 +08:00
Yan, Zheng
b7c6cd8a54 mds: reply session reject for open request from blacklisted client
Kernel client and old version libcephfs do not check if themselves
are blacklisted. They can be stuck at opening session after getting
blacklisted. The session reject message can avoid this.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/24054
2018-05-19 17:05:49 +08:00
Yan, Zheng
341a9114e0 client: fix issue of revoking non-auth caps
when non-auth mds revokes caps, Fcb caps can still be issued by auth
auth mds. It's wrong to flush buffer or invalidate cache when non-auth
mds revokes other caps. This bug can cause client to not respond the
revoke.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/24172
2018-05-19 16:57:58 +08:00
Patrick Donnelly
eee7ed2688
Merge PR #22073 into master
* refs/pull/22073/head:
	client: delay dentry trimming until after cap traversal
	qa: test for trim_caps segfault for trimmed dentries

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-05-18 21:36:50 -07:00
Patrick Donnelly
9199179799
client: delay dentry trimming until after cap traversal
Fixes: http://tracker.ceph.com/issues/24137

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-18 21:36:02 -07:00
Patrick Donnelly
abb2fa4d5b
qa: test for trim_caps segfault for trimmed dentries
Test case by Yan Zheng [1].

[1] http://tracker.ceph.com/issues/24137#note-6

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-18 21:35:56 -07:00
Sage Weil
564ef28a40 crush: update choose_args on bucket removal, resize, or position mismatch
The specific bug I see is that a bucket no longer exists but its
choose_args still does.  However, I'm also taking the opportunity to
verify that the choose_args agrees with the bucket sizes and position
counts everywhere else, too.  Check for

- ids or weight_sets for buckets that don't exist or aren't straw2
- weight_set_positions that don't match the choose_args
- weight_set sizes that don't match the bucket size

Fixes: http://tracker.ceph.com/issues/24167
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 17:12:22 -05:00
Sage Weil
d8d08b8cbf crush: create weight-set on demand when doing a choose-args reweight
If we try to reweight an item in a choose-args set for a given item
but the bucket doesn't have a weight_set yet, create it on the fly, and
populate it with the canonical bucket weights.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 17:12:22 -05:00
Sage Weil
7bfebfacfa test/cli/crushtool: use straw2 buckets for choose-args test
Choose-args only works for straw2 so it is misleading to test using a
map with straw buckets.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 17:12:22 -05:00
Patrick Donnelly
4b52418ccb
Merge PR #21548 into master
* refs/pull/21548/head:
	osdc/Objecter: apply throttle on enumerate_objects.

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-05-18 14:31:18 -07:00
Patrick Donnelly
9039ab3bfa
Merge PR #21963 into master
* refs/pull/21963/head:
	mds: properly setup client_need_snapflush for snap inode
	Revert "mds: properly setup need_snapflush for snapped inode"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-18 14:31:11 -07:00
Patrick Donnelly
6a6add587b
Merge PR #21972 into master
* refs/pull/21972/head:
	client: increase verbosity level for log messages in helper methods

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-18 14:31:03 -07:00
Sage Weil
6c9d937828
Merge pull request #22066 from liewegas/wip-pgmap-digest-decode
mon/PGMap: fix PGMapDigest decode

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-18 15:53:20 -05:00
Sage Weil
9661fa08cc mon/LogMonitor: call no_reply() on ignored log message
If we're dropping it on the floor, we need to tell the mon that, so that
it can tell the forwarding mon to discard its state.

Fixes: https://tracker.ceph.com/issues/24180
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 15:44:09 -05:00
Sage Weil
459b33e146 qa/suites/thrashosds-health: whitelist REQUEST_SLOW
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 14:01:33 -05:00
Sage Weil
59fe5dc5ce qa/suites/upgrade/luminous-x: whitelist SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 14:01:19 -05:00
Sage Weil
5a5e74e89c qa/suites/upgrade/luminous-x: more cinder volumes
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 14:01:01 -05:00
Sage Weil
0b956ef37d qa/workunits/cephtool/test.sh: update unit formatting
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 13:53:04 -05:00
Alfredo Deza
aa158b68f0
Merge pull request #22040 from alfredodeza/wip-rm24147
common/options: add description of osd objectstore backends

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <cutler@suse.cz>
2018-05-18 13:36:07 -04:00
Sage Weil
c173a275df crush: weight_set_size -> weight_set_positions
This naming was confusing!  This is the number of positions we
have weight_sets for.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 12:30:21 -05:00
Igor Fedotov
2cdd7621b2 os/bluestore: fix signed/unsigned mismatch warning during building
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-05-18 19:13:59 +03:00