Commit Graph

86854 Commits

Author SHA1 Message Date
Jos Collin
08334cc2d5 doc: update toctree for add-remove-mds.rst
Fixes: http://tracker.ceph.com/issues/24093
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-01 18:49:58 +05:30
Jos Collin
bf34da0ee7 doc: create add/remove metadata server
A new doc is created based on https://github.com/ceph/ceph/pull/22035#pullrequestreview-121600153.

Fixes: http://tracker.ceph.com/issues/24093
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-01 18:49:46 +05:30
Sage Weil
a8508255f4
Merge pull request #22156 from rzarzynski/wip-bug-24037
common: OpTracker doesn't visit TrackedOp when nref == 0.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-22 20:21:33 -05:00
Radoslaw Zarzynski
574aeb8130 common: OpTracker doesn't visit TrackedOp when nref == 0.
The patch fixes a race condition that happens between
`unregister_inflight_op` and `visit_ops_in_flight` of
`OpTracker`. When a callable passed to the former one
turns the plain reference it gets into `TrackedOpRef`,
an almost-to-terminate `TrackedOp` (with `nref == 0`)
can be resurrected (`nref++`). This will be reflected
in extra call to `unregister_inflight_op` for same op
leading to e.g. use-after-free. For more details see:
https://tracker.ceph.com/issues/24037#note-5.

The fix deals with the problem by ensuring there will
be no call to the visitor for ops with zeroized `nref`.

Fixes: http://tracker.ceph.com/issues/24037
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-05-22 18:21:56 +02:00
Casey Bodley
b5797e3c21
Merge pull request #21700 from cbodley/wip-rgw-dpp
rgw: use DoutPrefixProvider to add more context to log output

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-05-22 11:21:30 -04:00
Casey Bodley
51b1542083
Merge pull request #21755 from linuxbox2/wip-unordered-gc-delay
rgw: use partial-order bucket listing in RGWLC, add configurable processing delay

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2018-05-22 11:20:31 -04:00
Casey Bodley
fa1cf95df4
Merge pull request #21838 from yehudasa/wip-rgw-async-watch
rgw: async watch registration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:19:48 -04:00
Casey Bodley
ac36897f72
Merge pull request #22024 from votdev/bug_24142
rgw: Do not modify email if argument is not set

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-05-22 11:19:24 -04:00
Casey Bodley
ab5a158a3b
Merge pull request #22100 from joscollin/wip-rgw-period
rgw: update --url in usage and doc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:15:45 -04:00
Casey Bodley
7e8ee759d1
Merge pull request #22114 from zhangsw/cleanup-rgw-cors
rgw: remove the useless is_cors_op in RGWHandler_REST_Obj_S3.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:15:22 -04:00
Sage Weil
e823c15e04
Merge pull request #22083 from liewegas/wip-21480
os/bluestore: fix flush_commit locking

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-05-22 09:47:19 -05:00
Andrew Schoen
7cd3d7ca05
Merge pull request #22062 from alfredodeza/wip-rm24031
ceph-volume dmcrypt and activate --all documentation updates 

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-05-22 13:31:22 +00:00
Lenz Grimmer
7bf6c93e78
Merge pull request #22065 from ricardoasmarques/wip-table-pagination-style
Improve table pagination style

Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-05-22 14:09:30 +02:00
Boris Ranto
af3ddefd35
Merge pull request #22149 from b-ranto/wip-fix-metadata
prometheus: Fix order of occupation values

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-22 13:46:06 +02:00
Lenz Grimmer
8411506284
Merge pull request #22031 from tspmelo/wip-jest
mgr/dashboard: Add Jest Runner

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-22 12:52:16 +02:00
Lenz Grimmer
1922fba7d7
Merge pull request #22088 from tspmelo/fix-rbd-task-metadata
mgr/dashboard: Fix RBD task metadata

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-22 12:51:10 +02:00
Boris Ranto
b5f16367ea prometheus: Fix order of occupation values
When we merged the PR to unify the metadata labels, we forgot to switch
the order of hostname and disk in ceph_disk_occupation metric.

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-05-22 12:04:22 +02:00
Kefu Chai
46904a8025
Merge pull request #22069 from tchaikov/wip-mgr-cleanup
mgr: fix typo in variable name and cleanups

Reveiwed-by: John Spray <john.spray@redhat.com>
2018-05-22 10:44:36 +08:00
Kefu Chai
6b48184f4c
Merge pull request #22077 from majianpeng/config-w/o-mgr
cmake: make -DWITH_MGR=OFF work.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-22 10:43:10 +08:00
Kefu Chai
0f8583a881
Merge pull request #22089 from jcsp/wip-24175
mgr/status: output to stdout, not stderr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-22 10:42:04 +08:00
Josh Durgin
1642bc4491
Merge pull request #22074 from dzafman/wip-parens
test: Need to escape parens in log-whitelist for grep

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 15:54:05 -07:00
Josh Durgin
6ef75a62f7
Merge pull request #22096 from yuriw/wip-yuriw-crontab
qa/tests: added filters to support distro tests for client-upgrade tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 15:27:39 -07:00
Yuri Weinstein
2a01e68a68 qa/tests - reverted clients upgrades for luminous runs
removed ~/rhel_only_on_ovh.yaml to be able to run on ovh
forced runs on smithi only

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-21 14:44:09 -07:00
Sage Weil
efde8d440b os/bluestore: move txc on_commits assignment into ctor
This avoids adjusting the oncommits without a lock after the txc is
queued on the sequencer.

This is a bit defensive since the ObjectStore caller doesn't call
flush_commit() at the same time as queue_transaction(), but the could
change in the future.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-21 13:32:30 -05:00
Matt Benjamin
aefbe28ae3
Merge pull request #22036 from linuxbox2/wip-warn-orphans
rgw: require --yes-i-really-mean-it to run radosgw-admin orphans find
2018-05-21 13:55:58 -04:00
David Zafman
4fad800043 test: Add CACHE_POOL_NO_HIT_SET to whitelist for mon/pool_ops.sh
Ignore
  cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET)

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-21 09:47:59 -07:00
David Zafman
918921ab2f test: Need to escape parens in log-whitelist for grep
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-21 09:47:59 -07:00
Sage Weil
c7ca50231a Merge PR #22064 into master
* refs/pull/22064/head:
	os/bluestore: fix signed/unsigned mismatch warning during building

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 11:31:54 -05:00
Sage Weil
9860f53416 Merge PR #22091 into master
* refs/pull/22091/head:
	crush: update choose_args on bucket removal
	crush: update choose_args on bucket removal, resize, or position mismatch
	crush: create weight-set on demand when doing a choose-args reweight
	test/cli/crushtool: use straw2 buckets for choose-args test
	crush: weight_set_size -> weight_set_positions

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-05-21 08:41:00 -05:00
Sage Weil
a4042d51bc os/bluestore: fix flush_commit locking
We were updating the txc state to KV_DONE and queuing the oncommits
waiters without holding any locks.  This was mostly fine, *except* that
Collection|OpSequencer::flush_commit(Context *) was looking at the state
(under qlock) and also adding items to oncommits.

The flush_commit() method is only used in 2 places: osd bench, and the
PG reset_interval_flush outgoing message blocking machinery (which is
a bit ick). The first we could get rid of, but the second is hard to
remove (despite its ick factor).

The simple fix is to take qlock while updating the state value and
working with oncommits.

Fixes: http://tracker.ceph.com/issues/21480
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-21 08:27:10 -05:00
Sage Weil
ea205e1cbb Merge PR #21540 into wip-sage-testing-20180521.120735
* refs/pull/21540/head:
	tests/crypto: print compile warning when NSS is unavailable.
	tests/crypto: add tests for the no-bl encrypt/decrypt, part 2.
	tests/crypto: add tests for the no-bl encrypt/decrypt.
	auth: use OpenSSL for CryptoAESKeyHandler's no-bl encrypt/decrypt.
	auth: extend CryptoKey with no-bl encrypt/decrypt.
	auth: CryptoAESKeyHandler switches from NSS to OpenSSL.
	auth: the outbuf of AES should be multiple of block size
	auth: cache the PK11Context for CryptoAESKeyHandler
2018-05-21 07:07:59 -05:00
Sage Weil
1d684921e4 Merge PR #21973 into wip-sage-testing-20180521.120735
* refs/pull/21973/head:
	pybind/ceph_argparse.py: show usage on fully matched cmd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 07:07:53 -05:00
Sage Weil
19226d7e18 Merge PR #21985 into wip-sage-testing-20180521.120735
* refs/pull/21985/head:
	common: partially revert 95fc248 to make get_process_name work

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 07:07:48 -05:00
Sage Weil
9ded63e418 Merge PR #21994 into wip-sage-testing-20180521.120735
* refs/pull/21994/head:
	os/bluefs/BlueFS: cleanup code.

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-05-21 07:07:44 -05:00
Kefu Chai
59f5349c43
Merge pull request #22103 from tchaikov/wip-qa-test_envlibrados_for_rocksdb
qa/workunits/rados/test_envlibrados_for_rocksdb: install g++ not g++-4.7

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 19:36:57 +08:00
Jianpeng Ma
bac9caf71b cmake: make -DWITH_MGR=OFF work.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-05-21 17:55:13 +08:00
Zhang Shaowen
cc10d11091 rgw: remove is_cors_op in RGWHandler_REST_Obj_S3 which is not used.
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2018-05-21 17:08:51 +08:00
Kefu Chai
28d4d640fc
Merge pull request #22084 from liewegas/wip-fix-fop
osd/PrimaryLogPG: fix try_flush_mark_clean write contention case

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-21 16:40:41 +08:00
Mykola Golub
ff20920675
Merge pull request #22072 from dillaman/wip-24165
librbd: prevent the use of internal feature bits from external users

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-05-21 10:00:15 +03:00
Kefu Chai
2b904ae202 buffer.h: avoid using c++14 features
so we dont't need to force librados client to move to C++14 or up.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-21 13:28:23 +08:00
Kefu Chai
f8d47223e2 qa/workunits/rados/test_envlibrados_for_rocksdb: use cmake not make
* so we just rely on a single build system instead of two of them, the
  other place we use cmake is cmake/modules/BuildRockDB.cmake.
* disable gflags when building rocksdb, it's optional and does not help
  in the sense of testing librados support.
* disable prompts when installing on debian, to silence warnings like:
  debconf: unable to initialize frontend: Dialog
* drop --force-yes option, as it is deprecated, and is replaced with
  --allow-downgrades, --allow-remove-essential,
  --allow-change-held-packages,  but none of them apply in our case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-21 13:28:23 +08:00
Sage Weil
7f04b17234
Merge pull request #21982 from tchaikov/mgr-brag
mgr/telemetry: Add Ceph Telemetry module to send reports back to project
2018-05-20 21:34:12 -05:00
Sage Weil
ec418e0910 Merge PR #21847 into wip-sage-testing-20180521.023125
* refs/pull/21847/head:
	log: disk write coalescing

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-20 21:31:34 -05:00
Sage Weil
47dffc53d6
Merge pull request #22063 from liewegas/wip-unit-spaces
include/types: space between number and units

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-20 21:26:03 -05:00
Sage Weil
c7ac6169ff
Merge pull request #22042 from liewegas/wip-rm-pool-race
ceph_test_rados_api_misc: remove obsolete LibRadosMiscPool.PoolCreationRace

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-05-20 21:24:37 -05:00
Sage Weil
a5d30ad2ab
Merge pull request #22106 from liewegas/wip-rados-distros
qa/suites/rados/thrash-old-clients: only centos and 16.04
2018-05-20 21:23:48 -05:00
Patrick Donnelly
af129d1419
Merge PR #21997 into master
* refs/pull/21997/head:
	mds: broadcast quota to relevant clients when quota is explicitly set

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-05-20 16:52:40 -07:00
Patrick Donnelly
ca40b1c49c
Merge PR #22001 into master
* refs/pull/22001/head:
	client: avoid freeing inode when it contains TX buffer heads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-20 16:52:35 -07:00
Patrick Donnelly
c58158421e
Merge PR #22023 into master
* refs/pull/22023/head:
	messages: print quota info in MClientQuota msg

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-20 16:52:30 -07:00
Patrick Donnelly
ad55214d3b
Merge PR #22045 into master
* refs/pull/22045/head:
	client: cleanup Cap init

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-20 16:52:25 -07:00