Commit Graph

89086 Commits

Author SHA1 Message Date
Patrick Donnelly
418db4617b
Merge PR #23542 into master
* refs/pull/23542/head:
	qa: fix mon config section

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:15:20 -07:00
Patrick Donnelly
47e60908a3
qa: fix mon config section
Fixes: fc6e683832

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:13:06 -07:00
Patrick Donnelly
0b879f4401
Merge PR #23444 into master
* refs/pull/23444/head:
	cephfs-shell: avoid sys.argv modification
	tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 18:29:34 -07:00
Patrick Donnelly
e6c33aa09b
cephfs-shell: avoid sys.argv modification
In multiple locations in the code.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 15:01:34 -07:00
Patrick Donnelly
0ef08e1ba9
Merge PR #23066 into master
* refs/pull/23066/head:
	include/utime.h: remove improper comments

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-12 14:51:26 -07:00
Patrick Donnelly
aab25e41d9
Merge PR #23513 into master
* refs/pull/23513/head:
	doc: updated contact email for Ceph pull requests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 14:49:05 -07:00
Patrick Donnelly
8a5adec8d5
Merge PR #23280 into master
* refs/pull/23280/head:
	cephfs: LeaseStat versioning
	cephfs: DirStat versioning
	mds: make has_feature const function
	cephfs: InodeStat versioning
	mds: add new feature bit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-12 14:25:01 -07:00
Patrick Donnelly
45e96a2f46
Merge PR #23538 into master
* refs/pull/23538/head:
	mds: mark beacons as high priority

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-12 14:12:02 -07:00
Patrick Donnelly
fe9a1b5c58
Merge PR #23527 into master
* refs/pull/23527/head:
	mds: use fast dispatch to handle MDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 14:11:58 -07:00
Patrick Donnelly
358432308d
Merge PR #23457 into master
* refs/pull/23457/head:
	qa: ignore normal slow IO warnings for cephfs

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-12 14:10:09 -07:00
Patrick Donnelly
fc6e683832
qa: ignore normal slow IO warnings for cephfs
Generally the slow warnings we get are just over the threshold. These warnings
are related to deploying multiple Ceph daemons side-by-side. Let's see how we
do with two minutes.

Ignoring the warnings entirely is unsatisfactory as they serve as a useful
canary in the coal mine when you see warnings for ops > some unreasonably large
amount of time.

Fixes: http://tracker.ceph.com/issues/26900

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 13:59:59 -07:00
Casey Bodley
c954417ec3
Merge pull request #23416 from ZVampirEM77/wip-mfa-cmd-and-options
radosgw-admin: add mfa related command and options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-12 14:10:33 -04:00
Pavani Rajula
ab70dffdb2 tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.
Fixes:http://tracker.ceph.com/issues/26853
Fixes:http://tracker.ceph.com/issues/26855

Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-12 22:08:38 +05:30
Kefu Chai
e0abbb7d1c
Merge pull request #22563 from ifed01/wip-ifed-bdev-minsize
os/bluestore: fix bluefs extent miscalculations on small slow device

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-12 17:30:28 +08:00
Kefu Chai
7fada44d9a
Merge pull request #23294 from noahdesu/timely-mgr-health-updates
mgr: timely health updates between monitor and manager

Reviewed-by: John Spray <john.spray@redhat.com>
2018-08-12 17:29:29 +08:00
Kefu Chai
bf33564177
Merge pull request #23257 from ifed01/wip-ifed-fix-rcoll-race
os/bluestore: fix race between remove_collection and object removals

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-12 17:28:28 +08:00
Kefu Chai
84ef860caf
Merge pull request #23492 from liewegas/wip-mgrc-warning
mgr/MgrClient: make some noise for a user if no mgr daemon is running

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-08-12 17:26:17 +08:00
Jos Collin
2de7e88e4a
cephfs: LeaseStat versioning
* Use the new feature bit CEPHFS_FEATURE_REPLY_ENCODING for encoding.
* encode/decode in the new format.
* Dropped LeaseStat::encode().
* The old format is maintained for backward compatibility.
* Created Locker::encode_lease() for encoding and dropped the duplicates.

Fixes: http://tracker.ceph.com/issues/24444
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-08-12 06:42:18 +05:30
Jos Collin
b576cebb65
cephfs: DirStat versioning
* Use the new feature bit CEPHFS_FEATURE_REPLY_ENCODING for encoding.
* encode/decode in the new format.
* Dropped DirStat::encode().
* The old format is maintained for backward compatibility.
* Created CDir::encode_dirstat() for encoding and dropped the duplicates.

Fixes: http://tracker.ceph.com/issues/24444
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-08-12 06:38:41 +05:30
Patrick Donnelly
4a9fcb6c6f
Merge PR #23500 into master
* refs/pull/23500/head:
	debian: mark python-ceph-argparse Arch = all
	rpm: package cephfs-shell for fedora
	tools/cephfs,deb: package cephfs-shell
	cmake: install script and egg-info files of cephfs-shell
	tools/cephfs: add setup.py for cephfs-shell

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-11 16:33:47 -07:00
Patrick Donnelly
7b766ab48e
Merge PR #23480 into master
* refs/pull/23480/head:
	tools/cephfs: fix mkdirs(exist_ok) call
	tools/cephfs: cephfs-shell cleanup
	tools/cephfs: run cephfs-shell thru autopep8

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-11 16:27:48 -07:00
Patrick Donnelly
ec3fa7b565
mds: mark beacons as high priority
The mons already mark beacon replies as high priority (via default mon message
priority). We should expect that the mons handle our beacons at the same
priority so the MDS doesn't wrongly get marked laggy.

Fixes: http://tracker.ceph.com/issues/26899

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-11 16:11:34 -07:00
Casey Bodley
6bb38deb35
Merge pull request #22868 from iliul/modify-log-level
rgw: Fix log level of gc_iterate_entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-11 10:48:24 -04:00
iliul
0a3f3d0e34
rgw: Fix log level of gc_iterate_entries
Fixes: http://tracker.ceph.com/issues/23801

Signed-off-by: iliul <liul.stone@gmail.com>
2018-08-11 11:17:15 +08:00
Yan, Zheng
7fc04be933 mds: use fast dispatch to handle MDSBeacon
Current mds handles MDSBeacon messages through MDSRank::ms_dispatch().
MDSRank::ms_dispatch() locks mds_lock at the very beginning. This means
that long running task (such as processing finished contexts) can delay
MMDSBeacon. Using fast dispatch for MDSBeacon can avoid this issue.

Fixes: http://tracker.ceph.com/issues/23519
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-11 07:33:13 +08:00
Sage Weil
c6eb1c4a5a Merge PR #22838 into master
* refs/pull/22838/head:
	kv/RocksDBStore: Handle nullptr if clock cache is chosen.
	kv/rocksdb_cache/BinnedLRUCache: Don't promote data to the high pri pool.
	src/kv: Initial import of a custom RocksDB cache.
	src/rocksdb: switch back to master branch.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-10 16:32:34 -05:00
Sage Weil
bdf1653ec9 Merge PR #22970 into master
* refs/pull/22970/head:
	os/bluestore: limit OSD memory usage by tuning the cache size.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-10 16:32:29 -05:00
Enming.Zhang
fd47c91a45 radosgw-admin: add mfa related command and options
command:
+ mfa create
+ mfa list
+ mfa get
+ mfa remove
+ mfa check
+ mfa resync

options:
+ --totp-serial
+ --totp-seed
+ --totp-second
+ --totp-window
+ --totp-pin

Signed-off-by: Enming.Zhang <enming.zhang@umcloud.com>
2018-08-10 12:16:49 -04:00
Yuri Weinstein
75967da42b
Merge pull request #22967 from linuxbox2/wip-slo-nosize
rgw: Swift SLO size_bytes member is optional

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 09:14:09 -07:00
Yuri Weinstein
2a72d893d2
Merge pull request #23056 from stiopaa1/fixRgwAdminUser
rgw: fix dependencies/target_link_libraries

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-10 09:13:40 -07:00
Yuri Weinstein
d6e2f9f24b
Merge pull request #23282 from zhangsw/fix-rgw-server-header
rgw: add Http header 'Server' in response headers.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 09:13:18 -07:00
Yuri Weinstein
4ea1111e60
Merge pull request #23405 from joke-lee/WIP-RGW-BUCKET-NOTIFY
rgw: add s3 notification sub resources

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 09:12:41 -07:00
Yuri Weinstein
82b35dbc72
Merge pull request #23434 from joke-lee/wip-cors-rule-num-limit
rgw: cors rules num limit

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-08-10 09:12:15 -07:00
Alfredo Deza
0b63a746ee
Merge pull request #23210 from alfredodeza/wip-bluestore-sizing
doc: document sizing for `block.db`

Reviewed-by: Ben England <bengland@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-10 11:15:29 -04:00
Casey Bodley
81ce951655
Merge pull request #23511 from excellentkf/WIP-test
common/options: correct the description of rgw_enable_lc_threads option

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 09:00:47 -04:00
Jos Collin
270697eccf
mds: make has_feature const function
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-08-10 17:48:25 +05:30
Jos Collin
a39fb4ffa0
cephfs: InodeStat versioning
* Use the new feature bit CEPHFS_FEATURE_REPLY_ENCODING for encoding.
* encode/decode in the new format.
* The old format is maintained for backward compatibility.

Fixes: http://tracker.ceph.com/issues/24444
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-08-10 17:48:05 +05:30
Kefu Chai
50f7f7e32e
Merge pull request #23496 from bstillwell/crush_doc_fixes
doc: Fix a couple typos and improve diagram formatting

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-10 12:45:29 +08:00
Kefu Chai
c91006141b
Merge pull request #23477 from liewegas/wip-kv-merge-name
kv/KeyValueDB: return const char* from MergeOperator::name()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-10 10:54:13 +08:00
Kefu Chai
7acb991728
Merge pull request #23474 from tchaikov/wip-config-expand-meta
common: expand meta in parse_argv()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 10:52:53 +08:00
yanjun
e4c35bfa8f
Merge pull request #23481 from Yan-waller/wip-walle-180808-smooth-intervals
mgr,mon: fix to apply changed mon_stat_smooth_intervals

Reviewed-by: John Spray <john.spray@redhat.com>
2018-08-10 10:51:52 +08:00
yanjun
d50bef3861
Merge pull request #23482 from Yan-waller/wip-walle-180808-mgr-deadlock
mgr: fix beacon interruption caused by deadlock

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-10 10:49:19 +08:00
yanjun
8d50ca449c
Merge pull request #23487 from xiexingguo/wip-hb-peers-v2
osd/OSD: choose heartbeat peers more carefully

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
2018-08-10 10:47:19 +08:00
Mark Nelson
9202285b44 kv/RocksDBStore: Handle nullptr if clock cache is chosen.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-08-09 16:50:51 -05:00
Mark Nelson
269713d0f8 kv/rocksdb_cache/BinnedLRUCache: Don't promote data to the high pri pool.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-08-09 16:50:51 -05:00
Mark Nelson
9dd6b2885e src/kv: Initial import of a custom RocksDB cache.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-08-09 16:50:51 -05:00
Alfredo Deza
f563510c58
Merge pull request #23514 from bstillwell/operations_doc_fixes
doc: Multiple spelling fixes

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-08-09 17:41:58 -04:00
Bryan Stillwell
791b00daa1 doc: Multiple spelling fixes
I ran a lot of the docs through aspell and found a number of spelling problems.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-09 14:51:25 -06:00
Mark Nelson
1b8a87b39a os/bluestore: limit OSD memory usage by tuning the cache size.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-08-09 15:37:48 -05:00
Sage Weil
ebaa80690d Merge PR #23471 into master
* refs/pull/23471/head:
	mon/PGMap: fix spacing around pretty-printed SI units
	include/types: render SI units adjacent to number

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-08-09 14:35:56 -05:00