Commit Graph

102686 Commits

Author SHA1 Message Date
Kefu Chai
2b6056f935
Merge pull request #30655 from tchaikov/wip-cmake/crimson/pass-args
cmake: pass arguments to crimson tests

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-01 22:28:58 +08:00
Casey Bodley
ec0e97fe8d
Merge pull request #30613 from joke-lee/rgw-ceph-dencoder-add-RGWPeriodLatestEpochInfo
ceph-dencoder: add RGWPeriodLatestEpochInfo support.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-10-01 09:59:30 -04:00
Kefu Chai
d656c05f50 cmake: pass arguments to crimson tests
otherwise they will take all CPU cores and all memory

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-01 19:40:37 +08:00
Sebastian Wagner
4e3bdafc98
Merge pull request #30587 from sebastian-philipp/python-common-readme
python-common: Add small Readme

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2019-10-01 12:05:00 +02:00
Patrick Donnelly
59d740d7cd
Merge PR #30341 into master
* refs/pull/30341/head:
	cephfs-shell: better complain info, when deleting non-empty directory

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2019-10-01 01:21:16 -07:00
Patrick Donnelly
907c2d6ed5
Merge PR #30559 into master
* refs/pull/30559/head:
	mds: Reorganize class members in MDBalancer header

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-10-01 01:17:53 -07:00
Patrick Donnelly
4bb8cb3a90
Merge PR #30580 into master
* refs/pull/30580/head:
	client: don't ceph_abort on bad llseek whence value
	client: remove Inode dir_contacts field

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-01 01:15:54 -07:00
Ramana Raja
0bfcace85e
Merge pull request #30407 from joscollin/wip-B41841-yes-really-mean-it
mgr/volumes: protection for `fs volume rm` command
2019-10-01 13:05:33 +05:30
Patrick Donnelly
bbe3a33775
Merge PR #30552 into master
* refs/pull/30552/head:
	cmake: fix libtsan detection
	test: librados startup/shutdown racer test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-09-30 20:46:14 -07:00
Kefu Chai
a56266ef09
Merge pull request #30630 from tchaikov/wip-build-on-centos8
install-deps,rpm,do_cmake: build on RHEL/CentOS 8

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2019-10-01 10:57:16 +08:00
Kefu Chai
7925aee2d5
Merge pull request #30531 from alimaredia/wip-rgw-maven-version-update
qa: bump maven repo version in s3a_hadoop.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-10-01 10:45:23 +08:00
Xie Xingguo
b93b3dd827
Merge pull request #30615 from xiexingguo/wip-progress-time-remaining
mgr/progress: estimated remaining time for events

Reviewed-by: Sage Weil <sage@redhat.com>
2019-10-01 09:07:29 +08:00
Xie Xingguo
f28f35f79b
Merge pull request #30591 from xiexingguo/wip-balancer-throttler
mgr/balancer: upmap_max_iterations -> upmap_max_optimizations; behave as it is per pool

Reviewed-by: Sage Weil <sage@redhat.com>
2019-10-01 07:42:25 +08:00
Samuel Just
79847358cf
Merge pull request #29674 from athanatos/sjust/wip-fio-trace
os/bluestore: expand lttng tracepoints, improve fio_ceph_objectstore backend

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-30 14:15:31 -07:00
Jeff Layton
09bd258a9f cmake: fix libtsan detection
This variable is case-sensitive.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-30 14:49:12 -04:00
Lenz Grimmer
3de8ee9392
Merge pull request #30620 from votdev/issue_42069_validate_bucket_name
mgr/dashboard: Bucket names cannot be formatted as IP address

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kai Wagner <kwagner@suse.com>
2019-09-30 13:51:44 +00:00
Lenz Grimmer
3b30a5a54e
Merge pull request #30647 from s0nea/wip-dashboard-fix-typo
mgr/dashboard: fix small typos in description message

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-30 13:44:40 +00:00
Kefu Chai
cc9746a701
Merge pull request #29925 from sebastian-philipp/run_tox-overwrite-build-dir
script/run_tox.sh: Don't overwrite the build dir

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-30 21:18:43 +08:00
Tatjana Dehler
b3983578d6 mgr/dashboard: fix two small typos
Remove unnecessary blanks.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-09-30 13:59:48 +02:00
Sebastian Wagner
8826afd84e script/run_tox.sh: Don't overwrite the Ceph's bulid dir
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-30 13:21:40 +02:00
Kefu Chai
a06e7e094e
Merge pull request #30639 from tchaikov/wip-crimson-readable
crimson/osd: implement readable/lease related methods

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-30 17:51:04 +08:00
Xie Xingguo
97065f5c9a
Merge pull request #30644 from majianpeng/osd-remove-unused-func
osd: remove unused function

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-30 17:01:44 +08:00
Xie Xingguo
f1b55e7790
Merge pull request #30632 from xiexingguo/wip-kick-recovery-pri
osd/PrimaryLogPG: always use strict priority ordering for kicked recovery ops

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-30 16:59:55 +08:00
Kefu Chai
4d188a2348
Merge pull request #30642 from Rjerk/wip-fix-doc
doc/radosgw: fix typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:53:51 +08:00
Kefu Chai
f643de441e osd/PrimaryLogPG: add closing ")" in log
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:25:02 +08:00
Kefu Chai
106208cdd8 crimson/osd/pg: implement schedule_renew_lease()
see also d883db7028

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:25:02 +08:00
Kefu Chai
3138e195fa crimson/osd: implement ShardServices::get_hb_stamps()
PeeringState::proc_lease() requires a valid hb_stamps[0], which is in
turned maintained by `pl`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:25:02 +08:00
Kefu Chai
b031ecda44 crimson/osd/pg: implement queue_check_readable() and recheck_readable()
see also 7aec060e0aff4588ff51f744dd194d1c0f7793c2

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:25:02 +08:00
Kefu Chai
376335c93f common/ceph_time: do not handle negative case
this change partially reverts 353a0e5f, unlike `signedspan`,
`timespan::rep` is unsigned. so no need to handle negative case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-30 16:25:01 +08:00
Volker Theile
42be6df308 mgr/dashboard: Bucket names cannot be formatted as IP address
In general, bucket names should follow domain name constraints:
- Bucket names must be unique.
- Bucket names cannot be formatted as IP address.
- Bucket names can be between 3 and 63 characters long.
- Bucket names must not contain uppercase characters or underscores.
- Bucket names must start with a lowercase letter or number.
- Bucket names must be a series of one or more labels. Adjacent labels are separated by a single period (.). Bucket names can contain lowercase letters, numbers, and hyphens. Each label must start and end with a lowercase letter or a number.

Fixes: https://tracker.ceph.com/issues/42069

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-09-30 10:03:44 +02:00
Jianpeng Ma
8ba01c40ca osd: remove unused function
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-09-30 13:38:27 +08:00
Patrick Donnelly
4ebaa4ba72
Merge PR #30396 into master
* refs/pull/30396/head:
	doc: document mds journaling

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-29 21:05:02 -07:00
Patrick Donnelly
4c5f24ead9
Merge PR #30463 into master
* refs/pull/30463/head:
	vstart_runner: allow the use of it with kernel mounts

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-29 21:02:56 -07:00
Liu Lan
a2d5046340 doc/radosgw: fix typo
Signed-off-by: Liu Lan <liulan@umcloud.com>
2019-09-30 11:58:57 +08:00
xie xingguo
5f95ec4457 mgr/progress: estimated remaining time for events
Fixes: https://tracker.ceph.com/issues/40419
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-30 10:10:28 +08:00
Kefu Chai
2ab601ac01
Merge pull request #30638 from uweigand/cmake-atomic-16byte
cmake: Test for 16-byte atomic support on IBM Z

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-30 01:26:09 +08:00
Ulrich Weigand
d1b9d14324 cmake: Test for 16-byte atomic support on IBM Z
On IBM Z the Boost tagged pointer implementation cannot use
"pointer compression" as there are no unused bits in an address;
the whole 64-bit address space is available to user space code.

Instead, Boost uses 16-byte atomics.  This is always supported
on IBM Z, but depending on the particular compiler (version)
it may require linking against libatomic.  The existing checks
in CheckCxxAtomic.cmake do not catch this, however, as they only
test for (up to) 8-byte atomic support.

Fixed by adding a test for 16-byte atomic support on IBM Z.

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
2019-09-29 16:22:52 +02:00
Kefu Chai
dd96fdcc5f
Merge pull request #30617 from xiexingguo/wip-weird-daemon-key
mgr: fix weird health-alert daemon key

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-29 18:11:40 +08:00
xie xingguo
25963f24e5 mgr: fix weird health-alert daemon key
Was:
  19 slow ops, oldest one blocked for 34 sec, daemons [osd,2,osd,4] have slow ops.

Now:
  153 slow ops, oldest one blocked for 38 sec, daemons [osd.3,osd.4,osd.5] have slow ops.

Fixes: https://tracker.ceph.com/issues/42079
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 15:45:55 +08:00
Kefu Chai
e659e86096
Merge pull request #29236 from liewegas/wip-read-hole-bypg
osd: implement per-pg leases to avoid stale reads

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-09-29 14:39:32 +08:00
xie xingguo
d346fdca06 osd/PrimaryLogPG: always use strict priority ordering for kicked recovery ops
See 590c4979d4 for the background of
this change.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 14:05:56 +08:00
Kefu Chai
b10a2e753f
Merge pull request #30527 from uweigand/bloom-filter-endian
common/bloom_filter: Fix endian issues

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-29 14:04:19 +08:00
Kefu Chai
ec3d883ced
Merge pull request #30616 from ifed01/wip-ifed-fix-fsck
os/bluestore: fix invalid stray shared blob detection in fsck.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 13:41:11 +08:00
Kefu Chai
c16a14109c
Merge pull request #30625 from tchaikov/wip-42087
mgr/BaseMgrStandbyModule: drop GIL in ceph_get_module_option()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 13:38:27 +08:00
xie xingguo
5f22e36b44 Revert "osd: give recovery ops initialized by client op a higher priority"
This reverts commit c0f87e0f91.

The 'osd_op_queue_cut_off' config option determines which level of
high priority ops should use strict priority ordering and may change
from time to time. Since the main strategy of 'osd_kick_recovery_op_priority'
is to simply follow up 'osd_op_queue_cut_off', we can instead make a direct
use of 'osd_op_queue_cut_off' to achieve the same thing explicitly.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 13:08:29 +08:00
yuliyang
701ee00800 ceph-dencoder: add RGWPeriodLatestEpochInfo support.
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2019-09-29 07:06:16 +08:00
Sage Weil
da2dc1c3db crimson/osd: fix osdpg build
These are stubs; the reschule one (at minimum) probably needs a meaningful
implementation in order for the PG to peer in some cases.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Sage Weil
9d2325084e doc: document new 'laggy' and 'wait' pg states
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Sage Weil
8be0106d42 doc: stale reads notes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Sage Weil
4059946289 osd/PeeringState: skip wait state if osd set is empty
If there are no down OSDs from prior intervals, then the normal peering
process will end up contacting all of the prior OSDs and ensuring that
their prior interval is terminated during peering.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00