Commit Graph

79616 Commits

Author SHA1 Message Date
Kefu Chai
127d25ccbd doc: fix warning reported by "build-doc linkcheck"
all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:58:48 +08:00
Kefu Chai
e21cd99855 doc: update manual-deployment with latest code
rbd pool is not created by default any more.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-23 19:18:39 +08:00
Kefu Chai
8622fdddf2 Merge pull request #15811 from x-ion-de/wip-20309
doc: Update manual deployment

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 18:42:46 +08:00
Patrick Donnelly
2f7ae0e160
Merge PR #18372 into master
* refs/pull/18372/head:
	ptl-tool: Fix more readme examples

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-22 20:26:16 -07:00
Kefu Chai
6a35e37eb9 Merge pull request #18368 from kungf/scrub_week_day_bound
osd: add scrub week day constraint

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-22 03:33:14 +08:00
Sage Weil
7c387fd04a Merge pull request #18400 from dillaman/wip-21844
osdc/Objecter: skip sparse-read result decode if bufferlist is empty

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-21 12:46:57 -05:00
Sage Weil
b834df8823 Merge pull request #18418 from dillaman/wip-21860
common/common_init: disable ms subsystem log gathering for clients

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-21 12:46:14 -05:00
Sage Weil
953d785eb5 Merge pull request #18427 from dillaman/wip-21845
osdc/Objecter: delay initialization of hobject_t in _send_op

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-10-21 12:45:36 -05:00
Sage Weil
40f0bbc1c5 Merge pull request #18450 from liewegas/wip-osd-removing
osd: add numpg_removing metric

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-21 12:44:29 -05:00
Sage Weil
1e5fce39a4 Merge pull request #18452 from liewegas/wip-21880
ceph_test_objectstore: disable filestore_fiemap for tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-21 12:44:00 -05:00
Sage Weil
90e13e47a4 Merge pull request #18454 from liewegas/wip-21882
messages/MOSDMap: do compat reencode of crush map, too

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-21 12:43:20 -05:00
Sage Weil
95f5bdb752 Merge pull request #18457 from liewegas/wip-restful-health
qa/suites/rados/rest/mgr-restful: whitelist more health
2017-10-21 12:41:58 -05:00
Sage Weil
ddf3e9162d qa/suites/rados/rest/mgr-restful: whitelist more health
The test is fiddling with OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 23:14:36 -05:00
Sage Weil
9eaafc6627 messages/MOSDMap: do compat reencode of crush map, too
If we are reencoding an incremental, and it embeds a crush map, we need
to reencode that in a compatible way too.  This is especially true now
because we have the compat crush weight-sets.  Otherwise, a client may
learn the crush map through an incremental but not understand choose_args,
and not see/understand the alternate weight set.  It will send requests
to the wrong OSDs where they will just get dropped.

Fixes: http://tracker.ceph.com/issues/21882
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 22:36:57 -05:00
Kefu Chai
e6668b5646 Merge pull request #18406 from adamemerson/wip-insecticide
test,osd,kvstore_tool: silence warnings and prepare test buffer in the right way

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-21 10:42:04 +08:00
Kefu Chai
b40d3eb709 Merge pull request #18379 from liewegas/wip-kill-replay-interval
osd/osd_types: pg_pool_t: remove crash_replay_interval member

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-10-21 10:39:40 +08:00
Kefu Chai
17e7e835b6 Merge pull request #18407 from adamemerson/wip-upgrade-zstd
zstd: Upgrade to v1.3.2

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-21 10:39:18 +08:00
Kefu Chai
4ec719bf9e Merge pull request #18357 from asomers/have_libaio
Build: create a proper WITH_BLUESTORE option

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-10-21 10:38:37 +08:00
Sage Weil
1cb521e08c Merge pull request #18354 from kungf/no_scurb_deadline
osd: make scrub no deadline when max interval is zero

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-20 17:22:43 -05:00
Yuri Weinstein
5f763bf137 Merge pull request #18396 from xiexingguo/wip-scrub-mismatch
osd/osd_types.cc: copy extents map too while making clone

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-20 14:47:14 -07:00
Sage Weil
b8ba9334d9 ceph_test_objectstore: disable filestore_fiemap for tests
This option was enabled in 87f33376d9 but
causes ObjectStore/StoreTest.Synthetic/1 (filestore) to fail.  Revert that
bit for now until we fix fiemap properly.

See http://tracker.ceph.com/issues/21880

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 16:32:59 -05:00
Yuri Weinstein
9b18093892 Merge pull request #16958 from mikulely/fix-full-uri
rgw: fix opslog uri as per Amazon s3

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-20 13:49:29 -07:00
Yuri Weinstein
7ccd491953 Merge pull request #17546 from mikulely/rgw-cleanup-min
rgw: cleanup MIN macro with std::min

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-10-20 13:47:34 -07:00
Yuri Weinstein
8f2f0f0fc0 Merge pull request #17934 from joke-lee/rgw_list_objecst_wrong_result_with_marker_when_enable_versioning
rgw:fix list objects with marker wrong result  when bucket is enable versioning

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-10-20 13:46:09 -07:00
Ali Maredia
2e477f3c05 Merge pull request #17673 from mogeb/blkin
blkin: link against lttng-ust-fork
2017-10-20 15:52:55 -04:00
Kefu Chai
9970342d58 Merge pull request #18414 from majianpeng/pmem-work
libmpem: Revert "submodule: make libmpem as a submodule."

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-21 02:58:01 +08:00
Sage Weil
b50ee3e795 osd: add numpg_removing metric
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 13:34:20 -05:00
Casey Bodley
1a2db61de2 Merge pull request #18335 from linuxbox2/wip-rgw-readdir2
rgw_file: implement variant offset readdir processing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-20 11:55:17 -04:00
Jason Dillaman
a3a40413f7 common/common_init: disable ms subsystem log gathering for clients
The log gathering causes large performance degradation to clients
with high message throughputs. This is hopefully a short-term
workaround until per-message logging can be replaced with an
efficient data recording system for post-incident analysis
use-cases.

Fixes: http://tracker.ceph.com/issues/21860
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-20 11:15:07 -04:00
Kefu Chai
38e789dc3b Merge pull request #18392 from tchaikov/wip-21842
os/bluestore: implement BlueRocksEnv::AreFilesSame()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-20 21:37:44 +08:00
Jason Dillaman
eca4fafbcf osdc/Objecter: delay initialization of hobject_t in _send_op
Fixes: http://tracker.ceph.com/issues/21845
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-20 09:32:14 -04:00
John Spray
8c45855325 Merge pull request #18251 from jan--f/mgr-py-module-constants
pybind/mgr_module: move PRIO_* and PERFCOUNTER_* to MgrModule class

Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-20 12:58:22 +01:00
John Spray
bd8814bf58 Merge pull request #18021 from jcsp/wip-prometheus-disk-occupation
mgr/prometheus: add ceph_disk_occupation series

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2017-10-20 12:28:12 +01:00
Jianpeng Ma
73fb6eef73 Revert "submodule: make libmpem as a submodule."
This reverts commit 6a14159ee4.
Using ExternalProject_Add::GIT to download nvml source .

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-20 17:55:48 +08:00
Mykola Golub
8eeae328cb Merge pull request #18250 from dillaman/wip-21763
doc/rbd: tweaks for the LIO iSCSI gateway

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-20 11:55:44 +03:00
Kefu Chai
5d31a5aee4 os/bluestore: implement BlueRocksEnv::AreFilesSame()
it is used by the "repair" feature to dedup the files to be searched for
MANIFEST-* files. the default implementation is the POSIX one, which
tries to look at the local fs, but we should be looking for the files in
the bluefs. in this very use case, wal and db do not share the same device,
so we can just compare the paths. actually, it should aways return
"false". as the files being compared are always "db" and "db.wal".

Fixes: http://tracker.ceph.com/issues/21842
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-20 12:25:14 +08:00
Kefu Chai
d7244dc030 Merge pull request #18387 from tchaikov/wip-dmclock-client-info-ptr
osd,dmclock: use pointer to ClientInfo instead of a copy of it

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2017-10-20 11:47:59 +08:00
Kefu Chai
e956c9a195 Merge pull request #18350 from ovh/bp-ceph-conf-dump-all
tools/ceph-conf: dump parsed config in plain text or as json

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-20 11:46:26 +08:00
Kefu Chai
7425a8830c Merge pull request #18367 from zealoussnow/wip-10180
ceph-bluestore-tool: create out_dir before create full path  of kvdb

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-20 11:45:38 +08:00
kungf
87be7c70a1 osd: add scrub week day constraint
if add week day constraint, we can set scrub permit time
more flexible. eg. we can set scurb in Monday-Wednesday 0-12 o'clock
according set this parameter:
osd_scrub_begin_week_day = 1
osd_scrub_end_week_day = 3
osd_scrub_begin_hour = 0
osd_scrub_end_hour = 12

Signed-off-by: kungf <yang.wang@easystack.cn>
2017-10-20 10:33:21 +08:00
Jason Dillaman
dc9b309d03 osdc/Objecter: skip sparse-read result decode if bufferlist is empty
If the OSD does not execute sub-ops due to errors encountered prior to
the sub-op, the sub-op result remains zeroed with empty out data.
Attempting to decode the empty bufferlist results in large exception
handling CPU overhead.

Fixes: http://tracker.ceph.com/issues/21844
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-19 22:33:01 -04:00
Kefu Chai
74f147b849 Merge pull request #17441 from yanyixing/update-umcloud-affiliation
mailmap: Update umcloud affiliation

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-20 09:58:49 +08:00
Adam C. Emerson
14c3f3c214 zstd: Upgrade to v1.3.2
This buys us fixes for a few memory errors and asserts and also
improves the CMake build script so it doesn't mostly ignore the
CXXFLAGS we pass in.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 16:08:07 -04:00
Josh Durgin
34951266fe Merge pull request #18374 from tchaikov/wip-ceph-C-d
ceph.in: do not panic at control+d in interactive mode

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-10-19 11:52:13 -07:00
Adam C. Emerson
bda3c2673b OSD: Silence unused variable warnings
Even though extending the lifetime of this temporary delays execution
of its destructor, the compiler does not consider the reference to
have a side-effecting constructor.

The compiler is wrong, but we can silence its complaints.

This will cease to be an issue once we adopt C++17, since mandatory
RVO will solve the inability to bind a variable to a returned
move-only object and the need to extend a temporary.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 14:43:57 -04:00
Adam C. Emerson
87b4d1646e kvstore_tool: Create default constructor
Clang4 does not recognize a constructor with all arguments defaulted
as a default constructor in some circumstances.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 13:59:50 -04:00
Adam C. Emerson
c40953f696 test/cls_journal: Fix reversed std::string constructor arguments
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 13:15:32 -04:00
Jens Rosenboom
bd0576652d Update docs for manual deployment
Fixes: http://tracker.ceph.com/issues/20309
Signed-off-by: Jens Rosenboom <j.rosenboom@x-ion.de>
2017-10-19 17:03:16 +00:00
Kefu Chai
cc09e30d42 Merge pull request #17462 from majianpeng/pmem-work
cmake: compile nvml as an external project

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 23:38:10 +08:00
Jianpeng Ma
b4cc9a9aa8 cmake: Build libpmem from source code.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-20 00:44:09 +08:00