Commit Graph

79714 Commits

Author SHA1 Message Date
Kefu Chai
c6b8792677 Merge pull request #18397 from tchaikov/wip-mon-opts
common/options: set max_background_jobs instead of max_background_compactions

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-24 21:16:30 +08:00
Kefu Chai
d0b7a1f2f5 Merge pull request #18382 from ceph/wip-vstart-mgr-dashboard
cmake: add cython_rbd as a dependency to vstart target

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-24 21:15:10 +08:00
Alfredo Deza
72dba6c716 Merge pull request #18480 from tchaikov/wip-doc-cleanup
doc: various cleanups

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-10-24 07:03:29 -04:00
Mykola Golub
f2f893aeb1 Merge pull request #18405 from dillaman/wip-21849
librbd: default to sparse-reads for any IO operation over 64K

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-24 11:02:49 +03:00
Kefu Chai
e479bd0ac1 rpm,debian: use download.ceph.com/tarballs instead of ceph.com/download
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 16:00:09 +08:00
Kefu Chai
127d25ccbd doc: fix warning reported by "build-doc linkcheck"
all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:58:48 +08:00
Kefu Chai
fdc0183871 mon/OSDMonitor: more options in new-style
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:14:09 +08:00
Kefu Chai
ca1d9566d0 common/options: set max_background_jobs instead of max_background_compactions
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:14:09 +08:00
Haomai Wang
9f5b36879c Merge pull request #18409 from liu-chunmei/fix_dpdk_assert
Fix two dpdk assert happened in dpdk library.

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-10-24 01:06:53 -05:00
Kefu Chai
bc139f02d2 Merge pull request #18460 from liewegas/wip-straw2-command
mon/OSDMonitor: add 'osd crush set-all-straw-buckets-to-straw2'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-24 12:27:15 +08:00
Sage Weil
fed1938bbb Merge pull request #18428 from liewegas/wip-21878
os/bluestore/BlueFS: fix race with log flush during async log compaction

Reviewed-by: Varada Kari <varada.kari@gmail.com>
2017-10-23 22:30:05 -05:00
Sage Weil
a91064af10 Merge pull request #18470 from yuyuyu101/wip-tracker-lock
osd/OpRequest: reduce overhead when disabling tracking

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 22:29:41 -05:00
Sage Weil
557088e07d Merge pull request #18472 from yuyuyu101/wip-kill-asynccompressor
compressor: kill AsyncCompressor which is broken

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 22:29:19 -05:00
Patrick Donnelly
a9baa8b33a
Merge PR #18255 into master
* refs/pull/18255/head:
	os/bluestore: handle compressed extents in blob unsharing checks

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-23 17:07:37 -07:00
Matt Benjamin
6bef8e3bcc Merge pull request #17722 from amitkumar50/cov-rgw-6
rgw: Initialization of epoch,len
2017-10-23 17:00:37 -04:00
Yuri Weinstein
33191d23ad Merge pull request #17305 from theanalyst/rgw-lc-tagging
RGW: support for tagging in lifecycle policies

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-10-23 13:48:40 -07:00
Yuri Weinstein
c3d84fa3bb Merge pull request #18291 from ZVampirEM77/wip-copy-errormsg
rgw: copy object add response error messages

Reviewed-by: Amit Kumar amitkuma@redhat.com
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-23 13:46:01 -07:00
Sage Weil
fc0b547ba5 Merge pull request #18194 from ivancich/wip-mclock-repops-bitmap
osd: replace mclock subop opclass w/ rep_op opclass; combine duplicated code

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 14:33:57 -05:00
Sage Weil
3c3a53b538 Merge pull request #18487 from liewegas/wip-20557
/etc/sysconfig/ceph: remove jemalloc option

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-23 14:09:53 -05:00
Andrew Schoen
6e49b7dce6 Merge pull request #18448 from ceph/wip-bz1499840
ceph-volume lvm bluestore support

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-10-23 13:55:55 -05:00
Mykola Golub
1100a00d2d Merge pull request #18403 from dillaman/wip-librbd-flush
librbd: sync flush should re-use existing async flush logic

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-23 21:12:20 +03:00
Jason Dillaman
918df91213 rbd: bench should flush prior to starting a test
For the new read-based bench tests, flushing prior to the start of the test
will result in the exclusive lock being acquired and the object map being
utilized.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-23 13:22:50 -04:00
Sage Weil
19efccef24 /etc/sysconfig/ceph: remove jemalloc option
This breaks when used with rocksdb, which is now the default.

See http://tracker.ceph.com/issues/20557

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-23 12:05:39 -05:00
Sage Weil
a95d325bfa Merge pull request #18486 from liewegas/wip-20557
etc/default/ceph: remove jemalloc option

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-23 11:52:43 -05:00
Sage Weil
fba2055b4e etc/default/ceph: remove jemalloc option
This breaks when used with rocksdb, which is now the default.

See http://tracker.ceph.com/issues/20557

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-23 11:16:26 -05:00
Sage Weil
efff14c417 Merge pull request #18408 from liewegas/wip-buffer-mempool-abi
buffer: avoid changing bufferlist ABI by removing new _mempool field

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-23 10:52:42 -05:00
Kefu Chai
6c6db0271f Merge pull request #18356 from wido/docs-zabbix-mgr
doc: Updated documentation for Zabbix Mgr module

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 23:35:51 +08:00
Kefu Chai
ae054510c3 Merge pull request #18474 from tchaikov/wip-debian-fix-upgrade
debian: fix package relationships after 40caf6a6

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-23 23:30:22 +08:00
Alfredo Deza
9bb6cfd867 ceph-volume lvm.activate only prime-osd-dir when directory is empty
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-23 09:44:27 -04:00
J. Eric Ivancich
729cb600ac osd: replace mclock subop opclass w/ rep_op opclass; combine duplicated code
The OSD subops were replaced with replication ops (i.e., MSG_OSD_REPOP
and MSG_OSD_REPOPREPLY) in jewel. mClock incorrectly used them as an
op class rather than the newer replication ops. This fixes that and
places eight ops into the repop class -- MSG_OSD_REPOP,
MSG_OSD_REPOPREPLY, MSG_OSD_PG_UPDATE_LOG_MISSING,
MSG_OSD_PG_UPDATE_LOG_MISSING_REPLY, MSG_OSD_EC_WRITE,
MSG_OSD_EC_WRITE_REPLY, MSG_OSD_EC_READ, and MSG_OSD_EC_READ_REPLY.

This alo removes dupliated code related to op classes in
mClockOpClassQueue and mClockClientQueue and combines into
mClockOpClassSupport.

The three configuration options
osd_op_queue_mclock_osd_subop_{res,wgt,lim} have also been replaced
with osd_op_queue_mclock_osd_rep_op_{res,wgt,lim}.

This also removes OpQueueItem::OpQueueable::op_type_t::osd_subop since
it's not a category core ceph recognizes and is instead it's part of
an mclock view of ops.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2017-10-23 09:25:32 -04:00
Alfredo Deza
c9b5f352a8 ceph-volume lvm.activate safeguard against auto detect objectstore flag not being set
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-23 09:20:26 -04:00
Jason Dillaman
d8dacf8261 Merge pull request #18423 from ashishkumsingh/wip-doc-fix-iscsi-chap-config
doc: Added CHAP configuration instructions for iSCSI

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-23 08:37:43 -04:00
Sage Weil
4dcef73369 mon/OSDMonitor: add 'osd crush set-all-straw-buckets-to-straw2'
This is a common and recommended step that users should take once they
have clients that support straw2 (hammer!).  Let's make it easy.

This may result in a small amount of data movement, but usually it is
very little.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-23 07:34:20 -05:00
Kefu Chai
ed988fc660 debian: fix package relationships after d3ac8d18
d3ac8d18 moves ceph-client-debug from ceph-test to ceph-base without
updating the package relationships between the two involved packages.
which results in:

dpkg: error processing archive /var/cache/apt/archives/ceph-test_12.2.1-241-g43e027b-1trusty_amd64.deb (--unpack):
 trying to overwrite '/usr/bin/ceph-client-debug', which is also in package ceph-base 10.2.10-14-gcbaddae-1trusty
dpkg-deb: error: subprocess paste was killed by signal (Broken pipe)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-23 20:18:15 +08:00
Kefu Chai
50dad805d9 debian: fix package relationships after 40caf6a6
we have issues when running upgrade tests:

dpkg: error processing archive /var/cache/apt/archives/ceph-osd_13.0.0-2201-g6cc0b41-1trusty_amd64.deb (--unpack):
trying to overwrite '/usr/bin/ceph-osdomap-tool', which is also in package ceph-test 10.2.10-14-gcbaddae-1trusty

in 40caf6a6, we moves some tools from ceph-test out into ceph-osd,
ceph-mon and ceph-base respectively. but didn't update the relationships
between these packages accordingly. this causes the upgrade failure.

see https://www.debian.org/doc/debian-policy/#document-ch-relationships
for more details on "Breaks" and "Conflicts".

the reason why the package version to be replaced/conflicted is 12.2.2
is that: i assume that this change will be backported to luminous, and
the next release of it will be 12.2.2 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-23 20:18:14 +08:00
Kefu Chai
e21cd99855 doc: update manual-deployment with latest code
rbd pool is not created by default any more.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-23 19:18:39 +08:00
Jason Dillaman
8be1d7d776 Merge pull request #18478 from trociny/wip-valgrid-trim-unittest
test/librbd: memory leak in recently added test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-23 06:51:58 -04:00
Kefu Chai
8622fdddf2 Merge pull request #15811 from x-ion-de/wip-20309
doc: Update manual deployment

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-23 18:42:46 +08:00
Mykola Golub
e68fb7409c test/librbd: memory leak in recently added test
Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-23 12:34:19 +03:00
Haomai Wang
0ce27b9f6b compressor: kill AsyncCompressor which is broken
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-10-23 16:55:23 +08:00
Haomai Wang
d105ce6708 osd/OpRequest: don't mark_event when disable tracker
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-10-23 13:54:07 +08:00
Haomai Wang
17a192ba5c common/TrackedOp: make tracking_enabled atomic without lock protect
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-10-23 13:19:06 +08:00
Patrick Donnelly
2f7ae0e160
Merge PR #18372 into master
* refs/pull/18372/head:
	ptl-tool: Fix more readme examples

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-22 20:26:16 -07:00
Jason Dillaman
251658471e librbd: default to sparse-reads for any IO operation over 64K
Testing BlueStore against both HDDs and OSDs with fully allocated
and sparse-allocated objects shows a performance improvement with
sparse-read between 32K and 64K.

Fixes: http://tracker.ceph.com/issues/21849
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-22 20:57:26 -04:00
Jason Dillaman
dd54520040 librbd: templatize io::CopyupRequest and io::ObjectRequest
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-22 20:57:26 -04:00
Jason Dillaman
a878eca9d8 librbd: sync flush should re-use existing async flush logic
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-22 20:38:39 -04:00
Kefu Chai
6a35e37eb9 Merge pull request #18368 from kungf/scrub_week_day_bound
osd: add scrub week day constraint

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-22 03:33:14 +08:00
Sage Weil
edc411ee4c crush/CrushWrapper: add bucket_set_alg()
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-21 12:59:16 -05:00
Sage Weil
7c387fd04a Merge pull request #18400 from dillaman/wip-21844
osdc/Objecter: skip sparse-read result decode if bufferlist is empty

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-21 12:46:57 -05:00
Sage Weil
b834df8823 Merge pull request #18418 from dillaman/wip-21860
common/common_init: disable ms subsystem log gathering for clients

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-21 12:46:14 -05:00