Samuel Just
2ed7759cfe
PrimaryLogPG: reimplement osd_snap_trim_sleep within the state machine
...
Rather than blocking the main op queue, just pause for that amount of
time between state machine cycles.
Also, add osd_snap_trim_sleep to a few of the thrasher yamls.
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-20 21:24:33 -08:00
Samuel Just
4aebf59d90
rados: check that pool is done trimming before removing it
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-13 09:47:02 -08:00
Samuel Just
c2eac34c86
osd/: add PG_STATE_SNAPTRIM[_WAIT] to expose snap trim state to user
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-13 09:47:02 -08:00
Samuel Just
21cc515adf
osd/PrimaryLogPG: limit the number of concurrently trimming pgs
...
This patch introduces an AsyncReserver for snap trimming to limit the
number of pgs on any single OSD which can be trimming, as with backfill.
Unlike backfill, we don't take remote reservations on the assumption
that the set of pgs with trimming work to do is already well
distributed, so it doesn't seem worth the implementation overhead to get
reservations from the peers as well.
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-13 09:47:01 -08:00
Yuri Weinstein
df2e1fd84e
Merge pull request #13017 from chuanhong-wang/dev_add_perfcount_for_backoff_throttle
...
osd: adding PerfCounters for backoff throttle
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-02-13 09:02:40 -08:00
Yuri Weinstein
db4d4feb2c
Merge pull request #13274 from ifed01/wip-bluestore-perf-counters
...
os/bluestore: add more perf_counters to BlueStore
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-13 09:01:21 -08:00
Sage Weil
316dc98788
Merge pull request #13321 from liewegas/wip-kill-sortbitwise-harder
...
osd: kill sortbitwise
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-02-13 10:43:56 -06:00
Matt Benjamin
24f43e9f51
Merge pull request #13303 from Jing-Scott/fix-swift-cannot-disable-object-versioning
...
rgw: fix swift cannot disable object versioning
@Jing-Scott updated, addressing @rzarzynski's change request
2017-02-13 10:58:04 -05:00
Kefu Chai
1383652b93
Merge pull request #13393 from ddiss/fix_rgw_fcgi_include
...
rgw: set FCGI_INCLUDE_DIR for cephd_rgw_base
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-13 23:28:03 +08:00
Sage Weil
3ea49b2422
Merge pull request #13382 from xiexingguo/wip-counter-name
...
os/bluestore: fix wal-queue bytes-counter to keep pace with others
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-13 08:25:51 -06:00
David Disseldorp
3e55db45f9
rgw: set FCGI_INCLUDE_DIR for cephd_rgw_base
...
cephd_rgw_base build currently fails with fastcgi enabled:
--
In file included from /home/david/ceph/src/rgw/rgw_request.h:13:0,
from /home/david/ceph/src/rgw/rgw_main.cc:53:
/home/david/ceph/src/rgw/rgw_fcgi.h:8:21: fatal error: fcgiapp.h:
No such file or directory
^
--
This is despite the fact that fastcgi was detected and located at
configure time:
build/CMakeCache.txt:FCGI_INCLUDE_DIR:PATH=/usr/include/fastcgi
Fix this by ensuring that the cephd_rgw_base build target correctly uses
FCGI_INCLUDE_DIR.
Fixes: http://tracker.ceph.com/issues/18918
Signed-off-by: David Disseldorp <ddiss@suse.de>
2017-02-13 15:03:42 +01:00
Haomai Wang
d914f0f8a6
Merge pull request #13392 from Adirl/zero_inline
...
msg/async/rdma: zero wqe inline
Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-02-13 21:57:19 +08:00
Adir Lev
442e22e24f
msg/async/rdma: zero wqe inline
...
we dont use wqe inline
issue: none
Change-Id: Ib187eec3bc79f8caf040fbbfbf0a915186cd58ba
Signed-off-by: Adir Lev <adirl@mellanox.com>
2017-02-13 13:36:46 +00:00
Jing Wenjun
17c5a0edd2
rgw: fix swift cannot disable object versioning
...
we should be able to disable object verioning by removing its X-Versions-Location
metadata header by sending an empty key value. this description can be found at
No.8 in http://docs.openstack.org/user-guide/cli-swift-set-object-versions.html .
Fixes: http://tracker.ceph.com/issues/18852
Signed-off-by: Jing Wenjun <jingwenjun@cmss.chinamobile.com>
2017-02-13 21:13:05 +08:00
Kefu Chai
877c938937
Merge pull request #13380 from tchaikov/wip-sepia-bt
...
script/sepia_bt.sh: no need to pass version and sha1 anymore
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-02-13 20:48:17 +08:00
Nathan Cutler
6394d2fd6c
Merge pull request #13368 from smithfarm/wip-doc-dev
...
doc: instructions for provisioning OpenStack VMs ad hoc
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-02-13 12:39:59 +01:00
Kefu Chai
148d48812c
Merge pull request #13367 from tchaikov/wip-qa-jewel-x-singleton
...
test: Thrasher: update pgp_num of all expanded pools if not yet
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-13 14:54:27 +08:00
Kefu Chai
dbb6195662
script/sepia_bt.sh: no need to pass version and sha1 anymore
...
* try to figure out the working directory from the core dump's path
* add -C directory option, so user is able to specify the directory
for the downloaded packages, and extracted files.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-13 14:33:18 +08:00
xie xingguo
f50990d544
os/bluestore: fix wal-queue bytes-counter to keep pace with others
...
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-02-13 14:09:45 +08:00
Kefu Chai
de59b5102c
test: Thrasher: restore changed options after done with thrash
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-13 09:25:51 +08:00
Kefu Chai
761a1dc391
tests: Thrasher: extract _set_config() method
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-13 09:25:50 +08:00
Kefu Chai
995e144e3e
tests: CephManager: add get_config() method
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-13 09:25:50 +08:00
Kefu Chai
136483a8f9
test: Thrasher: update pgp_num of all expanded pools if not yet
...
otherwise wait_until_healthy will fail after timeout as seeing warning
like:
HEALTH_WARN pool cephfs_data pg_num 182 > pgp_num 172
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-13 09:25:50 +08:00
Yuri Weinstein
05f1a1987e
Merge pull request #13378 from liewegas/wip-luminous
...
qa/rados/upgrade/jewel-x-singleton: run luminous.yaml at the end
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-02-12 08:13:26 -08:00
Sage Weil
5f6384db76
Merge pull request #13365 from xiexingguo/wip-backoff-refleak
...
osdc/Objecter: fix possible OSDSession leak on wrong connection
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-12 08:50:38 -06:00
Sage Weil
cfccde7aaf
Merge pull request #13363 from jdurgin/wip-req-luminous-error
...
osd: clarify REQUIRE_LUMINOUS error message
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-12 08:49:57 -06:00
Sage Weil
6e998b2f8c
qa/rados/upgrade/jewel-x-singleton: run luminous.yaml at the end
...
renumber too
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-12 09:47:41 -05:00
Nathan Cutler
63100b4f9b
doc: instructions for provisioning OpenStack VMs ad hoc
...
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-02-11 18:57:33 +01:00
Sage Weil
784c7edb4e
osd/PrimaryLogPG: unconditionally set PGNLS next to hobject
...
Drop nibblewise workaround.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:17 -05:00
Sage Weil
75d7a5c85f
osd/PG: drop get_sort_bitwise() accessors, flag
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:17 -05:00
Sage Weil
b02439ff1c
osd/PG: always bitwise
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
d55cd22150
osd/PG: drop bitwise arg to MissingLoc::rebuild()
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
c5f880443d
osd/osd_types: make set_last_backfill() assume bitwise
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
32acb10bd0
osd: BackfillInterval is always bitwise
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
10aab91f5e
osd: fix add_source_info
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
ad4365b735
osd: fix write_blocked_by_scrub
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
b052e497a5
osd/osd_types: drop bitwise from ScrubMap
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
1699bf7b71
common/hobject: eliminate wonky compartors
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
43244da571
common/hobject: remove cmp_* comparators; add normal operators
...
Fix up callers.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
e8c55fe157
os: remove nibblewise sort order support
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Sage Weil
ea8b17035e
osd: shutdown if sortbitwise flag is ever cleared
...
Note we do this only in activate_map so that we can (while booting)
skip past maps that don't have it set.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-11 10:45:16 -05:00
Ilya Dryomov
eb8d3372e8
Merge pull request #13369 from idryomov/wip-doc-kernel-vers
...
doc: kernel client os-recommendations update
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-02-11 16:01:02 +01:00
Jason Dillaman
e95fe0dfad
Merge pull request #13229 from trociny/wip-18335
...
rbd-nbd: check /sys/block/nbdX/size to ensure kernel mapped correctly
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-02-11 09:29:23 -05:00
Kefu Chai
54354e597e
Merge pull request #13292 from tchaikov/wip-script-sepia-bt-support-xenial
...
script/sepia_bt.sh: support xenial
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-02-11 12:22:34 +08:00
xie xingguo
ad304a7d8e
osdc/Objecter: fix possible OSDSession leak on wrong connection
...
This is introduced by the newly added backoff logic.
Not sure if it will really happen, but just in case.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-02-11 11:01:15 +08:00
Sage Weil
d4db8e04dd
Merge pull request #12342 from liewegas/wip-backoff
...
osd,osdc: pg and osd-based backoff
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-10 19:47:49 -06:00
Sage Weil
46ade145a8
doc/dev/rados-client-protocol: describe some of rados protocol, including backoffs
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-10 18:55:59 -05:00
Sage Weil
105e9d4234
qa/suites/rados/thrash: vary backoff settings
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-10 18:55:58 -05:00
Sage Weil
1d1e990b7b
osd/PrimaryLogPG: backoffs on individual objects
...
Do these midway down do_op. Reorder the scrub waitlist after the
degraded and unreadable waitlists.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-10 18:55:58 -05:00
Sage Weil
b8e1c05ed9
osdc/Objecter: respect backoffs
...
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-10 18:55:58 -05:00