Commit Graph

69450 Commits

Author SHA1 Message Date
John Spray
8f6324f1d5 Merge pull request #13830 from jcsp/wip-doc-multimds
doc: instructions and guidance for multimds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-03-08 10:13:49 +00:00
Abhishek Lekshmanan
2b1e009835 doc: Jewel 10.2.6 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-03-08 10:51:06 +01:00
Nathan Cutler
6a0ffa22ae doc: mention interactive task in developer guide
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-08 10:12:10 +01:00
Nathan Cutler
266fe30654 doc: rewrite Deploy a cluster for manual testing section
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-08 10:07:42 +01:00
Jan Fajerski
e0a00b3948 doc: update links to point to ceph/qa instead of ceph-qa-suite
Also fix two broken links to install task and two typos.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-03-08 10:07:41 +01:00
Nathan Cutler
799fd70ee3 Merge pull request #12506 from SUSE/wip-18259
Revert "dummy: reduce run time, run user.yaml playbook"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-03-08 09:33:46 +01:00
Sage Weil
a68106934c Merge pull request #13615 from liewegas/wip-osd-full
mon,osd: new mechanism for managing full and nearfull OSDs for luminous

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-03-07 21:33:14 -06:00
Sage Weil
7fbe8fb085 Merge pull request #13759 from liewegas/wip-19133
osdc/Objecter: resend RWORDERED ops on full

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-03-07 21:31:50 -06:00
Sage Weil
71db343636 Merge pull request #13734 from liewegas/wip-jewel-x
qa/suite/upgrade/jewel-x: various fixes

Reviewed-by: Yuri Weinstein <yweinstei@redhat.com>
2017-03-07 21:25:13 -06:00
Venky Shankar
5f0f14d376 rbd: refactor header import
and resuse validate_banner() helper routine where
ever necessary.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Venky Shankar
1ff1e65c15 rbd: concurrent v2 image IO during import/import-diff
Fixes: http://tracker.ceph.com/issues/19034
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Venky Shankar
53312af663 rbd: cleanup unused throttle in v2 import
v2 import does not use throttle as of now although v1
import does use it - initialize throttle wherever its
necessary and avoid passing it functions that do not
require it.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Yehuda Sadeh
1bb5ea860f Merge pull request #13846 from rzarzynski/wip-qa-rgw-start-apache-first
qa/tasks/rgw.py: start Apache before RadosGW.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 15:13:35 -08:00
Sage Weil
296708091c qa/tasks/ceph_manager: use new luminous set-full-ratio etc
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 16:39:09 -05:00
Yehuda Sadeh
e9228f3460 Merge pull request #13410 from yehudasa/wip-tracing-fix
tracing: don't include oid when tracing at dequeue_op()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-07 13:31:47 -08:00
Sage Weil
4272214136 Merge pull request #13839 from theanalyst/release/10.2.6/changelog
doc: add changelog for v10.2.6 Jewel release
2017-03-07 15:30:04 -06:00
Abhishek Lekshmanan
32e128c093 doc: add changelog for v10.2.6 Jewel release
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-03-07 21:44:23 +01:00
John Spray
92e7e890c3 Merge pull request #13704 from batrick/mds-counter-unify
mds: remove some redundant object counters

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-03-07 19:50:11 +00:00
Sage Weil
c4b73f19a7 osdc/Objecter: resend RWORDERED ops on full
Our condition for respecting the FULL flag is complex, and involves
the WRITE | RWORDERED flags vs the FULL_FORCE | FULL_TRY flags.  Previously,
we could block a read bc of RWORDRED but not resend it later.

Fix by capturing the complex condition in a respects_full() bool and using
it both for the blocking-on-send and resending-on-possibly-notfull-later
checks.

Fixes: http://tracker.ceph.com/issues/19133
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 13:33:44 -05:00
Sage Weil
a202b68d18 qa/tasks/thrashosds: chance_thrash_cluster_full
Induce a momentarily full cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 13:33:44 -05:00
Daniel Gryniewicz
0007adb5b7 Merge pull request #13832 from linuxbox2/wip-rgw-fs_inst
rgw_file:  fix fs_inst progression
2017-03-07 12:52:44 -05:00
Yuri Weinstein
05412184b5 Merge pull request #10240 from songbaisen/b2
mon: remove the redudant jugement in paxosservice is_writeable function

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 08:57:40 -08:00
Matt Benjamin
0e988edfb6 rgw_file: fix fs_inst progression
Reported by Gui Hecheng<guimark@126.com>.  This change is a
variation on proposed fix by Dan Gryniewicz<dang@redhat.com>
to take root_fh.state.dev as fs_inst for new handles.

Fixes: http://tracker.ceph.com/issues/19214

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-03-07 11:43:39 -05:00
Radoslaw Zarzynski
6440750f53 qa/tasks/rgw.py: start Apache before RadosGW.
At the end of start_rgw() we wait till establishing HTTP connections
with RadosGW become possible. However, if RadosGW uses the FastCGI,
the condition can't be fulfilled without spawning HTTP server first.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-03-07 17:31:52 +01:00
Mykola Golub
fe31bca22f librbd: relax "is parent mirrored" check when enabling mirroring for pool
If the parent is in the same pool and has the journaling feature enabled
we can assume the mirroring will eventually be enabled for it.

Fixes: http://tracker.ceph.com/issues/19130
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-03-07 17:16:09 +01:00
Sage Weil
3f5269d8b5 Merge pull request #13323 from yehudasa/wip-18079-2
librados: use cursor for nobjects listing

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-07 08:41:08 -06:00
John Spray
73100305e5 Merge pull request #13262 from batrick/multimds-thrasher
Add multimds:thrash sub-suite and fix bugs in thrasher for multimds

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-07 14:29:18 +00:00
John Spray
76589ed9e1 doc: instructions and guidance for multimds
Inspired by http://tracker.ceph.com/issues/19135

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-07 14:08:22 +00:00
Kefu Chai
cec7e1a0db Merge pull request #13560 from wjwithagen/wip-wjw-ceph-disk-tests
ceph-disk/tests: Certain partition types do not work on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 15:37:18 +08:00
Haomai Wang
d124e6f669 Merge pull request #13810 from yuyuyu101/wip-rdma-inflight
msg/async/rdma: destroy QueuePair if needed

Reviewed-by: Adir lev <adirl@mellanox.com>
2017-03-07 15:25:55 +08:00
Kefu Chai
a07452d9d0 Merge pull request #13742 from liupan1111/wip-cleanup-journal
os/filestore: use existing variable for same func.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:24:50 +08:00
Kefu Chai
17ae338be3 Merge pull request #12177 from kylinstorage/wip-remove-unneeded-loop
os/filestore/FileStore.cc: remove unneeded loop

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:21:32 +08:00
Kefu Chai
413efbc60f Merge pull request #13741 from rzarzynski/wip-bs-fastcrc32-in-rocks
os/bluestore: enable SSE-assisted CRC32 calculations in RocksDB

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:06:22 +08:00
Kefu Chai
bdc22afd9b Merge pull request #13768 from tchaikov/wip-clang-fixes
librados, osd: clang fixes

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-07 12:05:36 +08:00
Kefu Chai
895561376c Merge pull request #13794 from liewegas/wip-clog-newlines
common: remove \n on clog messages

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-07 12:04:52 +08:00
Kefu Chai
d8bea23c5d Merge pull request #13796 from liewegas/wip-debian-base-dbg
debian/control: add ceph-base-dbg

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:04:25 +08:00
Sage Weil
3c80e15c3b qa/suites/upgrade/jewel-x/parallel: upgrade mons before osds
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 22:02:19 -05:00
Sage Weil
1a0ad2b488 qa/suites/upgrade/jewel-x/parallel: expand workload matrix
These should run independently against a racing upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 22:02:19 -05:00
Haomai Wang
53b4cece12 Merge pull request #13799 from optimistyzy/36_1
bluestore, NVMEDEVICE: Specify the max io completion in conf

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-03-07 09:48:28 +08:00
Jason Dillaman
91ae4cd794 Merge pull request #13806 from vshankar/rbd-internal-api-move
test/librbd: move tests using non-public api to internal

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-06 20:45:48 -05:00
runsisi
709d94ab76 librbd: rados callback cleanup
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-03-07 08:35:27 +08:00
Sage Weil
699df7d2b5 test/cli/osdmaptool: fix osdmap output
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:23 -05:00
Sage Weil
d795c3c457 mon/OSDMonitor: generate health warnings for luminous
Note that this tells us how many OSDs are full or nearfull; it
does not include detailed warnings telling you exactly what the
utilization is because we don't have the full osd_stat_t
available.  We leave it to ceph-mgr to generate those health
messages.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:22 -05:00
Sage Weil
8bab735909 mon/PGMonitor: stop generating health warnings with luminous
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:22 -05:00
Sage Weil
707e43d5ae mon/OSDMonitor: set cluster flags based on osd flags (luminous)
For luminous, set cluster flags based on osd flags.  Until
require_luminous is set, stick with the old pgmap-based behavior.
Move the new check to encode_pending so that the cluster flag is
set in the same epoch that the osd state(s) change.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:22 -05:00
Sage Weil
00a8bfa554 osd: request a fullness state change during tick if needed
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:22 -05:00
Sage Weil
53c1868f36 osd: require fullness state changes (as needed) before boot
This ensures that we don't have a down osd that is marked full
go up, then realize it's not actually full, and then clear its
full flag.  That would result in a cluster full blip that isn't
needed. This can easily happen if the full_ratio in the osdmap is
increased while the OSD is down.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:22 -05:00
Sage Weil
9f0bc152ab osd: restructure and simplify internal fullness checks
First, eliminate the useless nearfull failsafe--all it did was
generate a log message, which we can do based on the OSDMap
states.

Add some new helpers.

Unify the cluster nearfull/full vs failsafe states so that
failsafe is a "really" full state that is more severe than
full, so we have NONE, NEARFULL, FULL, FAILSAFE.

Pull the full/nearfull ratios out of the OSDMap (remember that
we require luminous mons, so these will be initialized).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 17:21:21 -05:00
Sage Weil
394e45ad81 mon/PGMonitor: disable old 'pg set_[near]full_ratio ...' in luminous
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 16:42:34 -05:00
Sage Weil
03287f7d22 qa/workunits/cephtool/test.sh: change [near]full_ratio tests
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 16:42:34 -05:00