Commit Graph

69464 Commits

Author SHA1 Message Date
John Spray
050dc5cc03 common/lockdep: clearer log messages
Previously these were contextless "using id..." messages with
no indication of what subsystem the message came from.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 10:20:55 +00:00
John Spray
059a877f05 osdc/Journaler: add have_waiter()
Allows users of wait_for_readable to conveniently
see if there is already a waiter.  Yes, they could
do this themselves, but I'd rather peek at an existing
variable than add a new one caller-side.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 10:20:55 +00:00
John Spray
58ec1c6aeb osdc/Journaler: remove incorrect assertion
This asserted that flush_pos would be ahead of
safe_pos after calling _flush.  However, this
is not guaranteed to be the case because
prezeroing might prevent us from flushing
right now.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 10:20:54 +00:00
John Spray
e8c6e74f20 osdc/Journaler: assign a name for logging
Now that we have an MDLog journaler and a PurgeQueue journaler,
this is needed to avoid confusion.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 10:20:54 +00:00
John Spray
6f6ef708b0 compact_set: add #includes for dependencies
This was previously working by side effects, I happened
to include it somewhere that its dependencies weren't
already included.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 10:20:53 +00:00
Kefu Chai
f46b327bb0 Merge pull request #13397 from SUSE/doc-fix-qa-links
doc: update links to point to ceph/qa instead of ceph-qa-suite

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-08 18:19:40 +08:00
John Spray
8bd12b2c14 Merge pull request #13816 from batrick/i19201
mds: print rank as int

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-03-08 10:14:19 +00:00
John Spray
8f6324f1d5 Merge pull request #13830 from jcsp/wip-doc-multimds
doc: instructions and guidance for multimds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-03-08 10:13:49 +00:00
Abhishek Lekshmanan
2b1e009835 doc: Jewel 10.2.6 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-03-08 10:51:06 +01:00
Nathan Cutler
6a0ffa22ae doc: mention interactive task in developer guide
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-08 10:12:10 +01:00
Nathan Cutler
266fe30654 doc: rewrite Deploy a cluster for manual testing section
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-08 10:07:42 +01:00
Jan Fajerski
e0a00b3948 doc: update links to point to ceph/qa instead of ceph-qa-suite
Also fix two broken links to install task and two typos.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-03-08 10:07:41 +01:00
Nathan Cutler
799fd70ee3 Merge pull request #12506 from SUSE/wip-18259
Revert "dummy: reduce run time, run user.yaml playbook"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-03-08 09:33:46 +01:00
Sage Weil
39fdc53fe5 qa/suites/upgrade/jewel-x: do not thrash cluster full during upgrade
The mon command varies.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 22:35:02 -05:00
Sage Weil
582a19f1e0 qa/suite/rados/upgrade: do not thrash full cluster during upgrade
The mon command varies!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 22:34:37 -05:00
Sage Weil
a68106934c Merge pull request #13615 from liewegas/wip-osd-full
mon,osd: new mechanism for managing full and nearfull OSDs for luminous

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-03-07 21:33:14 -06:00
Sage Weil
7fbe8fb085 Merge pull request #13759 from liewegas/wip-19133
osdc/Objecter: resend RWORDERED ops on full

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-03-07 21:31:50 -06:00
Sage Weil
71db343636 Merge pull request #13734 from liewegas/wip-jewel-x
qa/suite/upgrade/jewel-x: various fixes

Reviewed-by: Yuri Weinstein <yweinstei@redhat.com>
2017-03-07 21:25:13 -06:00
Venky Shankar
5f0f14d376 rbd: refactor header import
and resuse validate_banner() helper routine where
ever necessary.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Venky Shankar
1ff1e65c15 rbd: concurrent v2 image IO during import/import-diff
Fixes: http://tracker.ceph.com/issues/19034
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Venky Shankar
53312af663 rbd: cleanup unused throttle in v2 import
v2 import does not use throttle as of now although v1
import does use it - initialize throttle wherever its
necessary and avoid passing it functions that do not
require it.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-03-08 08:32:57 +05:30
Yehuda Sadeh
1bb5ea860f Merge pull request #13846 from rzarzynski/wip-qa-rgw-start-apache-first
qa/tasks/rgw.py: start Apache before RadosGW.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 15:13:35 -08:00
Sage Weil
9ffdc20ddd os/bluestore: drop unused OpSequencer::wait_for_wal_on_seq()
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 18:10:56 -05:00
Sage Weil
bed114db0a os/bluestore: add bluestore_prefer_wal_size[_hdd,_ssd] options
Add option to prefer a WAL write if the write is below a size threshold,
even if we could avoid it.  This lets you trade some write-amp (by
journaling data to rocksdb) for latency in cases where the WAL device is
much faster than the main device.

This affects:

 - writes to new extents locations below min_alloc_size
 - writes to unallocated space below min_alloc_size
 - "big" writes above min_alloc_size that are below the prefer_wal_size
   threshold.

Note that it's applied to individual blobs, not the entirety of the write,
so if your have a larger write torn into two pieces/blobs that are below
the threshold then they will both go through the wal.

Set different defaults for HDD and SSD, since this makes more sense for HDD
where seeks are expensive.

Add some test cases to exercise the option.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 18:10:55 -05:00
Sage Weil
296708091c qa/tasks/ceph_manager: use new luminous set-full-ratio etc
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 16:39:09 -05:00
Yehuda Sadeh
e9228f3460 Merge pull request #13410 from yehudasa/wip-tracing-fix
tracing: don't include oid when tracing at dequeue_op()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-07 13:31:47 -08:00
Sage Weil
4272214136 Merge pull request #13839 from theanalyst/release/10.2.6/changelog
doc: add changelog for v10.2.6 Jewel release
2017-03-07 15:30:04 -06:00
Abhishek Lekshmanan
32e128c093 doc: add changelog for v10.2.6 Jewel release
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-03-07 21:44:23 +01:00
John Spray
92e7e890c3 Merge pull request #13704 from batrick/mds-counter-unify
mds: remove some redundant object counters

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-03-07 19:50:11 +00:00
Sage Weil
c4b73f19a7 osdc/Objecter: resend RWORDERED ops on full
Our condition for respecting the FULL flag is complex, and involves
the WRITE | RWORDERED flags vs the FULL_FORCE | FULL_TRY flags.  Previously,
we could block a read bc of RWORDRED but not resend it later.

Fix by capturing the complex condition in a respects_full() bool and using
it both for the blocking-on-send and resending-on-possibly-notfull-later
checks.

Fixes: http://tracker.ceph.com/issues/19133
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 13:33:44 -05:00
Sage Weil
a202b68d18 qa/tasks/thrashosds: chance_thrash_cluster_full
Induce a momentarily full cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-07 13:33:44 -05:00
Daniel Gryniewicz
0007adb5b7 Merge pull request #13832 from linuxbox2/wip-rgw-fs_inst
rgw_file:  fix fs_inst progression
2017-03-07 12:52:44 -05:00
Yuri Weinstein
05412184b5 Merge pull request #10240 from songbaisen/b2
mon: remove the redudant jugement in paxosservice is_writeable function

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 08:57:40 -08:00
Matt Benjamin
0e988edfb6 rgw_file: fix fs_inst progression
Reported by Gui Hecheng<guimark@126.com>.  This change is a
variation on proposed fix by Dan Gryniewicz<dang@redhat.com>
to take root_fh.state.dev as fs_inst for new handles.

Fixes: http://tracker.ceph.com/issues/19214

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-03-07 11:43:39 -05:00
Radoslaw Zarzynski
6440750f53 qa/tasks/rgw.py: start Apache before RadosGW.
At the end of start_rgw() we wait till establishing HTTP connections
with RadosGW become possible. However, if RadosGW uses the FastCGI,
the condition can't be fulfilled without spawning HTTP server first.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-03-07 17:31:52 +01:00
Mykola Golub
fe31bca22f librbd: relax "is parent mirrored" check when enabling mirroring for pool
If the parent is in the same pool and has the journaling feature enabled
we can assume the mirroring will eventually be enabled for it.

Fixes: http://tracker.ceph.com/issues/19130
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-03-07 17:16:09 +01:00
Sage Weil
3f5269d8b5 Merge pull request #13323 from yehudasa/wip-18079-2
librados: use cursor for nobjects listing

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-07 08:41:08 -06:00
John Spray
73100305e5 Merge pull request #13262 from batrick/multimds-thrasher
Add multimds:thrash sub-suite and fix bugs in thrasher for multimds

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-07 14:29:18 +00:00
John Spray
76589ed9e1 doc: instructions and guidance for multimds
Inspired by http://tracker.ceph.com/issues/19135

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-07 14:08:22 +00:00
Kefu Chai
cec7e1a0db Merge pull request #13560 from wjwithagen/wip-wjw-ceph-disk-tests
ceph-disk/tests: Certain partition types do not work on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 15:37:18 +08:00
Haomai Wang
d124e6f669 Merge pull request #13810 from yuyuyu101/wip-rdma-inflight
msg/async/rdma: destroy QueuePair if needed

Reviewed-by: Adir lev <adirl@mellanox.com>
2017-03-07 15:25:55 +08:00
Kefu Chai
a07452d9d0 Merge pull request #13742 from liupan1111/wip-cleanup-journal
os/filestore: use existing variable for same func.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:24:50 +08:00
Kefu Chai
17ae338be3 Merge pull request #12177 from kylinstorage/wip-remove-unneeded-loop
os/filestore/FileStore.cc: remove unneeded loop

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:21:32 +08:00
Kefu Chai
413efbc60f Merge pull request #13741 from rzarzynski/wip-bs-fastcrc32-in-rocks
os/bluestore: enable SSE-assisted CRC32 calculations in RocksDB

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:06:22 +08:00
Kefu Chai
bdc22afd9b Merge pull request #13768 from tchaikov/wip-clang-fixes
librados, osd: clang fixes

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-07 12:05:36 +08:00
Kefu Chai
895561376c Merge pull request #13794 from liewegas/wip-clog-newlines
common: remove \n on clog messages

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-07 12:04:52 +08:00
Kefu Chai
d8bea23c5d Merge pull request #13796 from liewegas/wip-debian-base-dbg
debian/control: add ceph-base-dbg

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-07 12:04:25 +08:00
Sage Weil
3c80e15c3b qa/suites/upgrade/jewel-x/parallel: upgrade mons before osds
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 22:02:19 -05:00
Sage Weil
1a0ad2b488 qa/suites/upgrade/jewel-x/parallel: expand workload matrix
These should run independently against a racing upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-06 22:02:19 -05:00
Haomai Wang
53b4cece12 Merge pull request #13799 from optimistyzy/36_1
bluestore, NVMEDEVICE: Specify the max io completion in conf

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-03-07 09:48:28 +08:00