Commit Graph

53589 Commits

Author SHA1 Message Date
Piotr Dałek
3e80f8d74a msg/async: Implement smarter worker thread selection
This changeset makes AsyncMessenger a bit smarter when it comes
to assigning worker threads to AsyncConnections. Each time a worker
is assigned, its reference count is increased. Next time when Async
Messenger needs to assign another worker to new AsyncConnection, it
picks the one with the lowest reference count. If it cannot find an
idle one, and number of currently instantiated workers is less than
specified with "ms async op max threads", the new worker is created
and returned.
Once AsyncConnection goes away, the reference count on assigned
worker is decreased.
This does not prevent, but greatly reduces chances of having a single
async worker thread doing most (or even all) of the ops, and also
removes the need to manually tune the "ms async op threads" option.

Signed-off-by: Piotr Dałek <git@predictor.org.pl>
2016-05-15 21:42:32 +02:00
Shinobu Kinjo
3c47e48aa2 src/cls/rbd/cls_rbd.cc: fix super trivial typo 2016-05-15 18:01:25 +09:00
Michal Jarzabek
974d610fe4 CompatSet.h: remove unneeded #include<vector>
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-15 09:40:24 +01:00
Michal Jarzabek
aa3c3f6645 CompatSet.h: Remove unneeded constuctor
We have a constuctor taking a std::string so there is no need for
the constuctor taking char*.

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-15 07:27:21 +01:00
Mykola Golub
4381e341c4 doc: update mirroring guide to include pool/image status commands
Fixes: http://tracker.ceph.com/issues/15746
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-05-14 20:06:46 +03:00
Michal Jarzabek
d9bd6654f2 osd/OSD: pass op() params by const in PGQueueable
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-14 16:57:45 +01:00
Sage Weil
306c5e148c os/bluestore: persist alloc hint flags
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:39:23 -04:00
Sage Weil
5a233e5a9f os/kstore: persist alloc hint flags
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:39:23 -04:00
Sage Weil
0128adaa85 osd/ECTransaction: set SEQUENTIAL_WRITE | APPEND_ONLY on ec appends
EC objects are written sequentially and not modified.

Note: we could probably hint about write sizes here,
too...

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:20:00 -04:00
Sage Weil
c7b6e45670 osd: support new alloc_hint flags
Pass these through to the ObjectStore.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:20:00 -04:00
Sage Weil
018c8bcc25 librados: add set_alloc_hint2 with flags
Flags indicate expected future access pattern so the
OSD can behave accordingly.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:18:49 -04:00
Sage Weil
d179dd449c rados: define alloc hint flags
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-14 09:18:09 -04:00
Loic Dachary
62bd3fae3f Merge pull request #8767 from jjhuo/org_jianjian
.mailmap and .orgmap: organization affiliation

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-05-14 09:16:37 +02:00
Michal Jarzabek
b49b8d4ec3 osd/OSD.h: move some data members under private
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-13 22:10:16 +01:00
Jason Dillaman
cd729526e9 Merge pull request #9123 from idryomov/wip-qa-rbd-dont-chown
qa: rbd: don't modprobe, chown sysfs files or udevadm settle

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-05-13 15:52:01 -04:00
Ilya Dryomov
6643f4d972 qa: rbd/simple_big.sh: drop extraneous sudo
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-05-13 17:57:12 +02:00
Ilya Dryomov
a7d4189587 qa: rbd/concurrent.sh: suppress rbd map output
rbd_map_image() echoes the id of the image and is used in command
substitution:

    id=$(rbd_map_image "${image}")

Output from rbd map isn't consumed and clobbers the return.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-05-13 17:51:45 +02:00
Ilya Dryomov
6bddef8ecf qa: rbd: don't modprobe, chown sysfs files or udevadm settle
This is a followup to 38a572011d ("qa: rbd/map-snapshot-io.sh: don't
chown sysfs files") for the rest of the workunits:

- /sys/bus/rbd/add_single_major is used if present, so chown'ing
  /sys/bus/rbd/add doesn't help.  Use sudo on rbd map instead.

- Don't modprobe or udevadm settle - rbd CLI tool takes care of that.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-05-13 17:51:45 +02:00
Sage Weil
39402c0801 os: remove collection attr methods
These have been deprecated since hammer, and were only kept so that you
could do an offline upgrade from firefly.  Bye bye!

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-13 11:06:30 -04:00
Sage Weil
a3d08e28ed osd/PG: drop pre-jewel pg attr method
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-13 11:06:30 -04:00
Sage Weil
ab42bc5925 Merge pull request #9070 from liewegas/doc-ct
doc: words of caution about cache tiering

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Nick Fisk <nick@fisk.me.uk>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-05-13 11:00:00 -04:00
Sage Weil
7488c917af doc/rados: adjust example cache tiering settings
These are saner values.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-13 10:58:50 -04:00
Sage Weil
fcd1d097b1 doc/rados: words of caution about cache tiering
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-13 10:58:50 -04:00
Orit Wasserman
8454ff1a91 rgw: fix realm pull and period pull for apache frontend
add missing content-type and content-length headers

Fixes: http://tracker.ceph.com/issues/15846

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-05-13 16:05:55 +02:00
Sage Weil
f5e9d8e610 Merge pull request #9110 from stiopaa1/osd_moveTickClasses
osd: move tick classes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-13 09:35:46 -04:00
John Spray
a4e440eb44 Merge pull request #8887 from jcsp/wip-15689
osdc: send error to recovery waiters on shutdown

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2016-05-13 08:25:01 -05:00
John Spray
ae2346579f Merge pull request #8835 from xiaoxichen/implement_fsync_in_pybind
pybind: expose fsync in cephfs binding.

Reviewed-by: John Spray <john.spray@redhat.com>
2016-05-13 08:17:05 -05:00
David Disseldorp
1e5f233d9b librados: use caller provided snapid for aio_sparse_read()
...instead of the value set via set_snap_read(). This makes
aio_sparse_read() consistent with aio_read(), which also accepts a
snapid parameter.

Signed-off-by: David Disseldorp <ddiss@suse.de>
2016-05-13 11:30:22 +02:00
runsisi
3494a2ac66 osd/ReplicatedBackend: reuse the already computed cost
no need to compute the cost a second time

Signed-off-by: runsisi <runsisi@zte.com.cn>
2016-05-13 16:51:06 +08:00
Samuel Just
b224912d24 Pipe: take a ref to existing while we are waiting
Otherwise, if it is reaped while we are waiting, it'll be a
use-after-free.

Fixes: http://tracker.ceph.com/issues/15870
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-05-12 17:02:42 -07:00
Michal Jarzabek
ef3ea0150b osd/OSD.cc: add override to virtual functions
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-12 21:13:45 +01:00
Michal Jarzabek
2af377925a osd/OSD: move C_Tick and C_Tick_WithoutOSDLock
Since above classes are implementation detail of OSD class move them
to the .cc file.

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-05-12 21:13:38 +01:00
Casey Bodley
5db5c9f8be rgw: RGWZoneGroup::add_zone rejects duplicate zone names
Fixes: http://tracker.ceph.com/issues/15613

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-05-12 15:24:06 -04:00
Casey Bodley
6c05cd3b27 radosgw-admin: 'zone create' doesn't need to load RGWRealm
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-05-12 15:24:06 -04:00
Sage Weil
c347087e0a Merge pull request #9079 from liewegas/wip-bluestore-freelist
os/bluestore: switch to bitmap freelist by default

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-05-12 13:56:30 -04:00
Sage Weil
7d8fb8a050 Merge pull request #8956 from shinobu-x/wip-shinobu
os/bluestore: fix permissions on StupidAllocator.cc, cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-12 13:56:03 -04:00
Yehuda Sadeh
16c0605bf2 rgw: don't unregister request if request is not connected to manager
That means that request is already complete and done with the manager.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-05-12 09:14:40 -07:00
Kefu Chai
9eee5eba6d Merge pull request #9074 from tchaikov/wip-cmake-manpages
cmake: build man pages

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-05-12 22:14:18 +08:00
Abhishek Lekshmanan
4c849a34d7 rgw_rados: remove unused ioctx for domain root in create_bucket
In `create_bucket`, we open an ioctx for domain root pool and never use
it later, removing this.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-05-12 16:09:23 +02:00
Sage Weil
18d2bb9bc2 osd/OSDMap: fix clean_temps and test
For both pg_temp and primary_temp, we want to calculate what the
mapping *will* be after the inc is applied, and if the mapping is
redundant (it matches what we would have gotten anyway), remove
it.  Removing the mapping might mean putting a 'remove' entry in
the inc, or it might mean removing the proposed addition in the
inc.

Update the unit test to test both cases.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:30 -04:00
Sage Weil
1a255b9252 osd/OSDMap: consolidate into clean_temps
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:30 -04:00
Sage Weil
94f414a684 osd/OSDMap: move primary_temp checks to check_down_temps
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:30 -04:00
Sage Weil
bf9a9e241a osd/OSDMap: move redundant pg_temp check to remove_down_temps
Better to do this on the future map value.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:30 -04:00
Sage Weil
eeeec9772b osd/OSDMap: move old pool check to remove_down_temps
Better to do this on the projected map state.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:29 -04:00
Sage Weil
ddcf1a9a33 osd/OSDMap: minor optimization of remove_down_temps
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-12 09:59:29 -04:00
Mykola Golub
ddd6345f8f doc: fixup: "rbd-mirror daemon" instead of "rbd-daemon"
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-05-12 11:11:55 +03:00
Mykola Golub
8a71a79d24 qa: dynamic_features.sh: return error only if it failed on alive QEMU
Fixes: #15500
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-05-12 09:22:11 +03:00
Kefu Chai
31a0e0c4d8 cmake: restructure and add missing manpages
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-12 13:47:49 +08:00
Kefu Chai
ef6b52373c cmake: build man pages
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-12 13:01:52 +08:00
Jason Dillaman
82af391cea Merge pull request #9024 from trociny/fixup-rbd-mirror-asok
rbd-mirror: don't unregister asok commands if image replayer start failed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-05-11 17:13:11 -04:00