Commit Graph

70809 Commits

Author SHA1 Message Date
John Spray
f61c0ff395 Merge pull request #14505 from jcsp/wip-19566
mds: fix mgrc shutdown

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-04-14 10:49:20 +01:00
John Spray
517dbfdfa4 Merge pull request #14398 from jcsp/wip-19551
mon: emit cluster log messages on MDS health changes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-04-14 10:48:25 +01:00
John Spray
131d1bd570 qa: add log whitelists for MDS health messages
Now that we send these to the cluster log, we must
whitelist them in the tests that exercise those
unhealthy states.

Fixes: http://tracker.ceph.com/issues/19551
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-14 05:47:43 -04:00
Kefu Chai
125f27e3e8 Merge pull request #10851 from atheism/rgw-s3-doc-update
doc/radosgw/s3/cpp.rst: update usage of libs3 APIs to make the examples work

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-14 10:18:10 +08:00
Brad Hubbard
7aa5792d19 Merge pull request #14469 from badone/wip-return-error-on-missing-client-id
mds: Return error message instead of asserting

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-14 08:10:59 +10:00
Loic Dachary
6e20d648e9 Merge pull request #14508 from smithfarm/wip-doc-dev
doc: dev guide: how to run s3-tests locally against vstart

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-13 20:54:46 +02:00
Sage Weil
9967fceb62 Merge pull request #14420 from optimistyzy/329
os/bluestore/NVMEDevice: Add multiple thread support for SPDK I/O thread

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-13 12:34:51 -05:00
Nathan Cutler
0dd2dfce1d doc: dev guide: how to run s3-tests locally against vstart
Add a bunch of verbiage to the Developer Guide

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-04-13 19:14:52 +02:00
Matt Benjamin
9a5cdf3b48 Merge pull request #14458 from linuxbox2/wip-rgw_file-readahead
rgw_file: support readdir cb type hints (plus fixes)
2017-04-13 13:12:27 -04:00
John Spray
ccd6c81742 Merge pull request #13966 from jcsp/wip-client-logmsg
client: specify inode in get_caps log message

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-04-13 17:43:10 +01:00
John Spray
e1b4327d67 Merge pull request #14087 from jcsp/wip-doc-fscid
doc: how to specify filesystem for cephfs clients

 Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-13 17:42:13 +01:00
Matt Benjamin
007b7451c2 rgw_file: don't expire directories being read
If a readdir expire event turns out to be older than last_readdir,
just reschedule it (but actually, we should just discard it, as
another expire event must be in queue.

Fixes: http://tracker.ceph.com/issues/19625

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-13 11:30:31 -04:00
John Spray
01f79a748b mon: emit cluster log messages on MDS health changes
Previously, when we got a beacon that updated the health
metrics for an MDS, the user would just see mysterious-looking
cluster log messages indicating a rising fsmap epoch number.

It would be good to do this for health messages in general at
some point, but for now just do it for the MDS ones.

Fixes: http://tracker.ceph.com/issues/19551
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-13 11:06:13 -04:00
John Spray
fc28d29c0c mds: fix mgrc shutdown
Were previously only tearing MgrClient down when not
holding a rank, leading to it trying to continue
to run after monclient was shut down.

Fixes: http://tracker.ceph.com/issues/19566
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-13 11:00:46 -04:00
Matt Benjamin
e0191d74e3 rgw_file: chunked readdir
Adjust readdir callback path for new nfs-ganesha chunked readdir,
including changes to respect the result of callback to not
continue.

Pending introduction of offset name hint, our caller will just be
completely enumerating, so it is possible to remove the offset map
and just keep a last offset.

Fixes: http://tracker.ceph.com/issues/19624

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-13 10:58:22 -04:00
Matt Benjamin
2e66c7a7cc rgw_file: introduce rgw_lookup type hints
The new type hints optimize object type deduction, when the
rgw_lookup is called from an rgw_readdir callback.

Fixes: http://tracker.ceph.com/issues/19623

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-13 10:35:37 -04:00
Kefu Chai
8442cbb521 Merge pull request #14468 from tchaikov/wip-show-me-fake-plugin
qa/workunits/ceph-helpers: display rejected string

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-13 22:24:03 +08:00
John Spray
b81e4b70a4 Merge pull request #14234 from jcsp/wip-19406-dirhash
tools/cephfs: set dir_layout when injecting inodes

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-13 12:01:28 +01:00
Kefu Chai
051f9138df Merge pull request #14472 from joscollin/wip-warning-test
test: add explicit braces to avoid ambiguous ‘else’ and to silence warnings

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-13 16:28:12 +08:00
Kefu Chai
097d00cb81 Merge pull request #14495 from tchaikov/wip-cmake-ctags-without-repo
cmake: do not try to add submodule to exclude list if .git is not around

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-13 15:35:09 +08:00
Kefu Chai
9acd868857 Merge pull request #14404 from tchaikov/wip-another-mgr-command
mon,mgr: move reweight-by-* to mgr

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-13 13:57:42 +08:00
Kefu Chai
4847a88556 cmake: do not try to add submodule to exclude list if .git is not around
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-13 13:49:54 +08:00
Mykola Golub
b9522ef915 Merge pull request #14445 from dillaman/wip-rbd-import-diff
rbd: import-diff should discard any zeroed extents

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-13 08:00:05 +03:00
Matt Benjamin
335cf9a23e Merge pull request #14474 from Wilhelmshaven/fix_non-exist_string
rgw: avoid using null pointer in rgw_file.cc
2017-04-12 21:00:59 -04:00
Brad Hubbard
465ab063ad mds: Return error message instead of asserting
For "session evict" admin socket command return an error message when we
receive an invalid/missing client_id parameter rather than asserting.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-13 10:05:19 +10:00
Jason Dillaman
25eb40bd4b Merge pull request #14482 from trociny/wip-qa-diff
qa/workunits/rbd: diff.sh failed removing nonexistent file

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-12 16:43:21 -04:00
John Spray
7d6d542885 tools/cephfs: set dir_layout when injecting inodes
When we left this as zero, the MDS would interpret it was HASH_LINUX
rather than the default HASH_RJENKINS.  Potentially that
could cause problems if there perhaps were already dirfrags in
the metadata pool that were set up using rjenkins.  Mainly
it just seems more appropriate to explicitly set this field
rather than hit the fallback behaviour.

Related: http://tracker.ceph.com/issues/19406
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-12 16:30:51 -04:00
Jason Dillaman
7d12a7e184 Merge pull request #14463 from trociny/wip-19451
pybind/rbd: add image metadata methods

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-12 15:02:16 -04:00
Jason Dillaman
0d2f856464 Merge pull request #14471 from trociny/wip-19588
librbd: fix rbd_metadata_list and rbd_metadata_get

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-12 15:01:56 -04:00
Mykola Golub
bf21bae415 Merge pull request #14484 from dillaman/wip-librados-test-stub
test/librados_test_stub: fixed cls_cxx_map_get_keys/vals return value

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 21:04:42 +03:00
Yehuda Sadeh
41f0dd1d27 Merge pull request #14375 from cbodley/wip-rgw-fetch-versioned-obj 2017-04-12 09:02:44 -07:00
Kefu Chai
ef7583d717 qa/suites: add mon-reweight-min-pgs-per-osd = 4
so we can run reweight commands in a small cluster with 3 OSD and 27
PGs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-12 23:29:10 +08:00
Loic Dachary
f55b2a3fe1 Merge pull request #14476 from wjwithagen/wip-wjw-freebsd-ceph-disk-call-rc.d
ceph-disk/ceph_disk/main.py: fix calling of the bsdrc init scripts

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-12 17:04:35 +02:00
Jason Dillaman
9ffd464dac test/librados_test_stub: fixed cls_cxx_map_get_keys/vals return value
Fixes: http://tracker.ceph.com/issues/19597
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-12 10:49:05 -04:00
Sage Weil
92006f6d39 Merge pull request #14399 from ifed01/wip-bluestore-better-better-reuse
os/bluestore: refactor small write handling to reuse blob more effect…

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-12 09:31:45 -05:00
Sage Weil
048722605f Merge pull request #14422 from tchaikov/wip-19427
mon/MonClient: make get_mon_log_message() atomic

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-12 09:28:38 -05:00
Sage Weil
4f210cd13d Merge pull request #14439 from adamemerson/wip-warning-sign
misc: Warning Elimination

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-12 09:28:10 -05:00
Mykola Golub
bf52a2a53b qa/workunits/rbd: diff.sh failed removing nonexistent file
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 16:22:43 +02:00
John Spray
015daa2686 Merge pull request #14347 from ukernel/wip-19501
mds: make C_MDSInternalNoop::complete() delete 'this'

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-12 14:28:11 +01:00
Ziye Yang
d70216b9fa bluestore, NVMEDevice: Add multiple thread support for SPDK I/O thread
Previously, we only have one thread to do SPDK I/O, and this patch
adds the multiple thread support.

In this first version, we use the tid of the thread to map the I/Os
of this thread to the corresponding SPDK I/O thread.

Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-04-12 21:04:33 +08:00
Jason Dillaman
f682d26e6d rbd: import-diff should discard any zeroed extents
Sparse (zeroed) extents cannot be safely skipped. Instead, the
zeroed extent should be discarded from the image to ensure
the import remains consistent with the export.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-12 09:00:54 -04:00
Mykola Golub
9a80faa546 Merge pull request #14460 from dillaman/wip-qa-rbd-cli
qa/workunits: corrected issues with RBD cli test

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 15:44:25 +03:00
Willem Jan Withagen
fc01473e55 ceph-disk/ceph_disk/main.py: fix calling of the bsdrc init scripts
- rc.d/ceph does not really like the extra stop/start as las cmd.
 - And make Start and Stop look similar.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-12 14:02:26 +02:00
Jos Collin
12df9a3a18 test: add explicit braces to avoid ambiguous ‘else’ and to silence warnings
The following warning appears during make for several files in the test submodule:
warning: suggest explicit braces to avoid ambiguous ‘else’ [-Wdangling-else]

Fixed the review comment too.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-04-12 17:27:27 +05:30
Brad Hubbard
b2faddfca0 Merge pull request #14467 from badone/wip-debug-mon-features-api-removal-cleanup
mon: Tidy up removal of debug mon features

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-12 20:10:29 +10:00
Kefu Chai
6cb4503a40 qa/workunits/ceph-helpers: do not error out if is_clean
it would be a race otherwise, because we cannot be sure that the cluster
pgs are not all clean or not when run_osd() returns, but we can be sure
that they are expected to active+clean after a while. that's what
wait_for_clean() does.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-12 17:32:44 +08:00
lihongjie
4be4054d8f rgw: avoid using null pointer in rgw_file.cc
When rgw_fh doesn't exist, we should not use rgw_fh->full_object_name().

Signed-off-by: lihongjie <lihongjie@cmss.chinamobile.com>
2017-04-12 17:18:01 +08:00
Mykola Golub
780194199a pybind/rbd: add image metadata methods
Fixes: http://tracker.ceph.com/issues/19451
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 10:47:09 +02:00
Mykola Golub
75afc74ea6 librbd: fix rbd_metadata_list and rbd_metadata_get
- properly check for val_len in rbd_metadata_list
- don't expect output buffers are zero pre-filled

Fixes: http://tracker.ceph.com/issues/19588
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 10:42:45 +02:00
Kefu Chai
0196e154ed qa/workunits/ceph-helpers: display rejected string
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-12 16:34:51 +08:00