Commit Graph

74589 Commits

Author SHA1 Message Date
Jason Dillaman
82e4816988 pybind/mgr/dashboard: initial block integration
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-06-23 09:00:39 -04:00
xie xingguo
58335f1df5 mon/OSDMonitor: slightly nice error output if set-device-class failed
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-23 18:37:36 +08:00
xie xingguo
ec1b974be9 mon/OSDMonitor: set result code properly if we fail to process "swap-bucket"
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-23 18:37:35 +08:00
xie xingguo
d6ce05f88c mon/OSDMonitor: "osd crush class rename" support
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-23 18:37:35 +08:00
Radoslaw Zarzynski
2baed294ce rgw: use a struct instead of std::tuple in AWS's VersionAbstractor.
The C++11 standard mandates the variadic constructor of std::tuple
to be explicit. As a result, we can't use the uniform initialization
syntax in return statements. Moreover, the tuples became too verbose
after the AWSv4 rework.

See: https://stackoverflow.com/a/14961849
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-06-23 06:23:02 -04:00
Willem Jan Withagen
3ae960d6be ./src/vstart.sh: Work around mgr restfull not available
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-06-23 11:33:18 +02:00
Yanhu Cao
35e3b0b34a common/config_opts: drop unused opt
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-06-23 17:15:47 +08:00
Willem Jan Withagen
19892df1d8 test/osd/osd-scrub-repair.sh: Adjust for FreeBSD
Fixes 2 problems:
 -  Do not test Bluestore on FreeBSD, since that does not work (yet)
    And all erasure code overwrite tests are executed on BlueStore OSDs
    Erasure code overwrites are unsafe on Filestore, see:
    http://docs.ceph.com/docs/master/rados/operations/erasure-code/#erasure-coding-with-overwrites

 -  the JQ expression errors out with:
    (version 1.5-1-g940132e-dirty)
    ====
    jq: error (at :232): Cannot iterate over null (null)
    Traceback (most recent call last):
    File "", line 1, in
    File "/usr/lib64/python2.7/json/init.py", line 338, in loads
    return _default_decoder.decode(s)
    File "/usr/lib64/python2.7/json/decoder.py", line 365, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
    File "/usr/lib64/python2.7/json/decoder.py", line 383, in raw_decode
    raise ValueError("No JSON object could be decoded")
    ValueError: No JSON object could be decoded
    ====
    Adding a ? to the jq expression allows to proceed on null blocks.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-06-23 10:33:43 +02:00
Kefu Chai
efc0b61ba7 auth/RotatingKeyRing: use std::move() to set secrets
the param will be thrown away anyway. see
CephxClientHandler::handle_response().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-23 15:36:14 +08:00
Nathan Cutler
aab3920977 Merge branch 'master' of /home/smithfarm/src/ceph/upstream/teuthology into wip-swift-task-move-master 2017-06-23 08:30:38 +02:00
Nathan Cutler
7b58ac97e9 tests: move swift.py task to qa/tasks
In preparation for moving this task from ceph/teuthology.git into ceph/ceph.git

The move is necessary because jewel-specific changes are needed, yet teuthology
does not maintain a separate branch for jewel. Also, swift.py is a
Ceph-specific task so it makes more sense to have it in Ceph.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-06-23 08:27:42 +02:00
Jos Collin
4367361055 common: initialize array in struct BackTrace
Fixed the review comments.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-06-23 10:02:42 +05:30
Kefu Chai
ffeddb4f22 osdc/Objecter: pass vector by const reference
so we can pass temporary object to it as parameter.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-23 12:02:03 +08:00
Kefu Chai
40b96745f0 mgr: enable ceph_send_command() to send pg command
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-23 12:02:03 +08:00
Jos Collin
22e1d8984b common: initialize array in struct BackTrace
Fixes the coverity scan report:
1412839 Uninitialized pointer field
CID 1412839 (#1 of 1): Uninitialized pointer field (UNINIT_CTOR)2. uninit_member: Non-static
class member array is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-06-23 09:09:32 +05:30
Kefu Chai
fcc3effd8b crypto: allow PK11 module to load even if it's already initialized
there is chance that other pieces of application loads PK11 module
already and does not finalize it before calling common_init_finish().

also, upon fork, PK11 module resets its entire status including `nsc_init`,
by which PK11 module tell if it is initialized or not. so the behavior
of NSS_InitContext() could be different before and after fork. that's
another reason to ignore CKR_CRYPTOKI_ALREADY_INITIALIZED error (see
NSS_GetError()).

Fixes: http://tracker.ceph.com/issues/19741
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-23 11:31:07 +08:00
Yanhu Cao
beee827390 mon/PaxosService: use __func__ instead of hard code function name
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-06-23 10:27:49 +08:00
Haomai Wang
6ffb6eb0e8 Merge pull request #15832 from Adirl/pd_assert
msg/async/rdma: remove assert from ibv_dealloc_pd in ProtectionDomain

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-06-23 09:26:06 +08:00
Matt Benjamin
45f4853da1 Merge pull request #15283 from donglinpeng/copyPartUpload
rgw: multipart copy-part remove '/' for s3 java sdk request header.
(make check failures not related)
2017-06-22 19:15:00 -04:00
wujian
75e56c4c5d common/config_opt: remove unused config
Signed-off-by: alex.wu <wujian3659@163.com>
2017-06-23 05:41:28 +08:00
Sage Weil
90c8484618 Merge pull request #15857 from theanalyst/doc/v12.1.0/release-notes-3
doc: v12.1.0 release notes notable changes addition again
2017-06-22 16:25:06 -05:00
Abhishek Lekshmanan
570fa825fd doc: v12.1.0 release notes notable changes addition again
commmits from 9f259cb923e7474229bb2e5e54b59f3b7f068bc5..luminous && sort

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2017-06-22 22:58:37 +02:00
Casey Bodley
2b7cd0f281 vstart: remove rgw_enable_static_website
this was recently added for s3tests, but rgw_enable_static_website
isn't enough to get the test_s3website.py tests to pass. they're
skipped if rgw_enable_static_website is false, so enabling this just
caused them to fail instead

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-06-22 16:51:35 -04:00
Casey Bodley
94418464d1 rgw: fixes for AWSBrowserUploadAbstractor auth
return initializer lists rather than std::make_tuple(), which constructs
a temporary tuple and converts it to the return type. this was causing
an issue with std::string -> string_view conversions, because the
string_views ended up pointing to memory from a string in that
temporary tuple

Fixes: http://tracker.ceph.com/issues/20372

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-06-22 15:38:28 -04:00
Matt Benjamin
34ab09b614 Merge pull request #15819 from linuxbox2/wip-clru-lockfix
rgw_file: avoid a recursive lane lock in LRU drain
(failing make check is unrelated)
2017-06-22 15:33:50 -04:00
Matt Benjamin
e12fc13e25 rgw_file: avoid a recursive lane lock in LRU drain
While highly unlikely in normal fs operations, draining an
entire filesystem could induce a recursion on object delete/unref,
when provoked by cohort_lru::drain().

Adjusted to use intrusive slist rather than std:vector<T*>
after review.

Found running librgw_file_nfsns unit test.

Fixes: http://tracker.ceph.com/issues/20374

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-06-22 15:00:42 -04:00
Sage Weil
2c8904506a qa/tasks/ceph: create osds before starting
This ensure they are in the OSDMap before the CRUSH
map, which avoids the OSD_ORPHAN health warning.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-22 13:45:27 -04:00
Sage Weil
0eed85515a qa/tasks/ceph: do not pregenerate osdmap
This is useless, and further leads to a situation
where we have a populated CRUSH map before any OSDs,
triggering the OSD_ORPHAN error.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-22 13:45:26 -04:00
Adam Kupczyk
96f9198385 radosgw: fixed sizes of integers used to operate on offsets and lengths in compression,
followup of http://tracker.ceph.com/issues/20231

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-06-22 17:43:53 +02:00
Sage Weil
580c890522 Merge pull request #15814 from liewegas/wip-everyone-hates-btrfs
qa/objectstore/filestore-btrfs: test btrfs on trusty only
2017-06-22 09:50:55 -05:00
xie xingguo
78e0ea3d4d src/vstart.sh: kill dead upmap option
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 22:14:30 +08:00
Sage Weil
bc867c7299 Merge pull request #15820 from liewegas/wip-20303
mon/PGMap: slightly better debugging around pgmap updates

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-22 08:38:50 -05:00
Sage Weil
4a76eaee7a Merge pull request #15846 from xiexingguo/wip-remap-upmap
mon/OSDMonitor: _apply_remap -> _apply_upmap; less code redundancy

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-22 08:33:35 -05:00
xie xingguo
3e1e10b5d1 mon/OSDMonitor: less code redundancy
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 20:00:04 +08:00
John Spray
53fc7a5fc1 Merge pull request #15805 from jcsp/wip-mds-flush-upgrade
client: check for luminous MDS before sending FLUSH_MDLOG

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-22 07:08:51 -04:00
John Spray
b7048b2c7b Merge pull request #15800 from ukernel/wip-20340
mds: save  projected path into inode_t::stray_prior_path

Reviewed-by: John Spray <john.spray@redhat.com>
2017-06-22 07:07:59 -04:00
John Spray
1e917eb8d6 Merge pull request #15776 from ukernel/wip-20338
osdc/Journaler: fix memory leak in Journaler::_issue_read()

Reviewed-by: John Spray <john.spray@redhat.com>
2017-06-22 07:07:21 -04:00
John Spray
7e991fe36e Merge pull request #15430 from jcsp/wip-20165
mds: fix hangs involving re-entrant calls to journaler

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-06-22 07:06:41 -04:00
John Spray
38dccd2c72 Merge pull request #15548 from ukernel/wip-20196
mds: improvements for stray reintegration

Reviewed-by: John Spray <john.spray@redhat.com>
2017-06-22 06:46:27 -04:00
xie xingguo
422e218486 mon/MonCommand: fix description of "osd pg-upmap"
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 17:26:47 +08:00
xie xingguo
b84ab54280 osd/OSDMap: _apply_remap -> _apply_upmap
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 16:50:27 +08:00
Igor Fedotov
670d18e61b Merge pull request #15796 from lixiaoy1/fio_ceph_objectstore
fio_ceph_objectstore: Print db_statistics when rocksdb_perf is enabled
2017-06-22 12:01:00 +04:00
Orit Wasserman
c320fbd9f8 Merge pull request #15753 from pritha-srivastava/wip-rgw-s3tests-conf
rgw: Changes for s3test config file, to add user under a tenant.
Reviewed-by: Casey Bodely <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-06-22 11:00:26 +03:00
Daniel Bar-On
cb920f6485 msg/async/rdma: remove assert from ibv_dealloc_pd in ProtectionDomain
destructor

issue: 1044307

Change-Id: I2fe2099c5f4403f14877e0fbe5d4868dd34d4f9b
Signed-off-by: DanielBar-On <danielbo@mellanox.com>
2017-06-22 10:11:13 +03:00
xie xingguo
aa850b9944 os/bluestore: avoid initializing finishers in constructor
This is a follow up change of https://github.com/ceph/ceph/pull/15666,
which I forget to update.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 14:37:31 +08:00
xie xingguo
041296bdb1 os/bluestore: add "0x" prefix for hex outputs
Which is the normal case.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 14:37:31 +08:00
xie xingguo
be90d3afba os/bluestore: non-atomic min_alloc_size_order
This is not necessary because we now write min_alloc_size into disk
during mkfs.

There are two acaccompanying changes too:
(1) don't call _set_alloc_sizes() during mkfs() any more, which is
not necessary.
(2) don't update min_alloc_size during _set_alloc_sizes(), we instead
update min_alloc_size_order each time we successfully read min_alloc_size
from disk.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 14:37:30 +08:00
Orit Wasserman
ad420d5574 rgw: check all users bucket for resharding, this will reshard bucket created in older versions
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-22 09:31:02 +03:00
xie xingguo
95b40849e9 os/bluestore: drop _open_alloc() from mkfs
This is useless as the fsck() process will do necessary validations later.
And dropping this can make mkfs slightly faster.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 13:52:14 +08:00
xie xingguo
3492d3b670 os/bluestore: prefix open_statfs with "_"
As it is an internal method only.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-22 13:52:14 +08:00