Commit Graph

78424 Commits

Author SHA1 Message Date
Yan Jun
bebea1c5d6 osd/PrimaryLogPG: avoid accessing value of map.end()
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2017-09-20 17:04:56 +08:00
Kefu Chai
f27251432a Merge pull request #17785 from dzafman/wip-add-repair
test: Fix ceph-objectstore-tool usage check

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-20 12:35:16 +08:00
Kefu Chai
b49dd813a9 Merge pull request #17138 from Liuchang0812/wip-updata-osd-hostname-in-metaupdater
mgr: preventing blank hostname in DaemonState

Reviewed-by: John Spray <john.spray@redhat.com>
2017-09-20 11:22:49 +08:00
Kefu Chai
497c845c66 Merge pull request #17738 from jtlayton/wip-jlayton-20988
common: lockdep fixes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-09-20 11:11:02 +08:00
Kefu Chai
c2ef12d42a Merge pull request #17753 from tchaikov/wip-osd-cleanup
osd: cleanups

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-20 11:06:45 +08:00
Kefu Chai
176c01f15e Merge pull request #17787 from tchaikov/wip-os-release-wo-version_id
common/util: do not print error if VERSION_ID is missing

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-09-20 11:02:00 +08:00
Kefu Chai
fa85dd0565 Merge pull request #17788 from tchaikov/wip-cmake-rocksdb-tcmalloc
cmake: identify the possible incompatibility of rocksdb and tcmalloc

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-09-20 10:30:37 +08:00
Kefu Chai
ff8d6a730b cmake: error out if rocksdb is incompatible w/ tcmalloc
the commit d406f228 in gperf implements a c11 feature used by a
recent change in rocksdb: 16e03882, which uses aligned_alloc().
and 16e03882 in rocksdb was merged after v5.7 was tagged, while
16e03882 in gperf was merged after v2.6.1 was tagged.

because aligned_alloc() is not implemented by tcmalloc until the
not-yet-released 2.6.2, if we call aligned_alloc() in an application
linked against tcmalloc, what gets called will be the glibc's
aligned_alloc(). but if we free() the memory chunk allocated by
aligned_alloc(), the tcmalloc's implementation kicks in, then
InvalidFree() is called, because the memory chunk being freed was
allocated by tcmalloc. in short, "mixing allocators", quote from
Dan Mick.

in rocksdb, aligned_alloc() is used if _ISOC11_SOURCE is defined, this
makes sense, because aligned_alloc() is a C11 function. we could avoid
using it by not defining _ISOC11_SOURCE. but as long as _GNU_SOURCE is
defined, glibc defines _ISOC11_SOURCE. and libstdc++ requires
_GNU_SOURCE, because it uses a fair amount of GNU extensions.

Fixes: http://tracker.ceph.com/issues/21422
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-20 10:23:16 +08:00
Josh Durgin
311373a12a Merge pull request #17795 from jdurgin/wip-21428
osd: request new map from PG when needed

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-19 16:43:24 -07:00
Josh Durgin
dd33360e5a osd: request new map from PG when needed
The fast dispatch refactor in 3cc48278bf0ee5c9535d04b60a661f988c50063b
eliminated the osdmap subscription in the ms_fast_dispatch path, which
meant ops could reach a PG without having the latest map. In a cluster
with few osdmap updates, where the monitor fails to send a new map to
an osd (it tries one random osd), this can result in indefinitely
blocked requests.

Fix this by adding an OSDService mechanism for scheduling a new osdmap
subscription request.

Fixes: http://tracker.ceph.com/issues/21428
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-09-19 14:27:29 -04:00
Sage Weil
25e2fe3dd5 Merge pull request #17607 from liewegas/wip-post-luminous-more-mon
mon: post-luminous cleanup (part 3 of ?)

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-09-19 13:19:06 -05:00
Sage Weil
1722d458dd Merge pull request #16913 from liewegas/wip-20944
os/filestore: fix device/partition metadata detection

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-09-19 13:00:33 -05:00
Sage Weil
6767f841e5 Merge pull request #17427 from liewegas/wip-pg-num-limits
mon/OSDMonitor: implement cluster pg limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-09-19 12:57:10 -05:00
Sage Weil
5a32ef77e1 Merge pull request #17760 from liewegas/wip-21410-b
Revert "osd/OSDMap: allow bidirectional swap of pg-upmap-items"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-19 12:31:44 -05:00
Matt Benjamin
1456dbfeab Merge pull request #15369 from rzarzynski/wip-rgw-custom-errmsgs-2
rgw: improve handling of Swift's error messages and limits
2017-09-19 12:09:38 -04:00
Matt Benjamin
032f8cc804 Merge pull request #12704 from rzarzynski/wip-rgw-per-storage-policy-stats
rgw: add support for Swift's per storage policy statistics
2017-09-19 12:04:28 -04:00
Josh Durgin
401ccd5966 Merge pull request #17786 from neha-ojha/wip-cbt-teuthology-integration-cntd
qa/suites/rados/perf: add optimized settings

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-09-19 08:35:10 -07:00
Radoslaw Zarzynski
9b06985cae rgw: rename the configurables for metadata limits to start with rgw_.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-19 14:47:16 +02:00
Radoslaw Zarzynski
5e5c0677ba rgw: calculate and print Swift's X-Account-Storage-Policy-* headers.
Fixes: http://tracker.ceph.com/issues/17932
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-09-19 13:51:17 +02:00
Radoslaw Zarzynski
de7a8679af rgw: bucket linking stores also the info about a placement rule.
Fixes: http://tracker.ceph.com/issues/17932
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-09-19 13:51:16 +02:00
Radoslaw Zarzynski
5eca89f08d rgw: convey placement rule in RGWBucketEnt and cls_user_bucket_entry.
Fixes: http://tracker.ceph.com/issues/17932
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-09-19 13:51:16 +02:00
Radoslaw Zarzynski
545dabe31a rgw: clean-up around and implement the move semantics in RGWBucketEnt.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-19 13:51:07 +02:00
Kefu Chai
f59dc0acfc Merge pull request #17508 from liewegas/wip-crushrule-convert
mon: more aggressively convert crush rulesets -> distinct rules

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-19 18:18:55 +08:00
Kefu Chai
42bb43b206 Merge pull request #17802 from ygtzf/option-default-value-error
doc: update default value of option mon_sync_timeout

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-09-19 17:18:08 +08:00
Yao Guotao
f22c502553 doc: update default value of option mon_sync_timeout
Signed-off-by: Yao Guotao <yaoguot@gmail.com>
2017-09-19 04:47:00 -04:00
Kefu Chai
c999abd7a8 cmake: requires rockdb version 5.8
we've updated the rockdb wrapper on ceph side to be compatible with
the latest version of rocksdb upstream. so ceph is not compatible with
older version of rocksdb.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
987c1b3ec2 cmake: detect rocksdb's version
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
58179f098b cmake: detect gperf-tools' version
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
aa603621bd cmake: extract BuildRocksDB into BuildRocksDB.cmake
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
da8ce07a21 cmake: enable find_package(perftools) to check non-default dir
so it checks $ENV{GPERF_ROOT} first.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Neha Ojha
2635e7a591 qa/suites/rados/perf: add optimized settings
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-09-18 15:53:28 -07:00
David Zafman
0364ae104a test: Fix ceph-objectstore-tool usage check
Caused by: c7b7a1f04f

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-09-18 15:29:22 -07:00
Matt Benjamin
4639b96cae Merge pull request #15273 from rzarzynski/wip-rgw-18977
rgw: list_objects() honors end_marker regardless of namespace.
2017-09-18 16:10:08 -04:00
Matt Benjamin
6994e1dc5f Merge pull request #17320 from rzarzynski/wip-rgw-21148
rgw: add support for Swift's reversed account listings
2017-09-18 15:51:43 -04:00
Yuri Weinstein
f1f960e443 Merge pull request #17777 from cbodley/wip-qa-hadoop
qa/rgw: hadoop-s3a suite targets centos_latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 12:32:14 -07:00
Casey Bodley
a97d5bea42 qa/rgw: hadoop suite targets centos_latest
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:29:40 -04:00
Casey Bodley
4a953a16d7 qa/rgw: use overrides for hadoop version
instead of having two separate tasks, add v27.yaml and v28.yaml with
overrides for hadoop_version

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:28:24 -04:00
Yuri Weinstein
e876ffff99 Merge pull request #17776 from smithfarm/wip-rh-74
tests: CentOS 7.4 is now the latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 10:17:15 -07:00
Nathan Cutler
2311b64025 tests: CentOS 7.4 is now the latest
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-09-18 18:01:17 +02:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
John Spray
37e0e34007 Merge pull request #17318 from jcsp/wip-20899
mgr/prometheus: Fix for MDS metrics

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-18 11:35:59 +01:00
John Spray
5f9bfc5b0e Merge pull request #16762 from jcsp/wip-dashboard-trim
mgr: remove unused static files from dashboard module

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-18 11:34:18 +01:00
John Spray
85a87da7aa mgr/dashboard: re-arrange static files
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
199d7ff269 mgr/dashboard: don't include remote js/css
This will help anyone running away from the internet.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
888f0f934e mgr/dashboard: remove un-minified datatables source
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
5ce51ebbf0 mgr/dashboard: remove non-minified bootstrap
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
38df5150ee mgr/dashboard: remove unneeded bits of AdminLTE
AdminLTE is delivered in a handy all-in format,
but we don't need all this stuff at runtime.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:39 -04:00
Kefu Chai
eff4961f46 common/util: do not print error if VERSION_ID is missing
per os-release(5), VERSION_ID is optional.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-18 13:01:33 +08:00
Kefu Chai
28c8e8953c Merge pull request #17737 from ivancich/wip-pull-updated-dmclock
osd: update dmclock library w git subtree pull

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-17 19:42:52 +08:00
Kefu Chai
cd6a312a4f Merge pull request #17762 from yaozongyou/fix-typo-in-php-rst
doc: fix typo in php.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-17 02:00:50 +08:00