Commit Graph

81057 Commits

Author SHA1 Message Date
Matt Benjamin
134734ab74
Merge pull request #19079 from adamemerson/wip-static-ptr
Static Pointer
2017-11-29 11:17:22 -05:00
Jos Collin
3dfb57e0ed doc: Fix typo in mount.fuse.ceph
Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-29 21:43:46 +05:30
Patrick Donnelly
1ce4a41bb4
Merge PR #19212 into master
* refs/pull/19212/head:
	doc: Add section about MDS cache limits

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-29 07:20:19 -08:00
Andrew Schoen
eea4bb1367
Merge pull request #19213 from ceph/wip-bz1518264
ceph-volume: correctly fallback to bluestore when no objectstore is specified

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-29 09:05:56 -06:00
Orit Wasserman
1ad4b8df6b
Merge pull request #18267 from joscollin/wip-update-radosgw-admin-doc
doc: Update commands and options in radosgw-admin
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-29 15:08:47 +02:00
Kefu Chai
f63d1da4af tools/ceph_monstore_tool: rebuild initial mgrmap also
Fixes: http://tracker.ceph.com/issues/22266
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-29 20:22:07 +08:00
John Spray
967fc9cf8a
Merge pull request #18649 from b-ranto/wip-restful-fixes
mgr/restful: A couple of restful fixes

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-29 12:11:58 +00:00
Kefu Chai
185d2f5375 qa/tasks/ceph: add mon-health-to-clog option to "restart"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-29 20:04:44 +08:00
Barbora Ančincová
4f590990b0 doc: Add section about MDS cache limits
Signed-off-by: Bara Ancincova (bara@redhat.com)
2017-11-29 12:46:49 +01:00
Jos Collin
76a8dc1e31 doc: Update all OPTIONS sections in radosgw-admin
Updated all OPTIONS sections in RADOSGW-ADMIN doc page, using the latest options from rgw_admin.cc::usage()

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-29 16:48:32 +05:30
Kefu Chai
a406553a79 qa/tasks/ceph_manager: add inject_args() method
* move Thrasher._set_config() to CephManager, and make it a public
  method, and rename it to inject_args(),
* use this method instead of using 'tell ... injectargs ...' directly

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-29 18:44:16 +08:00
Kefu Chai
b3ceafe7d8 cmake,rpm,deb: update to accommodate SPDK v17.10
* cmake/modules/BuildSPDK.cmake: add lvol
* cmake/modules/BuildDPDK.cmake: add pci and bus_pci
* ceph.spec.in, cmake/modules/BuildSPDK.cmake, debian/control:
  re-introduce libuuid dependency, as 17.07 added lvol. and the latter
  depends on uuid.
* cmake/modules/BuildSPDK.cmake: avoid introducing local variable of
  `iface_libs`.
* cmake/modules/patch-dpdk-conf.sh: disable
  CONFIG_RTE_EAL_NUMA_AWARE_HUGEPAGES, this option introduces the
  balanced allocation of memory. but it also requires libnuma-dev.
  let's disable it for now.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-29 18:03:23 +08:00
Kefu Chai
b1378b343a
Merge pull request #9571 from yehudasa/wip-rgw-redirect-zone
rgw: add a default redirect field for zones

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-29 16:38:54 +08:00
Kefu Chai
44842235bd
Merge pull request #19159 from shinobu-x/drop_using_namespace_std
common: drop namespace using directives for std

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-11-29 16:16:39 +08:00
Kefu Chai
bc020436ca
Merge pull request #19165 from xiaoxichen/fix_used_pct
mon/PGMap: Fix %USED calculation bug.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-29 16:14:40 +08:00
Kefu Chai
2eb0006334
Merge pull request #19156 from cyx1231st/fix_blkin_tracing
blkin: Fix unconditional tracing in OSD

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-29 16:13:34 +08:00
Kefu Chai
f05b093f02
Merge pull request #19149 from rzarzynski/wip-common-perfguards
common:  RAII-styled mechanism for updating PerfCounters

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-29 16:12:57 +08:00
Kefu Chai
bde50ca234
Merge pull request #19112 from xiaoxichen/osd_mapped_pool
OSD/admin_socket: add get_mapped_pools command

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-29 16:12:02 +08:00
Kefu Chai
f39bff5e91
Merge pull request #18959 from cooboos/wip-cephdencoder-LCtype
ceph-dencoder: add support for RGWLifecycleConfiguration

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-29 16:10:46 +08:00
Kefu Chai
34ffafd7ca
Merge pull request #19174 from smithfarm/wip-cmake-exclude-gitignore
cmake: mgr: exclude .gitignore

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-29 15:39:14 +08:00
Kefu Chai
12dc5733c9
Merge pull request #18938 from tchaikov/wip-cmake
cmake: check gcc version not release date for libstdc++ saneness

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-29 15:38:16 +08:00
Kefu Chai
0e987665fe qa/suites/rados/singleton: more whitelist
* SLOW_OPS is normal in a cluster with flattering OSDs
* so is OBJECT_MISPLACED.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-29 13:53:44 +08:00
Patrick Donnelly
863fb6b98b
client: give full error message on failed remount
Fixes: http://tracker.ceph.com/issues/22254

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-28 12:45:57 -08:00
Patrick Donnelly
38f051c22a
Merge PR #19206 into master
* refs/pull/19206/head:
	doc: add pre-requisite to enable CephFS snapshot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-11-28 12:02:52 -08:00
Adam C. Emerson
11f54d730d common: Add static_ptr
Add static_ptr, a pointer-like class that contains its own storage,
avoiding use of the heap.

The full range of *_pointer_cast functions are included.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-28 14:29:04 -05:00
Kefu Chai
cf50fb941e cmake,common/RWLock: check for libpthread extensions
pthread_rwlockattr_setkind_np() is a GNU extension of libpthread. and
Tianshan Qu pointed out, we cannot use
ifdef(PTHREAD_RWLOCK_PREFER_WRITER_NONRECURSIVE_NP) to detect the
availability of this function, because it's an enum not a macro. so,
like other *_np() extensions, we check this one also using cmake at
the configure phase.

Reported-by: Tianshan Qu <tianshan@xsky.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 23:50:36 +08:00
Kefu Chai
6a9e622cf9
Merge pull request #19199 from tchaikov/wip-22136
qa/ceph-disk: enlarge the simulated SCSI disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-11-28 23:46:49 +08:00
Alfredo Deza
f0ac2dfdbc ceph-volume lvm.activate correct detection and fallback of objectstore flags
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-28 09:22:19 -05:00
Alfredo Deza
8d22856d6c ceph-volume tests.devices.lvm verify objectstore flags in activate
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-28 09:21:34 -05:00
Jason Dillaman
2241b9da12
Merge pull request #19163 from vshankar/rbd-image-map-mem-leak
rbd-mirror: ImageMap memory leak fixes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-28 09:03:12 -05:00
Jos Collin
158c0f1a1b .githubmap: Add ktdreyer
Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-28 16:44:11 +05:30
Jos Collin
6863b4914e
Merge pull request #19172 from joscollin/wip-mount-fuse-ceph-doc
doc: doc for mount.fuse.ceph

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2017-11-28 16:38:13 +05:30
Jos Collin
6c39818eaf doc: doc for mount.fuse.ceph
Created doc for mount.fuse.ceph.

Fixes: http://tracker.ceph.com/issues/21539
Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-28 15:56:09 +05:30
Kefu Chai
c05e842009 spdk: update SPDK to v17.10
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 18:06:34 +08:00
Yehuda Sadeh
5f84a72989 test_multi: add a test for zone redirect
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-11-28 01:27:43 -08:00
Yehuda Sadeh
d94e9cc973 rgw-admin: add option to configure redirect_zone
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-11-28 01:27:43 -08:00
Yan, Zheng
e4ecf26a8e mds: handle client reconnect gather race
Fixes: http://tracker.ceph.com/issues/22263
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-28 17:07:24 +08:00
rune
93f9007da3 doc: add pre-requisite to enable CephFS snapshot
Signed-off-by: Jian Su <sujian@umcloud.com>
2017-11-28 16:25:17 +08:00
Adam Kupczyk
b08ae658e8 common/log: Added new version of PrebufferedStreambuf, tuned for log usage
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 16:15:24 +08:00
Kefu Chai
b3c159e9fb qa/ceph-disk: enlarge the simulated SCSI disk
100MB will be allocated for journal, and the remaining 100MB is for data
device. taking the inode into consideration, there will be approximately
87988 kB available for the activated OSD. and it will complain with a
"nearfull" state.

Fixes: http://tracker.ceph.com/issues/22136
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
c78deac400 ceph-disk: should throw if fail to read key-management-mode
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
3e8c6f8d03 ceph-disk: fix the logging messages
logging.Logger.warn(format, *args). so no need to prepar a string
for it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
1113ac255a ceph-disk: path_set_context() after rename()
it does not matter if we chown/restorecon before or after the rename,
but the logging message looks better this way: instead of fixing the
.tmp files, we are updating the attributes of the dest files w/o
.${pid}.tmp extension.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
aa34321a4a qa/workunits/ceph-disk: do not redirect stderr to stdout
normally, if we care about the output of ceph-disk, we expect a json
string, and ceph-disk sends the output to stdout, and errors/warnings
to stderr. so everything works as expected. and the test should also
follow this tradition. for example, if deprecated warnings are printed,
the warning message should not be collected along with the json string.

see also: d44334f3

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:19 +08:00
Xiaoxi Chen
d10c6c26f9 mon/PGMap: Fix %USED calculation bug.
Previous code forgot to multiple raw_used_ratio to calculate
used byte.

Fixes: http://tracker.ceph.com/issues/22247
Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-11-27 22:26:35 -07:00
Adam Kupczyk
2c332eb83f common/log: Performance test for logging.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2017-11-28 12:50:06 +08:00
Adam C. Emerson
4489cb58a1 rgw: Expire entries in bucket info cache
To bound the degree to which an RGW instance can go out to lunch if
the watch/notify breaks down, force refresh of any cache entry over a
certain age.

Fifteen minutes by default, and expiration can be turned off entirely.

This is separate from the LRU. The LRU removes entries based on the
last time of access. This expiration patch forces refresh based on the
last time they were updated.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
e397b7e6d0 rgw: Handle stale bucket info in RGWDeleteBucketPolicy
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
1738b4f6b7 rgw: Handle stale bucket info in RGWPutBucketPolicy
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
f4d274248e rgw: Handle stale bucket info in RGWDeleteBucketWebsite
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00