Commit Graph

99714 Commits

Author SHA1 Message Date
Brad Hubbard
490829c8ea osd: Modify lazy omap stats to only show one copy
Only show stats from the primary to get more in line with other pg stats
representations.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-07-10 09:34:18 +10:00
Paul Cuzner
8ae471ec69 Add mgr metdata to prometheus exporter module
Add's metadata and status information for the mgr
daemon(s), together with the status of the mgr
modules.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2019-07-10 10:47:34 +12:00
Brad Hubbard
88e9ca58a0 tests: Add test for lazy omap stat collection
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-07-10 07:53:37 +10:00
Casey Bodley
9aa1eeb37a
Merge pull request #28910 from yuvalif/wip-yuval-pubsub-test-fixes
rgw/pubsub: tests enhancements and fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-09 16:24:56 -04:00
Yuri Weinstein
a2ac7e2f36
Merge pull request #28931 from yuriw/wip-yuriw-40452-master
qa/tests: added ragweed coverage to stress-split* upgrade suites
2019-07-09 12:54:07 -07:00
Yuri Weinstein
695f41952d
Merge pull request #28932 from yuriw/wip-yuriw-40452-master_2
qa/tests: added ragweed coverage to stress-split* upgrade suites
2019-07-09 12:53:52 -07:00
Jianpeng Ma
67964d421e common/config: Remove unused code.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-07-10 02:28:04 +08:00
Igor Fedotov
1a91a67bf2 os/bluestore: StupidAllocator stucks on 4GB allocations
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-09 21:19:37 +03:00
Igor Fedotov
e1b4984a63 os/bluestore: avoid length overflow in extents returned by Stupid
Allocator.

Fixes: http://tracker.ceph.com/issues/40703

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-09 21:02:08 +03:00
Sage Weil
bb051853fd osd: scrub_purged_snaps: fix log message tense
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 12:03:48 -05:00
Sage Weil
f7607512fe osd/SnapMapper: reset iterators at finish of run()
These iterators implicitly hold locks in FileStore, which can lead to a
deadlock if they are still alive and the caller tries to take new locks.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 12:03:35 -05:00
Sage Weil
238e740eb8 osd/SnapMapper: drop useless _init()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 11:59:48 -05:00
Sage Weil
8189007378 Merge PR #27965 into master
* refs/pull/27965/head:
	doc: remove recommendation for kernel.pid_max

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-09 11:19:12 -05:00
Sage Weil
878e08b97a osd: do proxy when in forward/readforward cache modes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 11:06:42 -05:00
Sage Weil
a422abec80 Merge PR #17614 into master
* refs/pull/17614/head:
	doc: cover more cache modes in rados/operations/cache-tiering.rst

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-09 10:38:55 -05:00
Nathan Cutler
31f29d796a doc: cover more cache modes in rados/operations/cache-tiering.rst
Fixes: http://tracker.ceph.com/issues/14153
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-07-09 17:06:05 +02:00
Kefu Chai
c1e9351d0d
Merge pull request #28850 from liewegas/wip-40634
mon/AuthMonitor: fix initial creation of rotating keys

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-09 22:20:43 +08:00
Sage Weil
23019cac50 Merge PR #28758 into master
* refs/pull/28758/head:
	mgr/progress: Created first unit test for progress module
	mgr/progress: makes changes to unit test PR
	mgr/progress: Created first unit test for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-09 08:24:45 -05:00
Sage Weil
a24d9f697a Merge PR #28842 into master
* refs/pull/28842/head:
	test/msgr: make ceph_perf_msgr_client/server work.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-09 08:24:18 -05:00
Sage Weil
9e41cecf71 osd: do not hold osd_lock while queueing stray purged_snaps
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 08:12:04 -05:00
Sage Weil
8bd7aa50cd osd: more debug output during scrub hang
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-09 08:10:09 -05:00
Casey Bodley
64cef4caee
Merge pull request #28873 from albIN7/liv3
rgw: fix bugs in listobjectsv1

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-07-09 08:45:05 -04:00
Kefu Chai
e2736ac7d0
Merge pull request #28913 from cyx1231st/wip-seastar-msgr-fix-perfasync
test/crimson: fix interpretability with perf_async_msgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-09 17:20:58 +08:00
Lenz Grimmer
2e1a6d4883
mgr/dashboard: set python binary for teuthology venv (#28914)
mgr/dashboard: set python binary for teuthology venv

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-09 11:01:18 +02:00
albIN7
c9a8e3acb1 rgw: fix bugs in listobjectsv1
Fixes: https://tracker.ceph.com/issues/40663

Signed-off-by: Albin Antony <aantony@redhat.com>
2019-07-09 13:53:31 +05:30
Kefu Chai
6453200265
Merge pull request #28920 from tchaikov/wip-cmake-pybind
cmake: avoid rebuilding extensions, and using python-config

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-09 16:05:44 +08:00
Kefu Chai
00d03f99d0
Merge pull request #28884 from DimStar77/depchain
ceph.spec.in: Drop systemd BuildRequires in case of building for SUSE

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-07-09 16:04:09 +08:00
Kefu Chai
dadc66a58e
Merge pull request #28843 from tchaikov/wip-armhf-build
cmake, pybind: fix build on armhf

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-09 16:03:35 +08:00
Lenz Grimmer
4ba9d4436c
mgr/dashboard: Fix npm vulnerabilities (#28903)
mgr/dashboard: Fix npm vulnerabilities

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-09 09:19:21 +02:00
alfonsomthd
522cbe8a73 mgr/dashboard: set python binary for teuthology venv
* Added env. var. to set python binary when creating teuthology venv.
* venv/bin/activate: run after setting PATH (as it does the last PATH export).

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-07-09 09:03:09 +02:00
Kefu Chai
221d976e3c
Merge pull request #28888 from joscollin/wip-fix-typo
doc: fix typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-09 11:26:13 +08:00
Sage Weil
c0403f5a41 Merge PR #28848 into master
* refs/pull/28848/head:
	common/blkdev: only pay attention to first 2 bits of smartctl return code
	common/blkdev: include stdout and stderr on join error
	common/blkdev: fix syntax of error message
	common/blkdev: fix smartctl output in error path
	common/blkdev: include bad json from smartctl when unparseable
	mgr/devicehealth: sort keys when dumping metrics

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-08 17:46:06 -05:00
Sage Weil
1d3d59be1f Merge PR #28052 into master
* refs/pull/28052/head:
	doc/rgw: document use of 'realm pull' instead of 'period pull'

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2019-07-08 16:45:16 -05:00
Yuri Weinstein
0f6b30d600 qa/tests: added ragweed coverage to stress-split* upgrade suites
added ceph config set global bluestore_warn_on_legacy_statfs fals
changed user "foo" to "ragweed" in ragweed.py

Fixes: http://tracker.ceph.com/issues/40452
Fices: http://tracker.ceph.com/issues/40467
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 12:51:51 -07:00
Yuri Weinstein
291629b417 qa/tests: added ragweed coverage to stress-split* upgrade suites
added ceph config set global bluestore_warn_on_legacy_statfs fals
chnaged user "foo" to "ragweed" in ragweed.py

Fixes: http://tracker.ceph.com/issues/40452
Fices: http://tracker.ceph.com/issues/40467
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 5e7e1f382f)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 12:38:25 -07:00
Andrew Schoen
404bde181c
Merge pull request #28791 from dcasier/bug-40100-2
Return an error, for Bluestore OSD, if WAL or DB are defined in the tags of the OSD but not present on the system

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-07-08 14:20:43 -05:00
Casey Bodley
e03b13aaca
Merge pull request #28152 from alimaredia/wip-rgw-thread-yield-context-prepare-bucket-index-transaction
rgw: thread option_yield through bucket index transaction prepare

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-08 15:16:32 -04:00
Ali Maredia
580c0804d9 rgw: change optional_yield to null_yield
In copy_obj_data() in the AtomicObjectProcessor
constructor

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-07-08 13:28:19 -04:00
Ali Maredia
d19a72dcec rgw: thread yield context through writing of head obj
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-07-08 13:28:19 -04:00
Ali Maredia
5bcee09699 rgw: thread option_yield through bucket index transaction prepare
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-07-08 13:28:18 -04:00
Kefu Chai
6050f28870 pybind: use distutils.sysconfig for compiling flags
this allows maintainer to override the compiling flags when
cross-compiling Ceph.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-09 00:23:42 +08:00
Casey Bodley
bf99e58799
Merge pull request #28823 from cbodley/wip-qa-rgw-swift-server
qa/rgw: more fixes for swift task

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 11:16:42 -04:00
Lenz Grimmer
d613747554
mgr/dashboard: Silence Alertmanager alerts (#27277)
mgr/dashboard: Silence Alertmanager alerts

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-08 16:31:18 +02:00
Yingxin Cheng
f752ba8fbe test/crimson: default bind to 127.0.0.1 for perf
Async-messenger's accepting in v2 will fail if it binds to a blank ip.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-08 22:19:18 +08:00
Yingxin Cheng
5fd2dc0fc6 test/crimson: add v1-crc-enabled for msgr perf
* fix a bug that perf_crimson_msgr and perf_async_msgr cannot connect
  to each other in v1 due to CRC checks;
* add an option to enable v1 CRC checks, because they are enabled in
  real world, and we might want to see the performance impact;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-08 22:19:18 +08:00
Yingxin Cheng
78f4ada0c9 test/crimson: track msg with tid in perf_async_msgr
fix perf_async_msgr by setting tid for perf_crimson_msgr to track
messages.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-08 22:17:39 +08:00
Sage Weil
b2eb5232de Merge PR #28901 into master
* refs/pull/28901/head:
	qa/standalone/scrub/osd-scrub-repair: fix 'scrub ok' grep
	osd/osd_types: remove 'snap_context' from SnapSet::dump()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-08 08:36:05 -05:00
Kefu Chai
1468c8fc35 cmake/modules/Distutils.cmake: add setup as a dependency
so the extension will be rebuilt if setup.py is updated

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-08 20:30:14 +08:00
Kefu Chai
f17861cdfa cmake/modules/Distutils.cmake: avoid rebuilding cython ext
use the combination of add_custom_command() and add_custom_target() to
build cython extensions to avoid rebuilding the cython extension
everytime we run "make"

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-08 20:30:14 +08:00
Kefu Chai
83ffb1e2ca cmake/modules/Distutils.cmake: add byproduct
so add_custom_target() has better idea what is generated. if any target
will use it, it can be used as a dependency.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-08 20:29:07 +08:00