Commit Graph

100232 Commits

Author SHA1 Message Date
Kamoltat (Junior) Sirivadhna
5604ba4ec1 qa/mgr/progress: Update the test suite for progress module
Update the test suite to reflect a feature
change that has been merged to master in
progress module where you create an event
when an osd is marked in.

Fixes: http://tracker.ceph.com/issues/40618
with success QA run in sepia:
http://pulpito.ceph.com/kchai-2019-07-16_10:10:01-rados-master-distro-basic-mira/

Signed-off-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2019-07-22 11:09:42 -04:00
Mykola Golub
978d185cc8
Merge pull request #29135 from dillaman/wip-40486
doc/rbd: re-organize top-level and add live-migration docs

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-22 17:22:38 +03:00
Jason Dillaman
7779860d38 cls/journal: reduce verbosity of debug logs for non-errors
Fixes: http://tracker.ceph.com/issues/40865
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-22 10:14:22 -04:00
Jason Dillaman
7a6a2aefd7 cls/rbd: reduce verbosity of debug logs for non-errors
Fixes: http://tracker.ceph.com/issues/40865
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-22 10:14:16 -04:00
Adam King
f9a40eb3db mgr/dashboard: Update formatting for dashboard e2e test files
Fixes: https://tracker.ceph.com/issues/40789

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-07-22 10:01:02 -04:00
Jianpeng Ma
981d4c7704 os/bluestore: Reduce unnecessary wakeups.
Add bool kv_sync_in_progress to indicate thread kv_sync_thread
is running or waiting. Only wake up if thread waiting.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-07-22 21:41:48 +08:00
Jianpeng Ma
83c2c8d3c9 os/bluestore: Reduce unnecessary wakeups.
Add bool kv_finalize_in_progress to indicate thread kv_finalize_thread
is running or waiting. Only wake up if waiting.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-07-22 21:41:48 +08:00
Pooja
f862933237 mgr/dashboard Displays progress bar in notification tray
Signed-off-by: Pooja <pooja.gautam@ts.fujitsu.com>
2019-07-22 14:52:42 +02:00
Sebastian Wagner
dffce107fb mgr: cleanup idle debug log at level 4.
Changed all messages to 10 that are printed repeatedly in an idle cluster.

This makes debugging Python modules easier as the log
is no longer pullued by mgr core messages.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-22 14:36:41 +02:00
Jason Dillaman
20c80dfd3f doc/rbd: initial live-migration documentation
Fixes: http://tracker.ceph.com/issues/40486
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-22 08:20:23 -04:00
Volker Theile
06b654274d mgr/dashboard: RGW User quota validation is not working correctly
Fixes: https://tracker.ceph.com/issues/40829

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-22 12:42:29 +02:00
Kefu Chai
0e93acad3e msg/Message: remove unused local variables
and avoid creating a temporary instance of `ceph_msg_footer`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-22 17:33:57 +08:00
Kefu Chai
492efbd694 cmake: use python2 by default
and s/PYTHON_EXECUTABLE/Python_EXECUTABLE/

it's a regression introduced by 5e2bd7fc4dd6d137cf67336d568da5b0d568efca

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-22 16:07:56 +08:00
Ricardo Marques
65c259c7b7
Merge pull request #28764 from rhcs-dashboard/rgw-bucket-placement-target
mgr/dashboard: select placement target on RGW bucket creation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-22 09:04:53 +01:00
Kefu Chai
0bf0cda304 test/crimson/: use 256M mem and 1 cpu core for each test
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-22 15:50:20 +08:00
Kefu Chai
991585cccf rgw/rgw_crypt.cc: silence -Wsign-compare GCC warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-22 15:15:09 +08:00
Varsha Rao
d54de19578 cephfs-shell: Fix flake8 E302 blank line error
Fixes: https://tracker.ceph.com/issues/40836
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-22 11:38:33 +05:30
Varsha Rao
521de4f94d cephfs-shell: Fix flake8 indentation error
Fixes: https://tracker.ceph.com/issues/40836
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-22 11:31:53 +05:30
xie xingguo
1ba264e8ac mgr/progress: evacuate_osds -> which_osds
PgRecoveryEvent should catch both in and out osds now,
not only out osds. Refresh the corresponding variable
name to better reflecting the function changing.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-07-22 13:17:04 +08:00
xie xingguo
8df45b4e15 mgr/progress: clamp pg recovery ratio to 0
There were times that I could observe the num_bytes_recovered field
of pg_stat_t may decrease, e.g., due to the primary switching
(or similar).
Clamp the pg recovery ratio to 0 too since it might go negative.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-07-22 11:07:08 +08:00
Kefu Chai
a1b9f60b3a
Merge pull request #29100 from tchaikov/wip-cmake-python-osx
cmake: use latest FindPython*.cmake

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-21 09:24:22 +08:00
Sage Weil
4f57e064f0 Merge PR #29012 into master
* refs/pull/29012/head:
	os/bluestore: proper locking for BlueFS prefetching

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-20 15:21:22 -05:00
Sage Weil
65008afcb1 Merge PR #29068 into master
* refs/pull/29068/head:
	os/bluestore: cleanup around allocator calls

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-20 15:21:01 -05:00
Sage Weil
dc32b1ac0e Merge PR #29072 into master
* refs/pull/29072/head:
	qa/suites/upgrade: set pg_autoscale_mode=off on existing pools
	mon/MgrMonitor: make pg_autoscaler always on
	qa/tasks/ceph.conf.template: osd_pool_default_pg_autoscale_mode = off

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-20 15:20:31 -05:00
Sage Weil
3092393b43 Merge PR #29085 into master
* refs/pull/29085/head:
	os/bluestore: add slow op detector for collection listing
	os/bluestore: parametrize latency threshold for log_latency funcs..
	os/bluestore: cleanup around slow op logging.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-20 15:19:47 -05:00
Sage Weil
1266eaf0f2 Merge PR #29145 into master
* refs/pull/29145/head:
	doc/release/nautilus: 14.2.2 changes redone

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2019-07-20 15:07:54 -05:00
Kefu Chai
79078f43e8 doc/dev/macos.rst: update to be in sync with master
* we've moved to cmake 3.5, so no need to hack for newer cmake
* nss dependency is dropped, no need to install it anymore
* pass clang and clang++ using cmake variable to be more consistent
* pass CMAKE_EXE_LINKER_FLAGS as `/usr/local/opt/llvm/lib` is
  not in default library paths.
* mention https://github.com/boostorg/atomic/issues/15

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-21 00:47:39 +08:00
Kefu Chai
606b9c1822 cmake: pass PYTHON_VERSION explicitly
allow `distutils_*()` functions to choose the python according to this
parameter, instead of implicitly using the variable of ${PYTHON_VERSION}
inherited from the caller.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-21 00:47:39 +08:00
Kefu Chai
5e2bd7fc4d cmake: update FindPython* modules
use the ones shiped from the latest cmake. which

* enables us to find the recent python intepreter and development files,
* find intepreter and development in a single `find_pacakge()` command,
  simpler this way and less error prone.

and to accomodate this change:

* all `PYTHON${PYTHON_VERSION}_*` variables are renamed to
  `Python${PYTHON_VERSION}_*` if we use `find_package(Python2...)` or
  `find_package(Python3...)` to find python2 or python3 instead of using
  `find_package(Python...)`.
* use "2" explicitly when using python2, as `Python_*` variables are not
  defined anymore
* when compiling python support of ceph-mgr, continue using `Python_*`
  variables. because we find the python interpreter and development
  files using `find_pacakge(Python...)` for ceph-mgr.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-20 22:35:07 +08:00
Rishabh Dave
80152465b5 qa/tests: test if unresponsive MDS client with no caps is evicted directly
Test if an unresponsive MDS client session holding no caps is evicted
directly at session_autoclose without being marked as stale at
session_timeout.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-20 09:04:50 +05:30
Kefu Chai
893030e51a
Merge pull request #29080 from tchaikov/wip-pybind
pybind: check "CEPH_LIBDIR" not "MAKEFLAGS"

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-20 11:32:09 +08:00
Kefu Chai
57d00693da
Merge pull request #28763 from tchaikov/wip-dpdk-fix-ftbfs
msg/async/dpdk: fix FTBFS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-20 10:37:57 +08:00
Josh Durgin
234a400376
Merge pull request #29120 from neha-ojha/wip-add-write-omap
qa: add basic omap testing capability

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-19 14:46:22 -07:00
Sage Weil
7962a36849 doc/release/nautilus: 14.2.2 changes redone
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 16:01:50 -05:00
Matt Benjamin
af327f21aa RGWLC: fix expiration header tag match
Need to match key->value

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2019-07-19 16:32:20 -04:00
Neha Ojha
3a2abb94eb qa/suites/rados/perf: add op_size to radosbench_omap_write.yaml
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-07-19 13:16:50 -07:00
Sage Weil
848c5b4a9a qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools
Follow-on to e7ca5a92d4

Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:49:26 -05:00
Sage Weil
3bddcc5ddf qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
01d1d232ab mgr/telemetry: fix remote into crash do_ls()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
32a4b510aa mgr/crash: don't make these methods static
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
52875c6cb2 mgr/BaseMgrModule: handle unicode health detail strings
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
277d974b4a mgr/crash: verify timestamp is valid
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
e2ff58ba16 qa/suites/mgr: whitelist RECENT_CRASH
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
37a8f2d66a mgr/crash: remove unused var
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
5b2cbb3a10 mgr/crash: remove unused import 'six'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Sage Weil
f6e0894902 qa/workunits/rados/test_crash: health check
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Patrick Donnelly
ca5ac3a7f5
common: add ref header
This enables the use of these handy ref templates outside of Message.h.
This is necessary for a future rework of #26348.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-19 11:55:19 -07:00
Patrick Donnelly
cd97739905
Merge PR #29123 into master
* refs/pull/29123/head:
	test_sessionmap: use sudo_write_file() from teuthology.misc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-19 10:41:29 -07:00
Casey Bodley
707482beed
Merge pull request #28946 from cbodley/wip-rgw-list-v1-close-section
rgw: add missing close_section in send_versioned_response

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
2019-07-19 12:08:03 -04:00
Xiaoxi CHEN
bb46de8853 Client: bump ll_ref from int32 to uint64_t
ll_ref can surge up if application repeatly lookup same dentry
and finally cause overflow.

https://tracker.ceph.com/issues/40775 is an example.

in kernel fuse driver and libfuse, uint64_t is used, update
ceph-fuse side to match.

Fixes: https://tracker.ceph.com/issues/40775

Signed-off-by: Xiaoxi CHEN <xiaoxchen@ebay.com>
2019-07-19 08:31:24 -07:00