Commit Graph

91467 Commits

Author SHA1 Message Date
Kefu Chai
82db568d64 os/tests: should read size_t options using get_val<Option::size_t>()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-24 22:18:34 +08:00
Kefu Chai
86106ecb00
Merge pull request #19964 from runsisi/wip-build
cmake: move ceph-osdomap-tool, ceph-monstore-tool out of ceph-test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-24 10:01:37 +08:00
Patrick Donnelly
f790de8e28
Merge PR #24540 into master
* refs/pull/24540/head:
	mgr/status: fix fs status subcommand did not show standby-replay MDS' perf info

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-23 15:32:55 -07:00
Patrick Donnelly
9c62710edd
Merge PR #24709 into master
* refs/pull/24709/head:
	PendingReleaseNotes: note about cephfs client state reclaim

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-23 15:24:09 -07:00
Patrick Donnelly
8c95f8e119
Merge PR #24466 into master
* refs/pull/24466/head:
	common: assert if buffer advance length overflow

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-23 15:02:26 -07:00
Patrick Donnelly
bc93a6173a
Merge PR #24529 into master
* refs/pull/24529/head:
	mds: cleanup command descriptions

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-10-23 15:01:53 -07:00
Patrick Donnelly
6d9f39b096
Merge PR #24640 into master
* refs/pull/24640/head:
	mds: remove MonClient reconnect

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-23 15:01:14 -07:00
Patrick Donnelly
60c63f71f6
Merge PR #24533 into master
* refs/pull/24533/head:
	qa: add timeouts for remote ops for client mounts

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-10-23 14:46:34 -07:00
Lenz Grimmer
f24b46ee4d
Merge pull request #24679 from tspmelo/wip-36528
mgr/dashboard: Fix HttpClient Module imports in unit tests

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-23 23:23:18 +02:00
Lenz Grimmer
549e00286e
Merge pull request #24632 from Devp00l/wip-issue-36468
mgr/dashboard: Handle class objects as regular objects in KV-table

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-23 23:22:05 +02:00
Alfredo Deza
7ba945534f
Merge pull request #24674 from sileht/master
ceph-volume: extract flake8 config

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-10-23 15:04:54 -05:00
Matt Benjamin
16dcd2ee6f
Merge pull request #23242 from linuxbox2/wip-rgw-inflight-ops
rgw: set default objecter_inflight_ops = 24576
2018-10-23 11:21:10 -04:00
Kefu Chai
86af98f42d
Merge pull request #24692 from tchaikov/wip-cmake-with-asan
cmake: fixes to enable WITH_ASAN with clang and GCC

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-23 19:26:59 +08:00
Lenz Grimmer
966a1e9629
Merge pull request #24664 from tspmelo/wip-36513
mgr/dashboard: Fix missing failed restore notification

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-23 12:59:06 +02:00
Lenz Grimmer
80dd99baa3
Merge pull request #24637 from ricardoasmarques/fix-rbd-actions-disable
mgr/dashboard: Fix RBD actions disable

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-23 12:35:53 +02:00
Lenz Grimmer
709e65e395
Merge pull request #24612 from Tinatinak/fix_bug24548
mgr/dashboard: Fixed documentation link on RGW page

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-23 12:28:57 +02:00
Tiago Melo
fba0097a8c mgr/dashboard: Fix HttpClient Module imports in unit tests
Some of the tests were importing the wrong HttpClient Module and that was
causing random errors.

Fixes: https://tracker.ceph.com/issues/36528

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-10-23 10:41:51 +01:00
Tiago Melo
2f4ce95725 mgr/dashboard: Fix missing failed restore notification
Fixes: http://tracker.ceph.com/issues/36513

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-10-23 10:34:03 +01:00
Lenz Grimmer
5727f9b455
Merge pull request #24544 from votdev/bug_24729
mgr/dashboard: Confirmation modal doesn't close

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-23 08:50:14 +02:00
Lenz Grimmer
087958f329
Merge pull request #24699 from rhcs-dashboard/add-tslint-rule
mgr/dashboard: Add TSLint rule "no-unused-variable"

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-23 08:48:54 +02:00
Lenz Grimmer
3105e967f5
Merge pull request #24694 from tspmelo/wip-36544
mgr/dashboard: Fix problem with ErasureCodeProfileService

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-23 08:47:55 +02:00
Mykola Golub
5dd0599bdf
Merge pull request #24696 from dillaman/wip-36542
qa/tasks/qemu: use unique clone directory to avoid race with workunit

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-23 09:41:43 +03:00
Sage Weil
a350131d16 Merge PR #24698 into master
* refs/pull/24698/head:
	Merge PR #24697 into nautilus
	ceph_test_msgr: fix authorizer behavior
	Merge pull request #24667 from liewegas/wip-ec-thrash-full
	Merge PR #24689 into nautilus
	qa/suites/rados/thrash-erasure-code*/thrashers/*: less likely resv rejection injection

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-22 22:46:23 -05:00
Kefu Chai
b0c8102cfb
Merge pull request #24691 from iridescent-rsy/fix_typo
common: fix typos in BackoffThrottle

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-23 10:56:13 +08:00
Sage Weil
a0b5445bc8 Merge PR #24697 into nautilus
* refs/pull/24697/head:
	ceph_test_msgr: fix authorizer behavior

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2018-10-22 20:45:40 -05:00
Brad Hubbard
a20ba3dcf7
Merge pull request #24652 from badone/wip-undefined-gperftool-symbols-2
rpm: Use updated gperftools-libs at runtime

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2018-10-23 09:37:35 +10:00
alfonsomthd
85570639cb mgr/dashboard: Add TSLint rule
- TSlint no-unused-variable rule added.
- Cleanup: unused imports and variables.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2018-10-22 19:38:38 +02:00
Lenz Grimmer
9d79acdaac
Merge pull request #24591 from tspmelo/wip-testing-module
mgr/dashboard: Unit Tests cleanup

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-22 19:33:53 +02:00
Sage Weil
1a01cf4872 ceph_test_msgr: fix authorizer behavior
Fixes breakage from this PR 2152d8ffb7.

Fixes: http://tracker.ceph.com/issues/36495
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-22 10:06:06 -05:00
Kefu Chai
3d0d24a228 include/ceph_assert.h: do not pack assert params if WITH_ASAN
we pack the asset() params for smaller code size, but this creates a
inlined `assert_data_ctx` instance for every compilation unit which
call ceph_assert() defined in .h .

__PRETTY_FUNCTION__ is likely to be referenced by `assert_data_ctx`
sections which are included by different compiled object files. if the
ceph_assert() call is used by header file, then there will be multiple
`assert_data_ctx` sections sharing the same identifier. these sections are
defined as "COMDAT" group sections, i.e. common data sections. when linker
see multiple COMDAT sections with the same identifer, it will simply discard
the duplicated ones, and only keep a single copy of them. without enabling
ASan, GCC can always handle this problem just fine. but the dedup feature
does not work well with ASan. if ASan is enabled, and we link the objects
with the wrong order, some references will be pointing to the discarded
sections.

to address this issue, we could audit the link command line and inspect
all .o files to make sure they are properly ordered. but this is
non-trivial. as a workaround, in this change, the assert params are not
packed, and sent to the  __ceph_assert_fail() overrides which accepts
unpacked params directly, so the COMDAT section is not created.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 23:01:36 +08:00
Jason Dillaman
5d56014c61 qa/tasks/qemu: use unique clone directory to avoid race with workunit
If there is a workunit task associated with the same client, the two
tasks will attempt to clone the suite repo to the same directory.
Worse, if it's parallel tasks, the two clones will clobber each
other.

Fixes: http://tracker.ceph.com/issues/36542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-22 10:44:40 -04:00
Josh Durgin
36ca230776
Merge pull request #24667 from liewegas/wip-ec-thrash-full
qa/suites/rados/thrash-erasure-code*/thrashers/*: less likely resv rejection injection

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-22 07:39:26 -07:00
Kefu Chai
4af71e7c00
Merge pull request #23103 from ifed01/wip-ifed-bluefs-migrate
os/bluestore: allow ceph-bluestore-tool to coalesce, add and migrate BlueFS backing volumes

Reviewed-by:  Sage Weil <sage@redhat.com>
2018-10-22 22:33:08 +08:00
Kefu Chai
09c31bbea3
Merge pull request #23090 from mingshuaiwang/master
OSD: ceph-osd parent process need to restart log service after fork

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-10-22 22:30:41 +08:00
Sage Weil
883fc4d122 Merge PR #24689 into nautilus
* refs/pull/24689/head:
	qa/tasks/ceph_manager: fix get_stuck_pgs from pg dump change

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-22 09:20:50 -05:00
Sage Weil
ae583f5dde Merge PR #24689 into master
* refs/pull/24689/head:
	qa/tasks/ceph_manager: fix get_stuck_pgs from pg dump change
	Merge PR #24625 into nautilus
	qa/suites/rados/mgr/tasks/module_selftest: whitelist 'foo bar security'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-22 09:19:46 -05:00
Ricardo Marques
48eb0a336b mgr/dashboard: Fix RBD actions disable
Fixes: https://tracker.ceph.com/issues/36403

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-10-22 14:02:37 +01:00
Volker Theile
7a44726645 mgr/dashboard: Confirmation modal doesn't close
Fixes: https://tracker.ceph.com/issues/24729

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-22 13:29:38 +02:00
Tiago Melo
f775e9844c mgr/dashboard: Fix problem with ErasureCodeProfileService
ErasureCodeProfileService was being provided twice and that was causing
problems in production mode.

Fixes: https://tracker.ceph.com/issues/36544

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-10-22 11:57:01 +01:00
Kefu Chai
399923c71a
Merge pull request #20004 from mogeb/steady-clock-tools-rados
librados: use steady clock for rados_mon_op_timeout

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-22 17:46:44 +08:00
Kefu Chai
298da11351
Merge pull request #24658 from tchaikov/wip-18202-rebased
blkdev: Rework API and add FreeBSD support

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-10-22 17:44:07 +08:00
Kefu Chai
5e12cef930 include/ceph_assert: always use __PRETTY_FUNCTION__ for C++
we've moved to GCC-7, no need to check for ancient compiler versions

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 16:53:05 +08:00
Kefu Chai
fd58e5d4ad cmake,ceph.in: preload libasan if WITH_ASAN
we need to preload libasan.so as the python exectuable is not likely to
be compiled with ASan enabled.
see:
https://github.com/google/sanitizers/wiki/AddressSanitizerAsDso#asan-and-ld_preload

just to ease the use of ASan, for fine-tuned behaviour, use
`ASAN_OPTIONS`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Kefu Chai
e851462977 ceph.in: extract get_cmake_variables()
so it can be reused

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Kefu Chai
669853e018 cmake: should compile libzstd with -fPIC
otherwise we will have

/usr/bin/ld: libzstd/lib/libzstd.a(error_private.c.o): relocation
R_X86_64_32S against `.rodata' can not be used when making a shared
object; recompile with -fPIC

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Kefu Chai
b605210b97 cmake: pass Sanitizers flags to linker for linking .so
see
https://github.com/google/sanitizers/wiki/AddressSanitizer#using-addresssanitizer

to be specific,

> In order to use AddressSanitizer you will need to compile and link your
> program using `clang` with the `-fsanitize=address` switch.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Kefu Chai
38e7686a37 cmake: pass cflags to disutils using CC instead of CFLAGS
in python's distutils.ccompiler, linker_exe is composed using CC instead
of LDFLAGS. the latter only effects how it builds (shared) library.

and put CMAKE_C_FLAGS into the cflags for the compiler for building
python C extensions, it's more consistent this way. more importantly,
if we build with ASan enabled, the canary program, a.k.a. rados_dummy.c,
won't link without proper CFLAGS.

without this change, rados.so fails to build with errors like:

/usr/bin/ld: /var/ssd/ceph/build/lib/librados.so: undefined reference to
`__asan_stack_free_10'
/usr/bin/ld: /var/ssd/ceph/build/lib/librados.so: undefined reference to
`__asan_report_exp_store8'
...
...

clang: error: linker command failed with exit code 1 (use -v to see
invocation)

Link Error: RADOS library not found
make[3]: ***
[src/pybind/rados/CMakeFiles/cython_rados.dir/build.make:57:
src/pybind/rados/CMakeFiles/cython_rados] Error 1

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Kefu Chai
3ac8c8dca7 common/TextTable: define endrow
otherwise "cmake -DWITH_ASAN=ON -DCMAKE_BUILD_TYPE=Debug" will fail to
build with

/usr/bin/ld: //var/ssd/ceph/build/lib/libceph-common.so.0: undefined
reference to `TextTable::endrow'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-22 14:40:03 +08:00
Shiyang Ruan
99ce7cf48b common: fix typos in BackoffThrottle
Signed-off-by: Shiyang Ruan <ruansy.fnst@cn.fujitsu.com>
2018-10-22 13:09:20 +08:00
Yan, Zheng
19d2cecd97 PendingReleaseNotes: note about cephfs client state reclaim
Fixes: http://tracker.ceph.com/issues/36394
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-10-22 11:57:08 +08:00