Commit Graph

89546 Commits

Author SHA1 Message Date
Lenz Grimmer
ec1c0f89a5
Merge pull request #23388 from ricardoasmarques/wip-fix-auto-logout
mgr/dashboard: Fix redirect to login page on session lost

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-08-17 11:04:31 +02:00
Erwan Velu
d1a807a277 run-make-check: Showing configuration before the build
The actual code is resetting the statistics before doing the actual compilation and prints them after the build.

That is nice to understand how much the cache was used but doesn't help understanding how much it _could_ have been used.

This patch is adding a reporting (-s) when cleaning the statistics so we can estimate :
- the actual number of files in cache
- the actual size of the cache

With this two missing information, its now possible estimate if there is some miss-usage of the cache.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-08-17 10:16:58 +02:00
Kefu Chai
6f231ee864 cmake: link against gtest in a better way
* add FindGMock.cmake which allows user to use the libgtest-dev
  shipped by distro
* add GMock::{GMock,Main}, GTest::{GTest,Main} targets to be
  compatible with FindGTest.cmake and FindGMock.cmake, which
  expose the built libraries with properties adhered to
  them. so the consumer of them can import them in a better way.
* update tests to drop the commands like
  set_target_properties(foo PROPERTIES COMPILE_FLAGS ${UNITTEST_CXX_FLAGS}),
  as they are already linked against gmock and gtest.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 15:21:27 +08:00
Kefu Chai
303e3c4a6c cmake: fix Finddpdk.cmake
* add dpdk::dpdk if dpdk is built or found, as seastar checks for
  it before adding its component libraries. if user installs libdpdk
  and builds WITH_SEASTAR=ON or WITH_DPDK=ON, cmake fails to configure
  the building system without this fix.
* add dpdk::cflags target for populating the -march=<arch> compile
  option.
* also use pkg-config for finding dpdk.
* link common_async_dpdk against dpdk::dpdk instead

please note, the reason why we can remove the "-march=native" compile
option from Finddpdk.cmake, is that the distro shipped header files
are "generic" in the sense of "-march=<ARCH>", they do not enable
the arch specific intrinsic by default, hence the source files
including them do not need specific compiler options.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 15:16:22 +08:00
Venky Shankar
f9b8ad5793 mds: access last std::vector element with back()
... rather than accessing it as an array. also convert
to range loops whereever necessary. plus some style
fixes.

Fixes: https://tracker.ceph.com/issues/25113
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-08-17 02:45:09 -04:00
Venky Shankar
bae6c9db65 mds: disallow certain file operations to "." and ".." dirents
Also, fixup return value for file operations such as rmdir()
and rename() on these directories.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-08-17 02:45:09 -04:00
Nathan Cutler
18dc98e3f0 cmake: do not build DPDK with -march=native
-march=native causes gcc to use opcodes according to whichever CPU happens to
be installed in the build host, which can be different for every build. This
makes it impossible to achieve a reproducible build.

Also, if the build host has a very new CPU, running the resulting binaries on
older CPUs (of the same family, i.e. x86_64) could result in segmentation
fault.

References: http://tracker.ceph.com/issues/24948
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-08-17 14:09:08 +08:00
Kefu Chai
65f6a3c564 cmake: honour CMAKE_REQUIRED_LIBRARIES in CheckIncludeFiles
to silence cmake warning regarding to CMP0075

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 14:08:57 +08:00
James McClune
9ee2d6b04c
doc: updated infernalis release reference link
Updated Infernalis reference link with reST label.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:37:54 -04:00
James McClune
a3a5036b10
doc: added ref label for infernalis release notes
Added reference label for Infernalis release notes.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:30:52 -04:00
James McClune
288d9713c2
doc: used reST label for ceph-deploy reference
Updated ceph-deploy man page link with ref label. Fixes
404 error. 

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:17:47 -04:00
James McClune
9fd5dc9cc2
doc: added reference label for ceph-deploy page
Added reST label for ceph-deploy page.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:05:20 -04:00
Yan, Zheng
a7076fae36 mds: adjust export size after renaming directory into freezing subtree
restart exporting the subtree if rename makes export size too large

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:59:54 +08:00
James McClune
d772bd3b5f
doc: updated cross referencing locations link
Updated cross referencing locations link for doc/start/documenting-ceph.rst

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 21:58:34 -04:00
Yan, Zheng
2788b132a8 mds: clear scatterlock's flushed when removing dirty
If mds imports scatterlock's parent inode later, the leftover flushed
flag may prevent Locker::eval_gather from calling scatter_writebehind
and result incorrect dirstat/neststat.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:44:23 +08:00
Yan, Zheng
da7fc1ad2c mds: export subtree part by part
When exporting a large subtree, migrator may only exports some portions
of the subtree. This patch makes migrator continue to export the rest
partions when previous operations finish.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:44:23 +08:00
Yan, Zheng
07ef150d3c mds: change default mds_max_export_size to 20M
1G seems too large. mds may speed long time on processing
imported/expored subtree.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:44:23 +08:00
Yan, Zheng
dd9ad34416 mds: limit total size of exporting subtrees
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:44:23 +08:00
Yan, Zheng
c163777ffe mds: optimize the way how max export size is enforced
The old way is checking export size after subtree gets frozen. It may
freeze a large subtree, but only exports small portion of the subtree.

The new way is choosing some subdirs according to the max export size,
then freeze these subdirs.

http://tracker.ceph.com/issues/25131
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:42:58 +08:00
Yan, Zheng
6538dae2c1 mds: make CInode::get_dirfrags container agnostic
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:40:16 +08:00
Yan, Zheng
efff5c69f1 mds: cleanup MutationImpl::More initialization
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:40:16 +08:00
Yan, Zheng
0f057feac3 mds: don't modify filepath when printing
filepath::depth() may call parse_bits(), which modifies mutable member
'bits'. dump_ops_in_flight asok command prints filepath without holding
mds_lock. So multiple threads may call parse_bits() at the same time.

Fixes: http://tracker.ceph.com/issues/26894
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:26:55 +08:00
Yan, Zheng
1013374863 mds: hold slave request refernce when dumping MDRequestImpl
dump_ops_in_flight asok command dumps MDRequestImpl without holding
mds_lock. MDS may free MDRequestImpl::slave_request in the middle of
dumping MDRequestImpl.

Fixes: http://tracker.ceph.com/issues/26894
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-17 09:26:45 +08:00
xie xingguo
12af0ed71b osd/PG: calc_min_last_complete_ondisk should return nothing
As we now no more use it to calc pg_trim_to.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-17 08:23:53 +08:00
xie xingguo
a9c4b7f425 osd/PrimaryLogPG: optimize recover order
By definition, async_recovery_targets should have a lower
priority than those coming from the acting set.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-17 08:23:53 +08:00
Patrick Donnelly
c25ef2a7ee
Merge PR #23468 into master
* refs/pull/23468/head:
	Allow to unittest shell using transcript
2018-08-16 16:34:23 -07:00
Patrick Donnelly
769a93f4ec
Merge PR #22555 into master
* refs/pull/22555/head:
	msg: define MFoo::create helper
	msg: add msgref cast method
	msg: cleanup factory/ref definition in messages
	mds: use message factory to avoid leaks
	msg: add factory method to correctly construct smart_ptr
	mds: remove dead MDS-MDS forwarding code
	mds: manage Message lifetime with intrusive_ptr
	common: add templated Context factory
	msg: add const version of get_payload
	msg: use queue of messages for dispatch
	msg: dispatch intrusive_ptr Messages
	msg: use deque for dispatcher pointers

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-16 16:17:42 -07:00
Nathan Cutler
cb1531dbd7 doc/releases/schedule: note Jewel EOL date
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-08-16 23:32:06 +02:00
Dan Mick
b221877462 debian/rules: fix ceph-mgr .pyc files left behind
Add second dh_python2 call with the "private" dir /usr/lib/ceph/mgr

Fixes: http://tracker.ceph.com/issues/26883
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-08-16 14:29:15 -07:00
Patrick Donnelly
acd02343f4
Merge PR #23551 into master
* refs/pull/23551/head:
	qa: use recent kernel to kernel build testing

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-16 09:57:27 -07:00
Jason Dillaman
a5302e18ff
Merge pull request #23608 from tchaikov/wip-librbd-test
test/librbd: fix -Wsign-compare warnings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-08-16 12:43:04 -04:00
Patrick Donnelly
f0fe0936e6
qa: use recent kernel to kernel build testing
Fixes: http://tracker.ceph.com/issues/24679

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:16:39 -07:00
Patrick Donnelly
f0800a49ed
Merge PR #23597 into master
* refs/pull/23597/head:
	qa: add cephfs-shell skeleton test case

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:14:11 -07:00
Patrick Donnelly
0b5df6e00a
qa: add cephfs-shell skeleton test case
Right now just tests that "help" works.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:13:36 -07:00
Matt Benjamin
d12c72cf4c
Merge pull request #21286 from joke-lee/wip-auth-uri-encode-decode
rgw:  should recode  canonical_uri when caculate s3 v4 auth
2018-08-16 11:58:14 -04:00
Jesse Williamson
1a44357f5c package: modify ceph.spec.in to support libradosstriper conditional compilation
Signed-off-by: Jesse Williamson <jwilliamson@suse.de>
2018-08-16 08:21:42 -07:00
Jesse Williamson
6e4db7b0a4 tools: make rados.cc compatible with conditionally-compiled striper
Signed-off-by: Jesse Williamson <jwilliamson@suse.de>
2018-08-16 08:21:37 -07:00
Yuri Weinstein
d3385fc6bb
Merge pull request #23533 from wjwithagen/wjw-fix-random_shuffle
osd: make random shuffle comply with C++17

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-16 08:09:21 -07:00
Yuri Weinstein
dbed62b323
Merge pull request #23547 from yaozongyou/mon-get-rank
mon/MonMap: remove duplicate code in get_rank

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2018-08-16 08:06:16 -07:00
Kefu Chai
fa43fc0ca7 test/librbd: fix -Wsign-compare warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-16 22:53:27 +08:00
Stephan Müller
7f804e3fab mgr/dashboard: Rename to taskMessageService
Renames taskManagerMessageService to taskMessageService.

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-08-16 16:38:04 +02:00
Tiago Melo
45e645b770 mgr/dashboard: Add decorator to skip parameter encoding
By enconding all parameters of api services we were also encoding parameters
that were being sent in the body of the request.
Those parameters don't need to be enconded and the server never decodes them.

With this new decorator you can specify if you don't want a parameter to be
enconded.

This is a regression introduced in f21d0da5a3.

Fixes: http://tracker.ceph.com/issues/26856

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-08-16 15:29:11 +01:00
Stephan Müller
ac867c7f83 mgr/dashboard: Cleaner notifications
Now background tasks and recent notifications won't differ in their
wording anymore and all notifications have the same style.

Fixes: https://tracker.ceph.com/issues/24460

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-08-16 16:26:22 +02:00
Tiago Melo
6a8cdcef77 mgr/dashboard: Use human readable units on the sparkline graphs
Fixes: http://tracker.ceph.com/issues/25075

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-08-16 15:00:46 +01:00
Lenz Grimmer
0feccf0ca9
Merge pull request #23445 from ricardoasmarques/wip-rbd-actions-disable
mgr/dashboard: Disable RBD actions during task execution

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-08-16 15:55:11 +02:00
Kefu Chai
5a2b1af273
Merge pull request #23485 from javacruft/misc-32bit-fixes
build: 32 bit architecture fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-16 20:57:59 +08:00
Kefu Chai
7a25929687
Merge pull request #23581 from JiYou/fix.examples.Makefile
examples/Makefile: add -Wno-unused-parameter to avoid compile error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-16 20:17:13 +08:00
Igor Fedotov
a60b2316ce os/bluestore: fix assertion in StupidAllocator::get_fragmentation
One might face an assertion (assert(intervals <= max_intervals))
in StupidAllocator::get_fragmentation method for clusters created
by early Luminous releases and before. The root cause is that block
volume size wasn't aligned with min_alloc_size and hence we missed
that last fraction interval during max_interval calculation.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-08-16 14:51:06 +03:00
Pavani Rajula
b0358447aa Allow to unittest shell using transcript
Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-16 17:11:20 +05:30
Kefu Chai
d9efc5aa63
Merge pull request #23600 from wjwithagen/wjw-fix-freebsd-manual
doc: fix/cleanup freebsd osd disk creation

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-16 18:13:33 +08:00