Commit Graph

89354 Commits

Author SHA1 Message Date
Patrick Nawracay
e71466cc49 mgr/dashboard: Add support for managing individual OSD settings (backend)
Add options to mark OSDs in/out/down/reweight/lost/remove/destroy/create

Fixes: http://tracker.ceph.com/issues/24270

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-09-03 12:51:04 +02:00
Kefu Chai
04b7d3db49
Merge pull request #23654 from cbodley/wip-crypto-assert-always
crypto: use ceph_assert_always for assertions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-21 11:00:50 +08:00
Patrick Donnelly
5f1727c5e4
Merge PR #22668 into master
* refs/pull/22668/head:
	mds: reorganize and curate perf log counters
	mds: show session load average in dump session
	mds: allow request load average decay rate configurable via admin socket
	mds: decay counter for tracking request load average
	mds: add perf counters to track current open/stale sessions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:45 -07:00
Patrick Donnelly
13214bdf68
Merge PR #23438 into master
* refs/pull/23438/head:
	client: fix choose_target_mds for requests that do name lookup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:38 -07:00
Patrick Donnelly
a031796058
Merge PR #23467 into master
* refs/pull/23467/head:
	cephfs-journal-tool: enable purge_queue journal's event commands

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-20 15:11:31 -07:00
Patrick Donnelly
dbaa32b412
Merge PR #23529 into master
* refs/pull/23529/head:
	mon: fix idempotent FS creation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-08-20 15:11:23 -07:00
Patrick Donnelly
84fa8ad720
Merge PR #23543 into master
* refs/pull/23543/head:
	tools/cephfs: make cephfs-data-scan prints the max used ino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:17 -07:00
Patrick Donnelly
9076ecf94a
Merge PR #23584 into master
* refs/pull/23584/head:
	mds: don't modify filepath when printing
	mds: hold slave request refernce when dumping MDRequestImpl

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:10 -07:00
Patrick Donnelly
3c8a66f186
Merge PR #23589 into master
* refs/pull/23589/head:
	mds: more description for failed authpin
	mds: cleanup CDir freezing/frozen tree check

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:01 -07:00
Lenz Grimmer
001fcbefba
Merge pull request #23315 from Devp00l/wip-clean-notification-messages
mgr/dashboard: Cleaner notifications

Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-08-20 20:05:35 +02:00
Noah Watkins
46e551108c
Merge pull request #23637 from noahdesu/qa-mgr-mod-path
qa: fix manager module paths
2018-08-20 10:41:29 -07:00
Casey Bodley
82c26d6c44 crypto: use ceph_assert_always for assertions
use ceph_assert_always() to enforce this comment in ceph_crypto.h:

This assert MUST NOT be compiled out, even on non-debug builds.

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-20 11:05:51 -04:00
Jason Dillaman
33bc68caf4
Merge pull request #23639 from trociny/wip-24910
librbd: potential race on image create request complete

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-08-20 09:11:17 -04:00
Jason Dillaman
9b240c040d
Merge pull request #23110 from Songweibin/wip-rbd-snap-rollback
librbd: use object map when doing snap rollback

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-08-20 08:56:54 -04:00
Erwan Velu
bef6670ac4
Merge pull request #23609 from ErwanAliasr1/evelu-ccache
run-make-check: Showing configuration before the build
2018-08-20 11:55:45 +02:00
Kefu Chai
95be1a5994
Merge pull request #23601 from tchaikov/wip-pybind-freebsd-clang
pybind: do not check MFLAGS

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-08-19 23:59:28 +08:00
Kefu Chai
ed6bcfed61
Merge pull request #23593 from jtlayton/wip-jlayton-26948
librados: add a rados_omap_iter_size function

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-19 23:10:51 +08:00
Kefu Chai
bf357a68e8
Merge pull request #23588 from gmayyyha/ceph-df-json
mon/PGMap: command 'ceph df -f json' output add total_percent_used

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-19 23:10:01 +08:00
Kefu Chai
09714acc55
Merge pull request #23563 from yaozongyou/mon-ping-timeout
mon/MonClient: use mon_client_ping_timeout during ping_monitor

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-19 23:08:54 +08:00
Kefu Chai
26c0df5700
Merge pull request #10305 from majianpeng/memdb-perfcounter
kv/MemDB: add perfcounter.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-19 23:08:24 +08:00
Kefu Chai
1d1833ece0
Merge pull request #23628 from tchaikov/wip-cmake-gtest-cleanup
cmake: link against gtest in a better way

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-08-19 22:58:47 +08:00
Mykola Golub
d9e5cfaf4a librbd: potential race on image create request complete
Fixes: http://tracker.ceph.com/issues/24910
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-18 19:24:55 +03:00
Sage Weil
4573c7453a Merge PR #23616 into master
* refs/pull/23616/head:
	doc/releases/schedule: note Jewel EOL date

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-18 09:11:48 -05:00
Sage Weil
5867a480a1 Merge PR #23618 into master
* refs/pull/23618/head:
	doc: updated infernalis release reference link
	doc: added ref label for infernalis release notes
	doc: used reST label for ceph-deploy reference
	doc: added reference label for ceph-deploy page
	doc: updated cross referencing locations link

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-18 09:10:32 -05:00
David Zafman
d0b260c272 test: Fix test to use -gt instead of creating an empty file "0"
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-17 19:33:44 -07:00
Patrick Donnelly
39a9e1bef2
Merge PR #23636 into master
* refs/pull/23636/head:
	messages: fix get_opname return type

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-17 18:43:58 -07:00
Kefu Chai
17fe9496b3
Merge pull request #23620 from tchaikov/wip-dpdk-cmake
cmake: add dpdk::dpdk if dpdk is built or found

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-18 09:42:25 +08:00
Noah Watkins
61e2648c19 qa/ceph_objectstore_tool.py: set mgr module path
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-17 15:24:10 -07:00
Noah Watkins
7d3fa9bda3 qa/standalone/ceph-helpers.sh: fix mgr module path
callers of get_python_path were not passing in a $1 parameter, so
ceph_lib was an empty string resulting in an invalid path to the built
cython modules. assume this is called from the `lib` parent directory.

pass path to the manager modules when starting ceph-mgr.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-17 15:21:57 -07:00
Patrick Donnelly
a69d4ec500
messages: fix get_opname return type
It cannot be a constexpr.

Introduce-by: 00b867fae2 / #23623

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-17 14:15:18 -07:00
Casey Bodley
e2ecb0ee1c
Merge pull request #23574 from cbodley/wip-26895
rgw multisite: bucket sync transitions back to StateInit on OP_SYNCSTOP

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-08-17 16:52:18 -04:00
Patrick Donnelly
21c56b7402
Merge PR #23575 into master
* refs/pull/23575/head:
	tools/cephfs-shell:pep8 code clean
	tools/cephfs-shell:resolved removing files using pattern inside sub-directories
	tools/cephfs-shell:changed output representation for the commands cwd and ls
	tools/cephfs-shell:resolved removing directories using pattern inside sub-directories

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-17 12:04:42 -07:00
Sage Weil
2b2f0ec6a5 Merge PR #18096 into master
* refs/pull/18096/head:
	os/bluestore: factor VDO into bluestore's 'allocated' value
	os/filestore: estimate omap_allocated
	os/ObjectMap: add get_db() accessor
	osd/OSDMap: include data, omap in 'osd df' output
	os/bluestore: report omap and internal metadata usage
	os/bluestore/BlueFS: drop get_fs_usage(); add get_used()
	kv: add per-prefix space estimation
	osd: decouple statfs update from hb peers, pg count
	osd: drop useless OSDService::update_osd_stat()
	osd/osd_types: separate accounting for data, omap, and metadata
	osd: re-add get_num_pgs()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-08-17 13:56:22 -05:00
Pavani Rajula
ed1b0c9c95 tools/cephfs-shell:pep8 code clean
Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-17 23:37:37 +05:30
Pavani Rajula
05428f4962 tools/cephfs-shell:resolved removing files using pattern inside sub-directories
Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-17 23:37:24 +05:30
Pavani Rajula
d5efa9caae tools/cephfs-shell:changed output representation for the commands cwd and ls
Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-17 23:37:05 +05:30
Pavani Rajula
384700acdf tools/cephfs-shell:resolved removing directories using pattern inside sub-directories
Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-17 23:36:52 +05:30
Kefu Chai
00b867fae2
Merge pull request #23623 from tchaikov/wip-inline-constants
messages: define HEAD_VERSION and COMPAT_VERSION inlined

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-08-17 23:07:04 +08:00
Kefu Chai
09d388e97f messages: define HEAD_VERSION and COMPAT_VERSION inlined
otherwise we could have ../lib/libceph-common.so.0: undefined reference
to `MOSDPGNotify::HEAD_VERSION

when the compiler tries to be smart and pass them by reference.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 18:59:29 +08:00
Lenz Grimmer
2d7d0d2069
Merge pull request #23419 from tspmelo/fix-26856
mgr/dashboard: Add decorator to skip parameter encoding

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-08-17 11:08:05 +02:00
Lenz Grimmer
39ef941966
Merge pull request #23446 from tspmelo/wip-25075
mgr/dashboard: Use human readable units on the sparkline graphs

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-08-17 11:07:48 +02:00
Lenz Grimmer
ec1c0f89a5
Merge pull request #23388 from ricardoasmarques/wip-fix-auto-logout
mgr/dashboard: Fix redirect to login page on session lost

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-08-17 11:04:31 +02:00
Erwan Velu
d1a807a277 run-make-check: Showing configuration before the build
The actual code is resetting the statistics before doing the actual compilation and prints them after the build.

That is nice to understand how much the cache was used but doesn't help understanding how much it _could_ have been used.

This patch is adding a reporting (-s) when cleaning the statistics so we can estimate :
- the actual number of files in cache
- the actual size of the cache

With this two missing information, its now possible estimate if there is some miss-usage of the cache.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-08-17 10:16:58 +02:00
Kefu Chai
6f231ee864 cmake: link against gtest in a better way
* add FindGMock.cmake which allows user to use the libgtest-dev
  shipped by distro
* add GMock::{GMock,Main}, GTest::{GTest,Main} targets to be
  compatible with FindGTest.cmake and FindGMock.cmake, which
  expose the built libraries with properties adhered to
  them. so the consumer of them can import them in a better way.
* update tests to drop the commands like
  set_target_properties(foo PROPERTIES COMPILE_FLAGS ${UNITTEST_CXX_FLAGS}),
  as they are already linked against gmock and gtest.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 15:21:27 +08:00
Kefu Chai
303e3c4a6c cmake: fix Finddpdk.cmake
* add dpdk::dpdk if dpdk is built or found, as seastar checks for
  it before adding its component libraries. if user installs libdpdk
  and builds WITH_SEASTAR=ON or WITH_DPDK=ON, cmake fails to configure
  the building system without this fix.
* add dpdk::cflags target for populating the -march=<arch> compile
  option.
* also use pkg-config for finding dpdk.
* link common_async_dpdk against dpdk::dpdk instead

please note, the reason why we can remove the "-march=native" compile
option from Finddpdk.cmake, is that the distro shipped header files
are "generic" in the sense of "-march=<ARCH>", they do not enable
the arch specific intrinsic by default, hence the source files
including them do not need specific compiler options.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 15:16:22 +08:00
Nathan Cutler
18dc98e3f0 cmake: do not build DPDK with -march=native
-march=native causes gcc to use opcodes according to whichever CPU happens to
be installed in the build host, which can be different for every build. This
makes it impossible to achieve a reproducible build.

Also, if the build host has a very new CPU, running the resulting binaries on
older CPUs (of the same family, i.e. x86_64) could result in segmentation
fault.

References: http://tracker.ceph.com/issues/24948
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-08-17 14:09:08 +08:00
Kefu Chai
65f6a3c564 cmake: honour CMAKE_REQUIRED_LIBRARIES in CheckIncludeFiles
to silence cmake warning regarding to CMP0075

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-17 14:08:57 +08:00
James McClune
9ee2d6b04c
doc: updated infernalis release reference link
Updated Infernalis reference link with reST label.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:37:54 -04:00
James McClune
a3a5036b10
doc: added ref label for infernalis release notes
Added reference label for Infernalis release notes.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:30:52 -04:00
James McClune
288d9713c2
doc: used reST label for ceph-deploy reference
Updated ceph-deploy man page link with ref label. Fixes
404 error. 

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:17:47 -04:00