Commit Graph

92295 Commits

Author SHA1 Message Date
Mykola Golub
b5ebe10f5f mgr/osd_perf_query: improvements for testing module
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 20:59:01 +02:00
Robin H. Johnson
e63e210679
Merge pull request #22599 from anthonyeleven/patch-2
doc: Tidy up description wording and spelling
2018-11-20 09:44:04 -08:00
Sage Weil
f3c27670c0 Merge PR #24737 into master
* refs/pull/24737/head:
	doc/ceph-bluestore-tool: add help for migrate and new DB/WAL commands.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 09:50:04 -06:00
Lenz Grimmer
1334e194f9
Merge pull request #25010 from nathan-weinberg/breadcrumb-tests
mgr/dashboard: Added additional breadcrumb tests to Cluster

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-11-20 16:36:48 +01:00
Lenz Grimmer
7c5ce8b87b
Merge pull request #25141 from rhcs-dashboard/wip-37293-master
mgr/dashboard: Fix Forbidden Error with some roles

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-11-20 16:34:59 +01:00
Kefu Chai
ebfa2df2d5 cmake: do not pass unnecessary param to setup.py
--single-version-externally-managed is used for packaging python eggs
to deb. so the metadata can be stored in the egg, and can be accessed
by user if necessary, see [1]. but this does not apply to users who
just want to "make install" without packaging Ceph.

the problem is, if we pass --single-version-externally-managed to
setup.py, we need to pass --record or --root also. otherwise setuptools
complains:

error: You must specify --record or --root when building system packages

so in this change, we choose not to pass
"--single-version-externally-managed", unless $DESTDIR is set.

both "ceph.spec.in" and "debian/rules" set $DESTDIR when running "make
install". so we can always check $DESTDIR to tell if current "make
install" is launched by the packaging script or not. this might not be
accurate, but good enough. assuming enduser does not use DESTDIR when
running plain "make install".

--
[1] https://wiki.debian.org/Python/FAQ#How_should_we_package_Python_eggs.3F

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-20 22:20:41 +08:00
Nathan Cutler
8ea39207bf build/ops: rpm: add link to doc explaining bcond syntax
The %bcond_with and %bcond_without macros are confusing to folks who
don't do a lot of RPM packaging work. Let's try to help these folks out!

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-11-20 15:01:44 +01:00
Nathan Cutler
7d4916618c build/ops: rpm: stop install-deps.sh clobbering spec file Python build setting
Fedora 29 still ships a Python 2 binary, but some of Ceph's build
dependencies are only available in py3 versions there. In other
words, from F29 on, it is no longer possible to do a py2 Ceph build
on Fedora, even if a python2 binary exists on the system.

If that were not enough, the Python 2 that ships with Fedora 29 is
linked against a non-compatible version of OpenSSL.

Before this commit, install-deps.sh was overriding the spec file's
Python build setting based on the presence or absence of a python2
binary. As the bug cited below indicates, this was not a good idea.

It's better for the spec file to be explicit about which OS versions
are py2 and which are py3, and just stick to that.

Fixes: http://tracker.ceph.com/issues/37301
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-11-20 15:00:48 +01:00
Kefu Chai
0a0e9f0179
Merge pull request #25176 from cyx1231st/wip-crimson-msgr-extract-states
crimson/net: encapsulate protocol implementations with states

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-20 21:58:37 +08:00
Yingxin
4da176a787 crimson/net: remove recursive call to handle_connect_reply()
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-11-20 22:18:01 +08:00
Yingxin
b4a83826ba crimson/net: fix minor issue and add TODO for error-handling
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-11-20 22:07:57 +08:00
Kefu Chai
e411f89ca6 crimson/net: extract state transition out of repeat_connect()
and extract state transition out of repeat_handle_connect()

in this change, the connect/handle-connect loop is restructured, to
avoid ad-hoc state changes in helper functions. this pave the road to
explicit state transtion using named states.

also, exception is thrown instead in handle_connect_reply(), we should
not proceed in case of failures. and we need do error handling in the
named state in future.

currentl, `state` is set to `state_t::open` in `start_connect()` and
`start_accept()`, the next step is to set it in a named state.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-20 22:00:08 +08:00
Lenz Grimmer
6e95664ead
Merge pull request #25149 from p-na/pna-fix-safe-to-destroy
mgr/dashboard: Fix failing QA test: test_safe_to_destroy

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-11-20 14:33:42 +01:00
Kefu Chai
23c0524c96 crimson/net: define an alias of seastar::stop_iteration
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-20 21:08:29 +08:00
Yingxin
c014f702d9 crimson/net: check short reads in read_exactly()
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-11-20 20:58:34 +08:00
Sage Weil
75f17a222b Merge PR #24844 into master
* refs/pull/24844/head:
	osd: drop PGBackend::Listener::get_epoch().
	osd: massively switch to get_osdmap_epoch().
	osd: switch the return type of PG::get_osdmap().

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 06:51:29 -06:00
Sage Weil
b84730a921 Merge PR #24867 into master
* refs/pull/24867/head:
	mon: compensate for not having STDLIB_MAP_SPLICING

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-11-20 06:50:50 -06:00
Sage Weil
c872e42657 Merge PR #24929 into master
* refs/pull/24929/head:
	osd: set lower bound+docs on osd_max_write_size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-20 06:50:33 -06:00
Sage Weil
9b3d909046 Merge PR #25058 into master
* refs/pull/25058/head:
	mgr: Fixed devicehealth plugin resource leak

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 06:50:17 -06:00
Sage Weil
d7ed1ccf48 Merge PR #25125 into master
* refs/pull/25125/head:
	mon: require keyring even if cephx is optional

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 06:49:54 -06:00
Sage Weil
4c0632df91 qa/tasks/ceph: gather crash dumps
Gather crash dumps as part of the teuthology run.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-20 06:49:20 -06:00
Yingxin
9b7d8ffd5e crimson/net: connection closed during connecting
It is possible during `seastar::connect()`, the connection is marked
closed (when SocketConnection::socket is unavailable), then
`seastar::connect()` successfully returns a connected socket.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-11-20 20:48:35 +08:00
Jan Fajerski
92494c969f doc/mgr/prometheus: readd section about custom instance labels
This section was removed accidentally by
331a826a9f. It offers a helpful configuration
variant to deal with mgr failovers.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-20 12:43:12 +01:00
Lenz Grimmer
228cffa107
Merge pull request #25121 from zmc/wip-dashboard-test-runner
mgr/dashboard: Small improvements for running teuthology tests

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2018-11-20 12:29:35 +01:00
Mykola Golub
b90c880281 mgr: parse OSDPerfMetricQuery spec that comes from python module
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Mykola Golub
b8362d904a mgr: make dynamic osd perf counters accessible from modules
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Mykola Golub
10dba8a6d6 osd: fixup to recently added dynamic perf stats
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Mykola Golub
ac8b016b72 mgr: fix PyFormatter's dump_unsigned
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Mykola Golub
438a3f7bc4 mgr: store osd perf counters received in osd reports
Make the counters accessible for the query owners.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Mykola Golub
073555e30f mgr: generalize OSDPerfMetricQuery to support different queries
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-20 13:18:30 +02:00
Lenz Grimmer
ac743f2a91
Merge pull request #24851 from rhcs-dashboard/grafana-roles
mgr/dashboard: Show/Hide Grafana tabs according to user role

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-20 10:21:04 +01:00
Abhishek L
0c7d5cbf46
Merge pull request #24762 from tspmelo/wip-credits
credits.sh: Ignore package-lock.json and .xlf files

Reviewed-By: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2018-11-20 09:40:59 +01:00
Volker Theile
945e790cab mgr/dashboard: Can't handle user editing when tenants are specified
Fixes: https://tracker.ceph.com/issues/36480

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-11-20 09:07:33 +01:00
Kefu Chai
004d918ae0
Merge pull request #25169 from tchaikov/wip-install-libboost-bionic
install-deps.sh: fix gcc detection and install pre-built libboost on bionic

Tested-by: Changcheng Liu <changcheng.liu@intel.com>
Reviewed-by: Changcheng Liu <changcheng.liu@intel.com>
2018-11-20 15:54:34 +08:00
Kefu Chai
98d7741579 install-deps.sh: install prebuilt libboost dependencies for bionic also
* extract boost install function into a helper, so we don't need to
  repeat it when adding support for new distros.
* install ceph-libboost-* for bionic build also. we check for the
  existence in run-make-check.sh, so there is no need to update
  the build script elsewhere.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-20 13:09:53 +08:00
Changcheng Liu
ab7344e617 install-deps.sh: correct gcc version info as major.minor.patch
On ubuntu 18.04, "gcc -dumpversion" output "7", it result in
that below check will return false:
    dpkg --compare-versions 7 ge 7.0
Then, this script will install other gcc.

Actully, the full gcc version "gcc -dumpfullversion" output is
"7.3.0", than below check will turn true:
    dpkg --compare-version 7.3.0 ge 7.0
So, there's no need to install other gcc.

In case of hitting error on ubuntu16.04, use below parameter:
   gcc -dumpfullversion -dumpversion

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2018-11-20 12:31:42 +08:00
hsiang41
5a5f744651 mgr: Diskprediction local activate when config changes
Trigger diskprediction local action when receive notify configuration changed.

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-20 11:03:12 +08:00
Sage Weil
38e95b2d8a Merge PR #24874 into master
* refs/pull/24874/head:
	os/filestore: collect partition/device metadata from journal
	os/filestore: include journal in get_devices result

Reviewed-by: Rick Chen <rick.chen@prophetstor.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-11-19 17:31:19 -06:00
Sage Weil
e2c1eb8fbc Merge PR #25140 into master
* refs/pull/25140/head:
	mon: by default, do NOT warn about misplaced objects
	mon: add mon_warn_on_misplaced option

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-11-19 17:29:57 -06:00
Sage Weil
4ebf2b2bea Merge PR #25147 into master
* refs/pull/25147/head:
	mgr/devicehealth: implement config_notify hook
	mgr: call config_notify method when mgr's config has changed
	mon/MonClient: add callback for (any) config change
	common/config: fix debug output for config callbacks changes

Reviewed-by: Tim Serong <tserong@suse.com>
2018-11-19 17:29:41 -06:00
Patrick Donnelly
a8937d987c
Merge PR #25158 into master
* refs/pull/25158/head:
	[doc] Fix typo in luminious release notes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-19 14:17:14 -08:00
Tiago Melo
ad293e1961 mgr/dashboard: Fix run-frontend-e2e-tests.sh
e2e tests were always returning positive result, even when they failed.

Fixed problem with jq, where it was failing when it was not receiving a string.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-11-19 19:20:36 +00:00
Sage Weil
ba49aacee2 Merge PR #25111 into master
* refs/pull/25111/head:
	test: Add test for requested scrub priority
	osd: Prioritize user specified scrubs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-19 13:15:21 -06:00
Yuri Weinstein
02df8f3008
Merge pull request #23819 from dongbula/nf-add-bucket-option-in-usage
rgw: add bucket as option when show/trim usage

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-19 08:49:06 -08:00
Yuri Weinstein
3a77ff454d
Merge pull request #23318 from theanalyst/wip-curl-errstring
rgw: http client: print curl error messages during curl failures

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-19 08:47:27 -08:00
Neha Ojha
7ac345044e
Merge pull request #25069 from markhpc/wip-memory-autotune-doc
doc/rados: Add bluestore memory autotuning docs.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-19 22:16:43 +05:30
Yuri Weinstein
d06f455bfd
Merge pull request #24492 from theanalyst/wip-rgw-es-attr-fixes
rgw: ES sync: be more restrictive on object system attrs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-19 08:44:50 -08:00
Yuri Weinstein
a2083445f8
Merge pull request #24730 from pritha-srivastava/wip-rgw-role-fixes
rgw: Minor fixes to radosgw-admin commands for a role.

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-19 08:44:10 -08:00
Yuri Weinstein
dde9ce1824
Merge pull request #24846 from taoCH/wip-fix-librgw-quota-check
rgw_file: not check max_objects when creating file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-19 08:43:10 -08:00
Maxime
ddadf083ee [doc] Fix typo in luminious release notes
Signed-off-by: Maxime <maxime@root314.com>
2018-11-19 16:36:04 +01:00