Commit Graph

106689 Commits

Author SHA1 Message Date
Kefu Chai
26c66630bd
Merge pull request #32702 from rzarzynski/wip-bug-43646
common/bl: fix the dangling last_p issue.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-20 20:33:48 +08:00
Radoslaw Zarzynski
6d590f617e msg/async: use dedicated method for clearing conn's priv up.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-20 12:19:32 +01:00
Radoslaw Zarzynski
c2f61b95f5 msg/async: mark down local_connection before draining the stack.
`AsyncMessenger` has `local_connection` – an instance of
`AsyncConnection` used to send messages to itself (loop back).
Connections are handled by `EventCenter` in its dedicated
thread. When shutting down a messenger, it must be ensured
there is no task left in the `EventCenter`'s queue. Otherwise
a use-after-free can happen. That's the reason why `shutdown()`
of `AsyncMessenger` does `mark_down_all()` on connections
**before** draining the stack. The latter actually injects a task
into all `EventCenter` instances and waits for its completion
(synchronization barrier).

However, that's not the case for `local_connection`. Without
the patch it's marked down by the messenger's destructor
far **after** the synchronization barrier. This behavior is
dangerous when an implementation of `mark_down()` creates
a new task to be executed inside the boundaries of corresponding
`EventCenter` instance.

The fix unifies handling of `local_connection` with other
connections in the aspect of the shutdown phase.

Fixes: https://tracker.ceph.com/issues/43667
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-20 12:15:22 +01:00
Jan Fajerski
e098536acc
Merge pull request #32325 from Kriechi/fix-42982
monitoring: fix prometheus alert for full pools
2020-01-20 10:42:36 +01:00
Volker Theile
ae97132cb2 mgr/dashboard: Cleanup router config
Now that a parent component takes care about the rendering of the workbench, then this componenta can also take care about the authentication check.

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-20 09:09:54 +01:00
Volker Theile
c320371e7d mgr/dashboard: Introduce layout components
This PR will simplify the code of the app component in that way that it introduces layout components. Depending on the route a specific layout is choosen. Currently there are two layouts:

- Workbench
- Blank

The blank layout, which does not show any navigation controls, is used for the error, login and logout pages. The workbench layout shows the navigation controls and is mainly used for all pages that are used to configure Ceph.

The 403 and 404 pages have a 'Back' button that will redirect to /login. The Angular router will redirect to /dashboard if logged in.

Fixes: https://tracker.ceph.com/issues/43565

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-20 09:09:54 +01:00
Rishabh Dave
cbcb829575 doc: fix links in developer_guide
Fixes: https://tracker.ceph.com/issues/43663
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-20 11:33:48 +05:30
Rishabh Dave
f6ea1ca36f doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst
Rename to mount-using-kernel.rst and mount-using-fuse.rst respectively
so that it's easier to find them in doc/cephfs directory.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-20 10:32:06 +05:30
Kefu Chai
2cc286075f
Merge pull request #32692 from tchaikov/wip-remove-btree-dump
include/cpp-btree: drop btree::dump()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2020-01-20 11:58:10 +08:00
Sage Weil
5c1e0e5f1f qa/suite/rgw/verify: valgrind on centos again!
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-19 18:47:13 -06:00
Sage Weil
ce16d20b2b Merge PR #32724 into master
* refs/pull/32724/head:
	qa/workunits/rados/test_crash.sh: suppress core files

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-19 18:13:43 -06:00
Sage Weil
290992e519 qa/workunits/rados/test_crash.sh: suppress core files
The cores will make teuthology fail the job--and we don't want them for
this test, where we are deliberately causing crashes.

Fixes: https://tracker.ceph.com/issues/43653
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-19 17:12:09 -06:00
Sage Weil
0aee4e5f04 qa/tasks/ceph_manager: fix shell osd for ceph-objectstore-tool commands
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-19 15:32:25 -06:00
Mykola Golub
edfc6934e2
Merge pull request #32684 from dillaman/wip-rbd-el8
tests: corrected issues with RBD tests under EL8 distros

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-01-19 20:48:09 +02:00
Sage Weil
8ad6cbef5f Merge PR #32681 into master
* refs/pull/32681/head:
	mgr/cephadm: fix section name for mon options in ceph.conf

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-19 11:38:38 -06:00
Sage Weil
0e56cb0dda Merge PR #32006 into master
* refs/pull/32006/head:
	mgr/cephadm: revert to OrchestratorClientMixin child
	mgr/cephadm: initial upgrade logic
	cephadm: return 'cephadm pull' result as JSON
	mgr/cephadm: upgrade start/stop/pause/resume
	mgr/cephadm: track ceph version as well as container in on 'upgrade check'
	mgr/orchestrator_cli: upgrade {start,pause,resume,stop}
	mgr/cephadm: fix upgrade check
	mon/ConfigKeyService: remove config-key set warning

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-19 11:38:22 -06:00
Sage Weil
305d4071fa Merge PR #32685 into master
* refs/pull/32685/head:
	cephadm: remove -crash container before starting it
	cephadm: stop the crash container the nice way
	cephadm: no need for podman rm when passing --rm to run
	ceph-crash: exit code 0 on SIGINT, SIGTERM

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-19 11:38:02 -06:00
Kefu Chai
75a0bbe795
Merge pull request #32720 from tchaikov/wip-disable-crimson-socket-test
test/crimson: remove unittest_seastar_socket temporarily

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-19 22:41:17 +08:00
Yuval Lifshitz
07630a8759 rgw/notification: add opaque data
opaque data may be set in topic configuration and later on sent inside
nottifications triggered by that topic.

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-01-19 15:37:56 +02:00
Mykola Golub
d3ca1cdc5e
Merge pull request #32687 from dillaman/wip-42097
librbd: support compression allocation hints to the OSD

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-01-19 10:41:14 +02:00
Mykola Golub
81808a1c97
Merge pull request #32671 from dillaman/wip-43537
rbd-mirror: periodically poll remote mirror configuration

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-01-19 10:40:05 +02:00
Kefu Chai
50e609359a test/crimson: remove unittest_seastar_socket temporarily
see also #32632. before we have the complete fix, we should disable this
test to avoid more noise from this test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-19 13:02:12 +08:00
Kefu Chai
a048784937
Merge pull request #32719 from liewegas/wip-o-upgrades
qa/suites/upgrade: fix mimic-x-singleton

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-19 11:39:01 +08:00
Sage Weil
b516cf7011 Merge PR #32673 into master
* refs/pull/32673/head:
	crush/CrushWrapper: behave with empty weight vector
	cmake: no need to link libglobal and libblkid for testing crush
	test/crush: no need to use libglobal for testing crush

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-18 21:11:51 -06:00
Sage Weil
5af9944000 Merge PR #32439 into master
* refs/pull/32439/head:
	test/kv_store_bench: Fix double free error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-18 21:11:36 -06:00
Sage Weil
2b75b04b78 Merge PR #32640 into master
* refs/pull/32640/head:
	cephadm: fix help message for bootstrap --mgr-id

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-18 14:47:40 -06:00
Sage Weil
f584c97220 Merge PR #32627 into master
* refs/pull/32627/head:
	test_cephadm: use container shell for ceph cmds
	test_cephadm: `-d` debug no longer exists
	test_cephadm: clean-up whitespace (tabs -> spaces)

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-18 14:47:30 -06:00
Sage Weil
c5710bc8fb Merge PR #32628 into master
* refs/pull/32628/head:
	test: Fix wait_for_state() to wait for a PG to get into a state

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-18 14:39:19 -06:00
Sage Weil
6818496448 Merge PR #32385 into master
* refs/pull/32385/head:
	mgr/cephadm: check-host on 'host add'

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-18 12:54:06 -06:00
Sage Weil
714eb18892 Merge PR #32712 into master
* refs/pull/32712/head:
	cephadm: SO_REUSEADDR when doing bind check

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-18 12:53:40 -06:00
Sage Weil
65c89b93ae Merge PR #32711 into master
* refs/pull/32711/head:
	qa/standalone/mon/osd-create-pool: fix utf-8 grep LANG

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-18 12:53:24 -06:00
Sage Weil
d631090d49 Merge PR #32641 into master
* refs/pull/32641/head:
	cephadm: fix logging defaults

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-18 12:50:51 -06:00
Sage Weil
62830f9549 Merge PR #32700 into master
* refs/pull/32700/head:
	rpm: Relax the selinux policy version for centos builds

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-18 11:27:37 -06:00
Sage Weil
0b641c4956 Merge PR #32560 into master
* refs/pull/32560/head:
	cephadm: show contextual message when port is in use

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-18 11:26:14 -06:00
Rishabh Dave
b9e006a4db qa/xfstests_dev: change deps for xfstests-dev on ubuntu
Rename python to python2 if Ubuntu distro release is 19 or later.

Fixes: https://tracker.ceph.com/issues/43522
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-18 11:45:13 +05:30
Vikhyat Umrao
e0abf8c13a test: test case for openfiletable MAX_ITEMS_PER_OBJ value verification
Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-01-17 19:35:46 -08:00
Sage Weil
2d90d5778d Merge PR #32713 into master
* refs/pull/32713/head:
	qa/tasks/cephadm: start watching initial daemons before bootstrap
	qa/tasks/cephadm: create /etc/ceph if it doesn't exist
	qa/tasks/cephadm: fix log whitelist when there is no whitelist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-17 19:46:39 -06:00
Sage Weil
7dd3b4f41d Merge PR #32701 into master
* refs/pull/32701/head:
	qa/tasks/ceph_manager: fix ceph-objectstore-tool calls
	qa/tasks/ceph_manager: fix admin_socket remote when using cephadm
	qa/tasks/ceph_manager: --no-mon-config to ceph-objectstore-tool
	qa/tasks/ceph_manager: fix filestore split command
	qa/tasks/ceph_manager: fix import line

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-17 19:13:11 -06:00
Sage Weil
5ef77e1165 qa/releases/octopus: disable autoscale warnings
Existing pools might have too many/few PGs and produce a warning that
prevents us from getting to HEALTH_OK.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:52:40 -06:00
Sage Weil
21ae3dc928 cephadm: SO_REUSEADDR when doing bind check
This is what the ceph daemons use; our check should do it too.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:27:04 -06:00
Sage Weil
0bdaf4b953 qa/tasks/ceph_manager: fix ceph-objectstore-tool calls
Pass the correct paths based on whether this is the importing or exporting
OSD.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:08:00 -06:00
Sage Weil
878e27ee0d qa/tasks/ceph_manager: fix admin_socket remote when using cephadm
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:07:40 -06:00
Sage Weil
81c735fc9c qa/tasks/ceph_manager: --no-mon-config to ceph-objectstore-tool
The config is currently fetched at osd.admin, so the keyring is not
found.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:07:40 -06:00
Sage Weil
7fefcdb6d3 qa/tasks/ceph_manager: fix filestore split command
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:07:40 -06:00
Sage Weil
60c2b8e800 qa/tasks/ceph_manager: fix import line
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 17:07:39 -06:00
Sage Weil
299eb6aad8 qa/tasks/cephadm: start watching initial daemons before bootstrap
This lets us see output while bootstrap is happening.

(Depends on the teuthology change to use journalctl, see
teuthology commit 4fa83040b05b604280789459f095d6f2ad1b0d01.)

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 23:01:09 +00:00
Sage Weil
2cc9fffc8e qa/tasks/cephadm: create /etc/ceph if it doesn't exist
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 22:59:57 +00:00
Sage Weil
2681985983 qa/tasks/cephadm: fix log whitelist when there is no whitelist
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 22:59:43 +00:00
Sage Weil
5673ff2e00 qa/suites/upgrade/mimix-x-singleton: upgrading to octopus, not n
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 15:06:54 -06:00
Sage Weil
a09eb10220 Merge PR #32698 into master
* refs/pull/32698/head:
	common: drop the unused mutable_item_history container.
	common: drop the unused prune() of {safe,mutable}_item_history.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-17 14:36:24 -06:00