Commit Graph

95580 Commits

Author SHA1 Message Date
Sage Weil
a196da4f8b doc/releases/nautilus: add msgr2 enablement steps
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 10:07:14 -06:00
Sage Weil
0e2ffd7b3a doc/releases/nautilus: add dashboard items
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 10:07:03 -06:00
Sebastian Wagner
bcedaebb52 mgr/ssh: fix type and doc errors
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-25 16:03:06 +01:00
Volker Theile
e5ac8db1ce mgr/dashboard: Change icon color in notifications
- Use CSS filters to convert the existing icons to white.
- Add new Prometheus SVG image, the previous PNG image has used the color white instead or transparent to fill some areas.

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-02-25 15:55:32 +01:00
Sage Weil
d1c3b40ea0 Merge PR #26280 into master
* refs/pull/26280/head:
	mgr: Remove _ceph_(g|s)et_module_option_ex() method
	mgr: remove _ceph_get_module_option_ex() method

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-02-25 08:44:23 -06:00
Sage Weil
1b52c723f8 Merge PR #26487 into master
* refs/pull/26487/head:
	CLI: ability to change file ownership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-25 08:43:57 -06:00
Sage Weil
9e3866620b Merge PR #26591 into master
* refs/pull/26591/head:
	osd/PrimaryLogPG: handle object !exists in handle_watch_timeout

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-25 08:43:40 -06:00
Sage Weil
47af6314d1 doc/releases/nautilus: note about msgr2
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 08:39:23 -06:00
Sage Weil
9183431e16 doc/releases/nautilus: rgw highlights
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 08:39:23 -06:00
Sage Weil
fdf75b2d22 doc/releases/nautilus: draft notes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 08:39:23 -06:00
Sage Weil
5c82ada83b ceph_test_msgr: skip injection test for simplemessenger
The interceptor is only implemented in asyncmessenger.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-25 08:34:45 -06:00
Lenz Grimmer
55dd5e11ce
Merge pull request #26539 from tspmelo/wip-nfs-status
mgr/dashboard: Add NFS status endpoint 

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-25 13:12:22 +01:00
Jan Fajerski
f648ba1d9a ceph-volume: don't create osd['block.db'] by default
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-02-25 12:55:42 +01:00
Tim Serong
be98097979 rpm,cmake: additional fixes to make amqp support optional
Signed-off-by: Tim Serong <tserong@suse.com>
2019-02-25 19:49:20 +11:00
Kefu Chai
4530e4874e
Merge pull request #26620 from cyx1231st/wip-seastar-async-echo
test/crimson: split async-msgr out of alien_echo

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-25 16:44:20 +08:00
Tim Serong
7e34b27676 mgr/PyModule: put mgr_module_path first in sys.path
If the various python site packages appear first in sys.path, and there
happens to be a package whose name is the same as an mgr module, mgr will
try to load that thing instead of the expected mgr module.  This results
in a very terse couple of errors:

  mgr[py] Class not found in module 'deepsea'
  mgr[py] Error loading module 'deepsea': (22) Invalid argument

Before this commit, sys.path on my SLE 11 SP1 dev system is:

  /usr/lib/python36.zip
  /usr/lib64/python3.6
  /usr/lib64/python3.6
  /usr/lib64/python3.6/lib-dynload
  /usr/lib64/python3.6/site-packages
  /usr/lib/python3.6/site-packages
  /usr/local/lib64/python3.6/site-packages
  /usr/local/lib/python3.6/site-packages
  /usr/lib64/ceph/mgr

After this commit, /usr/share/ceph/mgr comes before python's site-packages,
and everything works properly:

  /usr/lib/python36.zip
  /usr/lib64/python3.6
  /usr/lib64/python3.6
  /usr/lib64/python3.6/lib-dynload
  /usr/share/ceph/mgr
  /usr/lib64/python3.6/site-packages
  /usr/lib/python3.6/site-packages
  /usr/local/lib64/python3.6/site-packages
  /usr/local/lib/python3.6/site-packages

(If you're interested in seeing what's in sys.path, turn "debug mgr" up
to at least 10, then grep the logs for "Computed sys.path")

Fixes: https://tracker.ceph.com/issues/38469
Signed-off-by: Tim Serong <tserong@suse.com>
2019-02-25 19:05:14 +11:00
songweibin
bb8df22e4a rbd/pybind: add __enter__ and __exit__ for class Group
Fixes: http://tracker.ceph.com/issues/38468

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2019-02-25 14:58:44 +08:00
Yingxin Cheng
a8ddabb8ab test/crimson: enable unauthenticated connections for async_echo
Enable co-operability with crimson-msgr in unittest_alien_echo.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-02-25 14:36:29 +08:00
Yingxin Cheng
b9b0c61bf7 test/crimson: split async-msgr out of alien_echo
async-msgr is not compatible with custom-built libs for seastar, so
split it.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-02-25 14:32:13 +08:00
Brad Hubbard
ff324f450c rpm: Fix pyOpenSSL dependency
Fedora29 does not have pyOpenSSL but it does have python-pyOpenSSL

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-02-25 13:37:23 +10:00
James McClune
0dc5000124 doc: updated reference link for log based PG
Added :ref: label to Log Based PG page. Referenced <log-based-pg>
label on Asynchronous Recovery page.

Fixes: https://tracker.ceph.com/issues/38465
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-24 16:08:44 -05:00
James McClune
93b904b32a doc: updated governance link for Ceph project leads
Added :ref: label to Governance page. Referenced <governance>
label on Development Workflow page.

Fixes: https://tracker.ceph.com/issues/38464
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-24 15:58:02 -05:00
Sage Weil
d7a279f759 Merge PR #26466 into master
* refs/pull/26466/head:
	msg/async, v2: fix wrong base for KeepAliveFrameAck.
	msg/async, v2: frame decoding operates on bufferlist.
	msg/async, v2: drop ceph_msg_header2 fields duplicating segment info.
	msg/async, v2: drop the scaffolding in preamble parsing.
	msg/async, v2: handle msg authentication failures.
	msg/async, v2: drop depedency on uint128_t. Clean up onwire crypto.
	msg/async, v2: fix cur_msg_size in ::reset_recv_state().
	msg/async, v2: drop magic numbers for segments.
	msg/async, v2: get rid of magic number in SignedEncryptedFrame.
	msg/async, v2: get rid of the magic number for default alignment.
	msg/async, v2: decouple onwire segment length from logical length.
	msg/async, v2: follow the const bl& concept in authenticated_encrypt_update().
	msg/async, v2: drop handling of extra segments in ::fill_preamble().
	msg/async, v2: get rid of magic numbers for alignment.
	msg/async, v2: drop reserve() from onwire crypto's TxHandler.
	msg/async: add con_mode to debug lines
	msg/DispatchQueue: include con_mode in <== line
	common/ceph_strings: get_con_mode_name()
	msg/Connection: add get_con_mode()
	msg/async/ProtocolV2: clean up preamble comments
	msg/async, v2: improve debug around sending client indent.
	msg/async, v2: bring back the no-encryption ability.
	msg/async, v2: workaround con_mode handling.
	msg/async, v2: drop the throttles bypass.
	msg/async, v2: READ_MESSAGE_FRONT -> THROTTLE_DONE.
	msg/async: WaitFrame of V2 can be crypto processed now.
	msg/async: initial multi-segment support for V2.
	msg/async: V2 bypasses throttles just for development.
	msg/async: rectify reseting security state in ProtocolV2::reset_recv_state().
	msg/async: switch to CRC32 for V2 preamble blocks.
	msg/async: bump up preamble block size to 32 bytes.
	msg/async: get rid of the distiction on main and extra V2 preamble.
	msg/async: add debug around empty ClientIdent::addrs.
	msg/async: V2 uses segments instead of next_payload_len, part 1.
	msg/async: perform V2 frame dispatch in dedicated method.
	msg/async: implement crc checking for main preamble of V2.
	msg/async: receive V2 messages with new preable format.
	msg/async: transmit V2 messages with new preable format.
	msg/async: reset crypto processors in ProtocolV2::reset_recv_state().
	msg/async: preamble of V2 Frames is now encrypted and authenticated.
	msg/async: slightly rework ProtocolV2 preamble crafting.
	msg/async: reset the rx stream handler in ::handle_read_frame_length_and_tag.
	auth, msg/async, v2: drop AuthStreamHandler and AES128GCM_StreamHandler.
	msg/async: Messages in Protocol2 are crypto-processed only once.
	msg/async: SignedEncryptedFrame uses ceph::crypto::onwire.
	msg/async: expose message segmentation to ::write_message().
	auth: implement ceph::crypto::onwire with OpenSSL EVP.
	auth: introduce ceph::crypto::onwire interfaces.
	msg/async: decouple MessageHeaderFrame from SignedEncryptedFrame.
	msg/async: move Protocol* asserts in SignedEncryptedFrame to compile time.
	msg/async: simplify encryption handling in the PayloadFrame class.
	auth: drop AES128CBC_HMACSHA256_StreamHandler.
	msg/async: ensure consistency between con_mode and session_security.
	msg/async: drop MessageFrame. Use MessageHeaderFrame instead.
	msg/async: set con_mode and session_security at both peers.
	msg/async, auth: switch AuthStreamHandler::rxtx_t to std::unique_ptr.
	crypto: AES128GCM_StreamHandler brings authenticated encryption with AES-GCM.
	include: uint128_t -> ceph::uint128_t + using.
	msg/async: move crypto handling from ProtocolV2 into AuthStreamHandler.
	auth, msg: dissect AuthStreamHandler from AuthSessionHandler.
	auth/cephx: make _calc_signature() of CephxSessionHandler private.
	auth: drop {en,de}crypt_message() from AuthSessionHandler.
	auth: introduce DummyAuthSessionHandler.
	auth: make AuthSessionHandler purely abstract.
	auth: drop no_security() from AuthSessionHandler.
	auth: drop get_protocol() and get_key() from AuthSessionHandler.
	auth: drop sign_bufferlist() from AuthSessionHandler.
	msg/async: drop get_auth_meta() from Protocol.
	msg/async: emphasize ProtocolV2 does authenticated encryption.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-24 09:33:32 -06:00
Xie Xingguo
be26cb08e5
Merge pull request #26560 from xiexingguo/wip-pool-force-recovery
mgr: add per pool force-recovery/backfill commands

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-02-23 15:30:14 +08:00
xie xingguo
fa98f09674 mgr: add per pool force-recovery/backfill commands
For those with multiple storage pools sharing the same devices,
I think it would make much more sense to offer per-pool
commands to bring pools with high priority, e.g., because they
are hosting data of more importance than others, back to normal
quickly.

Fixes: http://tracker.ceph.com/issues/38456
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-02-23 12:18:24 +08:00
Radoslaw Zarzynski
1ea97560e4 msg/async, v2: fix wrong base for KeepAliveFrameAck.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-23 01:49:17 +01:00
Sage Weil
a0ea40bc5c Merge PR #26602 into master
* refs/pull/26602/head:
	Revert "pybind: set language_level for cythonize explicitly"
	Revert "pybind: auto encode/decode cstr"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-22 16:00:25 -06:00
David Zafman
99af224af2
Merge pull request #26436 from dzafman/wip-bionic-core
run-standalone.sh: Need double-quotes to handle | in core_pattern on all distributions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-22 12:52:37 -08:00
Jeff Layton
73ab735a50 mgr/dashboard: special casing for minikube in run-backend-rook-api-request.sh
For people running minikube for testing, the hostname "minikube" is
often not resolvable. If that's what the hostname is, then get
the address from "minikube ip" instead.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-02-22 14:45:23 -05:00
Neha Ojha
7c965b1778 Revert "pybind: set language_level for cythonize explicitly"
This reverts commit ded3d43dbf.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-02-22 11:41:55 -08:00
Neha Ojha
ce515221a2 Revert "pybind: auto encode/decode cstr"
This reverts commit c36d0f1a7d.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-02-22 11:41:04 -08:00
Jenkins Build Slave User
adfd524c32 14.1.0 2019-02-22 18:07:07 +00:00
Nathan Cutler
754d29671f doc: add missing 12.2.11 release note
This release note was added to PendingReleaseNotes by
4ad2b6c039 as part of
https://github.com/ceph/ceph/pull/24728 which went into 12.2.11

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-02-22 18:32:44 +01:00
Mykola Golub
cd0d6e2e31
Merge pull request #25438 from MahatiC/wip-move-to-trash
rbd: move image to trash as first step when removing

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-02-22 18:57:10 +02:00
Lenz Grimmer
5a742c68cc
Merge pull request #26506 from ricardoasmarques/multi-backstore-backend
mgr/dashboard: iSCSI - Infrastructure for multiple backstores (backend)

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-02-22 17:48:25 +01:00
Sage Weil
bdf2d1b973 osd/PrimaryLogPG: handle object !exists in handle_watch_timeout
- watch on object
- watch timeout queued
- rados op deletes object
- handle_watch_timeout tries to delete it again

Fixes: http://tracker.ceph.com/issues/38432
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-22 08:56:16 -06:00
Nathan Weinberg
336cc9cc82 mgr/dashboard: Added breadcrumb tests to Filesystems menu
Fixes: https://tracker.ceph.com/issues/38343
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
2019-02-22 09:50:24 -05:00
Matt Benjamin
a25d30b894
Merge pull request #26515 from theanalyst/civetweb-fixes-n
civetweb: pull up to ceph-master
2019-02-22 09:20:38 -05:00
Stephan Müller
fbf2592931 mgr/dashboard: Updated messages.xlf
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-02-22 15:05:07 +01:00
Stephan Müller
0d3d16724c mgr/dashboard: Pgs will update as expected
The problem was that PGs jumped over the next calculated number when
pressing "up".

Fixes: https://tracker.ceph.com/issues/38382
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-02-22 15:03:17 +01:00
Jeff Layton
196e8151b5 Revert "ceph.spec.in: python-kubernetes broken on rhel"
This reverts commit c32c4874e1.

An updated python2-kubernetes package that does not depend on
python-adal has made it into the epel7 repos. With that change,
we can now revert this patch.

When we readd it back though, add in %{_python_buildid} so that
this works correctly on python3-based distros as well.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-02-22 08:56:12 -05:00
Sage Weil
be257763f9 Merge PR #26550 into master
* refs/pull/26550/head:
	mon/AuthMonitor: provide auth_lock-safe _assign_global_id()
	mon/AuthMonitor: provide AuthMonitor with mon count and rank *only* while active

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-02-22 07:14:33 -06:00
Sage Weil
b700dca795 Merge PR #26476 into master
* refs/pull/26476/head:
	pybind: auto encode/decode cstr
	pybind: set language_level for cythonize explicitly

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-22 07:11:28 -06:00
Sage Weil
7633fff7d0 Merge PR #26552 into master
* refs/pull/26552/head:
	osdc/Objecter: invalidate crcs on preallocated rx buffers

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-22 07:10:51 -06:00
Sage Weil
6888565dbf Merge PR #26568 into master
* refs/pull/26568/head:
	unittest_auth: add unit tests for AuthRegistry con_mode selection
	auth/AuthRegistry: register as an observer
	auth/AuthRegistry: clear output vectors
	common/options: add ms_mon_client_mode
	auth: push con_mode selection into AuthRegistry helper

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-02-22 07:10:32 -06:00
Abhishek Lekshmanan
90c6e1d2f5 civetweb: pull up to ceph-master
Contains the following fixes
- absolute url fixes
- ssl socket closing fixes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-02-22 13:37:50 +01:00
Kefu Chai
80784dd9dc
Merge pull request #26584 from capri1989/doc-fixes
doc: Remove value 'mon_osd_max_split_count'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-22 19:31:58 +08:00
Kai Wagner
1bf96668a5 doc: Remove value 'mon_osd_max_split_count' from the docs
Signed-off-by: Kai Wagner <kwagner@suse.com>
2019-02-22 11:16:34 +01:00
Lenz Grimmer
72ef9b58ec
Merge pull request #26510 from callithea/wip-add-ganesha-qa-tests
mgr/dashboard: Added NFS Ganesha suite to QA tests

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-02-22 10:28:41 +01:00
Volker Theile
1bc6f5caed mgr/dashboard: Remove param when calling notificationService.show
The message parameter should be used for error notifications only.

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-02-22 10:01:16 +01:00