Commit Graph

91258 Commits

Author SHA1 Message Date
Mohamad Gebai
6d1aa954a5 osd: do not clear osdmap cache on 'drop cache' command
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-10 11:45:51 -04:00
Mohamad Gebai
62ffc9aac2 osd: offload dumping cache stats to the object store
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-10 11:45:51 -04:00
Mohamad Gebai
7e4ed82f01 osd: pass a stream to flush_cache commands for more verbosity
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-10 11:45:51 -04:00
Mohamad Gebai
d6eed7bfee osd: implement flush_cache() method for Filestore
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-10 11:45:51 -04:00
Mohamad Gebai
65767fbd35 osd: add clear_cache and get_cache_object_count commands
Fixes: http://tracker.ceph.com/issues/24176

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-10 11:45:51 -04:00
Mykola Golub
c552f166c3
Merge pull request #24476 from dillaman/wip-35944
librbd: add new configuration option to always move deleted items to the trash

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-10 18:40:14 +03:00
Jason Dillaman
a6a2f395b7
Merge pull request #24512 from trociny/wip-qa-namespace-create_args
qa/workunits/rbd: force v2 image format for namespace test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-10-10 10:42:08 -04:00
Mykola Golub
b3e4d43c15 rbd: add 'config global' command to get/store overrides in mon config db
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-10 17:31:32 +03:00
alfonsomthd
83b8cebe4c mgr/dashboard: Landing Page: info group visibility
Do not display info groups not containing any card.
Fixes: https://tracker.ceph.com/issues/27047

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2018-10-10 16:17:03 +02:00
John Spray
a3e91cc5c9 ceph.in: reinstate interactive mode output
This was broken in the following commit:
"""
commit 474c94b81e
Author: Mohamad Gebai <mgebai@suse.com>
Date:   Wed Feb 28 18:12:19 2018 -0500

ceph.in: handle polling commands

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
"""

Fixes: http://tracker.ceph.com/issues/36358

Signed-off-by: John Spray <john.spray@redhat.com>
2018-10-10 10:15:08 -04:00
Sage Weil
3a4af5df51 doc/rados/troubleshooting: update notes on rebuilding mon db
- those old pg settings are no longer lost as they go in the OSDMap now
- add a note about pools that were mid-create

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-10 08:47:22 -05:00
Sage Weil
a9369750d7 ceph-objectstore-tool: update-mon-db: remove pgmap references
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-10 08:47:22 -05:00
Sage Weil
375585a2b1 ceph-monstore-tool: remove remaining pgmap references, inflate-pgmap command
These are all also obsolete.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-10 08:47:22 -05:00
Sage Weil
0182931cfb ceph-monstore-tool: rebuild creating_pgs
In particular, we need to rebuild the created_pools set or else the mon
will try to recreate every PG in the system.  On an aged cluster, that
is extremely expensive, and will break things.

Fixes: http://tracker.ceph.com/issues/36306
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-10 08:47:22 -05:00
Sage Weil
04bbf0cc31 ceph-monstore-tool: rebuild: remove obsolete pgmap_meta fields
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-10 08:47:22 -05:00
Jason Dillaman
97950fec27 qa/workunits/rbd: test new move-to-trash on image remove config override
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-10 09:08:03 -04:00
Jason Dillaman
60b31cd919 librbd: optionally move image to trash when removed by user
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-10 09:08:02 -04:00
Jason Dillaman
24d05023ca librbd: move remove API method to api namespace
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-10 09:07:00 -04:00
Jason Dillaman
815177bd69 librbd: move trash API methods to api namespace
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-10 09:06:59 -04:00
Andrew Schoen
d95f032a21
Merge pull request #24407 from alfredodeza/wip-rm26953
ceph-volume: allow to specify --cluster-fsid instead of reading from ceph.conf

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-10-10 08:57:34 -04:00
Kefu Chai
77f771868b
Merge pull request #24515 from tchaikov/wip-cmake-rgw
cmake: do not use plain target_link_libraries(rgw_a ...)

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kai Wagner <kwagner@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-10 20:32:02 +08:00
John Spray
67d147c00d
Merge pull request #23622 from renhwztetecs/renhw-wip-25103
mgr: fixup pgs show in unknown state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-10 13:28:33 +01:00
Ricardo Marques
41b2f24ddc
Merge pull request #24448 from votdev/bug_36325
mgr/dashboard: Performance counter progress bar keeps infinitely looping

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-10 12:18:35 +01:00
John Spray
5a39f0a9aa
Merge pull request #23970 from noahdesu/mgr-always-on-mods-v2
mgr: always on modules v2

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-10 12:17:41 +01:00
John Spray
17778d217c
Merge pull request #24239 from votdev/python_ceph_audit_log
mgr: Add ability to trigger a cluster/audit log message from Python

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-10 11:47:49 +01:00
Kefu Chai
9bf16b6c31 cmake: do not use plain target_link_libraries(rgw_a ...)
this addresses following error:

CMake Error at src/rgw/CMakeLists.txt:178 (target_link_libraries):
  The plain signature for target_link_libraries has already been used
with
  the target "rgw_a".  All uses of target_link_libraries with a target
must
  be either all-keyword or all-plain.

  The uses of the plain signature are here:

   * src/rgw/CMakeLists.txt:168 (target_link_libraries)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-10 18:29:03 +08:00
Kefu Chai
f67df98d43 mgr/restful: do not print warning message at seeing unknown request
mgr broadcast "notify()" to call registered plugins upon finishing a
send_command() request. and restful plugin prints a warning message if
the request is not issued by itself. apparently, there is good chance
that the finished request is sent by other mgr plugins, in that case,
restful plugin always prints the warning messages like:

 "2018-10-09 14:52:07.818 7fbc4d8c5700  1 mgr[restful] Unknown request
''

this is misleading and annoying. so, in this change

* add a prefix of "restful.module" before that tag used for identifying
  a request. this prefix helps to differentiate the requests sent by
  restful plugin from other requests.
* do not print warning message if none running request matches the given tag
* break at seeing the first request matches the given tag, because
  the tags used by restful plugin are unique.
* do not str(self.id) before composing the tag, as it is a `str`
  already, see CommandsRequest.__init__()
* early return to reduce the indent level

Fixes: http://tracker.ceph.com/issues/36374
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-10 17:18:51 +08:00
Kefu Chai
ce68d848c0
Merge pull request #24487 from badone/wip-undefined-references-to-dpdk-symbols
cmake/modules/BuildDPDK.cmake: Build required DPDK libraries

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-10 16:48:22 +08:00
Mykola Golub
5c5c0244ce
Merge pull request #24450 from dillaman/wip-rbd-conf-keys
librbd: simplify config override handling

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-10 11:01:50 +03:00
Mykola Golub
24e1a6bd47 qa/workunits/rbd: force v2 image format for namespace test
While here, fix test_locking too.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-10 10:50:30 +03:00
Kefu Chai
c98bbf4f71
Merge pull request #24509 from badone/wip-releases-add-13.2.2
doc/releases: Add Mimic release 13.2.2

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-10 14:47:51 +08:00
Kefu Chai
2e146bf0ca
Merge pull request #24368 from tchaikov/wip-cmake-cleanup
cmake: use OpenSSL::Crypto instead of OPENSSL_LIBRARIES

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-10 12:39:06 +08:00
Brad Hubbard
2b188a2aed cmake/modules/BuildDPDK.cmake: Build required DPDK libraries
Make sure the mbuf and ethdev libraries are created as they export
required symbols.

Fixes: http://tracker.ceph.com/issues/36341

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-10-10 14:29:10 +10:00
Zhi Zhang
0261506815 client: explicitly show blacklisted state via asok status command
It is easy for common users to understand why their clients not working
due to blacklisted state.

Fixes: http://tracker.ceph.com/issues/36352

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2018-10-10 11:15:36 +08:00
Brad Hubbard
1adf6272e7 doc/releases: Add Mimic release 13.2.2
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-10-10 12:55:13 +10:00
Ali Maredia
26a6dd3975 rgw: add DoutPrefixProvider to the Auth Identifier classes
This caused DPP to be threaded through the
verify_{objecy/bucket/user}_permissions functions
in rgw_common.cc and change all of the calls to
them in rgw_op.cc and in other places.

The logging in STS engine authorize was
changed too.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-10-09 16:36:17 -04:00
Patrick Donnelly
dc6e7eadf8
qa: increase timeout for cleanup
Apparently 15m is not long enough for some workunits like fsstress.

Fixes: http://tracker.ceph.com/issues/36365

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-09 13:31:26 -07:00
Mykola Golub
4f5410dce6 rbd: nicer help output for commands without options
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-09 22:29:59 +03:00
Mykola Golub
243a159351 rbd: print long aliases specs shorter in help output
(by substituting the common part with '...')

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-09 22:29:59 +03:00
Patrick Donnelly
f9c7920f57
Merge PR #24496 into master
* refs/pull/24496/head:
	doc: fix typo in blkin.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-09 11:23:47 -07:00
Ali Maredia
652f3441dc rgw: changing logging in auth helper functions
Functions that aren't auth engine related were did
not have their logging changed

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-10-09 12:58:42 -04:00
Ali Maredia
d7c24978bd rgw: refactor logging in auth engines P1
pass DPP into authenticate functions for auth
engines and change any of the logging inside of
them.

Next up is passing DPP and changing the douts
in the helper functions called in authenticate.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-10-09 12:58:41 -04:00
Ali Maredia
e997ed2364 rgw: thread DoutPrefixProvider into RGW::Auth_S3::authorize
Pass a DPP into RGWOp::verify_request that leads
through RGWHandler -> RGWHandler_REST->
RGW::Auth_S3::authorize().

Change authenticate() in all the Handler classes
to take a DPP

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-10-09 12:58:41 -04:00
Sage Weil
d82fab79e2
Merge pull request #24484 from hsiang41/mgr/predictor_model_file
mgr/diskprediction: Replace local predictor model file

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-09 11:56:51 -05:00
Ricardo Marques
13af4b52f7
Merge pull request #21614 from Devp00l/pool-creation-form
mgr/dashboard: Pool management

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-09 17:29:09 +01:00
Gregory Farnum
bdf354aedb
Merge pull request #24497 from idryomov/wip-clarify-copy-from
include/rados: clarify which flags go where for copy_from

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-09 09:22:07 -07:00
Kefu Chai
1fb419ca76 cmake: use OpenSSL::Crypto instead of OPENSSL_LIBRARIES
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-10 00:20:14 +08:00
Mohamad Gebai
69737ddb50 osd: add required cls_* libraries as dependencies of osd
The libcls_*.so libraries are runtime dependencies of the OSD (and RGW).
Building the vstart target doesn't build these libraries, rendering some
functionalities unusable. This goes unnoticed when building the entire
source tree.

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-10-09 11:09:28 -04:00
Ilya Dryomov
3e06217360 include/rados: clarify which flags go where for copy_from
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-10-09 16:52:56 +02:00
Radoslaw Zarzynski
2b1a67a847 kv: apply the move semantics in KeyValueDB::get().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-10-09 16:50:48 +02:00