Commit Graph

110350 Commits

Author SHA1 Message Date
Kefu Chai
c8827963e0
Merge pull request #33365 from ifed01/wip-ifed-hybrid-alloc2
os/bluestore: introduce hybird allocator

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-14 22:44:50 +08:00
Kefu Chai
7f8e0f408d
Merge pull request #32704 from petrutlucian94/windows.2
common: Add dlfcn_compat.h for win32

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-14 22:42:17 +08:00
Lenz Grimmer
caaaf37c12
Merge pull request #34336 from nSedrickm/nsedrickm-ceph-dev
mgr/dashboard: Proposed About Modal box

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-04-14 14:46:11 +02:00
Lenz Grimmer
8ac048924b
Merge pull request #34469 from votdev/issue_44991_pool_promql
monitoring: alert for pool fill up broken

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2020-04-14 14:43:51 +02:00
Lenz Grimmer
cd271d9516
Merge pull request #34065 from tspmelo/wip-iscsi-advanced
mgr/dashboard: Prevent iSCSI target recreation when editing controls

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2020-04-14 13:31:37 +02:00
Lucian Petrut
6bf7a3eb40 common: Add dlfcn_compat.h for win32
We'll emulate the dlfcn.h interface using Windows functions, which
will allow loading Windows DLLs.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2020-04-14 11:11:32 +00:00
Lenz Grimmer
9b88f847be
Merge pull request #34009 from tspmelo/wip-iscsi-auth
mgr/dashboard: Fix iSCSI's username and password validation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-14 12:53:14 +02:00
Kefu Chai
1b6fc24552
Merge pull request #33816 from rzarzynski/wip-msg-no-extra-alloc-in-secure
msg/async: fix unnecessary 4 kB allocation in secure mode.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-14 17:52:46 +08:00
Sebastian Wagner
38ae96e1c9
Merge pull request #34344 from jmolmo/rook_inventory
mgr/rook: Fix wrong data output when listing devices

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-13 21:15:43 +02:00
Kefu Chai
9eef41235a
Merge pull request #33989 from ifed01/wip-ifed-better-bluefs-expand
os/bluestore: open DB in read-only when expanding DB/WAL.

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-04-14 00:28:22 +08:00
Kefu Chai
9070f9c90b
Merge pull request #33782 from aclamk/wip-alloc-aging-logging-simpler
os/bluestore: Simplified logic of sliding window.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-04-14 00:25:43 +08:00
Kefu Chai
a79fc42188
Merge pull request #33434 from ifed01/wip-ifed-big-writes-deferred
os/bluestore: go deferred for 'big' writes.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-14 00:25:24 +08:00
Kefu Chai
153f70c09f
Merge pull request #33715 from trociny/wip-pybind-rados-watch
pybind/rados: add watch object bindings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-14 00:23:21 +08:00
Casey Bodley
3f2e593120
Merge pull request #33982 from cbodley/wip-cls-cmpomap
cls/cmpomap: add cls module for CMPXATTR-like functionality in omap

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-04-13 11:03:28 -04:00
Casey Bodley
e1acaef311 options: add cmpomap to osd_class_load_list
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
577f211391 test: add ceph_test_cls_cmpomap
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
3d5c8e982e cls/cmpomap: add cls module for CMPXATTR-like functionality in omap
provides a cmp_vals() op similar to librados' omap_cmp(), but with full
support for the comparison modes and operations from cmpxattr(). if any
of the requested key/value comparisons are unsuccessful, the op fails
with -ECANCELED

cmp_vals() can be composed with other ops like set_omap_vals() to make
make them conditional on the successful comparison of all existing values

also provides cmp_set_vals() and cmp_rm_keys(), which apply a mutation
to only the keys that compare successfully. these enable batch
operations where, unlike cmp_vals() + set_omap_vals(), you don't want
one failed comparison to prevent operations on unrelated keys

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
68b02d9510 objclass: add cls_cxx_map_get_vals_by_keys
add an objclass api for CEPH_OSD_OP_OMAPGETVALSBYKEYS

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
ad990e8307 objclass: expose cls_cxx_map_get_val in header
this was defined in osd/objclass.cc but not declared in objclass/objclass.h

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
fd760174b5 buffer: add missing != operator for bufferlist
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Casey Bodley
9f10d87318 buffer: comparison operators take const bufferlist&
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Igor Fedotov
28c8e6e643 crimson: add HybridAllocator to alienstore build.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:23:01 +03:00
Igor Fedotov
c27490e3d6 os/bluestore: improve adjustent extents merge in hybrid allocatoc
Bitmap counterpart is inspected for adjustent free extents when
releasing extent and trying to add it to AVL tree.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:16:07 +03:00
Igor Fedotov
cccbc62528 os/bluestore: remove HybridAllocator::init_add_free method.
It's a 100% replica of AvlAllocator one which is inherited.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:16:07 +03:00
Igor Fedotov
b682d9a8e8 os/bluestore: configure hybrid allocator threshold to fallback.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:16:07 +03:00
Igor Fedotov
c90eee3495 os/bluestore: add hybrid (avl+bitmap) allocator
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:16:05 +03:00
Igor Fedotov
21532045ef os/bluestore: do not require min_length to be power of two for bmap
allocator.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:12:43 +03:00
Igor Fedotov
cccf94da46 os/bluestore: extend AvlAllocator interface.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:12:43 +03:00
Igor Fedotov
719cd7d942 tests/test_bluestore_types: show AvlAllocator's range_seg_t size.
Extend corresponding test case to be aware of the struct's sizeof.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:12:43 +03:00
Igor Fedotov
59c0aa5eb4 os/bluestore: make AvlAllocator overridable.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:12:43 +03:00
Igor Fedotov
efedcc077c os/bluestore: intdoduce spillover mechanics to AvlAllocator.
This to be utilized in AvlAllocator's descendant class(es) to be able
to limit amount of entries allocator tracks. Hence bringing a cap for
RAM used by the allocator.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 16:12:43 +03:00
Jeff Layton
ae1bb9d55d
Merge pull request #34455 from jtlayton/wip-44963
client: only set MClientCaps::FLAG_SYNC when flushing dirty auth caps
2020-04-13 07:22:06 -04:00
Jeff Layton
444a4e7f9b
Merge pull request #33761 from jtlayton/wip-44441
doc: document wsync and nowsync mount options in mount.ceph(8)
2020-04-13 07:20:40 -04:00
Kefu Chai
b176dcb3f9
Merge pull request #34231 from majianpeng/bluefs-fix-invalidate-cache-bug
os/bluestore: don't foreget invalidate cache of FileReaderBuffer.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-04-13 11:03:32 +08:00
Sage Weil
d3d1ea5507 Merge PR #34272 into master
* refs/pull/34272/head:
	mgr/PyModuleRegistry: ignore 'obsolete' modules
	qa/suites/fs/upgrade: start with msgr2
	qa/suites/fs/upgrade: s/mimic/nautilus/
	qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
	qa/standalone/mon/msgr-v2-transition: remove test
	mon/MgrMonitor: disable orchestrator_cli if >= octopus
	qa/suites/ugprade: remove mimic -> pacific upgrade tests
	qa/standalone/mon/misc: update TEST_mon_features
	mon/MgrMap: use always_on_modules from most recent release
	mon/MonCommands: require-osd-release pacific
	qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
	doc/dev/release-kickoff-checklist: include ceph-build change
	qa/workunits/cephtool/test.sh: fix require-osd-release test
	mon/MgrMonitor: define mgr modules for pacific
	doc/dev/release-checklists: generalize
	doc/dev/release-kickoff-checklist: quotes
	qa/suites/rados/thrash-old-clients/1-install/octopus
	qa/releases/pacific.yaml
	mds/cephfs_features: CEPHFS_CURRENT_RELEASE
	doc/dev/release-kickoff-checklist: a few other items
	osd: remove redundant check
	mon/OSDMonitor: make pacific changes
	mon/mon_types: add mon pacific feature
	include/ceph_features: define SERVER_PACIFIC
	include/ceph_features: fix whitespace
	mon: persistent INCOMPAT_PACIFIC item
	ceph-volume: __release__ == pacific
	script: update backport scripts for now-released octopus
	common: pacific release constants
	doc/dev/release-kickoff-checklist
	src/ceph_release: pacific, 16, dev
	CMakeLists: 16.0.0

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-04-12 17:33:57 -05:00
Sebastian Wagner
6a855bf23a
Merge pull request #34525 from Dmole/patch-5
doc: Update index.rst

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-11 21:24:00 +02:00
Sebastian Wagner
62abead9bd
Merge pull request #32297 from varshar16/wip-mgr-nfs-ganesha-exports
Create and delete exports for nfs ganesha with mgr volume 

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-11 21:22:56 +02:00
Sage Weil
a59f4e5deb mgr/PyModuleRegistry: ignore 'obsolete' modules
Old modules may be in the mgrmap (and always_on) but no longer exist.  Do
not try to load those or raise errors about them.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-11 13:36:51 -05:00
Tim
d7c7ccb439 Update index.rst
clean up "only only"

Signed-off-by: Tim <elatllat@gmail.com>
2020-04-11 08:30:08 -04:00
Kefu Chai
af75bd4f2b
Merge pull request #34348 from ifed01/wip-ifed-fix-enforce
os/bluestore: apply bluestore_debug_enforce_settings when choosing mi…

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-11 12:32:34 +08:00
Kefu Chai
56852b0b89
Merge pull request #34421 from ifed01/wip-ifed-kill-buf-in-read
os/bluestore: kill buf param in BlueFS::read

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-04-11 12:28:10 +08:00
Kefu Chai
c0896074bf
Merge pull request #34468 from tchaikov/wip-mgr-telegraph
mgr/telegraf: catch FileNotFoundError exception

Reviewed-by: Wido den Hollander <wido@42on.com>
2020-04-11 12:26:37 +08:00
Sebastian Wagner
c97e7afe5c
Merge pull request #34084 from sebastian-philipp/cephadm-host-ls-offline
mgr/cephadm: enhance `host ls`

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-04-10 22:56:20 +02:00
Sebastian Wagner
445caf6a56
Merge pull request #34382 from mgfritch/cephadm-nfs-grace
cephadm: add config required for ganesha grace

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-04-10 22:50:42 +02:00
Kefu Chai
fc01a2b1cc
Merge pull request #34488 from tchaikov/wip-dmclock
dmclock: pick up change to s/uint/unsigned/

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-04-11 00:46:06 +08:00
Kefu Chai
f60d66b96b
Merge pull request #34508 from tchaikov/wip-45022
selinux: add "type http_cache_port_t" in require section

Reviewed-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
2020-04-10 19:34:03 +08:00
Ilya Dryomov
8fbad612ea
Merge pull request #34494 from idryomov/wip-krbd-unmap-spacing
tests: update unmap.t for table spacing changes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-10 10:29:57 +02:00
Kefu Chai
4ca9ef4d27 selinux: add "type http_cache_port_t" in require section
this addresses the regression introduced by
611a2a7ce1

Fixes: https://tracker.ceph.com/issues/45022
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 14:28:20 +08:00
Kefu Chai
fc8a6a296e
Merge pull request #34499 from ceph/wip-rtd
doc: enable Read the Docs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-10 09:43:28 +08:00
Kefu Chai
e7ead41ed1
Merge pull request #34487 from tchaikov/wip-test-cronjob-py3
qa/tests: pass "-t 2" to teuthology-suite when testing non-master bra…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-10 09:42:42 +08:00