Commit Graph

110286 Commits

Author SHA1 Message Date
Changcheng Liu
36918d7f78 cmake: use cmake module to integrate liburing
1. WITH_LIBURING is used to set HAVE_LIBURING to decide
   use liburing in KernelDevice or not.
2. WITH_SYSTEM_LIBURING is to choose use system installed
   liburing or build the liburing from source code.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-04-17 23:22:56 +08:00
Sage Weil
d3d1ea5507 Merge PR #34272 into master
* refs/pull/34272/head:
	mgr/PyModuleRegistry: ignore 'obsolete' modules
	qa/suites/fs/upgrade: start with msgr2
	qa/suites/fs/upgrade: s/mimic/nautilus/
	qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
	qa/standalone/mon/msgr-v2-transition: remove test
	mon/MgrMonitor: disable orchestrator_cli if >= octopus
	qa/suites/ugprade: remove mimic -> pacific upgrade tests
	qa/standalone/mon/misc: update TEST_mon_features
	mon/MgrMap: use always_on_modules from most recent release
	mon/MonCommands: require-osd-release pacific
	qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
	doc/dev/release-kickoff-checklist: include ceph-build change
	qa/workunits/cephtool/test.sh: fix require-osd-release test
	mon/MgrMonitor: define mgr modules for pacific
	doc/dev/release-checklists: generalize
	doc/dev/release-kickoff-checklist: quotes
	qa/suites/rados/thrash-old-clients/1-install/octopus
	qa/releases/pacific.yaml
	mds/cephfs_features: CEPHFS_CURRENT_RELEASE
	doc/dev/release-kickoff-checklist: a few other items
	osd: remove redundant check
	mon/OSDMonitor: make pacific changes
	mon/mon_types: add mon pacific feature
	include/ceph_features: define SERVER_PACIFIC
	include/ceph_features: fix whitespace
	mon: persistent INCOMPAT_PACIFIC item
	ceph-volume: __release__ == pacific
	script: update backport scripts for now-released octopus
	common: pacific release constants
	doc/dev/release-kickoff-checklist
	src/ceph_release: pacific, 16, dev
	CMakeLists: 16.0.0

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-04-12 17:33:57 -05:00
Sebastian Wagner
6a855bf23a
Merge pull request #34525 from Dmole/patch-5
doc: Update index.rst

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-11 21:24:00 +02:00
Sebastian Wagner
62abead9bd
Merge pull request #32297 from varshar16/wip-mgr-nfs-ganesha-exports
Create and delete exports for nfs ganesha with mgr volume 

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-11 21:22:56 +02:00
Sage Weil
a59f4e5deb mgr/PyModuleRegistry: ignore 'obsolete' modules
Old modules may be in the mgrmap (and always_on) but no longer exist.  Do
not try to load those or raise errors about them.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-11 13:36:51 -05:00
Tim
d7c7ccb439 Update index.rst
clean up "only only"

Signed-off-by: Tim <elatllat@gmail.com>
2020-04-11 08:30:08 -04:00
Kefu Chai
af75bd4f2b
Merge pull request #34348 from ifed01/wip-ifed-fix-enforce
os/bluestore: apply bluestore_debug_enforce_settings when choosing mi…

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-11 12:32:34 +08:00
Kefu Chai
56852b0b89
Merge pull request #34421 from ifed01/wip-ifed-kill-buf-in-read
os/bluestore: kill buf param in BlueFS::read

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-04-11 12:28:10 +08:00
Kefu Chai
c0896074bf
Merge pull request #34468 from tchaikov/wip-mgr-telegraph
mgr/telegraf: catch FileNotFoundError exception

Reviewed-by: Wido den Hollander <wido@42on.com>
2020-04-11 12:26:37 +08:00
Sebastian Wagner
c97e7afe5c
Merge pull request #34084 from sebastian-philipp/cephadm-host-ls-offline
mgr/cephadm: enhance `host ls`

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-04-10 22:56:20 +02:00
Sebastian Wagner
445caf6a56
Merge pull request #34382 from mgfritch/cephadm-nfs-grace
cephadm: add config required for ganesha grace

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-04-10 22:50:42 +02:00
Kefu Chai
fc01a2b1cc
Merge pull request #34488 from tchaikov/wip-dmclock
dmclock: pick up change to s/uint/unsigned/

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-04-11 00:46:06 +08:00
Kefu Chai
f60d66b96b
Merge pull request #34508 from tchaikov/wip-45022
selinux: add "type http_cache_port_t" in require section

Reviewed-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
2020-04-10 19:34:03 +08:00
Ilya Dryomov
8fbad612ea
Merge pull request #34494 from idryomov/wip-krbd-unmap-spacing
tests: update unmap.t for table spacing changes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-10 10:29:57 +02:00
Kefu Chai
4ca9ef4d27 selinux: add "type http_cache_port_t" in require section
this addresses the regression introduced by
611a2a7ce1

Fixes: https://tracker.ceph.com/issues/45022
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 14:28:20 +08:00
Kefu Chai
fc8a6a296e
Merge pull request #34499 from ceph/wip-rtd
doc: enable Read the Docs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-10 09:43:28 +08:00
Kefu Chai
e7ead41ed1
Merge pull request #34487 from tchaikov/wip-test-cronjob-py3
qa/tests: pass "-t 2" to teuthology-suite when testing non-master bra…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-10 09:42:42 +08:00
Kefu Chai
8bd8a8badb doc: add in-doc search from read the docs
readthedocs-sphinx-search features better user experience than the
builtin search offered by sphinx

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 08:38:06 +08:00
Kefu Chai
0cb56e0f13 doc: use plantweb as fallback of sphinx-ditaa
RTD does not support installing system packages, the only ways to install
dependencies are setuptools and pip. while ditaa is a tool written in
Java. so we need to find a native python tool allowing us to render ditaa
images. plantweb is able to the web service for rendering the ditaa
diagram. so let's use it as a fallback if "ditaa" is not around.

also start a new line after the directive, otherwise planweb server will
return 500 at seeing the diagram.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 08:38:06 +08:00
Michael Fritch
25f4dedd3e
mgr/cephadm: add CACHEINODE and EXPORT_DEFAULTS sections
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-09 17:32:38 -06:00
Michael Fritch
8055d34455
mgr/cephadm: add config required for ganesha grace
adds minimal config for ganesha-rados-grace

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-09 17:32:38 -06:00
Michael Fritch
ea5b0430f3
cephadm: add userid during grace add/remove
ganesha-rados-grace needs a rados userid to add/remove from the grace db

Mar 27 10:05:25 host1 bash[11684]: rados_connect: -13
Mar 27 10:05:25 host1 bash[11684]: Can't connect to cluster: -13

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-09 13:28:48 -06:00
Daniel Gryniewicz
eadfffe596
Merge pull request #34502 from ceph/kalebskeithley-patch-1-2
Update ceph.te
2020-04-09 14:24:09 -04:00
Matt Benjamin
92af4e9bc6
Merge pull request #34484 from cbodley/wip-sub-spawn
spawn: update submodule
2020-04-09 14:17:52 -04:00
kalebskeithley
611a2a7ce1
Update ceph.te
Fixes: https://tracker.ceph.com/issues/45022
Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
2020-04-09 13:00:57 -04:00
Kefu Chai
847e4ef941 doc/conf.py: exclude pybindings docs from build for RTD
because it'd difficult to prepare (dummy) librados,libcephfs and librbd for
their python bindings in the building environment offered by Read the Docs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-09 22:47:56 +08:00
Lenz Grimmer
c6295bb02e
Merge pull request #34314 from ishanrai05/html-cleanup
mgr/dashboard: Clean up HTML

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-04-09 16:15:50 +02:00
Sebastian Wagner
dfcf8b0034
Merge pull request #34223 from liewegas/cephadm-dashboard-grafana-ssl-verify
mgr/cephadm: disable dashboard's grafana cert ssl_verify if we generate it

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-09 16:10:57 +02:00
Sebastian Wagner
370f2c033e
Merge pull request #34454 from mgfritch/cephadm-osd-fsid-test
qa/workunits/cephadm/test_cephadm.sh: add fsid to ceph-volume cmds

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-09 16:07:34 +02:00
Sebastian Wagner
a4ff076e6d
Merge pull request #34249 from mgfritch/cephadm-nfs-common-config
mgr/cephadm: nfs common config

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2020-04-09 16:05:59 +02:00
Sebastian Wagner
4cb7336150
Merge pull request #34485 from mgfritch/cephadm-no-func
cephadm: show error when no command is specified

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-09 16:03:36 +02:00
Lenz Grimmer
c5dd11b7ec
Merge pull request #34411 from votdev/issue_44589
mgr/dashboard: lint error on plugins/debug.py

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-09 13:25:11 +02:00
Ilya Dryomov
314b14aebe tests: update unmap.t for table spacing changes
Introduced in 4d42b4c5a0 ("common/TextTable: default to 2 spaces
separating columns") and 41f003518a ("common/TextTable: only pad
between columns").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-04-09 12:41:34 +02:00
Lenz Grimmer
0b18f60706
Merge pull request #34452 from rhcs-dashboard/fix-44923-master
mgr/dashboard: use FQDN for failover redirection

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-09 12:20:41 +02:00
Ilya Dryomov
4b04f2ba83
Merge pull request #34471 from idryomov/wip-rbd-fio-rstrip
qa/tasks/rbd_fio: unbreak after the conversion from StringIO

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-09 11:37:14 +02:00
Kefu Chai
99b75c14d2 readthedocs: add .readthedocs.yml
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-09 15:35:45 +08:00
Mykola Golub
978a2e364f
Merge pull request #34408 from dillaman/wip-44727
rbd-mirror: improved replication statistics

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-09 10:13:57 +03:00
Kefu Chai
7dc7b30350 dmclock: pick up change to s/uint/unsigned/
to address the FTBFS with musl libc which does not define uint.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-09 12:31:22 +08:00
Kefu Chai
21dacc823b qa/tests: pass "-t 2" to teuthology-suite when testing non-master branches
-t is an alias of "--teuthology-branch" which defaults to master. we
have a "py2" branch in teuthology. that branch is compatible with
python2, and the teuthology-worker is executed in a Python2 environment,
so all qa suites tested using "py2" branch of teuthology should work
fine as long as they are Python2 compatible. currently, all LTS branches
are compatible with Python2, and only master is also compatible with
Python3. but we plan to migrate master and octopus' qa suites to
python3 to ease the pain of maintainance in long term.

to achieve this goal, in this change, all non-master branches are now
tested using the "py2" teuthology branch.

once the python3 compatible changes are backported to octopus, "-t 2"
options will be removed from the command lines testing octopus.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-09 11:19:03 +08:00
Kefu Chai
8c63b26fe8
Merge pull request #34264 from tchaikov/wip-qa-py3
qa/tasks: be python3 compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-09 10:08:44 +08:00
Kefu Chai
3f253a9a83
Merge pull request #34284 from liewegas/followon-34266-cleanup
mgr/DaemonServer: add missing ceph_abort

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-09 08:39:27 +08:00
Sage Weil
8aa9c88f3e qa/suites/fs/upgrade: start with msgr2
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 15:46:36 -05:00
Michael Fritch
2ebb9373b5
cephadm: show error when no command is specified
Traceback (most recent call last):
  File "./cephadm", line 4452, in <module>
    if args.func != command_check_host:
AttributeError: 'Namespace' object has no attribute 'func'

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-08 14:43:41 -06:00
Michael Fritch
7e26083d92
qa/workunits/cephadm/test_cephadm.sh: use fsid during dump_log
needed when running with multiple ceph clusters

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-08 14:39:50 -06:00
Casey Bodley
b26a525eae
Merge pull request #34414 from yuvalif/add_timeout_to_http_client
rgw/http: add timeout to http client

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-08 15:35:11 -04:00
Casey Bodley
af8a7be18f spawn: update submodule
pulls in fixes for exception handling, and support for multiple return
values with std::tuple<>

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-08 14:40:13 -04:00
Jan Fajerski
4fc07f4aae
Merge pull request #34463 from jan--f/c-v-batch-filter-check-lvs-before-access
ceph-volume/batch: check lvs list before access
2020-04-08 18:07:06 +02:00
Jan Fajerski
647e43ba31
Merge pull request #34472 from jan--f/c-v-noninteractive-batch-idempotency-all-filtered
ceph-volume/batch: return success when all devices are filtered
2020-04-08 17:14:24 +02:00
Jason Dillaman
8a18a7fc71 rbd-mirror: fixed race condition with snapshot sync and shutdown
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-08 09:45:39 -04:00
Jan Fajerski
cb3eade3d0 ceph-volume/batch: return success when all devices are filtered
batch should only return an error if some (but not all) devices are
filtered. When only some devices are filtered the resulting osd layout
could look very different from what a user expects. If all devies are
filtered just return success.

Fixes: https://tracker.ceph.com/issues/44994

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2020-04-08 15:22:26 +02:00