Commit Graph

105795 Commits

Author SHA1 Message Date
Sage Weil
2ae3f66263 qa/suites/rados/cephadm: enable mgr debugging
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-23 10:01:35 -06:00
Sage Weil
1701498e23 cephadm: restart non-ceph daemons on reconfig
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 11:00:33 -06:00
Sage Weil
e97b54c0ec mgr/cephadm/test_cephadm: fix expected output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 11:00:33 -06:00
Sage Weil
b12aa3a838 mgr/cephadm: fix remapping of hosts and services
This was nondeterministically remapping services to different hosts
depending on which hosts had stale caches because the 'hosts' list order
didn't match 'results' + 'in_cache'.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 11:00:33 -06:00
Sage Weil
e07330c084 mgr/cephadm: add 'reconfig' service action
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Sage Weil
40b70c632d cephadm: move mon creation config bits into mgr/cephadm
There's no need for mgr/cephadm to pass --mon-* arguments to
/usr/bin/cephadm just so it can add bits to the config file when the
config file is also being passed in from mgr/cephadm.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Sage Weil
8dbb4be2c7 cephadm: fix bootstrap message 'ssh' -> 'cephadm'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Sage Weil
a0fc82af23 cephadm: add --reconfig option for 'deploy'
We could make this a totally separate command from 'deploy', but so much
of the code path is shared that this is a lot simpler.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Sage Weil
b77f0c74a5 mgr/orchestrator: drop 'reload' service[-instance] action
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Kefu Chai
70c29729f2
Merge pull request #32388 from wjwithagen/wjw-fix-boost_spirit-isblank-assert
test: Do not test unicode if boost::spirit >= 1.72

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-23 00:40:31 +08:00
Willem Jan Withagen
05fe3fc9c8 test: Do not test unicode if boost::spirit >= 1.72
Testing with Boost 1.72 unittest_confutil crashes with:
```
[ RUN      ] ConfUtils.ReadFiles2
Assertion failed: (strict_ischar(ch)), function isblank, file /usr/local/include/boost/spirit/home/support/char_encoding/standard.hpp, line 129.
Abort
```

Which is due to the fact that in Boost 1.72 most of the character
testing has been garded with an assert to make sure char holds an
ascii char.
Like:
```
        static bool
        isblank BOOST_PREVENT_MACRO_SUBSTITUTION (int ch)
        {
            BOOST_ASSERT(strict_ischar(ch));
            return (ch == ' ' || ch == '\t');
        }
```
And ReadFile2 explicitly tests for strings with char value > 0x7f.
So that is certainly going to crash.

Now I can imagine that we would like to be able to have users use
different encodings for things like logfiles.
But for now that is not going to work with the boost:spirit parser

Fixes: https://tracker.ceph.com/issues/43406
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-12-22 16:08:10 +01:00
Sage Weil
effe9c9a3f Merge PR #32261 into master
* refs/pull/32261/head:
	mgr/orchestrator: use full device path for blinking lights (if available)
	mgr: report device by-path paths too
	common/blkdev: include by-path path for each device in metadata
	common/blkdev: factor get_device_metadata out of mon, osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-21 19:59:37 -06:00
Sage Weil
73a56e36c3 Merge PR #32333 into master
* refs/pull/32333/head:
	qa/quites/rados/singleton-flat/valgrind-leaks: specify centos8
	qa/suites/rados: test cephadm on centos and ubuntu both
	qa/workunits/cephadm/test_cephadm.sh: detect python3 and python2

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-21 19:59:18 -06:00
Sage Weil
d96b6fd1c5 qa/quites/rados/singleton-flat/valgrind-leaks: specify centos8
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-21 09:03:55 -06:00
Sage Weil
47350be466 qa/suites/rados: test cephadm on centos and ubuntu both
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-21 09:03:55 -06:00
Sage Weil
e43c7cd6dd qa/workunits/cephadm/test_cephadm.sh: detect python3 and python2
Only test on whichever pythons are available on the host.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-21 09:03:55 -06:00
Sage Weil
e0170aa226 Merge PR #32384 into master
* refs/pull/32384/head:
	qa/tasks/mgr/test_orchestrator_cli: fix device ls test
	mgr/orchestrator_cli: no need for colored=False

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-21 08:21:04 -06:00
Sage Weil
d39ecb12a0 Merge PR #32334 into master
* refs/pull/32334/head:
	cephadm: add some coarse-grained locking
	cephadm: add FileLock class

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-20 20:41:07 -06:00
Sage Weil
6c876198b8 Merge PR #32327 into master
* refs/pull/32327/head:
	mgr/cephadm: remove old remotes
	mgr/cephadm: try various pythons for root mode _run_cephadm
	mgr/cephadm: no need to _get_connection from _create_daemon
	mgr/cephadm: include host name in check-host result
	mgr/cephadm: remove 'cephadm prepare-host' command

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-20 20:38:45 -06:00
Patrick Donnelly
3ebdbd4f55
Merge PR #27866 into master
* refs/pull/27866/head:
	mds: fix deadlock when xlocking policylock
	mds: handle link request with zero depth filepath2
	mds: enable lock cache for openc/unlink requests
	mds: include linkage type in dentry lease
	mds: cleanup Server::set_trace_dist()
	mds: define lease mask bits
	mds: delegete lock cache to client
	mds: suppress frozen inode when locks of dir operation is cached.
	mds: invalidate lock caches when freezing dirfrag/subtree
	mds: invalidate lock caches if they hold conflicting locks
	mds: initial code for lock cache
	mds: adjust locking for subtree migration
	mds: add 'path_locked' flag to MDCache::find_ino_peers()
	mds: change MDCache::discover_path()'s wants_xlocked semantic
	mds: introduce Server::rdlock_two_paths_xlock_destdn()
	mds: make Server::rdlock_path_xlock_dentry take locks
	mds: make Server::rdlock_path_pin_ref() take dentry rdlocks
	mds: take snaplock and policylock during path traverse.
	mds: let Locker::acquire_locks()'s caller choose locking order

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-20 18:16:11 -08:00
Samuel Just
2c95429015
Merge pull request #32380 from athanatos/sjust/wip-dmclock-fix
src/dmclock: bring in fixes for indirect_intrusive_heap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-20 14:48:47 -08:00
Sage Weil
e445c77214 mgr/cephadm: remove old remotes
These are not used.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 16:20:22 -06:00
Sage Weil
412b596b59 mgr/cephadm: try various pythons for root mode _run_cephadm
Some distros don't have the /usr/bin/python link.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 16:20:22 -06:00
Sage Weil
2b2c122fd8 qa/tasks/mgr/test_orchestrator_cli: fix device ls test
No more "$host:" formatting as of 594179f1aa

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 16:14:34 -06:00
Sage Weil
158a90bbcc mgr/orchestrator_cli: no need for colored=False
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 16:12:53 -06:00
Sage Weil
1d63e88a75 Merge PR #32332 into master
* refs/pull/32332/head:
	cephadm: bootstrap: force password choice

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-20 16:07:54 -06:00
Sage Weil
8becd2d66c Merge PR #32383 into master
* refs/pull/32383/head:
	qa/standalone: python -> python3
	qa/standalone/special/ceph_objectstore_tool: python3

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-20 15:47:37 -06:00
Sage Weil
137eea43dc Merge PR #32272 into master
* refs/pull/32272/head:
	pybind/mgr: Add orchestrator_cli to mgr/tox.ini
	mgr/orchestrator_cli: Fix NFS

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-20 15:43:04 -06:00
Sage Weil
9d48756e45 Merge PR #32314 into master
* refs/pull/32314/head:
	mgr/cephadm: fix listing services by host

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-20 15:42:47 -06:00
Sage Weil
6e365b89bd Merge PR #32378 into master
* refs/pull/32378/head:
	cephadm: python3 shebang

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-20 15:42:05 -06:00
Samuel Just
bdc3ed252e
Merge pull request #32381 from athanatos/sjust/wip-read-from-replica-py2
osd: propagate mlcod to replicas and fix problems with read from replica

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-20 13:07:56 -08:00
Samuel Just
5bb932c3d3
Merge pull request #32382 from athanatos/sjust/wip-backoff-fix
osd/scheduler/OpSchedulerItem: schedule backoffs as client ops

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-20 13:07:17 -08:00
Sage Weil
7e19a507f9 Merge PR #32375 into master
* refs/pull/32375/head:
	qa/tasks/cephadm: ceph.git branches are now pushed to quay.io

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-20 14:57:00 -06:00
Sage Weil
acd4f5bc43 qa/standalone: python -> python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 13:33:21 -06:00
Sage Weil
e47526e152 qa/standalone/special/ceph_objectstore_tool: python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 13:32:53 -06:00
Sage Weil
074f1ff246 cephadm: python3 shebang
We need to figure out if/how we can make this as tolerant as possible for
the curl users so that it can still run on a python2-only host.

Maybe.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 12:47:56 -06:00
Abhishek L
e10a890a10
Merge pull request #30669 from theanalyst/rgw/user-stats-flush
rgw: radosgw-admin flush user stats output
2019-12-20 18:25:32 +01:00
Abhishek L
aa39593f5d
Merge pull request #30993 from theanalyst/rgw/mp-list-encoding
rgw: support encoding-type param for list bucket multiparts
2019-12-20 18:14:22 +01:00
Abhishek L
c195b78049
Merge pull request #31127 from theanalyst/rgw/qa-s3-user-caps
qa: rgw: add user-policy caps for the s3tests users

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Pritha Srivastava <prsivas@redhat.com>
2019-12-20 18:13:03 +01:00
Abhishek L
7933cd191f
Merge pull request #31124 from theanalyst/rgw/user-policy-args
rgw: iam: add all http args to req_info

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Pritha Srivastava <prsivas@redhat.com>
Reviewed-By: Yuval Lifshitz <yuvalif@yahoo.com>
2019-12-20 18:12:22 +01:00
Sage Weil
4a566bdc2d Merge PR #32362 into master
* refs/pull/32362/head:
	qa/packages/packages: el8 has granular -debuginfo
	qa/tasks/cbt: include py2 deps on ubuntu for now
	src/test: misc python -> python3
	qa/suites/rados/singleton-flag/valgrind-leaks: run on latest centos
	qa/workunits: env python -> env python3
	qa/suites/rados/dashboard/tasks/dashboard: whitelist OSDMAP_FLAGS
	qa/suites/rados/verify: ping to specific centos
	qa/workunits/rados/test_envlibrados_rocksdb: enable el8 PowerTools
	qa/workunits/rados/test_pool_access.sh: python -> python3
	mgr/crash: fix signature for py3

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-20 09:29:47 -06:00
Sage Weil
895a5e1427 qa/tasks/cephadm: ceph.git branches are now pushed to quay.io
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 08:56:09 -06:00
Kefu Chai
ead5033931
Merge pull request #32374 from zdover23/wip-doc-osd-verb-commit-20-dec-2019
doc: added an "is" where it was needed.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-20 22:33:46 +08:00
Kefu Chai
49e3243230
Merge pull request #32371 from tchaikov/wip-mgr-dashboard-popd
mgr/dashboard: restore working directory after creating venv

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-20 22:28:29 +08:00
Kefu Chai
130e3eddb9 qa/tasks/vstart_runner.py: use current python executable
python3 is not always the path to executable used by current python
session.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-20 21:39:49 +08:00
Sage Weil
6f5fb95408 qa/packages/packages: el8 has granular -debuginfo
Also add a bunch of missing packages.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
3f2270a1c4 qa/tasks/cbt: include py2 deps on ubuntu for now
...until cbt is converted to py3

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
13cbfaaea8 src/test: misc python -> python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
c87a76096e qa/suites/rados/singleton-flag/valgrind-leaks: run on latest centos
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
1abcb0bb9b qa/workunits: env python -> env python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00