Commit Graph

122171 Commits

Author SHA1 Message Date
Sage Weil
d7b4a51a52 mgr/cephadm: include daemon_type in DaemonPlacement
Initially, this will always match the service_type.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 16:52:42 -04:00
Sage Weil
1897d1cd15 mgr/cephadm: update list-networks to report interface names too
Also, minor fix in the ipv6 addr reporting: ignore networks that aren't in CIDR
form (no /).

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 16:52:42 -04:00
Sage Weil
f93c555c24 mgr/orchestrator: streamline 'orch ps' PORTS formatting
"*:8000 *:8100" -> "*:8000,8100"

FWIW this matches the internal rendering used by DaemonPlacement

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 16:52:42 -04:00
Sage Weil
9256f1c374 mgr/cephadm/schedule: handle multiple ports per daemon
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 16:52:42 -04:00
Sage Weil
2e7808ccf8 mgr/cephadm/utils: resolve_ip(): prefer IPv4
On my system the first item in hte list is
'fe80::408d:35e7:510:e9fe%eno1np0'.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 16:52:42 -04:00
Patrick Donnelly
44f157742e
Merge PR #40833 into master
* refs/pull/40833/head:
	test/librados/tier_cxx: use non-deprecated wait_for_complete

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-13 13:26:43 -07:00
Samuel Just
50edcbcd81 test/librados/tier_cxx: use non-deprecated wait_for_complete
Fixes: https://tracker.ceph.com/issues/50342
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-04-13 18:18:17 +00:00
Yuval Lifshitz
8f57c508df
Merge pull request #40798 from yuvalif/wip-yuval-fix-49800
rgw/test: use 'localhost' for amqp ssl test
2021-04-13 19:00:49 +03:00
Yin Congmin
937af36e20 librbd/cache/pwl: Fix dead lock issue when pwl initialization failed
when pwl initialization failed, 'AbstractWriteLog' will release itself
in callback, it hold guard lock and want to get lock to delete data,
which causes dead lock. This PR works by release image_cache outside
the callback function.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-04-13 23:02:03 +08:00
Casey Bodley
8cb94edcb1 qa/rgw: rgw/crypt uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-13 10:44:05 -04:00
Jeff Layton
3b1bf45d62 mds: set fscrypt flag on create if xattr buffer has an encryption context
If the client sends an inode with a crypto context already in the xattr
buffer, ensure that we set the fscrypt flag in the inode.

Fixes: https://tracker.ceph.com/issues/50305
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2021-04-13 09:53:11 -04:00
Ilya Dryomov
7eb9c5ddb2 Merge branch 'master' into wip-unauthorized-gids
Sync up with master up to commit 3d8e73b266 ("Merge pull request
#40731 from tchaikov/wip-yamlize-options").  Specifically, bring in
src/common/options.cc yamlization and move new auth-related options
into src/common/options/global.yaml.in.

Conflicts:
	src/common/options.cc
	src/common/options/global.yaml.in

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-13 15:42:06 +02:00
Kefu Chai
ebed7e83c2
Merge pull request #40832 from wjwithagen/wjw-fix-y2c.py
common: make y2c.py work on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-13 21:14:44 +08:00
cypherean
777f236ad8 mgr/cephadm: skip-ssh flag enables cephadm mgr module
This commit fixes the use of skip-ssh flag. It disables ssh config and enables the cephadm mgr module.

Fixes: http://tracker.ceph.com/issues/49737
Signed-off-by: Shreyaa Sharma <shreyasharma.ss305@gmail.com>
2021-04-13 14:16:11 +05:30
Willem Jan Withagen
1851621793 common: make y2c.py work on FreeBSD
1) make reference to python3 indepedant of explicit path
2) add required py-yaml module to install list

fixes: #40731
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2021-04-13 10:17:01 +02:00
Greg Farnum
adbaeeec95 mon: set_healthy_stretch_mode in update_from_paxos, not random leader calls!
Add header comment describing how this works now.

Fixes: https://tracker.ceph.com/issues/50308

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-04-13 06:39:10 +00:00
Greg Farnum
73b461a4f3 mon: maintain stretch_recovery_triggered in new OSDMon::set_*_stretch_mode
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-04-13 06:39:10 +00:00
Greg Farnum
e1ae9257fb mon: add a set_recovery_stretch_mode function
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-04-13 06:39:10 +00:00
Greg Farnum
596d09aa7c mon: rename maybe_engage_stretch_mode to try_engage_stretch_mode
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-04-13 06:39:10 +00:00
Greg Farnum
b1e78c4177 mgr: do not require sqlite3.h if WITH_LIBCEPHSQLITE=OFF
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-04-13 04:12:11 +00:00
Kefu Chai
3d8e73b266
Merge pull request #40731 from tchaikov/wip-yamlize-options
common: extract options into yaml

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-13 11:38:49 +08:00
Kefu Chai
f9e1c6bc23
Merge pull request #40739 from jdurgin/wip-alienstore-debug
crimson/os/alienstore: use bluestore debug prefix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-13 11:06:53 +08:00
Patrick Donnelly
484fbb51df
SimpleRADOSStriper: use debug_cephsqlite
Instead of debug_client (which is primarily used by ceph-fuse).

Fixes: https://tracker.ceph.com/issues/50307
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-12 20:06:21 -07:00
Sage Weil
dcd90a1c8d Merge PR #40626 into master
* refs/pull/40626/head:
	qa/suites/rados/objectstore: separate store_test tests
	qa/standalone: split osd/ into 2 directories

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 22:38:49 -04:00
Kefu Chai
bfdca7fa01 common/options: s/immutable-objet-cache/immutable-object-cache/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-13 09:15:19 +08:00
Kefu Chai
5ddda38da4 common: extract options into yaml
extract the options in common/options.cc into separate .yaml.in
files, and preprocess them using CMake before translating them into .cc
files using a python script.

this change paves the road to render the options using sphinx, and
will allow us to further annotate the options to include more metadata.

also, a this YAML file can be consumed by applications like dashboard
and Sphinx to consume these metadata in a simpler way.

* use @variable-name@ for substituting the variables in .yaml.in file
* use cmake variable of `mgr_disabled_modules` instead of C macro
  to define `mgr_disabled_modules` in global.yaml.in
* debian/control, ceph.spec.in, win32_deps_build.sh: add python3-yaml
  as build dep
* add y2c.py (short for YAML to C++) to translate .yaml to .cc file
* common/options/*.yaml.in: extract and split options into .yaml.in
  files, the subvars in it is then replaced with CMake variables,
  and copied to the corresponding .yaml files
* include/config-h.in.cmake: remove MGR_DISABLED_MODULES, as it
  is not a CMake variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-13 09:13:47 +08:00
Kefu Chai
3bee4b0261 cmake: use the same name for macros and cmake variables
for two reasons,

* consolidate the namings
* pave the road to yamlize options where we will use cmake variables
  to substitude the @<variable-name>@ in .in files instead of relying
  on C/C++ macros

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-13 09:13:46 +08:00
Kefu Chai
bed1b32974 cmake: introduce WITH_EC_ISA_PLUGIN
instead of checking "HAVE_NASM_X64_AVX2 OR HAVE_ARMV8_SIMD" everywhere,
use a single cached variable of WITH_EC_ISA_PLUGIN. so it's more
consistent when checking the availability of ec_isa plugin.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-13 09:13:46 +08:00
Sage Weil
d4ac4f3b78 qa/suites/rados/objectstore: separate store_test tests
This takes 5 hours currently.

- Separate out filestore and memstore into separate task (~1 hr)
- Split bluestore into -a and -b (a tests exclude SynethicMatrixC,
  b tests include it)

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-12 16:27:29 -05:00
Ilya Dryomov
ca822b9a8d
Merge pull request #40576 from idryomov/wip-no-cephxv2-for-unmap
qa/suites/krbd: don't require CEPHX_V2 for unmap subsuite

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2021-04-12 21:23:06 +02:00
Yuval Lifshitz
a4a2b90032
Merge pull request #40800 from yuvalif/wip-yuval-fix-50291
rgw/amqp/test: fix mock prototype for librabbitmq-0.11.0
2021-04-12 22:19:10 +03:00
Patrick Donnelly
ca43c819c6
Merge PR #40651 into master
* refs/pull/40651/head:
	doc/cephadm: fix a typo

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-12 12:11:05 -07:00
Samuel Just
3f6f46d844
Merge pull request #40067 from myoungwon/wip-49726
osd: avoid for the two copy to cancel each other

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-12 11:50:06 -07:00
Patrick Donnelly
05c0ddbb01
pybind/mgr/devicehealth: fix command name
Regression: 61bb1691f4
Fixes: https://tracker.ceph.com/issues/50304
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-12 10:37:50 -07:00
Kefu Chai
8b879ca72c qa/suites/upgrade/pacific-x/rgw-multisite: specify distro
instead of using the default / existing distro, specify the distro for
testing. this change prevents us from using bionic for testing the
builds. this has two consequences:

* so we are one step closer to a non-bionic world.
* avoid building packages with PPA repo which *might* introduce runtime
  dependencies on 3rd party runtimes provided by PPA repo.

see also: https://tracker.ceph.com/issues/50218

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-12 12:56:35 -04:00
Sage Weil
e98923de9b Merge PR #40546 into master
* refs/pull/40546/head:
	SECURITY.md: Create SECURITY.md

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 12:36:48 -04:00
Casey Bodley
6262cfa41f qa/rgw: reenable valgrind in rgw/website
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:31:26 -04:00
Casey Bodley
bbefbd3146 qa/rgw: rgw/tempest uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:30:01 -04:00
Casey Bodley
0a4437ba6f qa/rgw: rgw/multifs uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
09c93945a7 qa/rgw: rgw/thrash uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1a42bd37d2 qa/rgw: rgw/notifications no longer pins centos
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
c59f994a7e qa/rgw: use symlinks for rgw/sts suite, target supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1942095a32 qa/rgw: rgw/multisite uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:06:29 -04:00
Casey Bodley
8f27c845be qa/rgw: move rgw/multisite valgrind config into valgrind.yaml.disabled
the valgrind coverage wasn't enabled, and it will take a lot more work
before we can reenable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:05:16 -04:00
Sage Weil
3798cc6592 Merge PR #40726 into master
* refs/pull/40726/head:
	doc: Add GPG Keys

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-12 11:53:02 -04:00
Sage Weil
463bb3d2ef Merge PR #40736 into master
* refs/pull/40736/head:
	mgr/cephadm: rewrite/simplify describe_service
	mgr/orchestrator: report osds as osd.unmanaged as appropriate
	mgr/orchestrator: remove IMAGE ID from 'orch ls'

Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-04-12 11:45:50 -04:00
Ernesto Puerta
648f9e11a6
Merge pull request #40721 from rhcs-dashboard/49925-fix-nfs-ganesha
mgr/dashboard: fix errors when creating NFS export.

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-04-12 17:33:52 +02:00
Sage Weil
0f65e5cffa qa/standalone: split osd/ into 2 directories
The whole osd/ directory takes 3 hours to run.  Of that, about half is
osd-backfill*:

2021-04-05T20:38:55.932 INFO:tasks.workunit:Running workunit osd/osd-backfill-prio.sh...
2021-04-05T20:47:27.184 INFO:tasks.workunit:Running workunit osd/osd-backfill-recovery-log.sh...
2021-04-05T20:55:59.497 INFO:tasks.workunit:Running workunit osd/osd-backfill-space.sh...
2021-04-05T21:48:47.549 INFO:tasks.workunit:Running workunit osd/osd-backfill-stats.sh...
2021-04-05T22:17:09.197 INFO:tasks.workunit:Running workunit osd/osd-bench.sh...

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-12 09:59:17 -05:00
Kefu Chai
2a7e54d5c4
Merge pull request #40814 from tchaikov/wip/ceph-object-corpus/pacific
ceph-object-corpus: pick up 16.2.0-90-g50f1821b4c

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 22:40:13 +08:00
J. Eric Ivancich
505b3f2108
Merge pull request #40801 from ivancich/wip-radoslist-incomplete-multipart-parts-marker
rgw: radoslist incomplete multipart parts marker

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-12 10:34:50 -04:00