Commit Graph

118875 Commits

Author SHA1 Message Date
Rishabh Dave
db0b85b440 qa/cephfs: remove parameter createfs from mount classes
It's better to get rid of this paramter since it doesn't actually create
any new Ceph file system.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-02-20 15:32:52 +05:30
Kefu Chai
71711b56db
Merge pull request #39016 from sebastian-philipp/cephadm-mypy-status-none
mgr/cephadm: mypy says: dd.status can be None

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-22 19:46:42 +08:00
Kefu Chai
eab2a7cf07
Merge pull request #38999 from tchaikov/wip-crimson-bootstrap
crimson/osd: fetch_config() before mkfs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-01-22 19:45:30 +08:00
Kefu Chai
2d63bc0fbd vstart.sh: print out osd mkfs command
for better understanding the progress of vstart, and also allows
developer to repeat the command.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 18:54:29 +08:00
Kefu Chai
37dc3ea9c2 mon/MonClient: do not include unused header
MGetConfig.h is not used anywhere in this source file, so no need to
include it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 18:54:28 +08:00
Kefu Chai
237cbc9ba5 crimson/os: do not use __func__ in lambda
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 18:54:28 +08:00
Kefu Chai
71229d557d crimson/mon: use switch case for checking return code
also, since seastar supports returning plain value instead a ready
future, let's return plain value. simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 18:54:28 +08:00
Jan Fajerski
1f9cabf8a8 Merge PR #32027 into master
* refs/pull/32027/head:
	librados: avoid symbol versioning on Windows

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-22 11:35:18 +01:00
Sebastian Wagner
2df47b88ab mgr/cephadm: Minor pep8 fix
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-22 11:32:40 +01:00
Sebastian Wagner
fb19769503 mgr/cephadm: mypy says: dd.status can be None
`DaemonDescription.status` is annotated
as `Optional[int]` and thus can be `None`

This is a conflict between c95ba878c6
and 01f60cf4e0

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-22 11:32:31 +01:00
Sebastian Wagner
e27cc8183e
Merge pull request #38978 from liewegas/cephadm-daemon-health
mgr/cephadm: raise HEALTH_WARN when cephadm daemon in 'error' state

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-22 10:40:00 +01:00
Sebastian Wagner
b8e49ea914
Merge pull request #38967 from liewegas/wip-cephadm-pacific
cephadm: latest stable release is now pacific

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-01-22 10:36:25 +01:00
Sebastian Wagner
6200f4c42e
Merge pull request #38739 from jecluis/wip-cephadm-splits
cephadm: splits bootstrap function, add context, drop global variables

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-22 10:35:19 +01:00
Kefu Chai
84b2e06794 crimson/osd: fetch_config() before mkfs
* fetch_config() before mkfs and starting osd
  for populating settings related to booting and transport layer
  before it starts.
* set fsid read from monitor before mkfs
  it's crucial to mkfs if osd is supposed to retrieve the fsid
  from monitor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 13:07:48 +08:00
Kefu Chai
c54bcf660f crimson/net: move implementation of dtor into .cc file
ceph_assert() is expanded into 5 lines of code. it'd help to speed up
the compiling a little bit.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 13:07:48 +08:00
Kefu Chai
9a248da3fe crimson/mon: add mon::Client::wait_for_config()
just for waiting for monmap and config from mon. crimson-osd needs this
for populating settings related to booting and transport layer before it
starts.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 13:07:48 +08:00
Kefu Chai
264e710a37 crimson/mon: fallback to msgr v2 for unbound msgr
so, for instance, if we want to connect to monitor without bind to any
address, we can try to use the v2 addresses advertised in monmap or
local settings, instead of being unable to connect to mon because we are
using an `entity_addr_t::TYPE_NONE` address which is returned by
`entity_addrvec_t::front()` if the addrvec is empty.

see also AsyncMessenger::should_use_msgr2().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 13:07:48 +08:00
Kefu Chai
51c8ffff6d crimson/mon: print out entity addr type when non peer address matches
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-22 13:07:48 +08:00
Casey Bodley
3cdd3d18a1
Merge pull request #39010 from mdw-at-linuxbox/wip-master-barbicany2021
qa/tasks/barbican.py: fix year2021 problem

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-21 17:42:38 -05:00
Casey Bodley
e36b72f4f0
Merge pull request #39008 from mdw-at-linuxbox/wip-master-vaultunzip
qa/tasks/vault.py: unzip: try harder to find a working unzip.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-21 17:42:09 -05:00
Jason Dillaman
8d86249a8e
Merge pull request #38988 from orozery/librbd-crypto-empty-copyup
librbd: don't restart empty copyups in crypto layer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-21 15:07:01 -05:00
Jason Dillaman
21bc198918
Merge pull request #38985 from orozery/rbd-nbd-luks2-blksize
tools/rbd-nbd: change block size to 4K for LUKS2 images

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-21 15:06:20 -05:00
Jason Dillaman
410c40ee53
Merge pull request #38983 from orozery/qa-qemu-rbd-encryption
qa/tasks/rbd: increase image size of encrypted disks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-21 15:05:30 -05:00
Marcus Watts
b1fac2224b qa/tasks/barbican.py: fix year2021 problem
The expiration timestamp was hard-coded as
2020-12-31T19:14:44.180394
which is now in the past.  Instead, use a timestamp
90 minutes in the future.

Fixes: https://tracker.ceph.com/issues/48919
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-01-21 13:31:27 -05:00
Marcus Watts
ed664a4d0b qa/tasks/vault.py: unzip: try harder to find a working unzip.
The existing logic uses "python -m zipfile" to unzip files.
This will (most likely) fail on CentOS 8-Stream , where python
defaults to 'unset' (see man unversioned-python).

So: try harder: try unzip, python3, and python in that order,
to find something that can unzip files.

Fixes: https://tracker.ceph.com/issues/48921
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-01-21 12:35:01 -05:00
Harish Munjulur
b32153a4ed
Merge pull request #38691 from soumyakoduri/lc_fixes
rgw/lc: Fix use-after-free in RGWLC::process
2021-01-21 09:25:06 -08:00
Harish Munjulur
dee214ea11
Merge pull request #38465 from IlsooByun/fix_lc_infinite_loop
rgw: lc: fix infinite loop in bucket_lc_prepare
2021-01-21 09:24:51 -08:00
Venky Shankar
beb00bd2a8
Merge pull request #36698 from vshankar/wip-cephfs-mirror-tests
cephfs-mirror: teuthology task and tests
2021-01-21 09:46:51 +05:30
Venky Shankar
a7d1fd6ae8
Merge pull request #35993 from vshankar/wip-fs-mirror-interface
pybind/mgr/mirroring: directory snapshot mirror support
2021-01-21 09:45:41 +05:30
Casey Bodley
d42db5f434
Merge pull request #38991 from cbodley/wip-rgw-perm-state-valgrind
rgw: fix reference to temporary in perm_state ctor

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-20 17:05:30 -05:00
Sage Weil
59576d17f7
Merge pull request #38817 from ideepika/fix-interactive-error
qa/tasks/ceph: do not update info.yaml if ctx.archive is not set
2021-01-20 15:21:15 -06:00
Neha Ojha
173ba0a239
Merge pull request #38941 from sseshasa/wip-48906-async-rec-min-cost-fix
osd: Remove override for osd_async_recovery_min_cost for mclock profiles

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-01-20 12:37:44 -08:00
Matt Benjamin
9773f0a538 rgw: avoid (rgw_file) illegal access to stack memory
Fixes: https://tracker.ceph.com/issues/48941

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-01-20 13:46:58 -05:00
Casey Bodley
b421128951
Merge pull request #38987 from cbodley/wip-qa-rgw-valgrind-supp-tls
valgrind: update suppression for _dl_allocate_tls

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-01-20 13:22:56 -05:00
Or Ozeri
cd6f3ccd33 librbd: don't restart empty copyups in crypto layer
This commit fixes a bug where an empty parent copyup is restarted indefinitely.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-01-20 18:43:47 +02:00
Casey Bodley
ae8db357f7
Merge pull request #38966 from rzarzynski/wip-qa-rgw-no-valgrind-early-exit
qa/task/rgw: instruct Valgrind to don't exit on first error.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-20 11:08:38 -05:00
Casey Bodley
db17daf3b0 valgrind: update suppression for _dl_allocate_tls
in the rgw suite, there's an extra allocate_dtv() call in this stack.
add a ... to match it

  <stack>
    <frame>
      <ip>0x4C3321A</ip>
      <obj>/usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
      <fn>calloc</fn>
      <dir>/builddir/build/BUILD/valgrind-3.16.0/coregrind/m_replacemalloc</dir>
      <file>vg_replace_malloc.c</file>
      <line>760</line>
    </frame>
    <frame>
      <ip>0x4012341</ip>
      <obj>/usr/lib64/ld-2.28.so</obj>
      <fn>allocate_dtv</fn>
    </frame>
    <frame>
      <ip>0x4012CD1</ip>
      <obj>/usr/lib64/ld-2.28.so</obj>
      <fn>_dl_allocate_tls</fn>
    </frame>
    <frame>
      <ip>0x101C7F32</ip>
      <obj>/usr/lib64/libpthread-2.28.so</obj>
      <fn>pthread_create@@GLIBC_2.2.5</fn>
    </frame>
    <frame>
      <ip>0x6F14E64</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>Thread::try_create(unsigned long)</fn>
    </frame>

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-20 11:03:21 -05:00
Joao Eduardo Luis
9e81a5dfc5
cephadm: fix stuff
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:47 -01:00
Joao Eduardo Luis
4fa175e967
cephadm: annotate variable type for mypy
mypy was complaining about the type of the variable being None, later on
on assignment with an int.

Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:47 -01:00
Joao Eduardo Luis
5178403833
cephadm/test: support context class
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:47 -01:00
Joao Eduardo Luis
c785dc5679
cephadm: have context handle config options
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
b56eb958df
cephadm: drop ctx class from where we don't need it
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
bc256983c1
cephadm/bootstrap: move mon net discovery to function
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
13addf6f54
cephadm: don't forget ipv6 behind
Fixes a bug introduced earlier in the patchset. It's just too hard to go
back and fix it up with the right commit.

Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
b5e9c81321
cephadm: split-off config work on bootstrap
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
4d30ee7e5d
cephadm: split-off dashboard setup on bootstrap
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:46 -01:00
Joao Eduardo Luis
9ef0a67926
cephadm: split-off ssh preparations on bootstrap
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:45 -01:00
Joao Eduardo Luis
60329c6be3
cephadm: split-off mgr creation
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:45 -01:00
Joao Eduardo Luis
1dd2dcc8ed
cephadm: split mon prepare and create
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:45 -01:00
Joao Eduardo Luis
adc58849fe
cephadm: move configuration out of the way
Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2021-01-20 13:20:45 -01:00