Commit Graph

111130 Commits

Author SHA1 Message Date
Yuri Weinstein
c94dc41144
Merge pull request #34894 from yuriw/wip-yuriw-distro-master
qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04
2020-05-05 08:31:32 -07:00
Tiago Melo
3cb9f0ce47 mgr/dashboard: Remove unnecessary call in health.component.ts
Fixes: https://tracker.ceph.com/issues/45386

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-05-05 14:10:36 +00:00
Sebastian Wagner
91afff19d0
Merge pull request #34856 from jschmid1/cephadm_osdspec_affinity
mgr/cephadm: add support for proper osd daemon tracking

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 16:00:12 +02:00
Tiago Melo
f1a020eaf5 mgr/dashboard: Reduce requests in Mirroring page
Fixes: https://tracker.ceph.com/issues/45385

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-05-05 13:44:49 +00:00
Sebastian Wagner
b62dd11e3d qa/workunits/cephadm: test grafana adoption
now includes af85d49307

Fixes: https://github.com/ceph/cephadm-adoption-corpus/pull/3
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 14:50:14 +02:00
Shilpa Jagannath
06e6013ec1 qa/rgw: add ssl option in reshard tests
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-05-05 15:07:59 +05:30
Sebastian Wagner
d347db28bc
Merge pull request #34773 from ricardoasmarques/cephadm-shell-mount
cephadm: Add shell '--mount' option to mount host file or directory

Reviewed-by: Matthew Oliver <moliver@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:57:05 +02:00
Sebastian Wagner
3924fd86b5
Merge pull request #34703 from SUSE/wip-fix-45129
cephadm: Add `chown` to unit.run for adoped simple OSDs

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:55:45 +02:00
Sebastian Wagner
cf60809597
Merge pull request #34778 from mgfritch/cephadm-dd-service-id
mgr/orch: service_id can contain a '.' char (mds, nfs, iscsi)

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:40:24 +02:00
Sebastian Wagner
f6ef61cbe8
Merge pull request #34814 from mgfritch/cephadm-iscsi-apply
mgr/orch: fix `orch apply iscsi`

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:38:26 +02:00
Sebastian Wagner
16c330cba9
Merge pull request #34658 from matthewoliver/cephadm_iscsi_ssl
cephadm: Make ceph-iscsi SSL aware

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:37:07 +02:00
Sebastian Wagner
af2dae1384
Merge pull request #34745 from cybozu/cephadm-fix-the-hang-up-on-creating-encrypted-osd
cephadm: fix the hang-up of cryptsetup on creating encrypted OSD

Reviewed-by: Sage Weil <sage@redhat.com>
2020-05-05 10:00:45 +02:00
Volker Theile
2fa69eb688 qa: mgr/dashboard: Replace Telemetry module in REST API test
Fixes: https://tracker.ceph.com/issues/45109

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-05-05 09:35:24 +02:00
Matthew Oliver
9b7dcb894c cephadm: give ceph-iscsi permissions to configfs
The cephadm container mounts the configfs and then bind mounts (-v) it
into the container. Currently the container is not a priviliaged
container which leads to 2 problems:

 1. The container can't insert the iscsi_target_mod kernel module; and
 2. The container can't write to the configfs as that's only writeable
    by root.

We _can_ get around 1, by preloading the kernel module. I.E add it the
systemd unit file. But that doesn't help with 2.

I've tried mounting the configfs with uid and gid options, but configfs
doesn't use them.

If we make the container a priviliged container then magically both 1
and 2 are solved. We don't need to preload the module so that's one less
workaround. But more importantly, configfs can be written to so we can
create ISCSI targets etc.

So that's what this patch does, it makes iscsi containers privileged
containers by setting the CephContainer --priviliged while creating it.

Fixes: https://tracker.ceph.com/issues/45252
Signed-off-by: Matthew Oliver <moliver@suse.com>
2020-05-05 16:17:06 +10:00
Kefu Chai
61ad4e6bb9
Merge pull request #34660 from majianpeng/bluestore-pmemdevice
os/bluestore: avoid offset overflow.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-05 12:59:50 +08:00
Kefu Chai
e2af5e13ad
Merge pull request #34837 from sseshasa/wip-mon-memory-target-fix
mon/OSDMonitor: Always tune priority cache manager memory on all mons

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-05-05 12:48:43 +08:00
Kefu Chai
91253038f6
Merge pull request #34788 from yuvalif/cls_q_has_empty_markers
cls/queue: fix empty markers when listing entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-05 12:47:27 +08:00
Michael Fritch
3cbebf37a6
mgr/orch: match last occurance of hostname in service_id
The RGW realm/zone might have a substr that matches the hostname

Fixes: https://tracker.ceph.com/issues/45294
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:41:06 -06:00
Michael Fritch
7efa0a6fda
mgr/cephadm: use keyword instead of positional args
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
Michael Fritch
01604b6e43
mgr/cephadm: get service_name from DaemonDescription
use the shared logic in the DaemonDescription class

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
Michael Fritch
0bd6d46af6
mgr/orch: allow '.' chars in the service_id
service_id can contain a '.' char (mds, nfs, iscsi)

Fixes: https://tracker.ceph.com/issues/45293
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
Yuri Weinstein
835f2f5f51 qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04
... so all tests for `pacific` will be tested on the latest ubuntu version

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-04 14:04:36 -07:00
Casey Bodley
cebce38f1c test/rgw: SystemObject.json_command no longer trims json output
this was a workaround for 'period commit' commands that used to write
the "Sending period to new master zone" line to stdout

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 16:38:36 -04:00
Casey Bodley
e48a200762 radosgw-admin: period commit writes messages to stderr
the period's json output is written to stdout. any other messages should
be written to stderr

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 16:36:18 -04:00
J. Eric Ivancich
524f22c8b5
Merge pull request #34148 from ivancich/octopus-rados-list
rgw: add `rgw-orphan-list` tool & `radosgw-admin bucket radoslist ...`

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 15:27:21 -04:00
Michael Fritch
41ffb701ec
mgr/insights: fix python3 DeprecationWarning
insights/module.py:167: DeprecationWarning: invalid escape sequence \d
    r = "ceph version (?P<release>\d+)\.(?P<major>\d+)\.(?P<minor>\d+)"

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 12:37:11 -06:00
Michael Fritch
586eb6ccb9
doc/mgr/orchestrator: update iscsi
`apply iscsi` and `add iscsi` are implemented in cephadm

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 12:28:05 -06:00
Michael Fritch
884fc3d07f
mgr/orch: add iscsi apply cli
`$ ceph orch apply iscsi --pool <pool>`

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 12:28:05 -06:00
Sebastian Wagner
53da12e7eb
mgr/cephadm: _apply_service: fix _create_iscsi invocation
Fixes: https://tracker.ceph.com/issues/45249
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-04 12:23:07 -06:00
J. Eric Ivancich
43c948a4ab qa/rgw: integration test for rgw-orphan-list & radosgw-admin radoslist
Add teuthology test for `rgw-orphan-list` in a new tool suite under
rgw. It only needs to be tested under one configuration. And the new
tool sub-suite can be used by other tooling int he
future. radosgw-admin `radoslist` is tested indirectly through
`rgw-orphan-list` and therefore does not need its own test.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
89654d0477 qa/rgw: allow the rgw teuthology task to capture/set dns names
A teuthology workunit might want to use the rgw task, setting the
rgw-dns-name and/or rgw-dns-s3website-name configuration options to
the fully-qualified domain name. Existing code implies that setting
these configuration options to the empty string will do that. However
the current logic does not support that given it has Python
conditionals that treat the empty string as false. This fixes that.

Now the following teuthology tasks YAML will work as expected:

  tasks:
  - rgw:
      client.0:
        dns-name: ''
        dns-s3website-name: ''

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
3aff078700 test/rgw: add static testing for ceph-diff-sorted
Tests are run during "make check".

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
9d5e9c3031 doc/rgw: add docs for rgw-orphan-list and ceph-diff-sorted
Add man pages and documentation for both tools.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:33:56 -04:00
J. Eric Ivancich
e396064d9a rgw: add rgw-orphan-list tool & radosgw-admin bucket radoslist ...
Adds a `radosgw-admin` subcommand and walks the associated bucket
indices and manifests to generate the list of rados objects that
represent the rgw objects in the bucket(s).

Also adds a tool named `rgw-orphan-list`, which uses the radoslist
subcommand, that produces a list in a local file of what appear to be
rgw orphans.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
J. Eric Ivancich
eaa8f66ec0 rgw: add const-correctness to rgw_obj_manifest and svc_tier_rados
Mark functions as "const" or function parameters as "const" in order
to make those functions more widely callable.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
Casey Bodley
a8762af4af
Merge pull request #34172 from cbodley/wip-44751
radosgw-admin: fix infinite loops in 'datalog list'
2020-05-04 12:30:18 -04:00
Casey Bodley
67415ea07b
Merge pull request #34286 from cbodley/wip-qa-rgw-cls-2pc-queue
qa/rgw: run ceph_test_cls_2pc_queue in verify suite

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-05-04 12:29:14 -04:00
Casey Bodley
a3f1f21462
Merge pull request #29062 from zhangsw/rgw-reshard-stats
rgw: add check for index entry's existing when adding bucket stats during bucket reshard.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 12:28:21 -04:00
J. Eric Ivancich
16ca63002e
Merge pull request #34892 from ivancich/wip-fix-tests_ps
qa/rgw: fix issue error in tests_ps.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 12:10:18 -04:00
J. Eric Ivancich
9218065109 qa/rgw: fix issue error in tests_ps.py
The Python interpreter on teuthology complains about the lack of
parens in a print statement.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 11:35:25 -04:00
Ricardo Marques
71c58f18b5 cephadm: Add '--mount' option to mount host file or directory
Fixes: https://tracker.ceph.com/issues/45284

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-05-04 15:35:43 +01:00
Patrick Donnelly
ec2fcf3035
Merge PR #34088 into master
* refs/pull/34088/head:
	doc: mailmap: changes for octopus release

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-04 06:44:39 -07:00
Mykola Golub
f3590d6334 librbd: small improvements for TaskFinisher
1) cancel: make return success status
2) queue: allow to pass return value
3) add method to reschedule event

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-05-04 13:42:12 +01:00
Jan Fajerski
39a5fc1af3
Merge pull request #34436 from jschmid1/dg_affinity
ceph-volume: add ceph.osdspec_affinity tag
2020-05-04 14:15:15 +02:00
Sebastian Wagner
c2c7829c9f mgr/cephadm: move SpecStore and HostCache to inventoy.py
Make module.py a bit smaller

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-04 12:42:00 +02:00
Lenz Grimmer
3af27bfb71
Merge pull request #34867 from tspmelo/wip-fix-table-filter
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-05-04 12:18:19 +02:00
Joshua Schmid
fbed226327 python-common: do not pass affinity to ceph_volume when None
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-05-04 12:17:49 +02:00
Joshua Schmid
1c0a0a6f61 mgr/cephadm: add support for proper osd daemon tracking
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-05-04 12:17:49 +02:00
Sebastian Wagner
e1360f1653
Merge pull request #34779 from mgfritch/cephadm-workunit-node-exporter-avail
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
2020-05-04 11:11:32 +02:00
Sebastian Wagner
d6872343ad
Merge pull request #34728 from ricardoasmarques/infer-config
cephadm: Infer config on "cephadm shell"
2020-05-04 11:11:01 +02:00