Commit Graph

110951 Commits

Author SHA1 Message Date
Sebastian Wagner
d347db28bc
Merge pull request from ricardoasmarques/cephadm-shell-mount
cephadm: Add shell '--mount' option to mount host file or directory

Reviewed-by: Matthew Oliver <moliver@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:57:05 +02:00
Sebastian Wagner
3924fd86b5
Merge pull request from SUSE/wip-fix-45129
cephadm: Add `chown` to unit.run for adoped simple OSDs

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:55:45 +02:00
Sebastian Wagner
cf60809597
Merge pull request from mgfritch/cephadm-dd-service-id
mgr/orch: service_id can contain a '.' char (mds, nfs, iscsi)

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:40:24 +02:00
Sebastian Wagner
f6ef61cbe8
Merge pull request from mgfritch/cephadm-iscsi-apply
mgr/orch: fix `orch apply iscsi`

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:38:26 +02:00
Sebastian Wagner
16c330cba9
Merge pull request from matthewoliver/cephadm_iscsi_ssl
cephadm: Make ceph-iscsi SSL aware

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 10:37:07 +02:00
Sebastian Wagner
af2dae1384
Merge pull request from cybozu/cephadm-fix-the-hang-up-on-creating-encrypted-osd
cephadm: fix the hang-up of cryptsetup on creating encrypted OSD

Reviewed-by: Sage Weil <sage@redhat.com>
2020-05-05 10:00:45 +02:00
Kefu Chai
61ad4e6bb9
Merge pull request from majianpeng/bluestore-pmemdevice
os/bluestore: avoid offset overflow.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-05 12:59:50 +08:00
Kefu Chai
e2af5e13ad
Merge pull request from sseshasa/wip-mon-memory-target-fix
mon/OSDMonitor: Always tune priority cache manager memory on all mons

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-05-05 12:48:43 +08:00
Kefu Chai
91253038f6
Merge pull request from yuvalif/cls_q_has_empty_markers
cls/queue: fix empty markers when listing entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-05 12:47:27 +08:00
Michael Fritch
3cbebf37a6
mgr/orch: match last occurance of hostname in service_id
The RGW realm/zone might have a substr that matches the hostname

Fixes: https://tracker.ceph.com/issues/45294
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:41:06 -06:00
Michael Fritch
7efa0a6fda
mgr/cephadm: use keyword instead of positional args
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
Michael Fritch
01604b6e43
mgr/cephadm: get service_name from DaemonDescription
use the shared logic in the DaemonDescription class

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
Michael Fritch
0bd6d46af6
mgr/orch: allow '.' chars in the service_id
service_id can contain a '.' char (mds, nfs, iscsi)

Fixes: https://tracker.ceph.com/issues/45293
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 15:35:53 -06:00
J. Eric Ivancich
524f22c8b5
Merge pull request from ivancich/octopus-rados-list
rgw: add `rgw-orphan-list` tool & `radosgw-admin bucket radoslist ...`

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 15:27:21 -04:00
Michael Fritch
586eb6ccb9
doc/mgr/orchestrator: update iscsi
`apply iscsi` and `add iscsi` are implemented in cephadm

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 12:28:05 -06:00
Michael Fritch
884fc3d07f
mgr/orch: add iscsi apply cli
`$ ceph orch apply iscsi --pool <pool>`

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-04 12:28:05 -06:00
Sebastian Wagner
53da12e7eb
mgr/cephadm: _apply_service: fix _create_iscsi invocation
Fixes: https://tracker.ceph.com/issues/45249
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-04 12:23:07 -06:00
J. Eric Ivancich
43c948a4ab qa/rgw: integration test for rgw-orphan-list & radosgw-admin radoslist
Add teuthology test for `rgw-orphan-list` in a new tool suite under
rgw. It only needs to be tested under one configuration. And the new
tool sub-suite can be used by other tooling int he
future. radosgw-admin `radoslist` is tested indirectly through
`rgw-orphan-list` and therefore does not need its own test.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
89654d0477 qa/rgw: allow the rgw teuthology task to capture/set dns names
A teuthology workunit might want to use the rgw task, setting the
rgw-dns-name and/or rgw-dns-s3website-name configuration options to
the fully-qualified domain name. Existing code implies that setting
these configuration options to the empty string will do that. However
the current logic does not support that given it has Python
conditionals that treat the empty string as false. This fixes that.

Now the following teuthology tasks YAML will work as expected:

  tasks:
  - rgw:
      client.0:
        dns-name: ''
        dns-s3website-name: ''

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
3aff078700 test/rgw: add static testing for ceph-diff-sorted
Tests are run during "make check".

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
J. Eric Ivancich
9d5e9c3031 doc/rgw: add docs for rgw-orphan-list and ceph-diff-sorted
Add man pages and documentation for both tools.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:33:56 -04:00
J. Eric Ivancich
e396064d9a rgw: add rgw-orphan-list tool & radosgw-admin bucket radoslist ...
Adds a `radosgw-admin` subcommand and walks the associated bucket
indices and manifests to generate the list of rados objects that
represent the rgw objects in the bucket(s).

Also adds a tool named `rgw-orphan-list`, which uses the radoslist
subcommand, that produces a list in a local file of what appear to be
rgw orphans.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
J. Eric Ivancich
eaa8f66ec0 rgw: add const-correctness to rgw_obj_manifest and svc_tier_rados
Mark functions as "const" or function parameters as "const" in order
to make those functions more widely callable.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
Casey Bodley
a8762af4af
Merge pull request from cbodley/wip-44751
radosgw-admin: fix infinite loops in 'datalog list'
2020-05-04 12:30:18 -04:00
Casey Bodley
67415ea07b
Merge pull request from cbodley/wip-qa-rgw-cls-2pc-queue
qa/rgw: run ceph_test_cls_2pc_queue in verify suite

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-05-04 12:29:14 -04:00
Casey Bodley
a3f1f21462
Merge pull request from zhangsw/rgw-reshard-stats
rgw: add check for index entry's existing when adding bucket stats during bucket reshard.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 12:28:21 -04:00
J. Eric Ivancich
16ca63002e
Merge pull request from ivancich/wip-fix-tests_ps
qa/rgw: fix issue error in tests_ps.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 12:10:18 -04:00
J. Eric Ivancich
9218065109 qa/rgw: fix issue error in tests_ps.py
The Python interpreter on teuthology complains about the lack of
parens in a print statement.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 11:35:25 -04:00
Ricardo Marques
71c58f18b5 cephadm: Add '--mount' option to mount host file or directory
Fixes: https://tracker.ceph.com/issues/45284

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-05-04 15:35:43 +01:00
Patrick Donnelly
ec2fcf3035
Merge PR into master
* refs/pull/34088/head:
	doc: mailmap: changes for octopus release

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-04 06:44:39 -07:00
Jan Fajerski
39a5fc1af3
Merge pull request from jschmid1/dg_affinity
ceph-volume: add ceph.osdspec_affinity tag
2020-05-04 14:15:15 +02:00
Lenz Grimmer
3af27bfb71
Merge pull request from tspmelo/wip-fix-table-filter
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-05-04 12:18:19 +02:00
Sebastian Wagner
e1360f1653
Merge pull request from mgfritch/cephadm-workunit-node-exporter-avail
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
2020-05-04 11:11:32 +02:00
Sebastian Wagner
d6872343ad
Merge pull request from ricardoasmarques/infer-config
cephadm: Infer config on "cephadm shell"
2020-05-04 11:11:01 +02:00
Sebastian Wagner
e150f0250c
Merge pull request from matthewoliver/cephadm_iscsi_remove_fqdn_enabled
cephadm: remove fqdn_enabled from ceph-iscsi

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-05-04 11:09:05 +02:00
Lenz Grimmer
b7b46a9691
Merge pull request from Devp00l/wip-44621
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-05-04 10:51:18 +02:00
Lenz Grimmer
9334471340
Merge pull request from SchoolGuy/monitoring/rbd-image-details
mgr/dashboard/grafana: Add rbd-image details dashboard

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-05-04 09:59:53 +02:00
Kefu Chai
516785822e
Merge pull request from tchaikov/wip-crimson-thread-pool-test
test/crimson: minimize the lexical scope of thread pool

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-05-02 11:52:41 +08:00
Josh Durgin
beaa4b04bc
Merge pull request from neha-ojha/wip-balancer-cleanup
qa/suites/rados/thrash*: remove upmap.yaml and off.yaml

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-05-01 13:15:58 -07:00
Gregory Farnum
294a662a86
Merge pull request from varshar16/wip-cephfs-shell-flake8-py3
cephfs-shell: Change tox testenv name to py3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 12:30:00 -07:00
Neha Ojha
d46ea00320 qa/suites/rados/thrash*: add on.yaml
To test with balancer in upmap mode, which is the default.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-01 18:49:36 +00:00
Neha Ojha
cb5611e0d5 qa/suites/rados/thrash*: remove upmap.yaml and off.yaml
The balancer is always on, so we don't need upmap.yaml.
off.yaml doesn't make sense anymore.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-01 18:31:01 +00:00
Jason Dillaman
5b1e05fc25
Merge pull request from changchengx/doc
doc/rbd: explicit reminder for libvirt directory access permissions

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 12:33:00 -04:00
Casey Bodley
83cea4f3b7
Merge pull request from vumrao/wip-vumrao-45355
rgw/rgw_bucket: clear tenant string for non tenanted buckets in rgw_bucket_parse_bucket_key function.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-01 12:31:49 -04:00
Vikhyat Umrao
6c4594a6aa rgw/rgw_bucket: clear tenant string for non tenanted buckets
in rgw_bucket_parse_bucket_key function.

Fixes: https://tracker.ceph.com/issues/45355

Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-05-01 08:28:55 -07:00
Jason Dillaman
efb6b656a1
Merge pull request from trociny/wip-45305
qa/workunits/rbd: fix list-mapped filter in unmap_device

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 11:23:02 -04:00
Changcheng Liu
f90b4997b8 doc/rbd: explicit remind the directory access right
It needs to create admin socket to use perf counter for
debug purpose. Remind the access right to directory.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-05-01 22:51:18 +08:00
Jason Dillaman
384c3db1ed
Merge pull request from yison/rwl-image-writeback-cache-seq7
rbd/cache: Replicated Write Log core codes - aio_discard

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 10:41:28 -04:00
Yuri Weinstein
9bc92c3aac
Merge pull request from hillpd/suicide_grace_fix
rados: prevent ShardedOpWQ suicide_grace drop when waiting for work.
2020-05-01 07:33:10 -07:00
Yuri Weinstein
e10f02cbde
Merge pull request from ifed01/wip-ifed-more-bluefs-stats
os/bluestore: improve bluefs stats reporting

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-05-01 07:31:52 -07:00