Commit Graph

107005 Commits

Author SHA1 Message Date
Igor Fedotov
c1ee532392 os/bluestore: fix duplicate onode instance while doing omap repair.
Fixes: https://tracker.ceph.com/issues/43824

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-01-27 21:47:08 +03:00
Igor Fedotov
263e84427d test/store_test: introduce test case for per-pool omap repair.
This also reproduces
https://tracker.ceph.com/issues/43824

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-01-27 21:11:51 +03:00
Sage Weil
d32b0ad99d Merge PR #32812 into master
* refs/pull/32812/head:
	mgr/cephadm: get --osd-uuid deploy arg from osdmap
	mgr/cephadm: fetch keyring in _create_daemon()

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-27 11:39:53 -06:00
Sage Weil
b0bea75ed7 Merge PR #32885 into master
* refs/pull/32885/head:
	qa/suites/rados/thrash: debug monc

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 11:36:37 -06:00
Sage Weil
ef7b0a7fd0 Merge PR #32886 into master
* refs/pull/32886/head:
	cephadm: no --no-systemd arg to ceph-volume deactivate

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-27 11:31:36 -06:00
Sage Weil
e33f610af9 Merge PR #32851 into master
* refs/pull/32851/head:
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2020-01-27 11:05:29 -06:00
Sage Weil
674622190e qa/suites/rados/rest: run restful test on el8
For some reason the requests library has trouble connecting from
ubuntu 18.04.  I reproduced this locally on my 18.04 desktop, although
there it fails on the first API request instead of the last (as in QA).

In any case, this appears to be a client library problem.

Fixes: https://tracker.ceph.com/issues/43720
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 11:02:07 -06:00
Sage Weil
14d1490f58 Merge PR #32898 into master
* refs/pull/32898/head:
	qa/suites/rados/singleton/all/recovery-preemption: fix pg log length

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 10:37:16 -06:00
Casey Bodley
ad45d6b623
Merge pull request #32617 from taodd/bug-43563
rgw: update the hash source for multipart entries during resharding

Reviewed-by: Eric J. Ivancich <ivancich@redhat.com>
2020-01-27 10:49:33 -05:00
Casey Bodley
ce525d8137
Merge pull request #32487 from ofriedma/wip-ofriedma-copy-part-hdr
rgw: Fix upload part copy range able to get almost any string

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-27 10:48:40 -05:00
Casey Bodley
e0743af281
Merge pull request #31887 from ofriedma/wip-ofriedma-lc-hdr-mid
rgw: LC expiration header should present midnight expiration date

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-01-27 10:48:11 -05:00
Casey Bodley
5b3822fab0
Merge pull request #30778 from joke-lee/rgw-ipv6
rgw: fix SignatureDoesNotMatch when use ipv6 address in s3 client

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-01-27 10:47:38 -05:00
Casey Bodley
91886f99f2
Merge pull request #31977 from ofriedma/wip-ofriedma-dynamic-disable
rgw: Fix dynamic resharding not working for empty zonegroup in period

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-01-27 10:46:15 -05:00
Casey Bodley
4bf2f02506
Merge pull request #31185 from joke-lee/rgw-user-modify-placement
rgw: support specify user default placement and placement_tags when create or modify user

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-27 10:44:17 -05:00
Jan Fajerski
8236ddc842
Merge pull request #32235 from jan--f/c-v-prepare-size-args
ceph-volume: add sizing arguments to prepare
2020-01-27 16:03:07 +01:00
Patrick Seidensal
4483ad4317 mgr/dashboard: unify indentation in dashboard.rst
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2020-01-27 15:56:25 +01:00
Michael Fritch
0d331fccdc
cephadm: remove logs command
Fixes: https://tracker.ceph.com/issues/43618
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-27 07:22:11 -07:00
Sage Weil
695d0be225 qa/suites/rados/singleton/all/recovery-preemption: fix pg log length
This was broken by the variable PG log lengths in
9c69c2f7cc585b5e13e4d1b0432016d38135a3de.

Disable the new option to get (roughly) the old behavior, or at least the
short logs that we want to trigger some backfill.

Fixes: https://tracker.ceph.com/issues/43810
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 07:42:50 -06:00
Sage Weil
05cc0d8c70 Merge PR #32853 into master
* refs/pull/32853/head:
	qa/suites/fs/upgrade: finish at octopus
	qa/suites/fs/upgrade: set min-compat-client to octopus
	qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-27 07:14:37 -06:00
Sage Weil
b732cadc6a Merge PR #32883 into master
* refs/pull/32883/head:
	qa/workunits/rados/test_crash.sh: do not fail if coredump not found
	rgw: set bucket quota only when necessary

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-27 07:08:40 -06:00
Tatjana Dehler
7e7cac9811 mgr/dashboard: show checkboxes for booleans
The frontend showed textboxes for the dashboard settings because
the actual type information was missing here. The REST API then
returned the default type 'str'.

Edit the e2e test case in order to update a different setting as
the 'editMgrModule' method can't handle checkboxes.

Fixes: https://tracker.ceph.com/issues/43769
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-01-27 11:52:56 +01:00
Lenz Grimmer
9c19d0edb9
monitoring: add details to Prometheus' alerts (#32803)
monitoring: add details to Prometheus' alerts

Reviewed-by: Andreas Jaeger <aj@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-01-27 08:23:29 +00:00
Jason Dillaman
df82a274be
Merge pull request #32434 from trociny/wip-41559
mgr/rbd_support: implement mirror snapshot scheduler 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-26 13:31:39 -05:00
Mykola Golub
6fcb1d3ace librbd: optimize mirror_image_info_list (don't open image context)
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 12:47:39 -05:00
Mykola Golub
9d43e39123 librbd: make mirror get info request not require image context
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 12:47:39 -05:00
Kefu Chai
fdc1e88b87 qa/workunits/rados/test_crash.sh: do not fail if coredump not found
Fixes: https://tracker.ceph.com/issues/43653
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-27 01:20:56 +08:00
Sage Weil
72197478b6 cephadm: no --no-systemd arg to ceph-volume deactivate
ceph-volume lvm deactivate: error: unrecognized arguments: --no-systemd

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-26 11:17:01 -06:00
Sage Weil
e04a08069f qa/suites/rados/thrash: debug monc
Hunting https://tracker.ceph.com/issues/43825

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-26 11:13:20 -06:00
Kefu Chai
d1f8717988 rgw: set bucket quota only when necessary
this change fixes the regression introduced by 9a7f76a7

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-27 00:23:17 +08:00
Mykola Golub
6ddb736940 mgr/rbd_support: optimize scanning images in mirror snapshot mode
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 11:20:29 -05:00
Mykola Golub
ab24bb86f6 librbd: add API to list mirror image info
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 11:20:29 -05:00
Mykola Golub
3a022a9cc3 mgr/rbd_support: implement mirror snapshot scheduler
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 11:20:29 -05:00
Mykola Golub
b96818ff5b pybind/mgr/rbd_support: split module.py into several files
(it is becoming too large)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-26 11:20:29 -05:00
Jason Dillaman
d2425609e2
Merge pull request #32734 from trociny/wip-43589
librbd: don't call refresh from mirror::GetInfoRequest state machine

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-26 11:19:11 -05:00
Kefu Chai
e2f969d9a6
Merge pull request #32766 from rzarzynski/wip-common-ceph_atomic
crimson, common: introduce ceph::atomic and apply it on bufferlist.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-27 00:01:57 +08:00
Jason Dillaman
f8b4709c0e
Merge pull request #32760 from trociny/wip-43666
librbd: fix potential snapshot remove failure due to duplicate RPC messages

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-26 10:15:26 -05:00
Kefu Chai
c63587ae35
Merge pull request #32730 from tchaikov/wip-mgr-maybe-unused
mgr: better error handling when reading option

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-26 11:56:10 +08:00
Kefu Chai
42cf0226bd
Merge pull request #32758 from ifed01/wip-ifed-fix-legacy-omap
os/bluestore: upgrade legacy omap to per-pool format automatically.

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-26 11:55:21 +08:00
Kefu Chai
6b19e3d4d9
Merge pull request #32764 from liewegas/fix-43552
mon/Session: only index osd ids >= 0

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-26 11:53:40 +08:00
Kefu Chai
3f320e5f79
Merge pull request #32753 from mgfritch/cephadm-tox-escape-seq
cephadm: fix tox DeprecationWarning

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-26 11:45:28 +08:00
Kefu Chai
0a084244bb
Merge pull request #32352 from rzarzynski/wip-bug-43070
msg/async: reset the V1's session_security in proper EventCenter.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-26 11:41:06 +08:00
Kefu Chai
484317a7d5
Merge pull request #32785 from rzarzynski/wip-encoding-no-bl-copy_in-2
common: encode for std::list<T> doesn't use bl::copy_in() anymore.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-26 11:37:01 +08:00
Sage Weil
7ce7ac8bfc qa/suites/fs/upgrade: finish at octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 16:04:28 -06:00
Sage Weil
b305796a12 mgr/cephadm: get --osd-uuid deploy arg from osdmap
During the initial OSD creation, we had the osd_uuid handy.  However, on
reconfig/redeploy, we don't.

Refactor a bit so that this is extracted from the osdmap by the
_create_daemon() method.  While we're at it, make the deployment case
verify that the deployed OSD uuid matches the one in the osdmap.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 13:57:11 -06:00
Sage Weil
3d94bc42db qa/suites/fs/upgrade: set min-compat-client to octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 13:31:08 -06:00
J. Eric Ivancich
55f131ecc8
Merge pull request #30272 from ivancich/wip-move-some-bucket-listing-logic-to-cls
rgw: move delimiter-based bucket listing/filtering logic to cls

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-25 14:12:02 -05:00
Sage Weil
41c03aa143 qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-24 21:01:07 -06:00
Sage Weil
4fda278eaf Merge PR #32750 into master
* refs/pull/32750/head:
	qa/suites/upgrade/*-x/stress-split: run latest python tests at end
	qa/tasks/ceph_manager: kludge around /var/log/ceph permissions
	mgr/pg_autoscaler: don't check anything until cluster is nautilus
	qa/suites/upgrade: install python3-* as part of final upgrade step
	qa/tasks/radosbench: only set object size if != block size
	qa/tasks/ceph: simplify mon_health_to_clog suppression during restart
	cls_hello: alias write_return_data -> writes_dont_return_data
	ceph_test_cls_hello: only do returndata test on octopus+
	qa: remove unnecessary package excludes in upgrades/nautilus*
	qa: exclude cephadm from upgrade/nautilus-x
	qa/suites/upgrade/mimic-x/parallel: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x/stress-split: fix msgr2 vs octopus ordering
	qa/suites/upgrade/mimic-x: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x: end on octopus
	qa/suites/upgrade/mimic-x: finish at octopus
	qa/suites/upgrade/nautilus-x: disable TOO_FEW_PGS warning
	qa/tasks/ceph: set mon_health_to_clog=false via mon config
	qa/suites/upgrade/mimic-x: disable TOO_FEW_PGS warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-24 17:21:28 -06:00
Neha
b20817795a qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:42:04 +00:00
Neha
994698277b qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:20:21 +00:00