Commit Graph

90435 Commits

Author SHA1 Message Date
John Spray
51691d84b9 mgr/progress: fix PgRecoveryEvent completion cases
The event was previously not getting moved to the completed
list.  There are a couple more cases too:
 - When some pgs go away (a pool is removed) during the event
 - When the OSD comes back in after going out

Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-11 11:21:35 +01:00
John Spray
5c071a61f4 mgr: expose osdmap pg_to_up_acting_osds
It's not efficient to have python calling this
O(pg_num) times to find the pgs for an OSD, but
I'm just shooting for something functional for now.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-11 11:21:35 +01:00
Lenz Grimmer
a0c6b83334
Merge pull request #23910 from votdev/improve_autofocus_directive
mgr/dashboard: Refactor autofocus directive

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-09-11 11:56:56 +02:00
zhengyin
76673a76d7 rbd: add protected in snap list
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2018-09-11 05:17:19 -04:00
Kefu Chai
e96e507874
Merge pull request #23752 from ifed01/wip-ifed-fix-garbage-test
os/tests: fix garbageCollection test case from store_test suite.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-11 17:10:37 +08:00
Xie Xingguo
54b6ce1ae2
Merge pull request #24021 from libingyang-zte/master
doc: Fix Spelling Error of Radosgw

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-11 16:47:48 +08:00
李丙洋 10208981
53feb4ad4e doc: Fix Spelling Error of Radosgw
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-11 15:30:20 +08:00
Yan, Zheng
920ef96431 mds: prevent rctime from going back
Fixes: http://tracker.ceph.com/issues/35916
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-09-11 10:56:42 +08:00
Paul Emmerich
cffcbc73aa os/bluestore: handle spurious read errors
Some kernels (4.9+) sometime fail to return data when reading
from a block device under memory pressure. This patch retries
the read if the checksum verification fails, tests show that
the first retried read succeeds in ~99.5% of the cases, so
3 attempts are made by default before giving up on the data.

Works-around: http://tracker.ceph.com/issues/22464
Signed-off-by: Paul Emmerich <paul.emmerich@croit.io>
2018-09-10 22:54:45 +00:00
Noah Watkins
5c2615e3d7 qa/tasks/mgr: whitelist insights test health checks
these drive health history tracking tests.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-09-10 15:02:49 -07:00
David Zafman
050a4bb20e test: Allow directory specified to run-standalone.sh
Fixes: http://tracker.ceph.com/issues/35912

Example:
cd build
../qa/run-standalone.sh scrub

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-09-10 12:23:11 -07:00
David Zafman
6e3f04365f test: Trap termination so we can capture logs on teuthology timeout
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-09-10 12:23:07 -07:00
vasukulkarni
10f1c4c9de
Merge pull request #23602 from smanjara/wip-test-netem
qa: Task to emulate network delay and packet drop between two given h…
2018-09-10 09:57:10 -07:00
Tianshan Qu
2d38306e93 rgw: async sync_object and remove_object does not access coroutine memory
Fixes: http://tracker.ceph.com/issues/35905

Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2018-09-11 00:53:52 +08:00
Volker Theile
7243d9b67d mgr/dashboard: Progress bar does not stop in TableKeyValueComponent
Fixes: https://tracker.ceph.com/issues/35907

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-09-10 18:29:05 +02:00
Alfredo Deza
9ca5263362 ceph-volume tests.util verify Disk objects don't change state with divisions
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 12:28:57 -04:00
Alfredo Deza
7d1a3c7424 ceph-volume util.disk fix an issue where Disk objects would mutate on div operations
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 12:18:49 -04:00
Alfredo Deza
860068ec5d ceph-volume util.prepare add a helper to get block.db sizes from ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 12:09:50 -04:00
Alfredo Deza
0eb0bdfc55 ceph-volume lvm.batch.bluestore add TODOs for custom fast/slow devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 12:09:15 -04:00
Alfredo Deza
d117d66903 -f ceph-volume lvm.batch.bluestore validation and reporting with VG reuse
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 12:08:35 -04:00
John Spray
1ee21323ad mon: remove pre-luminous health output compatibility
As of nautilus, this will be more than two versions old:
external tooling should have been updated by now.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-10 16:39:58 +01:00
David Zafman
dc80f8585a test: Use a grep pattern that works across releases
Fixes: http://tracker.ceph.com/issues/35845

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-09-10 08:21:36 -07:00
John Spray
8279d8713e doc/cephfs: add notes on application best practices
Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-10 15:53:42 +01:00
Sage Weil
d71258495e
Merge pull request #23997 from batrick/multimds-qa-broken-symlink
qa: fix symlink
2018-09-10 09:26:12 -05:00
Sage Weil
3a34c9ee38 Merge PR #23965 into master
* refs/pull/23965/head:
	doc/dev/msgr2: better formatting
	doc/dev/msgr2: clarify padding alignment
	doc/dev/msgr2: tweak message flow handshake
	doc/dev/msgr2: remove stream concept, streamline auth

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-10 09:23:32 -05:00
Mohamad Gebai
872d909d22 cmake: fix version matching for Findfmt
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-09-10 10:22:24 -04:00
Alfredo Deza
267a386cc2 ceph-volume lvm.batch fix error reporting, Device objects aren't strings
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 09:17:11 -04:00
Alfredo Deza
27f47565a0 ceph-volume lvm.batch.bluestore validation and reporting with VG reuse
Reworks the bluestore validation and reporting to account for reusable
VGs from fast devices, and adds validation calls to ensure the new way
to calculate this process will work.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 09:17:11 -04:00
Alfredo Deza
71fcd35c3d ceph-volume lvm.batch.filestore capture SizeAllocationErrors
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 09:17:11 -04:00
Alfredo Deza
d2ea49a4e6 ceph-volume lvm.batch make sure data devices don't have existing LVs on bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-10 09:17:11 -04:00
Mykola Golub
40af4f87b6 librbd: flatten operation should use object map
If the object is known to exist in the image, the copy-up operation
can be skipped for that object.

Fixes: http://tracker.ceph.com/issues/23445
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-10 16:14:03 +03:00
Mykola Golub
4c86bccf07 librbd: add object_may_not_exist helper
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-10 16:14:03 +03:00
Casey Bodley
dfc1c78889
Merge pull request #21271 from cbodley/wip-rgw-beast-async
rgw: beast frontend reworks pause/stop and yields during body io

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-09-10 09:05:57 -04:00
Sage Weil
4d2a73c7f1 Merge PR #23845 into master
* refs/pull/23845/head:
	osd/OSDMap: include age in up and in counts for ceph status
	mon/OSDMonitor: set new_last_{up,in}_change
	osd/OSDMap: store last_up_change and last_in_change
	mgr/MgrMap: include mgr age in map printer
	mon/MgrMap: track active_changed timestamp
	mon: include mon quorum age in status
	include/utime: add utimespan_str helper

Reviewed-by: John Spray <john.spray@redhat.com>
2018-09-10 07:45:58 -05:00
Sage Weil
ff826e69c7 Merge PR #23949 into master
* refs/pull/23949/head:
	mon/OSDMonitor: invalidate max_failed_since on cancel_report

Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-10 07:41:44 -05:00
Sage Weil
838958daa4 Merge PR #23968 into master
* refs/pull/23968/head:
	dout: add basic prefix providers
	dout: add DoutPrefixPipe for composing prefix providers

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-10 07:41:25 -05:00
Sage Weil
9f30b12e39 Merge PR #23971 into master
* refs/pull/23971/head:
	cls/numops: fix cls_numops.cc log add to mul

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-10 07:41:03 -05:00
Sage Weil
f9d45d06f9 Merge PR #23975 into master
* refs/pull/23975/head:
	common/buffer.cc: add create_small_page_aligned to avoid mem waste when apply for small mem in big page size(e.g. 64k) OS

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-09-10 07:40:37 -05:00
Lenz Grimmer
51604c6c78
Merge pull request #23939 from votdev/bug_35685
mgr/dashboard: Fix bug in user form when changing password

Reviewed-by: Stephan Müller <smueller@suse.com>
2018-09-10 14:29:24 +02:00
xie xingguo
7bc97797eb osd/OSD: kick right merge source
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-10 20:01:24 +08:00
Mykola Golub
496604fe43 test/librbd: migration tests did not delete additional pool
Instead of creating an additional pool on every migration test
that needs it, create a pool on the test case setup and reuse.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-10 14:33:53 +03:00
Jason Dillaman
95861114d6
Merge pull request #23839 from trociny/wip-migration-commit-race
librbd: fix potential live migration after commit issues due to not refreshed image header

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-10 07:27:24 -04:00
xie xingguo
4c0804ad02 osd/OSD: clear ping_history on heartbeat_reset
Because the old connections are gone, and hence we should not
leave behind a long list of obsolete ping_history there, which
is misleading...

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-10 18:50:50 +08:00
xie xingguo
79f480442f mon/OSDMonitor: share new maps with even non-active osds
OSDs may not be aware of their deadness and trapped at
an obsolete map in which they were still marked as up:

```
host        osd     down_at     stuck_at
ceph-03     9       e712        e711
ceph-03     13      e700        e699
ceph-03     28      e697        e696
ceph-03     48      e697        e696
ceph-03     52      e707        e704
ceph-03     61      e710        e708
ceph-03     73      e712        e710
ceph-03     77      e708        e707

ceph-05     12      e711        e710
ceph-05     21      e703        e702
ceph-05     24      e700        e699
ceph-05     29      e703        e699
ceph-05     41      e711        e710
ceph-05     53      e711        e710
ceph-05     72      e712        e711

```

In https://github.com/ceph/ceph/pull/23958 an OSD will ping monitor
periodically now if it is stuck at __wait_for_healthy__. But in the
above case OSDs are still considering themselves as __active__ and
hence should miss that fixer.

Since these OSDs might be still able to contact with monitors (
otherwise there is no way for them to be marked up again) and send
beacons contiguously, we can simply get them out of the trap by
sharing some new maps with them.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
Signed-off-by: runsisi <runsisi@zte.com.cn>
2018-09-10 18:48:21 +08:00
Volker Theile
f3d25fb3a8 mgr/dashboard: Refactor autofocus directive
Refactor the autofocus directive and add some unit tests.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-09-10 12:08:34 +02:00
Volker Theile
7f3a982d6f mgr/dashboard: Unable to edit user when making an accidental change to the password field
Fixes: https://tracker.ceph.com/issues/35685

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-09-10 12:03:25 +02:00
xie xingguo
4b10ed1035 mgr/DaemonServer: split should respect inflight creating pgs
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-10 16:58:03 +08:00
Kefu Chai
6cf6615225
Merge pull request #23993 from badone/wip-fedora-build-Cython3-error
rpm: Fix Fedora error "No matching package to install: 'Cython3'"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-10 16:46:26 +08:00
Kefu Chai
69d81c55ce
Merge pull request #23833 from falcon78921/wip-docs-34539
doc/rados: fixed hit set type link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-10 15:13:20 +08:00
Xie Xingguo
cfa8591128
Merge pull request #24000 from libingyang-zte/master
doc: Fix Spelling Error of Radosgw

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-10 10:56:01 +08:00