Commit Graph

93757 Commits

Author SHA1 Message Date
Sage Weil
b73ef78363 Merge PR #25902 into master
* refs/pull/25902/head:
	qa/standalone/mon/mon-handle-forward: fix grep path and check return results
	mon/MonClient: be less aggressive/paranoid about reopening mon connections

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-12 10:26:32 -06:00
Sage Weil
42c9ee9eb6 Merge PR #25884 into master
* refs/pull/25884/head:
	msg/async: better debug output

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-12 10:26:16 -06:00
Sage Weil
d0bf18379c Merge PR #25917 into master
* refs/pull/25917/head:
	qa/suites/rados/multimon/tasks/mon_recovery: whitelist PG_AVAILABILITY

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-12 10:25:57 -06:00
Sage Weil
94620be57c Merge PR #25273 into master
* refs/pull/25273/head:
	doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:56:41 -06:00
Sage Weil
646a468e12 Merge PR #25828 into master
* refs/pull/25828/head:
	osd, mgr, mds: make timeout of updating rotating keys configurable

Reviewed-by: yanjun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:45:46 -06:00
Sage Weil
9a32d5ba1f Merge PR #25886 into master
* refs/pull/25886/head:
	qa/tasks/rebuild_mondb: use monmap to properly name the mons
	ceph-monstore-tool: add --monmap <path> argument to rebuild command
	ceph-mon: dump monmap to debug logs
	Revert "mon/MonMap: no noname- mon name prefix when for_mkfs"
	mon/MonMap: improve/fix initial monmap generation for mkfs
	ceph-mon: make membership check with public_addr more robust
	ceph-mon: make mkfs check whether I am in monmap more robust

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-12 05:44:00 -06:00
Sage Weil
ed56c86b1c Merge PR #25806 into master
* refs/pull/25806/head:
	mgr: diskprediction_cloud Add nvme devcie support

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:13:32 -06:00
Ilya Dryomov
fce08ffbab
Merge pull request #25662 from yangdongsheng/abort_on_full
rbd: introduce abort_on_full option for rbd map

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-12 10:29:56 +01:00
Dongsheng Yang
5639a8b187 rbd: introduce abort_on_full option for rbd map
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2019-01-12 03:42:15 -05:00
Brad Hubbard
522a21ec62 doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS
Document LARGE_OMAP_OBJECTS health check

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-01-12 12:16:47 +10:00
Neha Ojha
995f320fc6
Merge pull request #25924 from neha-ojha/wip-fix-scrub-doc
doc/rados/configuration: add osd scrub {begin,end} week day

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-11 15:05:02 -08:00
Sage Weil
c18a5d2e1c qa/tasks/rebuild_mondb: use monmap to properly name the mons
We used to rely on the monmap bootstrap code to magically create a valid
monmap with named mons because our old-style ceph.conf had mon_addr
values in each mon.foo section.  Instead, just feed it a real monmap
from pre-destruction.

In practice, a user can manually generate this monmap, or rename the
mons after the fact with --inject-monmap, or whatever.  Out of scope
for this test, so we just do the simplest thing to make the rebuild test
work.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Sage Weil
b6b7ef8af4 ceph-monstore-tool: add --monmap <path> argument to rebuild command
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Sage Weil
65fb65c1ce ceph-mon: dump monmap to debug logs
Verbosely during mkfs, at level 10 on normal startup.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Neha Ojha
3659a8c5f6 doc/rados/configuration: add osd scrub {begin,end} week day
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-01-11 12:55:51 -08:00
Jason Dillaman
fad75f10f4
Merge pull request #24427 from thmour/thmour_api_purge
librbd: add trash purge api calls

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 14:43:08 -05:00
Jason Dillaman
0d8b41f10d
Merge pull request #25908 from trociny/wip-dperf-bytes
mgr: change 'bytes' dynamic perf counters to COUNTER type

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 14:42:40 -05:00
Sage Weil
ed70f50b49 msg/async: better debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 12:31:35 -06:00
Neha Ojha
7c081e0fc8
Merge pull request #25887 from neha-ojha/wip-hide-flag
include/rados.h: hide CEPH_OSDMAP_PGLOG_HARDLIMIT from ceph -s

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
2019-01-11 09:21:50 -08:00
Sage Weil
af435783b4 qa/suites/rados/multimon/tasks/mon_recovery: whitelist PG_AVAILABILITY
The mgr creates a pool for device health, and mons may be thrashing and
make peering slow.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 09:43:07 -06:00
Jason Dillaman
504f4e78ef librbd: tweaked trash purge API
Removed the internal usage of the public librbd API, avoided double-opening
image to determine data pool, and fixed issues with the unit test case.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 10:40:54 -05:00
Jason Dillaman
a3155c3fc2 cls/rbd: reduce erroneous error messages when omap keys don't exist
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:18:45 -05:00
Julien Collet
4d281f8321 test/librbd: fix librbrd test relative to trash purge
Signed-off-by: Julien Collet <julien.collet@cern.ch>
2019-01-11 09:18:45 -05:00
Theofilos Mouratidis
b6f9aab037 librbd: add trash purge api calls
Add trash purge api calls and fix the docs of some other rbd trash functions

Signed-off-by: Theofilos Mouratidis <mtheofilos@gmail.com>
2019-01-11 09:18:45 -05:00
Jason Dillaman
e920693ff6
Merge pull request #25529 from Songweibin/wip-fix-rbd-migration
librbd: disallow trash restoring when image being migrated

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:03:58 -05:00
Jason Dillaman
cf9deaf8f8
Merge pull request #25765 from Songweibin/wip-fix-migrate-parent
librbd/api: misc fix migration

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:03:39 -05:00
Jason Dillaman
4f16d9d871
Merge pull request #25834 from trociny/wip-21392
rbd-mirror: create and export replication perf counters to mgr 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:02:19 -05:00
Jason Dillaman
9a91dc5ea2
Merge pull request #25896 from trociny/wip-37861
rbd: fix delay time calculation for trash move

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:01:49 -05:00
Lenz Grimmer
0cc78cfb63
Merge pull request #25656 from tspmelo/wip-npm-update
mgr/dashboard: Update npm packages

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-11 14:11:36 +01:00
Mykola Golub
6eac70d83a
Merge pull request #25883 from dillaman/wip-37745
librbd: keep access/modified timestamp updates out of IO path

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-01-11 13:30:40 +02:00
Lenz Grimmer
c9f005db10
Merge pull request #25894 from Devp00l/wip-kv-table-update
mgr/dashboard: Hide empty fields and render all objects in KV-table

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-11 10:29:39 +01:00
Mykola Golub
bf5435409f mgr: change 'bytes' dynamic perf counters to COUNTER type
(so they are of the same type as in static perf)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-11 09:13:45 +00:00
Stephan Müller
1033314a24 mgr/dashboard: Render all objects in KV-table
The problem was that the key value table didn't render all objects in
the given object, even if 'renderObjects' was set to true.

For example you give it an object with 2 attributes each of them holds a
non empty object, this will result in a table data that is not fully
converted to key value objects, which will result as text '[Object
object]' in the table view.

Now every object will be rendered and the key value array will be sorted
by key.

Fixes: https://tracker.ceph.com/issues/37859
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-11 09:07:47 +01:00
Stephan Müller
e99a8ee39b mgr/dashboard: Hide empty fields in KV-table
It exends the key value table by the option to hide empty fields.

Fixes: https://tracker.ceph.com/issues/37860
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-11 09:07:47 +01:00
Sage Weil
9bfd5bd322 Revert "mon/MonMap: no noname- mon name prefix when for_mkfs"
This reverts commit c078c81031.

# Conflicts:
#	src/mon/MonMap.cc

The ceph_mon.cc bootstrap code expects a noname- prefix to identify which
unamed mons (i.e., generated from mon_host) in the initial monmap can be
taken over as itself.

At the same time, the mon recovery code needs a way to know how to name
the monitors.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
0368fbd851 mon/MonMap: improve/fix initial monmap generation for mkfs
The monmap generation from mon_host for mon mkfs was pretty much completely
broken.  Restructure the code.

Generally, prefer v2+v1 addrvecs, unless a specific addr type and/or
port is specified.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
cee2cf62ab ceph-mon: make membership check with public_addr more robust
If the public_addr has no port, we will check v1 and v2 addresses.
MonMap::contains() checks for *any* overlap/match, so we should find
ourselves.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
5b020479ba ceph-mon: make mkfs check whether I am in monmap more robust
If we have a local address, check for both v1 and v2 variants in the
monmap.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
5dfcb551ff Merge PR #25755 into master
* refs/pull/25755/head:
	msg/async/Protocol*: bump global_seq when retrying connection
	msg/async/Protocol*: unregister con from accept vs mark_down race

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
2019-01-10 18:12:47 -06:00
Sage Weil
221afb0e28 Merge PR #25840 into master
* refs/pull/25840/head:
	qa/msgr: add async-v1only case

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-10 17:20:10 -06:00
Sage Weil
2762955576 qa/standalone/mon/mon-handle-forward: fix grep path and check return results
This makes the test more strict and less confusing.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 17:18:38 -06:00
Sage Weil
a210f7dd3b mon/MonClient: be less aggressive/paranoid about reopening mon connections
Previously we were reopening any time the name of our mon changed.  That
was pretty much every time, since we started out with names from the
seed monmap like 'noname-[abc]' that never match the real mons.

Instead, only reopen if the addr we are connecting to is no longer in the
monmap.  We don't actually care about the mon's name.

Fixes: http://tracker.ceph.com/issues/37868
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 17:18:38 -06:00
Sage Weil
f1dd338eb6 Merge PR #25792 into master
* refs/pull/25792/head:
	common/numa: remove unused _mask variants
	osd: support osd_numa_node, osd_numa_auto_affinity, osd_numa_prefer_iface
	mon/OSDMonitor: add 'osd numa-status' command
	osd: report numa node for network interface(s)
	common/pick_address: get numa node info for a interface
	os/bluestore: report numa node info for storage
	os/bluestore/KernelDevice: report numa info for each device
	os/bluestore: allow get_devices() to run without bluestore started
	common/blkdev: query numa info
	common/numa: cpu_set helpers and numa helpers
	common/blkdev: drop debug statements

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-01-10 16:50:38 -06:00
Sage Weil
2114036e59 Merge PR #25841 into master
* refs/pull/25841/head:
	mon/MonClient: make mon hunt more aggressive

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-10 16:50:09 -06:00
Sage Weil
888bf53235 Merge PR #25827 into master
* refs/pull/25827/head:
	test/cls_rgw: fix signed/unsigned warning
	test/msgr/test_msgr: fix signed/unsigned warning
	msg/Connection: protect peer_addrs with safe_item_history<>

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-01-10 16:29:10 -06:00
Josh Durgin
76f95c52c4
Merge pull request #25704 from tchaikov/wip-36737-unittest-log
test: write log file to current directory

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-10 13:33:57 -08:00
Sage Weil
4eee470cd3 Merge PR #25898 into master
* refs/pull/25898/head:
	qa/tests: reduced nubmer of runs on 'ovh'

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-10 12:06:04 -06:00
Yuri Weinstein
4d7d0f53f3 qa/tests: reduced nubmer of runs on 'ovh'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-01-10 09:03:16 -08:00
Sage Weil
bdb86f4f9c Merge PR #25544 into master
* refs/pull/25544/head:
	common/PriorityCache: Automatic chunk sizing

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-10 09:54:00 -06:00
Sage Weil
39e8de2d72 msg/async/Protocol*: bump global_seq when retrying connection
In the top connect retry in particular we do not bump connect_seq, so it
is critical that we bump global_seq so that the two connection attempts
are distinguishable at the peer.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 09:33:28 -06:00