Commit Graph

93908 Commits

Author SHA1 Message Date
Theofilos Mouratidis
b6f9aab037 librbd: add trash purge api calls
Add trash purge api calls and fix the docs of some other rbd trash functions

Signed-off-by: Theofilos Mouratidis <mtheofilos@gmail.com>
2019-01-11 09:18:45 -05:00
Jason Dillaman
e920693ff6
Merge pull request #25529 from Songweibin/wip-fix-rbd-migration
librbd: disallow trash restoring when image being migrated

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:03:58 -05:00
Jason Dillaman
cf9deaf8f8
Merge pull request #25765 from Songweibin/wip-fix-migrate-parent
librbd/api: misc fix migration

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:03:39 -05:00
Jason Dillaman
4f16d9d871
Merge pull request #25834 from trociny/wip-21392
rbd-mirror: create and export replication perf counters to mgr 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:02:19 -05:00
Jason Dillaman
9a91dc5ea2
Merge pull request #25896 from trociny/wip-37861
rbd: fix delay time calculation for trash move

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:01:49 -05:00
Lenz Grimmer
0cc78cfb63
Merge pull request #25656 from tspmelo/wip-npm-update
mgr/dashboard: Update npm packages

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-11 14:11:36 +01:00
Mykola Golub
6eac70d83a
Merge pull request #25883 from dillaman/wip-37745
librbd: keep access/modified timestamp updates out of IO path

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-01-11 13:30:40 +02:00
Tatjana Dehler
613ea569f3 mgr/dashboard: Provide all four 'mandatory' flags
Fixes: https://tracker.ceph.com/issues/37857
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-01-11 10:52:06 +01:00
Volker Theile
a76f6c798b mgr/dashboard: Confusing tilted time stamps in the CephFS performance graph
Fixes: https://tracker.ceph.com/issues/37862
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-01-11 10:44:34 +01:00
Lenz Grimmer
c9f005db10
Merge pull request #25894 from Devp00l/wip-kv-table-update
mgr/dashboard: Hide empty fields and render all objects in KV-table

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-11 10:29:39 +01:00
Mykola Golub
bf5435409f mgr: change 'bytes' dynamic perf counters to COUNTER type
(so they are of the same type as in static perf)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-11 09:13:45 +00:00
Stephan Müller
1033314a24 mgr/dashboard: Render all objects in KV-table
The problem was that the key value table didn't render all objects in
the given object, even if 'renderObjects' was set to true.

For example you give it an object with 2 attributes each of them holds a
non empty object, this will result in a table data that is not fully
converted to key value objects, which will result as text '[Object
object]' in the table view.

Now every object will be rendered and the key value array will be sorted
by key.

Fixes: https://tracker.ceph.com/issues/37859
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-11 09:07:47 +01:00
Stephan Müller
e99a8ee39b mgr/dashboard: Hide empty fields in KV-table
It exends the key value table by the option to hide empty fields.

Fixes: https://tracker.ceph.com/issues/37860
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-11 09:07:47 +01:00
Zhi Zhang
99e63f761a common/HeartbeatMap: no health check if heartbeat_file is empty
CephContext service thread will also do health check. But if
heartbeat_file is empty, this health check is useless. So try to check
heartbeat_file first and then do health check.

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2019-01-11 12:58:34 +08:00
Sage Weil
9bfd5bd322 Revert "mon/MonMap: no noname- mon name prefix when for_mkfs"
This reverts commit c078c81031.

# Conflicts:
#	src/mon/MonMap.cc

The ceph_mon.cc bootstrap code expects a noname- prefix to identify which
unamed mons (i.e., generated from mon_host) in the initial monmap can be
taken over as itself.

At the same time, the mon recovery code needs a way to know how to name
the monitors.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
0368fbd851 mon/MonMap: improve/fix initial monmap generation for mkfs
The monmap generation from mon_host for mon mkfs was pretty much completely
broken.  Restructure the code.

Generally, prefer v2+v1 addrvecs, unless a specific addr type and/or
port is specified.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
cee2cf62ab ceph-mon: make membership check with public_addr more robust
If the public_addr has no port, we will check v1 and v2 addresses.
MonMap::contains() checks for *any* overlap/match, so we should find
ourselves.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
5b020479ba ceph-mon: make mkfs check whether I am in monmap more robust
If we have a local address, check for both v1 and v2 variants in the
monmap.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 19:00:39 -06:00
Sage Weil
5dfcb551ff Merge PR #25755 into master
* refs/pull/25755/head:
	msg/async/Protocol*: bump global_seq when retrying connection
	msg/async/Protocol*: unregister con from accept vs mark_down race

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
2019-01-10 18:12:47 -06:00
Sage Weil
221afb0e28 Merge PR #25840 into master
* refs/pull/25840/head:
	qa/msgr: add async-v1only case

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-10 17:20:10 -06:00
Sage Weil
2762955576 qa/standalone/mon/mon-handle-forward: fix grep path and check return results
This makes the test more strict and less confusing.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 17:18:38 -06:00
Sage Weil
a210f7dd3b mon/MonClient: be less aggressive/paranoid about reopening mon connections
Previously we were reopening any time the name of our mon changed.  That
was pretty much every time, since we started out with names from the
seed monmap like 'noname-[abc]' that never match the real mons.

Instead, only reopen if the addr we are connecting to is no longer in the
monmap.  We don't actually care about the mon's name.

Fixes: http://tracker.ceph.com/issues/37868
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 17:18:38 -06:00
Sage Weil
f1dd338eb6 Merge PR #25792 into master
* refs/pull/25792/head:
	common/numa: remove unused _mask variants
	osd: support osd_numa_node, osd_numa_auto_affinity, osd_numa_prefer_iface
	mon/OSDMonitor: add 'osd numa-status' command
	osd: report numa node for network interface(s)
	common/pick_address: get numa node info for a interface
	os/bluestore: report numa node info for storage
	os/bluestore/KernelDevice: report numa info for each device
	os/bluestore: allow get_devices() to run without bluestore started
	common/blkdev: query numa info
	common/numa: cpu_set helpers and numa helpers
	common/blkdev: drop debug statements

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-01-10 16:50:38 -06:00
Sage Weil
2114036e59 Merge PR #25841 into master
* refs/pull/25841/head:
	mon/MonClient: make mon hunt more aggressive

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-10 16:50:09 -06:00
Sage Weil
888bf53235 Merge PR #25827 into master
* refs/pull/25827/head:
	test/cls_rgw: fix signed/unsigned warning
	test/msgr/test_msgr: fix signed/unsigned warning
	msg/Connection: protect peer_addrs with safe_item_history<>

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-01-10 16:29:10 -06:00
Josh Durgin
76f95c52c4
Merge pull request #25704 from tchaikov/wip-36737-unittest-log
test: write log file to current directory

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-10 13:33:57 -08:00
Patrick Donnelly
66a5b27a76
client: define template to declare ref
To avoid including message headers in Client.h.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-10 10:34:51 -08:00
Patrick Donnelly
72afe87f82
client: use message smart ptr instead of raw ptr
Fixes: http://tracker.ceph.com/issues/37864

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-10 10:34:40 -08:00
Sage Weil
4eee470cd3 Merge PR #25898 into master
* refs/pull/25898/head:
	qa/tests: reduced nubmer of runs on 'ovh'

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-10 12:06:04 -06:00
Yuri Weinstein
4d7d0f53f3 qa/tests: reduced nubmer of runs on 'ovh'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-01-10 09:03:16 -08:00
Sage Weil
bdb86f4f9c Merge PR #25544 into master
* refs/pull/25544/head:
	common/PriorityCache: Automatic chunk sizing

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-10 09:54:00 -06:00
Sage Weil
39e8de2d72 msg/async/Protocol*: bump global_seq when retrying connection
In the top connect retry in particular we do not bump connect_seq, so it
is critical that we bump global_seq so that the two connection attempts
are distinguishable at the peer.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-10 09:33:28 -06:00
Casey Bodley
4eb2911360
Merge pull request #25744 from cbodley/wip-test-rgw-reshard-wait
test/rgw: add ifdef for HAVE_BOOST_CONTEXT

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-10 10:32:26 -05:00
Mykola Golub
947351e626 rbd: fix delay time calculation for trash move
Fixes: https://tracker.ceph.com/issues/37861
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 15:15:36 +00:00
Jason Dillaman
5f3cb951c5 librbd: keep access/modified timestamp updates out of IO path
If the cache is enabled, it was possible for the timestamp updates
to cause race conditions with librbd clients (e.g. rbd export)
that had data corrupting effects since callbacks were expected to
be serialized.

Fixes: http://tracker.ceph.com/issues/37745
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-10 10:00:20 -05:00
Casey Bodley
8338de3ee4
Merge pull request #25892 from theanalyst/doc-rgw-usage-fix
doc: rgw: fix the default value of usage log setting

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-01-10 09:37:18 -05:00
Stephan Müller
5f977920a6 mgr/dashboard: RbdMirroringService test suite fails in dev mode
If you have set DEV in unit-test-configuration.ts to true, in order to
run all unit tests much faster, the unit test suite of rbd mirroring
service fails.

The reason is, that it's expecting a call, that is triggered inside the
constructor, which is only done once in for the copy used in the fast
testing mode (if it would be done on within ngOnInit this wouldn't be a
problem).

Fixes: http://tracker.ceph.com/issues/37841
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-10 15:31:51 +01:00
Mykola Golub
ffb41b06c8 rbd-mirror: add aggregated replication perf counters
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Mykola Golub
99763d2d46 pybind/mgr/prometheus: export rbd-mirror metadata
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Mykola Golub
2162ed91d9 pybind/mgr: add rbd-mirror to get_all_perf_counters by default
This effectively enables rbd-mirror stats for modules like prometheus or
influx.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Mykola Golub
bb3d573a6e pybind/mgr/diskprediction_cloud: only perfs for mon and osd needed
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Mykola Golub
048bd5d0cc pybind/mgr: allow to specify services for get_all_perf_counters
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Mykola Golub
19a41c3563 rbd-mirror: create and export replication perf counters to mgr
Fixes: https://tracker.ceph.com/issues/21392
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-10 10:36:45 +00:00
Abhishek Lekshmanan
b21c96ec69 doc: rgw: fix the default value of usage log setting
Fixes: http://tracker.ceph.com/issues/37856
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-10 11:13:33 +01:00
Lenz Grimmer
929575bdad
Merge pull request #25769 from votdev/navbar_focus_color
mgr/dashboard: Fix navbar focused color

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Neha Gupta <gnehapk@gmail.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-01-10 11:01:21 +01:00
Lenz Grimmer
7fe4820c60
Merge pull request #25791 from rhcs-dashboard/36740-pool-stats-read-write-columns
mgr/dashboard: add columns to Pools table

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-01-10 09:58:05 +01:00
Sebastian Wagner
4dd332ebfb
Merge pull request #25839 from tchaikov/wip-37773
mgr/test_orchestrator: correct ceph-volume path

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-10 09:29:11 +01:00
Tatjana Dehler
17bdec41fc mgr/dashboard: use new config options type names
Use the new config option type names (given by the cluster) in the
dashboard.

Fixes: http://tracker.ceph.com/issues/37843
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-01-10 08:08:54 +01:00
Neha Ojha
dfc2929235 include/rados.h: hide CEPH_OSDMAP_PGLOG_HARDLIMIT from ceph -s
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-01-09 18:12:17 -08:00
Brad Hubbard
885a37ac02 mount.fuse.ceph: Fix ambiguous shebang
The ambiguous shebang now produces an error in rawhide and halts the
build. In f29 this was a warning. Add python3 as a dependency for
ceph-fuse.

Fixes: http://tracker.ceph.com/issues/37787

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-01-10 10:32:07 +10:00