Commit Graph

93269 Commits

Author SHA1 Message Date
Tina Kallio
ceb1fdc095 mgr/dashboard: Correct permission decorator
'CreatePermission' is required in order to restore an image from trash.

Signed-off-by: Tina Kallio <tina.kallio@gmail.com>
2019-01-29 10:07:36 +01:00
Xie Xingguo
0ccdc79938
Merge pull request #25702 from wjwithagen/wjw-fix-bluestore-warning
bluestore: silence Clang warning on possible uninitialize usuage

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-12-26 08:52:57 +08:00
Patrick Donnelly
cebcf238b0
Merge PR #25591 into master
* refs/pull/25591/head:
	mds: clean up log messages for standby-replay

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-12-25 10:21:04 -08:00
Willem Jan Withagen
b23220ca81 bluestore: silence Clang warning on possible uninitialize usuage
```
/home/wjw/ceph.head/ceph/src/os/bluestore/BlueStore.cc:5935:15: note: initialize the variable 'reserved' to silence this warning
  int reserved;
              ^
               = 0
1 warning generated.
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-12-25 16:07:16 +01:00
Kefu Chai
e0d538d3f5
Merge pull request #25688 from wjwithagen/wjw-fix-kerberos
install-deps.sh: Add Kerberos requirement for FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-24 19:38:18 +08:00
Willem Jan Withagen
4d04ce251a build: Add Kerberos requirement for FreeBSD
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-12-24 10:52:58 +01:00
Kefu Chai
94cb394d62
Merge pull request #25675 from dzafman/wip-36525
test: Disable duplicate request command test during scrub testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-24 00:16:00 +08:00
Kefu Chai
8928f1ffd7
Merge pull request #25582 from trociny/wip-osd-perf-query-wrs
osd: Weighted Random Sampling for dynamic perf stats

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-24 00:12:47 +08:00
Kefu Chai
98078f1748
Merge pull request #25584 from thinkercui/bugfix
osd/PrimaryLogPG: fix the extent length error of the sync read

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-12-23 22:30:58 +08:00
Kefu Chai
d351e02880
Merge pull request #25626 from xiexingguo/wip-no-upmap-for-merge
mgr/balancer: skip auto-balancing for pools with pending pg-merge

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-23 22:28:49 +08:00
Kefu Chai
5cbec0f22e
Merge pull request #25645 from sebastian-philipp/orchestrator-ansible-minor-cleanup
mgr/ansible: Python 3 fix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-23 22:28:12 +08:00
Patrick Donnelly
8722fbab07
Merge PR #25619 into master
* refs/pull/25619/head:
	mds: use frag_vec_t for efficient frag storage
	mds: do not copy session map accidentally
	mds: use vector for subtree access
	include/frag: use more efficient small vectors
	StackStringStream: add strv method short-cut
	include: add small_vector encode/decode/<<
	mds: scope using directives

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2018-12-22 20:16:13 -08:00
Sage Weil
f3e4e56fa5 Merge PR #25618 into master
* refs/pull/25618/head:
	mgr/dashboard: Updated API pool tests

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-22 16:04:55 -06:00
Patrick Donnelly
017e7c587c
Merge PR #25648 into master
* refs/pull/25648/head:
	client: add latency statistics for a read/fsync operation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-22 12:34:57 -08:00
Patrick Donnelly
7b08cd79fe
Merge PR #24797 into master
* refs/pull/24797/head:
	mds: handle state change race

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-22 12:33:19 -08:00
Patrick Donnelly
7e8c6838af
Merge PR #23126 into master
* refs/pull/23126/head:
	wherever: guard handle_conf_change() from concurrent execution
	config: drop config_proxy::lock when invoking config observer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-22 12:27:57 -08:00
Jason Dillaman
ce13562a74
Merge pull request #25636 from trociny/wip-prometheus-rbd-ns
pybind/mgr/prometheus: rbd stats namespace support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-22 10:25:32 -05:00
Jason Dillaman
4d4418b3af
Merge pull request #25666 from trociny/wip-instance-watcher-assert
rbd_mirror: assert no requests on destroying InstanceWatcher

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-22 10:25:17 -05:00
Jason Dillaman
b87bfb663c
Merge pull request #25667 from trociny/wip-37672
test/librados_test_stub: handle object doesn't exist gracefully 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-22 10:24:22 -05:00
David Zafman
554ea73cb5 test: Disable duplicate request command test during scrub testing
Scrub testing requires an orderly control of scrubbing.  Most but not
all the time, the duplicate scrub request is ignored because the first
request hasn't finished.  Teuthology enables this environment variable
in the workunit handling.

Fixes: https://tracker.ceph.com/issues/36525

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-12-21 18:28:23 -08:00
Kefu Chai
34fa1b6922
Merge pull request #25671 from tchaikov/wip-seastar-pthread
seastar: pickup the change to link pthread

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-12-22 09:51:52 +08:00
Kefu Chai
fe89e0e96c
Merge pull request #25608 from tchaikov/bluestore_fbsd
os/bluestore: support for FreeBSD

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-22 09:39:28 +08:00
Patrick Donnelly
ebb26940fb
Merge PR #25536 into master
* refs/pull/25536/head:
	mds: don't wait for snapclient sync when handling reconnect
	mds: extend reconnect period when mds is busy
	mds: renew client session when receiving any message
	mds: use mono_clock for reconnect timeout

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-21 17:16:11 -08:00
Patrick Donnelly
12aba241ec
Merge PR #25658 into master
* refs/pull/25658/head:
	MDSMonitor: allow beacons from stopping MDS that was laggy

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-21 17:13:05 -08:00
Kefu Chai
2d393b27a5 do_freebsd.sh: enable WITH_BLUESTORE
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-12-22 00:22:13 +08:00
Kefu Chai
4b50bd7b86 os/bluestore: s/event/events/
because `events` is an array, so name it with a plural name.

Signed-off-by: Alan Somers <asomers@gmail.com>
2018-12-22 00:22:07 +08:00
Alan Somers
9ae94e48be os/bluestore: support for FreeBSD
Signed-off-by: Alan Somers <asomers@gmail.com>
2018-12-22 00:21:56 +08:00
Kefu Chai
7fb4712aea os: rename aio.h to avoid conflict
FreeBSD's libc offers <aio.h>.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-12-22 00:20:56 +08:00
Sage Weil
6e6159c899 Merge PR #25620 into master
* refs/pull/25620/head:
	os/bluestore: more robust handling for lack of per-pool stats cases.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-21 10:12:42 -06:00
Kefu Chai
185144b04e seastar: pickup the change to link pthread
otherwise seastar applications might fail to link on ubuntu xenial due
to unresolvable symbols like thread_setname_np()

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-12-22 00:06:17 +08:00
Sage Weil
42de7e43a4 Merge PR #25632 into master
* refs/pull/25632/head:
	test: add a json tester
	ceph_json: parser sets data on all types when parsing

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-21 09:49:37 -06:00
Kefu Chai
e57649dd9c
Merge pull request #22800 from wjwithagen/wjw-ctest-timeout
cmake: allow setting of the CTest timeout during building.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-21 23:40:27 +08:00
Mykola Golub
135f0e9947 test/librados_test_stub: handle object doesn't exist gracefully
Fixes: https://tracker.ceph.com/issues/37672
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-21 13:33:18 +02:00
Mykola Golub
b26a5a942c test/rbd_mirror: fix typo in InstanceWatcher mock test
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-21 13:23:00 +02:00
Mykola Golub
75119f30ed rbd_mirror: assert no requests on destroying InstanceWatcher
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-21 13:18:49 +02:00
Kefu Chai
28b91c5305
Merge pull request #25661 from joscollin/wip-doc-changing-monitors
doc: fix typo in add-or-rm-mons

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-21 14:46:48 +08:00
Kefu Chai
3dcb9fdfe6
Merge pull request #25639 from oliveiradan/wip-krb_pr25566_cleanup_oliveiradan
auth/krb: Fix Kerberos build warnings

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-21 14:36:51 +08:00
Kefu Chai
bfd5aabcf7
Merge pull request #25537 from jecluis/dev/wip-mgr-module-error
mgr: make module error message more descriptive

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-21 14:09:40 +08:00
Kefu Chai
b5cb2115ba
Merge pull request #25595 from rzarzynski/wip-ec-drop_bl_crosstalk_dependency
ec: lrc doesn't depend on crosstalks between bufferlists anymore.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-21 14:06:08 +08:00
Kefu Chai
5d9440b203
Merge pull request #25503 from ceph/rbd-mirror-ceph-base
spec: requires ceph base instead of common

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-21 14:04:34 +08:00
Jos Collin
6dba3865c9
doc: fix typo in add-or-rm-mons
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-21 10:47:04 +05:30
Jason Dillaman
c84cc4a542
Merge pull request #25655 from gregsfortytwo/wip-rbd-snap-doc
doc: Clean up the snapshot consistency note

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-20 18:07:36 -05:00
Sage Weil
fc4adfd27a Merge PR #25577 into master
* refs/pull/25577/head:
	test: allow ceph_kvstorebench to be build on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-20 17:02:15 -06:00
Sage Weil
4d61afd33a Merge PR #25508 into master
* refs/pull/25508/head:
	kv/rocksdb_cache: Remove C style struct hack undefined behavior

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-20 17:01:54 -06:00
Sage Weil
bb804eb895 Merge PR #25236 into master
* refs/pull/25236/head:
	ceph-volume: Add venv to vstart cmake target
	mgr/orchestrator: Add test orchestrator

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-12-20 17:01:04 -06:00
Patrick Donnelly
05e9037245
MDSMonitor: allow beacons from stopping MDS that was laggy
Otherwise these get continually dropped.

Reproducing this manually:

o only have 2 MDS running (to prevent failover)
o max_mds=2
o create a lot of dirs with pins on rank 1 to make stopping take a while (as of this commit)
o max_mds=1
o immediately start dropping beacon packets to the mons from rank 1 using iptables
o wait ~30 seconds until the rank shows up as laggy
o remove the iptables rule

Now debug output shows after this commit:

    2018-12-20 14:58:07.190 7fbe19f5d700  5 mon.a@0(leader).mds e148 preprocess_beacon mdsbeacon(34119/b up:stopping seq 155 v148) v7 from mds.1 127.0.0.1:6839/1223470631 compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
    2018-12-20 14:58:07.190 7fbe19f5d700 10 mon.a@0(leader).mds e148 preprocess_beacon: GID exists in map: 34119
    2018-12-20 14:58:07.190 7fbe19f5d700  5 mon.a@0(leader).mds e148 _note_beacon mdsbeacon(34119/b up:stopping seq 155 v148) v7 noting time
    2018-12-20 14:58:07.190 7fbe19f5d700  7 mon.a@0(leader).mds e148 prepare_update mdsbeacon(34119/b up:stopping seq 155 v148) v7
    2018-12-20 14:58:07.190 7fbe19f5d700 12 mon.a@0(leader).mds e148 prepare_beacon mdsbeacon(34119/b up:stopping seq 155 v148) v7 from mds.1 127.0.0.1:6839/1223470631
    2018-12-20 14:58:07.190 7fbe19f5d700 15 mon.a@0(leader).mds e148 prepare_beacon got health from gid 34119 with 0 metrics.
    2018-12-20 14:58:07.190 7fbe19f5d700  0 log_channel(cluster) log [INF] : MDS health message cleared (mds.1): 1 slow metadata IOs are blocked > 30 secs, oldest blocked for 30 secs
    2018-12-20 14:58:07.190 7fbe19f5d700  1 -- 127.0.0.1:40495/0 --> 127.0.0.1:40495/0 -- log(1 entries from seq 129 at 2018-12-20 14:58:07.192368) v1 -- 0x5de9f11a80 con 0
    2018-12-20 14:58:07.190 7fbe19f5d700  1 mon.a@0(leader).mds e148 prepare_beacon clearing laggy flag on 127.0.0.1:6839/1223470631
    2018-12-20 14:58:07.190 7fbe19f5d700  5 mon.a@0(leader).mds e148 prepare_beacon mds.1 up:stopping -> up:stopping  standby_for_rank=-1

Fixes: https://tracker.ceph.com/issues/37724
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-20 12:04:28 -08:00
Greg Farnum
505025c641 doc: Clean up the snapshot consistency note
The old note made it sound like we weren't crash-consistent, and had a
confusing section about needing to clone before mounting.
You *do* need to clone the snapshot before mounting it, but that has
nothing to do fs freezing or consistency.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-12-20 10:33:38 -08:00
Daniel Oliveira
1f32b2b37c auth/krb: Fix Kerberos build warnings
Signed-off-by: Daniel Oliveira <doliveira@suse.com>
2018-12-20 11:16:00 -07:00
Mykola Golub
749f15a3fe osd: Weighted Random Sampling for dynamic perf stats
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-20 17:20:16 +00:00
Kefu Chai
539a16f376
Merge pull request #25207 from cyx1231st/wip-crimson-msgr-dispatch-events
crimson/net: encapsulate protocol implementations with states (remaining part)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-20 23:51:20 +08:00