Commit Graph

105293 Commits

Author SHA1 Message Date
Sage Weil
3398379af8 Merge PR #32178 into master
* refs/pull/32178/head:
	qa/standalone/test_ceph_daemon.sh: disable adoption for the moment

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-11 11:10:42 -06:00
Jason Dillaman
64b9e69d2b
Merge pull request #32176 from idryomov/wip-doc-fancy-striping
doc: clarify support for rbd fancy striping

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-11 11:35:42 -05:00
Patrick Donnelly
be58eb0a8d
Merge PR #32163 into master
* refs/pull/32163/head:
	qa: fix output check to not be sensitive to debugging

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-12-11 06:24:13 -08:00
Nathan Cutler
7afafc060a
Merge pull request #32083 from smithfarm/wip-42612
rpm: add rpm-build to SUSE-specific make check deps

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-11 15:14:31 +01:00
Sage Weil
e5e41c443d Merge PR #32160 into master
* refs/pull/32160/head:
	doc/releases/nautilus,PendingReleaseNotes: consolidate telemetry note

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-12-11 08:06:40 -06:00
Sage Weil
80cbe97e7b qa/standalone/test_ceph_daemon.sh: disable adoption for the moment
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-11 07:32:29 -06:00
Thomas Bechtold
2ad13f5d48
Merge pull request #32161 from mgfritch/wip-cd-tox-warn
ceph-daemon: `imp` module  DeprecationWarning
2019-12-11 13:44:27 +01:00
Lenz Grimmer
d6e7f51070
mgr/dashboard: Disable cache for static files (#31018)
mgr/dashboard: Disable cache for static files

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-12-11 12:28:19 +00:00
Ilya Dryomov
abd20b5ca9 doc: clarify support for rbd fancy striping
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-12-11 12:41:09 +01:00
Kefu Chai
8e00a36d53
Merge pull request #32025 from tchaikov/wip-pick-address-silence-warning
common/pick_address.cc: silence GCC warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-11 12:08:10 +08:00
Sage Weil
628af7f226 Merge PR #32091 into master
* refs/pull/32091/head:
	common/config: update values when they are removed via mon

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-10 22:05:03 -06:00
Kefu Chai
b9225dfbc3 common/pick_address.cc: silence GCC warning
* use `string_view` instead of string
* use `auto` instead of `int` to silence the warning
* use `enum class` instead of plain `enum`
* do not specify the value of enum, as
  we don't care about it

this change silences following warning

```
../src/common/pick_address.cc: In function ‘int get_iface_numa_node(const string&, int*)’:
../src/common/pick_address.cc:517:11: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_type’ {aka ‘const long unsigned int’} [-Wsign-com\
pare]
  517 |   if (pos != string::npos ) {
      |       ~~~~^~~~~~~~~~~~~~~
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-11 10:04:16 +08:00
Kefu Chai
0e52da069b
Merge pull request #31839 from alimaredia/wip-s3-test-branch-refactor
qa: update s3-test download code for s3-test tasks

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-12-11 09:28:58 +08:00
Patrick Donnelly
0448a31fcb
qa: fix output check to not be sensitive to debugging
The traceback would screw up the equality checks.

Also, use unittest asserts so we can easily see the assert values.

Fixes: https://tracker.ceph.com/issues/43247
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 16:45:09 -08:00
Sage Weil
79f7e6aeef Merge PR #31772 into master
* refs/pull/31772/head:
	qa/standalone/test_ceph_daemon.sh: clone corpus explicitly
	ceph-daemon: re-enable the OSD standalone test
	ceph-daemon: move standalone test tgz to corpus
	ceph-daemon: add ceph-daemon-adoption-corpus.git submodule

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-10 16:40:58 -06:00
Jason Dillaman
f6c18468ce
Merge pull request #30548 from trociny/wip-41557
rbd-mirror: snapshot mirror mode

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-10 16:41:28 -05:00
Patrick Donnelly
c4d9e8337d
Merge PR #31122 into master
* refs/pull/31122/head:
	mds: Reorganize class members in MDSTable header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 13:33:54 -08:00
Patrick Donnelly
0da6402e12
Merge PR #31253 into master
* refs/pull/31253/head:
	mds: Reorganize class members in Migrator header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 13:32:19 -08:00
Patrick Donnelly
39df21b940
Merge PR #31596 into master
* refs/pull/31596/head:
	mds: Reorganize class members in PurgeQueue header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 13:31:28 -08:00
Michael Fritch
0504c3ed89
ceph-daemon: imp module DeprecationWarning
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-10 14:09:08 -07:00
Sage Weil
c50c17e755 doc/releases/nautilus,PendingReleaseNotes: consolidate telemetry note
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-10 14:36:06 -06:00
Sage Weil
aa760fa501 Merge PR #32148 into master
* refs/pull/32148/head:
	doc/releases/nautilus: fix release notes (crash->device)

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2019-12-10 14:33:02 -06:00
David Zafman
47b5fd9383
Merge pull request #32041 from dzafman/wip-balancer3-pending
release note: Add pending release notes for already merged code

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-10 10:56:04 -08:00
Sage Weil
6d3a035b26
qa/standalone/test_ceph_daemon.sh: clone corpus explicitly
When this is run by teuthology we don't have a full ceph source tree
checkout with submodules.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-10 11:34:42 -07:00
Michael Fritch
4aa7d5582b
ceph-daemon: re-enable the OSD standalone test
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-10 11:34:42 -07:00
Michael Fritch
a0eed4cb84
ceph-daemon: move standalone test tgz to corpus
Fixes: https://tracker.ceph.com/issues/42876
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-10 11:32:18 -07:00
Michael Fritch
da36bdfb61
ceph-daemon: add ceph-daemon-adoption-corpus.git submodule
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-10 11:32:15 -07:00
Sage Weil
cc8e8d868b Merge PR #32127 into master
* refs/pull/32127/head:
	mgr/rook: Added Mypy static type checking

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-10 12:16:23 -06:00
Sage Weil
0e981c4c30 Merge PR #32138 into master
* refs/pull/32138/head:
	ceph-daemon: combine SUDO and ARGS into a single var

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-10 12:16:07 -06:00
Sage Weil
b93ff4ec1f Merge PR #32137 into master
* refs/pull/32137/head:
	ceph-daemon: don't deref symlinks during chown

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-10 12:15:53 -06:00
Ali Maredia
f43c0cf454 qa: update s3-test download code for s3-test tasks
- Ensure the download code for all tasks running
s3-tests is consistent.
- Simplify download code to only use the config
variable 'force-branch' for the branch being
cloned.
- make ceph-master the force-branch for all
suites using s3-tests.

Fixes: https://tracker.ceph.com/issues/43077

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-12-10 12:39:28 -05:00
Nathan Cutler
6378fa45ac rpm: add rpm-build to SUSE-specific make check deps
The binary /usr/bin/rpmspec was recently moved to rpm-build, breaking
install-deps.sh on openSUSE Tumbleweed. The package is not strictly
needed for SLE-15-SP* and openSUSE Leap 15.*, but it doesn't hurt to
have it, and will future-proof these distros from this regression.

Putting the dependency in the spec file does not address the issue,
because /usr/bin/rpmspec must be available before install-deps.sh runs it to
determine the dependencies, but it's nice to have it explicitly listed there,
since it *is* a dependency of "make check" on SUSE distros.

SUSE versions < 15 are of no interest in master/octopus+.

Fixes: https://tracker.ceph.com/issues/42612
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-12-10 18:31:16 +01:00
Patrick Donnelly
9a5e26d586
Merge PR #32145 into master
* refs/pull/32145/head:
	doc: show how to count jobs before triggering them

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 09:22:06 -08:00
Kefu Chai
4aae1d4b14
Merge pull request #32140 from tchaikov/wip-cmake-cleanup
cmake: silence messages when cppcheck/IWYU is not found

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-12-11 00:28:49 +08:00
David Zafman
ea9ccfed05
Merge pull request #31954 from dzafman/wip-42346
osd: Use physical ratio for nearfull (doesn't include backfill resserve)

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-10 08:08:37 -08:00
Mykola Golub
17e98dae73 librbd: force promote for snapshot mirroring
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
3c78082282 librbd: introduce LIST_WATCHERS_MIRROR_INSTANCES_ONLY flag
Also, don't skip listing mirror watchers if the image has journaling
disabled -- it is not correct for snapshot mirror mode.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
fe550f5e52 librbd: refactor CreateNonPrimaryRequest and CreatePrimaryRequest
to extract re-usable functions into utils

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
bec03e5046 librbd: store/remove image state when creating/removing mirror snapshot
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
c6feb3411f librbd: requests for mirror snapshot image state
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
b08e709e6a cls/rbd: async methods for snapshot_get_limit
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
c2a3063d67 rbd: list primary mirror snapshots in mirror image status
TODO: provide the same in verbose mirror pool status.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
34734dd2b4 rbd: add 'mirror image snapshot' command
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
3a1361ba69 librbd: API method to get mirror image mode
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
2611373a0f librbd: add mirror image snapshot tests
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
01a8a510f6 librbd: add mirror image snapshot API
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
8d383d3160 librbd: when removing mirror peer unlink it from all snapshots
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
c9c8852f6e librbd: snapshot mirror mode
Enabling mirroring for an image that does not support journaling
assumes snapshot based mirroring, which is supported only when the
pool is in the "image" mirror mode.

Also for the pool in the "image" mirror mode disabling/enabling
journaling feature for a mirroring image will switch
snapshot/journal mirror mode.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
55dcce90bf librbd: state machine for snapshot based mirror promote/demote
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
2bfac34784 librbd: state machine for creating mirroring snapshot
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00