Commit Graph

105366 Commits

Author SHA1 Message Date
Mykola Golub
c2a3063d67 rbd: list primary mirror snapshots in mirror image status
TODO: provide the same in verbose mirror pool status.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
34734dd2b4 rbd: add 'mirror image snapshot' command
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
3a1361ba69 librbd: API method to get mirror image mode
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
2611373a0f librbd: add mirror image snapshot tests
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
01a8a510f6 librbd: add mirror image snapshot API
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
8d383d3160 librbd: when removing mirror peer unlink it from all snapshots
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
c9c8852f6e librbd: snapshot mirror mode
Enabling mirroring for an image that does not support journaling
assumes snapshot based mirroring, which is supported only when the
pool is in the "image" mirror mode.

Also for the pool in the "image" mirror mode disabling/enabling
journaling feature for a mirroring image will switch
snapshot/journal mirror mode.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
55dcce90bf librbd: state machine for snapshot based mirror promote/demote
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
2bfac34784 librbd: state machine for creating mirroring snapshot
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
0096d079e1 librbd: state machine for unlinking peer from mirror snapshot
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
a27fa5fb51 cls/rbd: method to set mirror snapshot copy progress
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
9328b402c2 cls/rbd: method to unlink peer from mirror snapshot
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
b78ebb3675 cls/rbd: async methods for mirror_peer_list
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
a5f4236a75 librbd: cleanup: remove unused function
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Mykola Golub
cfb0c070ac cls/rbd: add mode (journal/snapshot) to mirror image
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-10 15:45:30 +00:00
Michael Fritch
5111a11459
ceph-daemon: don't deref symlinks during chown
- consolidate move/copy loop logic
- chown the actual file and not the symlink

Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-10 08:18:51 -07:00
Sage Weil
86512b71fc Merge PR #32132 into master
* refs/pull/32132/head:
	osd/OSDMap: rename old calc_pg_role -> calc_pg_role_broken
	osd/OSDMap: remove dead osd_is_valid_op_target
	osd/OSDMap: fix get_pg_acting_role()
	osd: use spg_t for pending_creates_from_osd
	osd/OSDMap: drop unused get_pg_acting_role()
	osd/OSDMap: fix+simplify is_up_acting_osd_shard
	osd: use new and improved calc_pg_role()
	osd/OSDMap: new calc_pg_role() that takes a pg_shard_t
	osd/OSDMap: calc_pg_rank -> calc_pg_role
	osd/PeeringState: debug lines for upacting_features, proc_lease
	osd/PeeringState: use pg_vector_string for operator<<

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-12-10 08:49:52 -06:00
Sage Weil
c221b06bbf doc/releases/nautilus: fix release notes (crash->device)
Fix pending note for octopus too

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-10 08:32:02 -06:00
Sage Weil
ce1c7ba038 Merge PR #31827 into master
* refs/pull/31827/head:
	mgr/ssh: add 'upgrade check' command
	ceph-daemon: add 'pull' command
	mgr/orchestrator_cli: document orchestrator option
	mgr/ssh: move entity name munging into a helper

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-10 07:15:59 -06:00
Sage Weil
56c4b039fa Merge PR #31970 into master
* refs/pull/31970/head:
	doc/releases: add Nautilus 14.2.5 to release timeline
	doc/releases: add release notes for nautilus v14.2.5

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-10 07:13:47 -06:00
Kefu Chai
b2d97ef5aa
Merge pull request #32141 from tchaikov/wip-doc-highlight-console
doc: use the console lexer for rendering command line sessions

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-10 21:12:28 +08:00
Kefu Chai
31015b4b24
Merge pull request #31965 from rosinL/wip-osd-support-bond-network
osd/osd: Refactor get_iface_numa_node

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-10 21:07:29 +08:00
Kefu Chai
2a071bd0f9
Merge pull request #27392 from rouming/bluestore-iouring
os/bluestore: introduce new io_uring IO engine

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-10 20:28:57 +08:00
Sebastian Wagner
71dea68307
Merge pull request #31979 from jan--f/c-v-patch-volumegroups
ceph-volume/test: patch VolumeGroups

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-10 11:23:45 +01:00
Lenz Grimmer
f3b20cebb4
Merge pull request #32122 from s0nea/wip-dashboard-fix-tests
qa/tasks/mgr/dashboard/test_health: update schema

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-12-10 09:33:41 +00:00
Rishabh Dave
2b5a9efaf1 doc: show how to count jobs before triggering them
Suggesting to use teuthology-suite command switch --dry-run for that.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-12-10 15:01:17 +05:30
Roman Penyaev
2268be9ff9 os/bluestore: introduce new io_uring IO engine
This implements low-level IO engine, which utilizes brand-new
io_uring IO interface: https://lwn.net/Articles/776428/

By default libaio is used.  If bluestore_ioring=true is set but kernel
does not support io_uring or architecture is not x86-64, libaio will be
used instead.

In current patch liburing library is used in order not to open code
everything.

In order to compile with liburing WITH_LIBURING=ON should be specified.

Signed-off-by: Roman Penyaev <rpenyaev@suse.de>
2019-12-10 17:22:15 +08:00
Roman Penyaev
c05c1bd7b9 os/bluestore: make abstract interface for any sorts of AIO queues
In the next patch new io_uring API will be used instead of libaio.
So this prepares the abstract interface.

Signed-off-by: Roman Penyaev <rpenyaev@suse.de>
2019-12-10 17:21:38 +08:00
Kefu Chai
6c7f395233
Merge pull request #32007 from tchaikov/wip-osd-cleanup
osd: use unique_ptr for managing life cycles

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2019-12-10 17:18:03 +08:00
Kefu Chai
425368c888
Merge pull request #31931 from majianpeng/bluestore-bugfix
os/bluestore: fix wakeup bug

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-10 17:13:21 +08:00
Kefu Chai
a11ae900e9
Merge pull request #32052 from mgfritch/wip-cd-standalone-tempfiles
ceph-daemon: clean-up tempfiles on EXIT

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-10 16:57:48 +08:00
Kefu Chai
5a3d093545 qa/workunits/rados/test_envlibrados_for_rocksdb: accomodate rocksdb cmake changes
since
bac38c992a,

tests are not enabled for non-debug builds.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-10 14:58:00 +08:00
Yehuda Sadeh
b976dc5aa3
Merge pull request #32100 from yehudasa/wip-43184
qa: radosgw-admin: remove dependency on bunch package

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-10 07:51:27 +02:00
Jos Collin
8df6e03d80
Merge pull request #31961 from joscollin/wip-B43038-subvolume-group-create-fail
mgr/volumes: check for string values in uid/gid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-10 11:12:03 +05:30
Kefu Chai
310d145ef5 doc: use console lexer for rendering command line sessions
by default the pygements uses python lexer for rendering literal blocks,
and `#` is considered as the marker for inline comments. in this change,
the "console" lexer is specified explicitly. see
https://pygments.org/docs/lexers/#lexers-for-various-shells for more details,
in which "BashSessionLexer" is for this very use case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-10 12:46:42 +08:00
Patrick Donnelly
4635f943cd
Merge PR #32124 into master
* refs/pull/32124/head:
	doc/cephfs/disaster-recovery-experts: Add link for scrub and note for scrub_path

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-09 19:52:41 -08:00
Kefu Chai
1c0bc5dad4 cmake: silence messages when cppcheck/IWYU is not found
* remove messages spit when these tools are not found
  they are not necessary for building Ceph. and the messages in the cmake
  output are distracting.
* fix a typo

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-10 11:08:02 +08:00
Patrick Donnelly
12e7401a43
Merge PR #27894 into master
* refs/pull/27894/head:
	cephfs-shell: Add default list to df
	cephfs-shell: Add tests for df command
	cephfs-shell: Fix 'df' command errors

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-09 17:05:52 -08:00
Patrick Donnelly
6cd51077e2
Merge PR #32131 into master
* refs/pull/32131/head:
	codeowners: Add ceph2.py to @ceph/orchestrators

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-09 16:39:36 -08:00
Patrick Donnelly
b8635afe10
Merge PR #32038 into master
* refs/pull/32038/head:
	doc: reorganize CephFS landing page and ToC

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-12-09 16:36:59 -08:00
Sage Weil
dcb5e9b6d8 Merge PR #32098 into master
* refs/pull/32098/head:
	ceph-daemon: py2: tolerate whitespace before config key name

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-09 18:29:41 -06:00
Nathan Cutler
d9a0e9b0d7
Merge pull request #32037 from smithfarm/wip-43152-workaround
build/ops: make-dist: default to no dashboard frontend build parallelism

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-10 00:42:16 +01:00
Nathan Cutler
7409a135f8 doc/releases: add Nautilus 14.2.5 to release timeline
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-12-09 23:28:58 +01:00
Nathan Cutler
e524bb8880 doc/releases: add release notes for nautilus v14.2.5
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-12-09 23:27:54 +01:00
Ilya Dryomov
0bc226f6e1
Merge pull request #32088 from idryomov/wip-krbd-exclusive-lock-fixups
qa: krbd_exclusive_option.sh: update for recent kernel changes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-09 22:59:13 +01:00
Sage Weil
bffe2dd9e9 Merge PR #32046 into master
* refs/pull/32046/head:
	mgr/DaemonServer: fix 'osd ok-to-stop' for EC pools

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-09 15:34:57 -06:00
Sage Weil
ae60fd9519 Merge PR #31489 into master
* refs/pull/31489/head:
	pybind/rados: add WriteOp::writesame() and test WriteOp::writesame()
	pybind/rados: add Ioctx::aio_writesame() and test Ioctx::aio_writesame()
	pybind/rados: add Ioctx::writesame() and test Ioctx::writesame()

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2019-12-09 14:46:40 -06:00
Sage Weil
946a8f7cb5 Merge PR #29214 into master
* refs/pull/29214/head:
	mgr: templatize/generalize metrics collection interface

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-09 14:46:09 -06:00
Sage Weil
5993dd82b0 Merge PR #32102 into master
* refs/pull/32102/head:
	mgr/diskprediction_local: import scipy early to fix self-test deadlock

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-09 14:44:37 -06:00
David Zafman
65d03bae8b release note: Add pending release notes for already merged code
Follow on to https://github.com/ceph/ceph/pull/31774

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-12-09 11:51:32 -08:00