Commit Graph

89193 Commits

Author SHA1 Message Date
Mykola Golub
7f27f19753 rbd: CLI to migrate images
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
2bcc61a854 pybind/rbd: API for image migration
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
119c7ea66b librbd: API for image migration
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
813e5f28cf librbd: allow 'migrating' internal feature on image create
We want this feature set from the start to avoid races when a client
is opening an image being prepared for migration.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
7000860b26 librbd: handle CEPH_NOSNAP case outside of deep_copy::util::compute_snap_map
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
eed5415aec librbd: add function to wait writes unblocked
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
04c33f6bd6 librbd: use newly added method to list watchers in remove request
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
8d3e0e093e librbd: async request to list watchers
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Mykola Golub
179a5b82d6 librbd: allow to remove already opened image
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
91bb4775d6 librbd: shortcut to skip v2 probing when opening v1 image
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
3d785798e1 librbd: add flags to open request
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
57ef57abd9 cls/rbd: add assert_snapc_seq method
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
ad4809bab2 librbd: add "migration" trash image source
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
431b443718 cls/rbd: add "migration" trash image source
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Mykola Golub
2f7c4ae3fc cls/rbd: methods to set/get/remove image migration header
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:44 -04:00
Andrew Schoen
2bec876995
Merge pull request #23532 from alfredodeza/wip-rm24960
ceph-volume:  expand auto engine for single type devices on filestore

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-08-14 20:59:24 +00:00
Casey Bodley
b2fe116d97
Merge pull request #23402 from cbodley/wip-23659
qa/rgw: patch keystone requirements.txt

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-14 16:53:30 -04:00
Patrick Donnelly
fbfbe8f3df
Merge PR #23426 into master
* refs/pull/23426/head:
	client: privatize some class members
	client: reorganize Client header

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2018-08-14 11:50:09 -07:00
Patrick Donnelly
a807a7ebf0
Merge PR #23470 into master
* refs/pull/23470/head:
	tools/cephfs-shell: unable to copy files to a sub-directory from local file system

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-14 09:41:01 -07:00
Pavani Rajula
b726ac2513 tools/cephfs-shell: unable to copy files to a sub-directory from local file system
Fixes:http://tracker.ceph.com/issues/26874

Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-14 21:48:04 +05:30
Patrick Donnelly
038b95da83
Merge PR #23561 into master
* refs/pull/23561/head:
	tools/cephfs: do not split args if it's already a list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-14 08:59:29 -07:00
Alfredo Deza
9066792764 ceph-volume lvm.zap loop over all vgs from a pv to destroy them
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-14 11:59:25 -04:00
Sage Weil
1ee7b8c6c2 Merge PR #23552 into master
* refs/pull/23552/head:
	ceph_test_objectstore: queue split on parent pg sequencer
	os/bluestore: fix split vs finish_write race

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-08-14 10:34:29 -05:00
Alfredo Deza
7a5ee22437 ceph-volume tests.util ensure dmcrypt_close will skip non-existent paths
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-14 10:47:14 -04:00
Alfredo Deza
635f8e9e2e ceph-volume util.encryption if crypt path does not exist, skip it
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-14 10:47:14 -04:00
Alfredo Deza
549109c1de ceph-volume lvm.zap unmount lvs and close dmcrypt on partitions
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-14 10:47:13 -04:00
Sage Weil
de747b0dc1 ceph_test_objectstore: queue split on parent pg sequencer
This matches the OSD.

It also ensure that we drain transactions that precede the split, which
will include any finish_write calls that might otherwise attach the
Buffer to the wrong cache shard: _txc_finish() calls finish_write and
passes the cache shard without the cache shard lock held, but may block
waiting for split_cache() which then changes the destination collection's
shard.  Once it gets the lock and proceeds it would operate on the wrong
cache shard, leading to a failed assert later when the sharedblob is
trimmed.

Fixes: http://tracker.ceph.com/issues/24439
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-14 09:08:12 -05:00
Kefu Chai
aec096558e
Merge pull request #23539 from cyx1231st/wip-seastar-msgr-cyx
crimson/net: fix unittest_seastar_messenger errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-14 20:47:44 +08:00
Ricardo Marques
2a6ce09691
Merge pull request #22457 from p-na/dash-settings
mgr/dashboard: Add backend support for changing dashboard configuration settings via the REST API

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-08-14 09:27:09 +01:00
Yingxin
d5d7c698c3 crimson/net: fix unittest_seastar_messenger errors
fix several bugs that may fail unittest_seastar_messenger:
1. keep holding the connection reference until closed.
2. zero h.reply before start to use it.
3. set server-side features correctly.
4. add missing return to link write with flush.
5. remove an empty lambda operation.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-08-14 16:15:53 +08:00
Kefu Chai
130ab077f9 tools/cephfs: do not split args if it's already a list
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-14 09:59:00 +08:00
Patrick Donnelly
c1a43ca22e
Merge PR #23537 into master
* refs/pull/23537/head:
	tools/cephfs-shell:fixing the issue in using  with_argparse.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-13 16:39:32 -07:00
Gregory Farnum
2b0ceced42
Merge pull request #23519 from falcon78921/wip-doc-troubleshoot-osds
doc: cleaned up troubleshooting OSDs documentation

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-08-13 13:57:58 -07:00
Casey Bodley
909f74d6c5
Merge pull request #23401 from cbodley/wip-rgw-getomapkeys2-more
rgw: RGWRadosGetOmapKeysCR uses 'more' flag from omap_get_keys2()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-13 15:44:45 -04:00
Sage Weil
a3d64ea9db Merge PR #23406 into master
* refs/pull/23406/head:
	TestOSDMap: Test with negative upmap values
	osd/OSDMap: Disallow negative values in _apply_upmap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-08-13 13:00:51 -05:00
Sage Weil
211cd6388b Merge PR #23512 into master
* refs/pull/23512/head:
	osd: vary tick interval +/- 5% to avoid scrub livelocks
	osd: tick at OSD_TICK_INTERVAL, not heartbeat interval

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-13 13:00:46 -05:00
Sage Weil
88ec550112 Merge PR #23515 into master
* refs/pull/23515/head:
	os/bluestore_tool: print actual usage in BlueFS::dump_block_extents.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-13 13:00:41 -05:00
Sage Weil
4c2591b5d3 Merge PR #23516 into master
* refs/pull/23516/head:
	os/bluestore: check bluefs_extents consistency (DB vs. BlueFS)

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-13 13:00:36 -05:00
Sage Weil
58a45f13a4 Merge PR #23517 into master
* refs/pull/23517/head:
	os/bluestore: uniform loging format for bluefs_extent_t.
	os/bluestore_tool: handle fsck's returned  status properly.
	os/bluestore_tool: fix multiple extents handling in BlueFS::log_dump

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-13 13:00:32 -05:00
Patrick Donnelly
9ce675d0ca
Merge PR #23536 into master
* refs/pull/23536/head:
	mds: report lagginess at lower debug
	MDSMonitor: note beacons and cluster changes at low dbg level

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-13 10:16:32 -07:00
Sage Weil
f21f1f14f2 os/bluestore: fix split vs finish_write race
In _tcx_finish(), we were looking at the right Cache for the collection,
and then calling finish_write with that Cache and taking the lock.  This
could race with a split_cache() such that after we got the lock the
collection was not on a different cache.  This would in turn lead to a
failed assertion later on in _rm_buffer when the sharedblob was trimmed.

Fixes: http://tracker.ceph.com/issues/24439
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-13 12:10:59 -05:00
Sage Weil
3d774d6a91 Merge PR #23291 into master
* refs/pull/23291/head:
	tests: add Cephx-resembling scenarios to crypto tests.
	tests: differentiate AES testing regarding text size.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-13 10:49:41 -05:00
Sage Weil
8f3560d4ed Merge PR #22879 into master
* refs/pull/22879/head:
	doc/rados/operations/user-management: document 'network' clause of moncap and osdcap
	mds/SessionMap: make Session::connection private
	mds/MDSAuthCaps: parse and enforce network restriction
	mds/MDSAuthCaps: pass addr to is_capable
	mds/SessionMap: track socket_addr for each Session
	osd/OSDCap: enforce network restriction
	osd/OSDCap: take addr arg to is_capable
	osd/OSDCap: parse 'network' clause in grant
	mon: adapt MonCap network checks to addrvecs
	mon/MonCap: enforce network constraint (if present)
	mon/MonCap: take addr for MonCap::is_capable
	mon/MonCap: parse 'network ...' suffix
	osd: add peer_socket_addr to Session
	mon: use addrvec for RoutedRequest and MForward
	msg/Connection: add get_peer_socket_addr()
	common/ipaddr: add network_contains() helper
	common/ipaddr: add parse_network helper
	common/ipaddr: expose netmask_ipv[46]

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-08-13 08:48:14 -05:00
Kefu Chai
e2e6a77b38
Merge pull request #23510 from tchaikov/wip-cmake-boost-build
cmake: fix build WITH_SYSTEM_BOOST=ON

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-13 21:42:10 +08:00
Alfredo Deza
ac00e72255 ceph-volume tests.functional batch add filestore sceanrios to tox.ini
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-13 08:38:08 -04:00
Patrick Donnelly
418db4617b
Merge PR #23542 into master
* refs/pull/23542/head:
	qa: fix mon config section

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:15:20 -07:00
Patrick Donnelly
47e60908a3
qa: fix mon config section
Fixes: fc6e683832

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:13:06 -07:00
Patrick Donnelly
0b879f4401
Merge PR #23444 into master
* refs/pull/23444/head:
	cephfs-shell: avoid sys.argv modification
	tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 18:29:34 -07:00
Sage Weil
d7596a74e1 doc/rados/operations/user-management: document 'network' clause of moncap and osdcap
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-12 17:03:20 -05:00
Sage Weil
d3af166d6e mds/SessionMap: make Session::connection private
Ensure all setters go through set_connection()

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-12 17:03:20 -05:00