Commit Graph

82891 Commits

Author SHA1 Message Date
Andrew Schoen
f88f2d3bc1 ceph-volume: no need to return osd_id from util.prepare.check_id
Now that osd_id is passed to util.prepare.create_id it doesn't
make any sense to return osd_id from check_id anymore as it's
not being used.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-31 09:04:09 -06:00
xie xingguo
28d487379f pybind/mgr/balancer: load weight-set from ms
See https://github.com/ceph/ceph/pull/20178, so we won't
try to call 'ceph osd crush weight-set create-compat' multiple times.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-01-31 17:38:34 +08:00
songweibin
3041b9af1a rbd: add open/close section when listing group images
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 17:34:36 +08:00
songweibin
1efda79fb6 rbd: translate pool id into pool name in error msg
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 17:34:36 +08:00
songweibin
0e50c352b3 pybind/rbd: fix some typo
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 17:34:35 +08:00
Malcolm Lee
753b3a7cbf rgw: If use 'copy part' without 'x-amz-copy-source-range',
it will copy an entire source object

Signed-off-by: Malcolm Lee <fengxueyu35@126.com>
2018-01-31 13:56:02 +08:00
songweibin
a12f9b81cb doc/rbd: update rbd man page
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 12:20:18 +08:00
songweibin
d8608ceb2e rbd: add missing period at the end of mesg
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 12:20:18 +08:00
songweibin
c7990c66cd rbd: s/group-spec/group-snap-spec for group snapshot
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-31 12:20:18 +08:00
luomuyao
341ddddf24 rgw: drop a repeated statement for encode_xml()
Signed-off-by: luomuyao <luo.muyao@zte.com.cn>
2018-01-31 10:33:27 +08:00
xie xingguo
47d1eb35e7 pybind/mgr/balancer: increase bad_steps properly
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-01-31 10:15:53 +08:00
xie xingguo
16f0015755 crush, mon: bump up map version only if we truly created a weight-set
In crush-compat mode mgr/balancer will do 'ceph osd crush weight-set create-compat'
on each call to 'ceph balancer optimize <plan>', which turns out to be
bumping up osdmap version without modifying anything (we haven't executed the
plan yet).

E.g.:
./bin/ceph balancer reset && ./bin/ceph balancer optimize crush test && ./bin/ceph balancer show crush
// starting osdmap epoch 993
// starting crush version 962
// mode crush-compat

./bin/ceph balancer reset && ./bin/ceph balancer optimize crush test && ./bin/ceph balancer show crush
// starting osdmap epoch 994
// starting crush version 963
// mode crush-compat

Fix the above problem by checking whether a new weight-set is truly created or not
on the OSDMonitor-side.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-01-31 09:02:55 +08:00
Neha Ojha
921f1113ad PG: primary should not be in the peer_info, skip if it is
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-01-30 15:43:57 -08:00
Patrick Donnelly
d8ba4862c1
Merge PR #19760 into master
* refs/pull/19760/head:
	mds: add dump flag for CInode
	mds: add command "openfiles ls"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:18:10 -08:00
Patrick Donnelly
90687e499c
Merge PR #19825 into master
* refs/pull/19825/head:
	client: properly choose target mds for rmsnap/renamesnap
	mds: properly setup need_snapflush for snapped inode
	mds: ignore MClientCaps::FLAG_NO_CAPSNAP

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:18:01 -08:00
Patrick Donnelly
6c6e25f8ee
Merge PR #19833 into master
* refs/pull/19833/head:
	common: add C_SaferCond ctor with name argument
	Client: use C_SaferCond for "_flush_range"
	client: use C_SaferCond for _fallocate and ll_write_block
	client: use C_SaferCond for _sync_fs and _fsync
	client: use C_SaferCond in Client::_write
	client: use C_SaferCond for _read_sync
	client: use C_SaferCond in _read_async
	client: use C_SaferCond for "Client::_read"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:54 -08:00
Patrick Donnelly
bb329c5582
Merge PR #19836 into master
* refs/pull/19836/head:
	Avoid the assert failure when the inode for the cap_export from other MDS happened not in MDCache

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-01-30 15:17:48 -08:00
Patrick Donnelly
89dfc9521d
Merge PR #19842 into master
* refs/pull/19842/head:
	client: unify function name in debug log for Client.cc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:42 -08:00
Patrick Donnelly
b233abc211
Merge PR #19991 into master
* refs/pull/19991/head:
	cephfs-journal-tool: move shutdown to the deconstructor of MDSUtility

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:35 -08:00
Patrick Donnelly
388c9dd37c
Merge PR #20001 into master
* refs/pull/20001/head:
	mds: use the steady clock on tick

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:29 -08:00
Patrick Donnelly
23ff594e16
Merge PR #20012 into master
* refs/pull/20012/head:
	mds: fix scrub crash

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2018-01-30 15:17:22 -08:00
Patrick Donnelly
69765dcbcb
Merge PR #20079 into master
* refs/pull/20079/head:
	mds: set higher priority for some perf counters

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:16 -08:00
Patrick Donnelly
ae0b89c6c9
Merge PR #20113 into master
* refs/pull/20113/head:
	osdc/ObjectCacher: don't merge TX buffer heads
	osdc/ObjectCacher: fix off-by-one error in bh_write_commit()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 15:17:10 -08:00
Andrew Schoen
43f699fcbc ceph-volume: when reusing an osd ID you must give that id to 'osd new'
If you do not then auth will not be created for the new OSD and the
daemon will not be able to start.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-30 16:28:17 -06:00
Alfredo Deza
6c87d66d76 ceph-volume simple.scan support dmcrypt OSDs when scanning
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
e5759e4fc9 ceph-volume util.encryption add a utilty to open plain encrypted devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
60e8699650 ceph-volume util.system tmp mounts can now remove a dmcrypt mapper
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
469d01dc1a ceph-volume util.system do not 'translate' using realpath
Using realpath always means that device mapper paths, like for dmcrypt
or LVM will get mangled and will return something like `/dev/dm-1` which
is not useful for anything in ceph-volume

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
cdb812438d ceph-volume util.disk add a PART_ENTRY_TYPE detection utility
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
d59b087e50 ceph-volume util.encryption add helpers for legacy devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
548a74bd23 ceph-volume util.constants add ceph-disk partition labels
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:55 -05:00
Alfredo Deza
b90044c2ff ceph-volume util.disk support PKNAME and absolute paths in lsblk
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-30 16:33:54 -05:00
Casey Bodley
22df0fbffd rgw: civetweb accepts multiple port= entries
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-01-30 13:35:30 -05:00
Andrew Schoen
7c809166ae ceph-volume: prepare_* methods do not need to recreate fsid or osd_id
The prepare_filestore and prepare_bluestore methods do not need to
attempt to recreate osd_id or fsid because this happens in prepare
already.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-30 11:39:05 -06:00
Andrew Schoen
a08fc63961 ceph_volume: modify util.prepare.check_id to handle stdout as a list
process.call returns stdout as a list, not a string

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-30 11:32:53 -06:00
Casey Bodley
cf1b84195e rgw: frontend config uses multimap
this allows us to configure multiple values for a given key without
resorting to string formatting to cram them into a single key/value pair

ex. port=80 port=443s instead of port=80+443s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-01-30 12:05:52 -05:00
Casey Bodley
9cdd2fe658
Merge pull request #20000 from zhouyuan/rgw_beast_listen
rgw: allow beast frontend to listen on specific IP address

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-30 12:04:47 -05:00
Casey Bodley
50917930b9
Merge pull request #20058 from cbodley/wip-doc-rgw-frontends
doc/rgw: add page for http frontend configuration

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-01-30 11:38:06 -05:00
Patrick Donnelly
0d6c5927ba
Merge PR #20165 into master
* refs/pull/20165/head:
	doc/client: uniform naming

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-30 08:35:58 -08:00
Casey Bodley
8ccefcbacd
Merge pull request #20164 from luomuyao/typo
rgw: fix a typo in comment

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-01-30 11:29:45 -05:00
Andrew Schoen
0d27fff319 ceph-volume: tests for util.prepare.check_id
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-30 09:22:58 -06:00
Andrew Schoen
699aa65878 ceph-volume: return osd_id from util.prepare.check_id if it exists
This also changes this so the osd_id is returned as a string so
an ID of 0 would evaluate to True.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-30 09:21:47 -06:00
Casey Bodley
95ad024c3c log: clear thread-local stream's ios flags on reuse
when reusing a thread-local std::ostream for a new log entry, clear any
ios flags (ie eofbit/failbit/badbit) that may have been set during its
previous use

without this, any stream errors (for example, passing a nullptr to
operator<< sets the badbit) will result in all log output on that thread
to be blank for the remainder of the process

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-01-30 09:28:01 -05:00
Kefu Chai
8ea03a78d5 test/cli/crushtool: add test for --add-bucket and --move
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-30 22:09:59 +08:00
Kefu Chai
c1f4334345 crush/CrushWrapper: lower log level of check_item_loc()
it's not an error if the item is not at loc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-30 22:09:58 +08:00
Kefu Chai
22c943511e crushtool: add --move
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-30 22:09:58 +08:00
Jason Dillaman
5b95c51a75
Merge pull request #20159 from shun-s/fix-rbd-log
librbd: clean up ManagedLock log prefix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-30 08:10:41 -05:00
Kefu Chai
4525003908 crushtool: add --add-bucket
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-30 19:09:09 +08:00
Gu Zhongyan
b0d8043a72 common/pick_address: wrong prefix_len in pick_iface()
With prefix_len initialized as zero, mask in netmask_ipv4/6()
will always be zero, so find_ip_in_subnet() always return the
first interface.
Set prefix_len to the right value to fetch the right interface.

Signed-off-by: Gu Zhongyan guzhongyan@360.cn
Signed-off-by: yupeng chen chenyupeng-it@360.cn
2018-01-30 18:37:34 +08:00
xie xingguo
cdae240ed9 pybind/mgr/balancer: fix sanity check against minimal pg numbers per pool
And rename some variables properly.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-01-30 17:02:41 +08:00