Commit Graph

88128 Commits

Author SHA1 Message Date
Nathan Cutler
a1d4f9d57c
Merge pull request #22922 from smithfarm/wip-argparse-py3
tests: make test_ceph_argparse.py pass on py3-only systems

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-07 09:52:04 +02:00
Kefu Chai
71e4255f3b
Merge pull request #22912 from tchaikov/wip-cmake-cleanup
cmake: remove workarounds for supporting cmake 2.x

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-07 14:38:54 +08:00
Nathan Cutler
5ed075d77f tests: make test_ceph_argparse.py pass on py3-only systems
On systems that do not have Python 2 installed, this test fails to
import StringIO.

Fixes: http://tracker.ceph.com/issues/24816
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-07 00:47:34 +02:00
Sage Weil
d5468145b3 Merge PR #22863 into master
* refs/pull/22863/head:
	rgw: fix gc may cause a large number of read traffic

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-06 13:51:30 -05:00
Yuri Weinstein
cb467fccb9
Merge pull request #20779 from oritwas/wip-rgw-23257
rgw: radogw-admin reshard status command should print text for reshard status

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-07-06 11:49:00 -07:00
Yuri Weinstein
6e156812d8
Merge pull request #22721 from linuxbox2/wip-rgw-23099
rgw: escape markers in RGWOp_Metadata_List::execute

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-07-06 11:46:13 -07:00
Sage Weil
884a0d24ab Merge PR #22745 into master
* refs/pull/22745/head:
	debian/control: require sudo
	ceph.spec: require sudo
	ceph.spec: install etc/sudoers.d/ceph-osd-smartctl
	debian: install etc/sudoers.d/ceph-osd-smartctl
	sudoers.d/ceph-osd-smartctl: allow user ceph to run smartctl as root

Reviewed-by: Erwan Velu <erwan@redhat.com>
2018-07-06 13:43:15 -05:00
Sage Weil
f5df6ddeb2 Merge PR #22858 into master
* refs/pull/22858/head:
	osd/PrimaryLogPG: rebuild attrs from clients

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-06 13:43:03 -05:00
Sage Weil
bc4381691a Merge PR #22870 into master
* refs/pull/22870/head:
	mgr: replace iteritems with six.iteritems (mgr_module.py)
	mgr: replace iteritems with six.iteritems (crash)
	mgr: replace iteritems with six.iteritems (telegraf)
	mgr: replace iteritems with six.iteritems (status)
	mgr: replace iteritems with six.iteritems (restful)
	mgr: replace iteritems with six.iteritems (influx)
	mgr: replace iteritems with six.iteritems (balancer)

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-06 13:42:58 -05:00
Sage Weil
dc87c3c580 githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-06 13:42:57 -05:00
Sage Weil
15732cdfc1 Merge PR #22871 into master
* refs/pull/22871/head:
	deb/rpm: add python-six as build-time and run-time dependency

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-07-06 13:42:38 -05:00
Sage Weil
7d287ff30a Merge PR #22873 into master
* refs/pull/22873/head:
	os/bluestore: fix incomplete faulty range marking when doing compression

Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-06 13:42:34 -05:00
Kefu Chai
34f1ee7897 cmake: remove workarounds for supporting cmake 2.x
and bump up the required cmake version to 3.5.1

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-07 01:24:02 +08:00
Kefu Chai
00d1038d1d
Merge pull request #22896 from tchaikov/wip-cmake3
deb,rpm,do_cmake: switch to cmake3

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2018-07-07 00:46:16 +08:00
Yuri Weinstein
0a9871b17e
Merge pull request #22619 from zhangsw/fix-rgw-deletemarker-bug
rgw: The delete markers generated by object expiration should have owner attribute.

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-07-06 07:43:05 -07:00
Yuri Weinstein
bb0b5cd000
Merge pull request #22145 from Jeegn-Chen/wip-issue-24223
rgw: reject invalid methods in validate_cors_rule_method

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-06 07:02:06 -07:00
Yuri Weinstein
3410d641a0
Merge pull request #22452 from theanalyst/wip-placement-target-warn
rgw: warn if zone doesn't contain all zg's placement targets

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-06 07:00:55 -07:00
Yuri Weinstein
745d6a6c26
Merge pull request #22614 from tianshan/fix_24563
rgw: fix copy response header etag format not correct

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-06 07:00:21 -07:00
Yuri Weinstein
3c3e02c21a
Merge pull request #22623 from zhangsw/fix-rgw-lifecycle-rule-num
rgw: Limit the number of lifecycle rules on one bucket.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-07-06 06:58:07 -07:00
Yuri Weinstein
84be9c4947
Merge pull request #22635 from zhangsw/fix-rgw-admin-objectexpire-bug
rgw: "radosgw-admin objects expire" always returns ok even if the process fails.

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-06 06:57:10 -07:00
Kefu Chai
af2c91ace6 deb,rpm,do_cmake: switch to cmake3
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-06 13:29:21 +08:00
Sage Weil
6b0a270842 debian/control: require sudo
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-05 16:28:01 -05:00
Sage Weil
72fcace746 ceph.spec: require sudo
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-05 16:27:55 -05:00
Alfredo Deza
eeadc06a31
Merge pull request #22878 from falcon78921/wip-falcon78921-docs-install
doc: fixed minor typo in Debian packages section

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-07-05 13:32:01 -04:00
James McClune
0bf4d59634
doc: fixed minor typo in Debian packages section
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-07-05 13:14:20 -04:00
Nathan Cutler
093562f6de mgr: replace iteritems with six.iteritems (mgr_module.py)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
9aa1d49583 mgr: replace iteritems with six.iteritems (crash)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
ab001e1342 mgr: replace iteritems with six.iteritems (telegraf)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
5866377ec3 mgr: replace iteritems with six.iteritems (status)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
c02c660175 mgr: replace iteritems with six.iteritems (restful)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
a62ab8ae8c mgr: replace iteritems with six.iteritems (influx)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
962f0c416c mgr: replace iteritems with six.iteritems (balancer)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:15 +02:00
Igor Fedotov
643192e715
Merge pull request #22874 from ddiss/bluestore_docs
doc/bluestore: fix minor typos in compression section

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-07-05 17:51:00 +03:00
Igor Fedotov
0f04d4484c os/bluestore: fix incomplete faulty range marking when doing compression
GC.

Under some scenarios GC might process an extent range where some inner extents are left untouched by GC (as there is no need for that). Hence GC doesn't invaliate these inner extents with fault_range call. If untouched extents are mapped to unloaded shards it results in subsequent assertion on o->extent_map.dirty_range() call.
The solution is to invalidate the whole extent range when doing GC.

Fixes: https://tracker.ceph.com/issues/23540

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-07-05 17:47:37 +03:00
Casey Bodley
3c6797c974
Merge pull request #22617 from tianshan/fix_http_err_return
rgw: set cr state if aio_read err return in RGWCloneMetaLogCoroutine

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-05 09:48:57 -04:00
Nathan Cutler
7467777429
Merge pull request #22793 from kshtsk/wip-add-opensuse-leap
Add new OpenSUSE Leap id for install-deps.sh

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 15:39:26 +02:00
Orit Wasserman
14d25dca34 rgw: radogw-admin reshard status command should print text for reshard status
Fixes: http://tracker.ceph.com/issues/23257
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2018-07-05 15:58:19 +03:00
David Disseldorp
fbc3330102 doc/bluestore: fix minor typos in compression section
Signed-off-by: David Disseldorp <ddiss@suse.de>
2018-07-05 13:41:35 +02:00
Lenz Grimmer
54037e5214
Merge pull request #22829 from tspmelo/fix-24757
mgr/dashboard: Fix regression on rbd form component

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-07-05 12:46:28 +02:00
Lenz Grimmer
bc1743e732
Merge pull request #22762 from ricardoasmarques/wip-toolbar-text
mgr/dashboard: Remove top-right actions text and add "About" page

Reviewed-by: Kanika Murarka <murarkakanika@gmail.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-05 12:44:52 +02:00
Kefu Chai
e53bb2c5a3 deb/rpm: add python-six as build-time and run-time dependency
python-six is used by dashboard's controllers. please note,
${python:Depends} is able to fill the installation dependencies for
debian package. so python-six is not added to Requires of ceph-mgr.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-05 18:42:57 +08:00
Kefu Chai
0e76e87d35
Merge pull request #20133 from smithfarm/wip-redundant-recommends
build/ops: deb: drop redundant ceph-common recommends

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-05 14:45:24 +08:00
liaoxin01
afc3b1ab1f rgw: fix gc may cause a large number of read traffic
fix http://tracker.ceph.com/issues/24767

Signed-off-by: Xin Liao <liaoxin01@baidu.com>
2018-07-05 14:24:21 +08:00
Kefu Chai
9e08278907
Merge pull request #22847 from ErwanAliasr1/evelu-ccache2
run-make-check.sh: Adding ccache tuning for the CI

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-05 11:39:18 +08:00
Sage Weil
6dbf8ad2ec Merge PR #22703 into master
* refs/pull/22703/head:
	doc/mgr: add doc for crash mgr module
	qa/suites/rados/mgr: Add test_crash
	qa/tasks/mgr: add test_crash, call from test_module_selftest
	qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
	mgr/pybind/crash: handle crashdumps

Reviewed-by: John Spray <john.spray@redhat.com>
2018-07-04 14:22:18 -05:00
Sage Weil
c5b449865f Merge PR #22704 into master
* refs/pull/22704/head:
	osd/PG: do not send notify to empty peer
	osd/PG: do not assume delete event means found_missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-04 14:22:13 -05:00
Sage Weil
7895d5b746 Merge PR #22733 into master
* refs/pull/22733/head:
	os/bluestore: set correctly shard for existed Collection.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-07-04 14:22:08 -05:00
Sage Weil
0cb7b47d4a Merge PR #22738 into master
* refs/pull/22738/head:
	mgr/status: add exabytes unit

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-04 14:22:00 -05:00
Sage Weil
b12dfc15b2 Merge PR #22534 into master
* refs/pull/22534/head:
	msg/Messenger: use safe_item_history<> for my_addrs
	msg/simple: fix set_myaddrs()
	msg/Messenger: use mutable_item_history<> for my_addrs
	common/item_history: container to support lockless reads, infrequent updates
	msg/simple/Accepter: fix my_addr == my_addrs.v[0] constraint
	msg/async: track target_addr for each connection
	msg/async: mark accepted connections with addr type (legacy or msgr2)
	msg/async: mark AsyncConnection with msgr2 flag
	msg/async: track connections by addrvec
	mon/Session: inst -> name and addrs
	osd/OSDMap: don't print hb addrs
	msg/DispatchQueue: myaddr -> myaddrs
	mgr: myaddr -> myaddrs
	msg: make set_addr_unknowns take an addrvec
	mon/LogMonitor: myaddr -> myaddrs
	librados: myaddr -> myaddrs
	common/LogClient: myaddr -> myaddrs
	client: myaddr -> myaddrs
	osd/OSDMap: is_blacklisted() for addrvecs
	osd: populate metadata with all addrs
	mds: addr -> addrvec
	mon/MonClient: get_myaddrs()
	mon/OSDMonitor: addrvec blacklist helper
	mds: use new pick_addresses
	ceph-osd: use new bindv()
	msg/async: bind to multiple addresses
	msg/async: (legacy) handshake using legacy addr
	msg/async: fix some debug prefixes
	msg/async: multiple listening ServerSockets
	osd/OSDMap: make cluster addrs addrvecs too
	msg/Messenger: my_addr -> my_addrs
	msg/Connection: peer_addr -> peer_addrs
	msg/msg_types: hash<> for entity_addrvec_t
	mgr/DaemonServer: use new bindv() and pick_addresses()
	msg/Messenger: new bindv() that takes an addrvec
	common/pick_address: fill in ipv4/6 and msgr1/msgr2 via config options
	common/pick_addresses: new addrvec-based pick_addresses()
	common/pick_addresses: add filtering by ipv4 and ipv6
	CEPH_MON_PORT -> CEPH_MON_PORT_LEGACY; define CEPH_MON_PORT_IANA
	osd: kill osd_heartbeat_addr option
	common/options: add addrvec option type

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-07-04 14:20:27 -05:00
Sage Weil
0a0f8d5e6f osd/PrimaryLogPG: rebuild attrs from clients
Ensure that buffers coming in via client ops are rebuilt before populating
the PGTransaction.  This ensures that we don't pin the raw buffers for
the entire incoming message in memory.

In the past we've addressed this issue at the ObjectStore layer, but we
did not consider the attr_cache in ObjectContext.  Rebuilding the buffers
at this point will sanitize any incoming attribute before it reaches
either PGBackend or ObjectContext object_cache or the ObjectStore
implementation.

Fixes: http://tracker.ceph.com/issues/24768
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-04 14:19:04 -05:00