Commit Graph

70282 Commits

Author SHA1 Message Date
Kefu Chai
09c977869d Merge pull request #14124 from Fabian-Gruenbichler/ipv6_fix
common: fix segfault in public IPv6 addr picking

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-02 01:41:50 +08:00
Kefu Chai
c2432a5a6b Merge pull request #14173 from badone/wip-do_request-abort
common: Fix heap buffer overflow in do_request

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-02 01:40:30 +08:00
Kefu Chai
e2b7cc00d9 Merge pull request #14193 from liupan1111/wip-fix-delete-full
librados: set the flag CEPH_OSD_FLAG_FULL_TRY of Op in the right place.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-02 01:39:46 +08:00
Kefu Chai
3f92a8522f Merge pull request #14248 from badone/wip-simple_spin_lock-delay
common: Make spinlock delay more conventional

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-02 01:38:13 +08:00
Kefu Chai
6ae3ce9148 Merge pull request #13690 from jcsp/wip-17503
mgr: pass through cluster log to plugins

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-02 01:37:31 +08:00
Orit Wasserman
ea9331e484 Merge pull request #14276 from atheism/rgw-rgwop-remove-unused-iter
rgw: rgw_op: remove unused variable iter
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-01 09:48:46 +03:00
Weibing Zhang
d5a525c645 rgw: rgw_op: remove unused variable iter
The variable iter is not used in  RGWInitMultipart::execute().

Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>
2017-04-01 11:52:59 +08:00
Sage Weil
c4ba267245 Merge pull request #13811 from rzarzynski/wip-bs-bitmap-mem-cleanup
os/bluestore: memory and dereference clean-up in the BitAllocator

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-31 20:54:22 -05:00
Sage Weil
cc6a88ec2c Merge pull request #14121 from majianpeng/bluefs-get-allocated
os/bluestore/BlueFS: optimize get_allocated

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-31 20:54:07 -05:00
Sage Weil
841de704cf Merge pull request #14162 from majianpeng/optimize-bluestore-force-flush
os/bluestore: clean up flush logic

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-31 20:53:57 -05:00
Sage Weil
b19613f8ab Merge pull request #14225 from ivancich/wip_fix_throttle_config_change
os/bluestore: make live changes for BlueStore throttle config work like initial config

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-31 20:52:59 -05:00
vasukulkarni
574049a90b Merge pull request #14229 from ceph/wip-systemd
qa: Add reboot case for systemd test
2017-03-31 09:15:53 -07:00
John Spray
992b8499d0 Merge pull request #14254 from idryomov/wip-vstart-runner-ps
qa/vstart_runner: amend ps invocation

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-31 17:15:30 +01:00
vasukulkarni
b6895fbe0e Merge pull request #14226 from ceph/preset-mon
systemd: remove ceph-create-keys from presets
2017-03-31 09:15:21 -07:00
Sage Weil
59548509ef Merge pull request #14266 from tchaikov/wip-require-mgr-for-pg-dump
tests: add MGR=1 so 'pg dump' won't be blocked

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-03-31 10:58:56 -05:00
Sage Weil
e5b07011b2 Merge pull request #14259 from johnwilkins/wip-doc-multisite
doc: wip-doc-multisite ports downstream multisite document upstream.
2017-03-31 10:52:53 -05:00
Kefu Chai
8a3b48551a osd/OSDMap: use _pg_to_up_acting_osds() to get_pg_acting_primary()
avoid unnecessary swap() call of vector<int> which will be dropped on
the floor after getting its first element, which can be retrieved using
another parameter using _pg_to_up_acting_osds() directly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-31 18:32:43 +08:00
Kefu Chai
73c75b97c5 mgr: use OSDMap::get_pg_acting_primary() to get the primary
OSDMap::pg_to_acting_osds() assumes that the "acting" parameter is not
null.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-31 18:31:05 +08:00
Kefu Chai
63f69e04df tests: add MGR=1 so 'pg dump' won't be blocked
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-31 14:26:09 +08:00
Kefu Chai
8f8575a4eb Merge pull request #14260 from dmick/wip-workunit-clone-with-branch
workunit: request branch when cloning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-31 13:17:46 +08:00
Brad Hubbard
34481768cb common: Make spinlock delay more conventional
The accepted method of implementing a spinlock delay is the "pause"
instruction.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-31 14:33:32 +10:00
Kefu Chai
9ca7ccf5f1 tasks/workunit.py: specify the branch name when cloning a branch
c1309fb failed to specify a branch when cloning using --depth=1, which
by default clones the HEAD. and we can not "git checkout" a specific
sha1 if it is not HEAD, after cloning using '--depth=1', so in this
change, we dispatch "tag", "branch", "HEAD" using three Refspec classes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-03-30 20:30:09 -07:00
Sage Weil
b782b3716e Merge pull request #14219 from ShiqiCooperation/master
os/bluestore: clean up Invalid return value judgment

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-30 17:23:09 -05:00
Sage Weil
b0ed37a2dc Merge pull request #14228 from ifed01/wip-bluestore-fix-store-test
test/store_test: fix bluestore test cases disablement

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-03-30 17:21:55 -05:00
Sage Weil
578b0f7cfc Merge pull request #13617 from liewegas/wip-mgr-commands
mon,mgr: tag some commands for ceph-mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-30 17:12:00 -05:00
Sage Weil
d0a3f156b2 mon/ConfigKeyService: wait for quorum
Among other things, this prevents a mgr activation stall if it
happens to request config-keys from a mon that is out of
quorum.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-30 17:57:35 -04:00
Sage Weil
319b72380e mon/MgrMonitor: show delta
This is mostly because I couldn't debug a weird state where
it kept updating but it appeared the addr was not changing
(always '-').

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-30 17:57:35 -04:00
Sage Weil
dc49857a65 mon/MgrMap: implement dump, add to ceph-dencoder
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-30 17:57:35 -04:00
Sage Weil
dacb05251d mon/MgrMonitor: print MgrMap to log on each change
The other services do this.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-30 17:57:35 -04:00
Sage Weil
31419d0e0f mon/MgrMonitor: health warn/err if no active mgr
Start warning once mons are luminous; start erroring once
require_luminous is set in osdmap.  Allow a grace period for
mgr to restart or standby to take over before we turn a warning
into an error.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-30 17:57:34 -04:00
John Wilkins
925f290023 Ported the downstream (and tested) document upstream.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-03-30 14:54:42 -07:00
John Wilkins
1eda9918f3 Clarified index.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-03-30 14:53:49 -07:00
John Wilkins
f80981248c doc: Added a new version of the multi-site graphic.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-03-30 14:07:07 -07:00
Orit Wasserman
0008a1a51d Merge pull request #14183 from joscollin/wip-rgw-cleanup-removeunwantedheaders
rgw: Removed Unwanted headers
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-03-30 20:44:12 +03:00
Yehuda Sadeh
68d26da678 Merge pull request #14194 from joscollin/wip-rgw_rados-warning
rgw: warning, output may be truncated before the last format character

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-30 10:43:37 -07:00
Ilya Dryomov
8d8cd4e4d5 qa/vstart_runner: amend ps invocation
"ps -xwwu<id>" is parsed as BSD, because -x is not a UNIX option.
"u" is a BSD option for user-oriented format, so the <id> ends up being
parsed as an old-style "select by pid".  The only reason this command
doesn't dump other user's processes is that the BSD "only yourself"
restriction is in effect.

I'm not sure what's wrong with a simple "ps xww", but if we want to
select by euid, let's do it right.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-03-30 19:36:43 +02:00
Mykola Golub
2e68099a17 Merge pull request #14253 from liupan1111/wip-remove-debug-message
rbd-nbd: remove debug messages from do_unmap

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-30 20:24:03 +03:00
Kefu Chai
ea093baec9 Merge pull request #13999 from tchaikov/wip-extract-creating-pgs
mon,osd: decouple creating pgs from pgmap

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-31 00:35:45 +08:00
Pan Liu
cd748f9b26 rbd-nbd: remove debug message from do_unmap
Global context is not initialized when do_unmap is called.

Signed-off-by: Pan Liu <liupan1111@gmail.com>
2017-03-31 00:23:12 +08:00
Kefu Chai
d3e6a2869b tools/ceph-objectstore-tool: always set first_committed
otherwise the workaround of 7fb3804fb is triggered. we need to remove
that workaround later on.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
9331cedd96 mon: switch to osdmon when handling osd_pg_creates subs
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
616e970ada mon/OSDMonitor: avoid search and lookup anti-pattern
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
ebde28b683 mon/OSDMonitor: pass by reference not pointer of const param
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
f61853ae89 mon/OSDMonitor: switch to the new creating_pgs
* prime_pg_temp(): switch to the new creating_pgs
* get_trim_to(): switch to the new creating_pgs

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
a316eb3078 mon: handle MOSDPGCreated messages
MOSDPGCreated messages are used to prune the creating_pgs_by_osd_epoch
and creating_pgs, by updating created_pools. as once a pool is created
we will not send MOSDPGCreate to its acting_primary OSD anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
a2e39d91c9 osd: send pg-created message if any pg is newly created
add an option named "osd_created_report_interval" to specify the
interval to check and send the "pg_created" mesages to mon

because pg could update its state when it is still in the pg_stat_queue,
for example, to change its state to PG_STATE_CLEAN, we cannot tell if we
have sent a "pg-created" message for it or not without introducing a new
member variable in PG.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:18 +08:00
Kefu Chai
e5ea630e9f messages/MPGCreated: add MPGCreated
add a new message type MPGCreated. osd is supposed to send this message
to monitor to inform that any pg(s) is created and activated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:17 +08:00
Kefu Chai
43ded67243 mon/OSDMonitor: add send_pg_create() to OSDMonitor
OSDMonitor will handle the pg-create subscriptions after luminous.
1. scan new pools to get the pgs to be created
2. send pg creates using the collected pgs
3. trim the creating_pgs using the "created!" messages from OSD.

please note that we need to wait for the OSDMonitor::mapping to be fully
populated, so we cannot scan the incrementa map for creating pgs until
it is applied and accepted by other monitors.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:17 +08:00
Kefu Chai
df6dafe1bb mon: acquire lock when accessing mon->session_map
we will access the mon->session_map for sending the osd-pg-creates
messages when finishing osdmapping in OSDMonitor, this could happen in
another thread without the protection of Monitor::lock, or in the same
thread already guarded by Monitor::lock. so instead of changing
Monitor::lock to a recursive lock, a new lock is introduced to protect
session_map.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:17 +08:00
Kefu Chai
11f82480a0 mon/OSDMonitor: run mapping on peons also
otherwise subcriptions on peons won't get the creating_pgs notification
mapping updated. we want to send the notification from peons also. and
the notifications should be updated with the updated pg mapping.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-30 20:21:17 +08:00