Commit Graph

80225 Commits

Author SHA1 Message Date
Kefu Chai
c8d4005558 cmake,deb: remove the last trace of atomic_ops
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-03 16:23:42 +08:00
Kefu Chai
c43bac48b0 cmake: fix indent
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-03 16:23:26 +08:00
Kefu Chai
4c2dd1607f cmake: remove unused definitions
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-03 16:23:12 +08:00
Kefu Chai
761c729779 cmake: do not link ${XIO_LIBRARY} if not necessary
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-03 16:22:59 +08:00
Kefu Chai
9502a8e521
Merge pull request #18695 from cooboos/wip-doc-wrongspell
doc/release-notes: fix typo 'psd' to 'osd'

Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-11-03 13:21:07 +08:00
wangsongbo
e0b0e911de doc: correct wrong spell 'psd' to 'osd'
Signed-off-by: wangsongbo wangsongbo@cloudin.cn
2017-11-03 12:49:11 +08:00
Yuri Weinstein
3c528845f6
Merge pull request #13992 from dreamhost/wip-19264
rgw: fix Swift container naming rules.

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-02 09:47:31 -07:00
Yuri Weinstein
931d1ba1e0
Merge pull request #18606 from adamemerson/wip-op-perm-refactor
rgw: Small refactor and two bug fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-11-02 09:46:20 -07:00
Kefu Chai
428c7751e2
Merge pull request #14955 from aclamk/fix-civetweb-cryptopp
radosgw: Make compilation with CryptoPP possible.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-02 23:59:03 +08:00
Orit Wasserman
87aff41a37
Merge pull request #18664 from oritwas/wip-rgw-21996
rgw: init oldest period after setting run_sync_thread
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-02 16:31:08 +02:00
Kefu Chai
9357e13a24
Merge pull request #18680 from tchaikov/wip-doc-mgr
doc/mgr: document facilities methods using `automethod` directive

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-02 20:39:25 +08:00
Kefu Chai
315cde54ad
Merge pull request #18685 from jcsp/wip-mgr-load-module
qa: fix mgr _load_module helper

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-02 20:20:52 +08:00
John Spray
4fb3025682 qa: fix mgr _load_module helper
I inadvertently broke this with the latest change
to the module ls output.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-11-02 07:42:56 -04:00
Alfredo Deza
02a0369879
Merge pull request #18656 from ceph/ceph-volume-bluestore-tests
ceph-volume: adds functional testing for bluestore
2017-11-02 07:30:39 -04:00
John Spray
737877fb38
Merge pull request #18399 from jcsp/wip-20950
mon: don't blow away bootstrap-mgr on upgrades

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-02 10:37:09 +00:00
Haomai Wang
0ee9fd2c14
Merge pull request #18681 from tchaikov/wip-msg-async-popcnt
msg/async: use bitset<> to do the popcnt

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-11-02 04:54:48 -05:00
Ilya Dryomov
c1d6f8364f
Merge pull request #18652 from idryomov/wip-qa-krbd-blkroset
qa/suites/krbd: add krbd BLKROSET test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-02 10:10:39 +01:00
Kefu Chai
79476d4e25 msg/async: use bitset<> to do the popcnt
libstdc++ uses popcnt to count the bits. it's faster and simpler.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-02 15:22:11 +08:00
Kefu Chai
220e038dc5 doc/mgr: document mgr/plugin using automethod
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-02 14:34:13 +08:00
Kefu Chai
b050f8a061 pybind/mgr: sync the docstring with the doc/mgr
also update the docstring to confirm to
http://www.sphinx-doc.org/en/stable/domains.html#info-field-lists.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-02 14:34:13 +08:00
Jason Dillaman
540b4cf575
Merge pull request #18619 from trociny/wip-qa-mirror-remove
qa/workunits/rbd: unnecessary sleep after failed remove

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-01 21:34:35 -04:00
Sage Weil
aa828be008
Merge pull request #17983 from liewegas/wip-balancer
mgr/balancer: make crush-compat mode work

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-01 14:46:07 -05:00
Orit Wasserman
cc3246cf46 rgw: add missing current_history initialization
Fixes: http://tracker.ceph.com/issues/21996
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-01 17:49:46 +02:00
Orit Wasserman
8b30167916 rgw: init oldest period after setting run_sync_thread
Fixes: http://tracker.ceph.com/issues/21996
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-11-01 17:48:41 +02:00
Matt Benjamin
e857d71acf
Merge pull request #18657 from cbodley/wip-21990
rgw: remove placement_rule from rgw_link_bucket()
2017-11-01 11:47:24 -04:00
Yuri Weinstein
1465a86ad9
Merge pull request #18534 from ZVampirEM77/wip-emlc-contentmd5
rgw: lc support Content-MD5 request header and fix a rgw crash bug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-11-01 08:27:29 -07:00
Yuri Weinstein
223f45e4e1
Merge pull request #18610 from cbodley/wip-osd-subop-num
osd: add processed_subop_count for cls_cxx_subop_version()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-11-01 08:24:13 -07:00
Yuri Weinstein
b51f285676
Merge pull request #18641 from joke-lee/rgw_modify_subuser_access_error
rgw: modify s3 type subuser access permissions fail through admin rest api

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-01 08:22:12 -07:00
Kefu Chai
2a3d3b87fe
Merge pull request #18659 from tchaikov/wip-21993
qa: stop testing deprecated "ceph osd create"

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-01 23:08:55 +08:00
Kefu Chai
01a65f0a0d
Merge pull request #15193 from mynaramana/arraycode
osd: introduce sub-chunks to erasure code plugin interface

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-01 22:50:24 +08:00
John Spray
e18a529c9b
Merge pull request #18637 from yaozongyou/fix-dashboard-bug
osd: make stat_bytes and stat_bytes_used counters PRIO_USEFUL

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-01 15:07:36 +01:00
Sage Weil
5ba89bf7ce
Merge pull request #18347 from Synesis-LLC/fix-21773
mgr: skip first non-zero incremental in PGMap::apply_incremental()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-01 08:39:11 -05:00
Sage Weil
1df0acca0e
Merge pull request #18453 from liewegas/wip-osd-devs
osd: enumerate device names in a simple way

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-01 08:36:59 -05:00
Sage Weil
4efbb32f6f
Merge pull request #18509 from tchaikov/wip-osd-cleanups
osd,mgrclient: pass daemon_status by rvalue ref and other cleanups

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-01 08:36:37 -05:00
Casey Bodley
8e62e35266 rgw: remove placement_rule from cls_user_bucket_entry
placement_rule is no longer needed in cls_user_bucket_entry, because the
only time that it's needed, we can read it from the bucket instance in
RGWRados::update_containers_stats()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-01 09:08:34 -04:00
Jason Dillaman
5220c7369f
Merge pull request #18504 from badone/wip-GroupSnapshotNamespace-group_pool-uninitialised
cls/rbd: Silence gcc7 maybe-uninitialized warning

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-01 09:08:33 -04:00
Casey Bodley
dd5d278a4f rgw: remove placement_rule from rgw_link_bucket()
with the fallback in RGWRados::update_containers_stats(), we no longer
need to pass placement_rule into the cls_user_bucket_entry

this removes the dependency between bucket entrypoint metadata and its
bucket instance metadata during multisite sync

Fixes: http://tracker.ceph.com/issues/21990

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-01 09:08:33 -04:00
Casey Bodley
531195d80d rgw: take placement_rule from bucket info in update_containers_stats
in case the cls_user_bucket_entry doesn't contain a placement_rule, take
it from the bucket instance info

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-01 09:08:27 -04:00
Sage Weil
a59a1df853 mgr/balancer: simplify pool_info tracking
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
2c300bc8d7 mgr/balancer: less verbose on 'eval' by default; add 'eval-verbose'
The verbose output is helpful for debugging and understanding what is
being measured, but most of the time all that you care about is the score.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
6513e8b0fc mgr/balancer: fix pg vs object terminology
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
3f0b50b50a mgr/balancer: restrict to time of day
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
297e2d65ab mgr/module: adjust osd_weight min step to .005
That should be ~1 PG or less on average; no real sense it taking a
step smaller than that!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
70b503495a mgr/balancer: if score regresses, take a few more steps
To avoid getting stuck in a local minima, take a few additional
steps if our score drops and see if it gets better.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
1ad3101818 mgr/balancer: allow 5% misplaced
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
0dbcf737ea mgr/balancer: more aggressive steps
We are smart enough to back off if we misplace too much.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
2c9c18d1ec qa/suites/rados/thrash/d-balancer: enable balancer in various modes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
861c37fd99 mgr/balancer: crush-compat: phase out osd_weights
Phase out the osd_weight values as we optimize the crush compat
weight set.  Allow a small regression in overall score if it means
we are taking a step to remove the osd_weight value.

Fix the 'osd reweightn' invocation.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
c2bba5820a mgr/balancer: crush_compat: cope with 'out' osds
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00
Sage Weil
f1f3014ffc mgr/balancer: stop if we get a perfect score
..and fix the 'worse' threshold (we're just working around floating
point imprecision; 1.01 was too coarse).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-01 07:28:49 -05:00