Commit Graph

67850 Commits

Author SHA1 Message Date
Kefu Chai
61b345eb65 Merge pull request #13090 from dzafman/wip-18624
Revert "PrimaryLogPG::failed_push: update missing as well"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 22:32:13 +08:00
Haomai Wang
2e6ba82496 Merge pull request #13096 from amirv/new_connect_arg
msg/RDMA: Fix broken compilation due to new argument in net.connect()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-25 22:22:22 +08:00
Sage Weil
9080596335 Merge pull request #9348 from LiumxNL/fix-mksnap
mon/OSDMonitor: make snaps on tier pool should not be allowed
2017-01-25 06:35:36 -06:00
Sage Weil
84ae7d2f86 Merge pull request #12937 from chendave/auth_method
auth: Enhancement for the supported auth methods

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:35:10 -06:00
Sage Weil
07cb98e45e Merge pull request #12992 from tchaikov/wip-demangle-on-freebsd
common/BackTrace: demangle on FreeBSD also

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-01-25 06:34:52 -06:00
Sage Weil
801fd3c25c Merge pull request #12620 from varadakari/wip-rocksdb-histogram
os/bluestore: kvdb histogram

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-25 06:34:24 -06:00
Sage Weil
a35a8ecfcb Merge pull request #13031 from dzafman/wip-calc-stats
osd: Calculate degraded and misplaced more accurately

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:33:48 -06:00
Sage Weil
3c5928091b Merge pull request #13032 from liewegas/wip-bluefs-append
os/bluestore/BlueFS: tune flushing of writes

Tested-by: Chagam, Anjaneya <anjaneya.chagam@intel.com>
2017-01-25 06:24:30 -06:00
Sage Weil
2947cf3c6d Merge pull request #13072 from wido/issue-18638
osd: Return correct osd_objectstore in OSD metadata

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-25 06:22:41 -06:00
Sage Weil
c5663a78d5 Merge pull request #13018 from songbaisen/s11
global: we need to handle the init_on_startup return value when global_init.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 06:22:15 -06:00
Amir Vadai
a579329333 msg/RDMA: Fix broken compilation due to new argument in net.connect()
Fixes: 6e4ed291af ("msg: add ms_bind_before_connect to bind before connect")
Change-Id: Ia45f215b5d59dfc8545017518e5162404059829e
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-01-25 10:39:11 +02:00
David Zafman
1642adda32 Revert "PrimaryLogPG::failed_push: update missing as well"
This reverts commit dd48b972af.

Fixes: http://tracker.ceph.com/issues/18624

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-01-24 16:31:59 -08:00
Adam C. Emerson
5ce40363ae Merge pull request #12445 from pritha-srivastava/wip_glob_func
rgw: Added a globbing method for AWS Policies.
2017-01-24 15:16:44 -05:00
Matt Benjamin
3534595021 Merge pull request #13084 from linuxbox2/wip-librgw-parentref
rgw_file:  interned RGWFileHandle objects need parent refs
2017-01-24 14:58:58 -05:00
Sage Weil
3140a52f58 Merge pull request #13083 from dachary/wip-15653-crush-weights
crush: verify weights is influenced by the number of replicas

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-24 13:52:52 -06:00
Mykola Golub
d4932a7c96 Merge pull request #13076 from dillaman/wip-18617
test: use librados API to retrieve config params

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-24 21:32:13 +02:00
David Zafman
2c7de6c5dd Merge pull request #12866 from dzafman/wip-18471
qa/workunits/ceph-helpers: wait_for_clean() races with pg creation

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 11:02:38 -08:00
Matt Benjamin
0e5299f3f4 rgw_file: interned RGWFileHandle objects need parent refs
RGW NFS fhcache/RGWFileHandle operators assume existence of the
full chain of parents from any object to the its fs_root--this is
a consequence of the weakly-connected namespace design goal, and
not a defect.

This change ensures the invariant by taking a parent ref when
objects are interned (when a parent ref is guaranteed).  Parent
refs are returned when objects are destroyed--essentially by the
invariant, such a ref must exist.

The extra ref is omitted when parent->is_root(), as that node is
not in the LRU cache.

Fixes: http://tracker.ceph.com/issues/18650

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-24 12:57:11 -05:00
Matt Benjamin
748f0a6fb9 Merge pull request #13038 from linuxbox2/wip-librgw-invalidate
rgw_file: add timed namespace invalidation
2017-01-24 12:15:12 -05:00
Kefu Chai
47c59be6e1 Merge pull request #12916 from Liuchang0812/xmlformatter-fix
common/xmlformatter: turn on underscored and add unittest

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 23:20:16 +08:00
Jason Dillaman
d934aa2942 librbd: improve debug logging for lock / watch state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:48:43 -05:00
Jason Dillaman
2ed02f3cd5 test: use librados API to retrieve config params
The CephContext object is not ABI-stable, so it is necessary to
use the "conf_get" librados methods to safely retrieve a setting.

Fixes: http://tracker.ceph.com/issues/18617
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:29:59 -05:00
Loic Dachary
24cb06a96d crush: verify weights is influenced by the number of replicas
Refs: http://tracker.ceph.com/issues/15653

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-01-24 15:14:45 +01:00
Matt Benjamin
deb2c1ea98 rgw_file: add timed namespace invalidation
With change, librgw/rgw_file consumers can provide an invalidation
callback, which is used by the library to invalidate directories
whose contents should be forgotten.

The existing RGWLib GC mechanism is being used to drive this.  New
configuration params have been added.  The main configurable is
rgw_nfs_namespace_expire_secs, the expire timeout.

Updated post Yehuda review.

Fixes: http://tracker.ceph.com/issues/18651

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-24 08:21:33 -05:00
Haomai Wang
b2df030a50 Merge pull request #12956 from liuhongtong/wip-nvmedevice
os/bluestore: fix NVMEDevice::open failure if serial number ends with a …

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan liu <liupan1111@gmail.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-24 18:07:05 +08:00
Wido den Hollander
8fe6a0303b
osd: Return correct osd_objectstore in OSD metadata
Do not simply read the configuration value as it might have changed
during OSD startup by reading the type from disk.

Fixes: http://tracker.ceph.com/issues/18638

Signed-off-by: Wido den Hollander <wido@42on.com>
2017-01-24 08:22:34 +01:00
Haomai Wang
8558a0fe52 Merge pull request #13055 from optimistyzy/2017123_random_read
os/bluestore/NVMEDevice.cc: fix the random read issue.

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-24 12:01:27 +08:00
optimistyzy
c02e3e5266 os/bluestore/NVMEDevice.cc: use aio_wake in both read and read_random
There are some issues with random read, it seems that
we did not call aio_wake.

Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-01-24 11:35:45 +08:00
Sage Weil
7eddf919b4 Merge pull request #12929 from wjwithagen/wip-wjw-empty-cluster_network
common/pick_address.cc: Copy public_netw to cluster_netw if cluster empty

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 21:16:21 -06:00
Sage Weil
d0740a3514 Merge branch 'master' into wip-wjw-empty-cluster_network 2017-01-23 21:16:09 -06:00
Yuri Weinstein
f9f9b63e09 Merge pull request #12901 from yuyuyu101/wip-msgr-client-bind
msg: client bind

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 15:00:26 -08:00
Nathan Cutler
f848235d19 Merge pull request #13036 from SUSE/wip-michal-koutny
mailmap: Michal Koutny affiliation

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Michal Koutný <mkoutny@suse.com>
2017-01-23 22:25:34 +01:00
Jason Dillaman
20da91e881 Merge pull request #12326 from vshankar/wip-15028
librbd: create fewer empty objects during copyup

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-23 10:39:16 -05:00
Sage Weil
8f5fcfd857 os/bluestore/BlueFS: tolerate longer tail
The important requirement here is that we have enough buffer to write the
whole page.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-23 10:24:40 -05:00
Sage Weil
c776710a8e os/bluestore/BlueFS: increase size threshold before we flush (and generate io)
Having this too high means you might be more bursty. In practice,
though, the commit path is doing explicit syncs on small chunks
anyway.  And compaction work should probably stay reasonably chunky.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-23 10:21:09 -05:00
Sage Weil
7a53d4389e os/bluestore/BlueFS: preallocate larger write buffer
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-23 10:21:09 -05:00
Ramesh Chander
506a06a71e unittest_bit_alloc race fix
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 10:19:48 -05:00
Haomai Wang
2b2ab914b2 Merge pull request #13056 from optimistyzy/123_logic
NVMEDevice.cc: cleanup the logic in data_buf_next_sge

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-23 22:44:07 +08:00
Kefu Chai
1e8ca9bb90 Merge pull request #12938 from LiumxNL/fix-process-osd-failure
mon/OSDMonitor: fix process osd failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-23 20:07:35 +08:00
Kefu Chai
4f13f3e9b5 Merge pull request #9419 from songbaisen/a4
osdmaptool: show all the pg map to osds info

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 19:43:35 +08:00
Kefu Chai
d54f75d244 Merge pull request #12828 from donglinpeng/dlppull
common/buffer: close pipe fd if set nonblocking fails.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-23 19:42:14 +08:00
optimistyzy
edb0e7d4c6 NVMEDevice.cc: cleanup the logic in data_buf_next_sge
Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-01-23 11:00:02 +08:00
Sage Weil
65f5187e42 Merge pull request #12980 from liewegas/wip-osdop-printer
osd/osd_types: clean up OSDOp printers

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:45:37 -06:00
Sage Weil
1bda01736f osd/osd_types: clean up OSDOp printers
Specify which ones get offset~length instead of blacklisting those that
don't.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-22 11:44:46 -05:00
Sage Weil
55b96a3b65 Merge pull request #12950 from liewegas/wip-omap-getkeys
osd: extend OMAP_GETKEYS and GETVALS to include a 'more' output field

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-22 10:44:04 -06:00
Sage Weil
9a6a276aa2 Merge pull request #12961 from songbaisen/s10
crush:  when osd_location_hook does not exist, we should exit error.


Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:43:27 -06:00
Sage Weil
5dccac8697 Merge pull request #12975 from wonzhq/fix-pgstats-down
mon: don't set last_osd_report when the pg stats msg is ignored

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:43:00 -06:00
Sage Weil
c0b4ced7b1 Merge pull request #12976 from LiumxNL/wip-170118
osd/OSDMap: get_previous_up_osd_before() may run into endless loop

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:42:33 -06:00
Sage Weil
4bad4bd86a Merge pull request #12981 from liewegas/wip-crush-move-osd
mon/OSDMonitor: make 'osd crush move ...' work on osds

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:42:08 -06:00
Sage Weil
7495487e56 Merge pull request #13008 from athanatos/wip-clone-range
osd,librados: remove clone_range and associated multi-object cruft

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:41:55 -06:00