Commit Graph

67158 Commits

Author SHA1 Message Date
Ramesh Chander
2942bc627a consolidate allocator calls to single alloc_extent api
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-12-18 10:40:40 -08:00
Ramesh Chander
8ed5ec0277 allocator min_alloc arguments in call stack and tests
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-12-18 10:40:40 -08:00
Ramesh Chander
f9338b1a1f allocator alloc_extents min_alloc
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-12-18 10:40:40 -08:00
Ramesh Chander
6ad9814b93 os/bluestore:Bluefs balance should use alloc_extent api with bluefs_alloc_size
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-12-18 10:40:40 -08:00
Avner BenHanoch
daca8f6873 msg/async/rdma: fix bad message that went to the user
1. the printed value of "bad length" was incorrect, because 'r' was changed before the log line.
2. log appeared to user as error even though everything was calm; hence, reducing its severity

issue: 914840

Change-Id: I41520d27fc53fbbe07b61dd915e16448b87769d5
Signed-off-by: Avner BenHanoch <avnerb@mellanox.com>
2016-12-18 16:52:12 +00:00
Mark Korenberg
2ccd02a838 Fix startup of Ceph cluster manager daemon on Debian 8
Signed-off-by: Mark Korenberg <socketpair@gmail.com>
2016-12-18 18:07:21 +05:00
Loic Dachary
049641df2e Merge pull request #12531 from dachary/wip-18291-bluestore
ceph-disk: do not create bluestore wal/db partitions by default

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-18 09:59:23 +01:00
Loic Dachary
c83d030d30 ceph-disk: do not create bluestore wal/db partitions by default
Fixes: http://tracker.ceph.com/issues/18291

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-12-17 20:55:36 +01:00
liuchang0812
6fc0e59a1c doc: explain rgw_fcgi_socket_backlog in rgw/config-ref.rst
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-17 22:49:42 +08:00
Xie Xingguo
a30d90cdc6 Merge pull request #12458 from Liuchang0812/add-more-log-for-network-error
osd: enhance logging for osd network error

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-17 12:54:32 +08:00
liuchang0812
7ceadba31d ods: enhance logging for osd network error
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-17 12:07:36 +08:00
huangjun
9e19b86721 osd/ECBackend: remove unused variable "ReadCB"
Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-17 10:00:06 +08:00
Yunchuan Wen
25efc6f060 test: add new testcase for request admin_socket with long request
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-17 08:40:26 +08:00
Sage Weil
3cf1ca5d41 Merge pull request #12343 from liewegas/wip-bluestore-release
os/bluestore: simplify allocator release flow

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 17:40:47 -06:00
Sage Weil
45d698ebdc Merge pull request #12351 from xiexingguo/xxg-wip-bluestore-1207
os/bluestore: clear omap flag if parent has none

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 17:40:30 -06:00
Sage Weil
4444540d78 Merge pull request #12353 from xiexingguo/xxg-wip-bluestore-1207-01
os/bluestore: don't implicitly create the source object for clone

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 17:40:06 -06:00
Sage Weil
be4c0c7261 Merge pull request #12466 from kylinstorage/wip-remove-unused-class-declaration
remove unused declaration

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 17:39:44 -06:00
Sage Weil
2c7c27ab6c Merge branch 'master' into wip-remove-unused-class-declaration 2016-12-16 17:38:32 -06:00
Dan Mick
e72c80197b ceph.in: allow 'flags' to not be present in cmddescs
the 'flags' key in the command description dict may not be
present on older monitors.  Check for existence before
using it.

Introduced in 61d63433df

Fixes: http://tracker.ceph.com/issues/18297
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2016-12-16 14:59:17 -08:00
Sage Weil
26ab33ae79 Merge pull request #12538 from liewegas/wip-workunits
qa/tasks/workunit: retry on ceph.git if checkout fails

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-12-16 15:38:24 -06:00
Sage Weil
02d301bff0 Merge pull request #12534 from liewegas/wip-truncate-fix
osd/PrimaryLogPG: don't truncate if we don't have to for WRITEFULL

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 14:08:59 -06:00
Sage Weil
72d73b8c88 qa/tasks/workunit: retry on ceph.git if checkout fails
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-16 15:06:16 -05:00
Mykola Golub
4fe7e2a458 Merge pull request #12486 from dillaman/wip-18247
librbd: keep rbd_default_features setting as bitmask

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-12-16 21:15:02 +02:00
Sage Weil
de3186203f Merge pull request #12514 from vasukulkarni/wip-cd-shaman
qa/tasks/ceph_deploy: use dev option instead of dev-commit

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 11:46:38 -06:00
Samuel Just
2323aa17d4 ReplicatedPG: don't truncate if we don't have to for WRITEFULL
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-12-16 12:40:34 -05:00
Yehuda Sadeh
ed3e9c1d4d Merge pull request #10160 from jmunhoz/bugfix-16463-presigned-url
rgw: aws4: add presigned url bugfix in runtime

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-12-16 08:42:10 -08:00
Sage Weil
3d1ec3c9e4 Merge pull request #12530 from liewegas/wip-bluestore-ceph-disk
ceph-disk: adjust bluestore default device sizes

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-12-16 10:24:42 -06:00
Igor Fedotov
1b66857702 test: add mempool dump to Onode size tracking test case
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-16 16:14:54 +00:00
Igor Fedotov
9a7838790b os/bluestore: add an estimation for Onode in-memory size
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-16 15:51:21 +00:00
Sage Weil
38a501a28e Merge pull request #12516 from hjwsm1989/fix-rpg
osd/PG: fix the unreadable log in choose_acting

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 09:27:09 -06:00
Sage Weil
15fdc67c10 Merge pull request #12521 from kylinstorage/wip-for-coverity
osd/osdmap: fix divide by zero error

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-16 09:24:24 -06:00
Jeff Layton
9f8810008c client: set metadata["root"] from mount method when it's called with a pathname
Currently, we only set the root properly config file or the
--client_metadata command line option. If a userland client program
tries to call ceph_mount with a pathname, it's not being properly
set.

Since we already hold the mutex, we can just update it directly.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2016-12-16 10:19:18 -05:00
Sage Weil
478551e988 Merge pull request #12507 from ifed01/wip-bluestore-fix-cache
os/bluestore: fix target_buffer value overflow in Cache::trim()

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-16 09:02:12 -06:00
Jason Dillaman
1b0a9d8c8e Merge pull request #12525 from trociny/wip-18261
rbd: fix json formatting for image and journal status output

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-16 09:47:40 -05:00
Sage Weil
19346c7e67 ceph-disk: default DB size of 20GB
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-16 09:45:16 -05:00
Sage Weil
7a5051af2f ceph-disk: default WAL size of 576 MB
Enough for 2 256MB write buffers, and then some.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-16 09:45:06 -05:00
Jason Dillaman
8ddfb45326 librbd: keep rbd_default_features setting as bitmask
Support both human readable, comma delimited list of feature
names and also integer bitmask value. Attempting to read the
setting will always result in the feature bitmask integer
value.

This is required to avoid breaking backwards compatibility with
librbd clients that are dependent on the older behavior (e.g.
OpenStack).

Fixes: http://tracker.ceph.com/issues/18247
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-16 09:26:28 -05:00
Jason Dillaman
9a79286d4c Merge pull request #12407 from majianpeng/rbd-stripe-unit
rbd : make option --stripe-unit w/ B/K/M work

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-16 09:21:26 -05:00
Jason Dillaman
d5f3410863 Merge pull request #12484 from runsisi/wip-fix-rollback-warn
librbd: ignore error when object map is already locked by current client

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-16 08:45:48 -05:00
Mykola Golub
4c2659a0f4 rbd: fix json formatting for image and journal status output
Fixes: http://tracker.ceph.com/issues/18261
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-12-16 12:50:50 +02:00
huangjun
317100ad5b osd/ECBackend: only need check missing_loc when doing recovery
Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 18:14:23 +08:00
Jianpeng Ma
c5ce82e62d rbd: make option --stripe-unit w/ B/K/M work.
As 'man rbd' said:  --stripe-unit size-in-B/K/M. But w/ B/K/M, the
command failed and said invalid options. So fix it.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-12-16 17:56:04 +08:00
huangjun
73fc22590a osd/PrimaryLogPG: unify the access to primary pg
Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 17:47:55 +08:00
huangjun
7858f7e355 osd/ECBackend: Send write message to peers first, then do local write
Like ReplicatedBackend did, this will improve write performance.

  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 17:33:26 +08:00
Yunchuan Wen
61d3e4f38c osdmap: fix divide by zero error
*** CID 1397255:  Incorrect expression  (DIVIDE_BY_ZERO)
/home/brad/working/src/ceph/src/osd/OSDMap.cc: 2995 in
OSDMap::summarize_mapping_stats(OSDMap*, const std::set<long,
std::less<long>, std::allocator<long>> *,
std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char>> *, ceph::Formatter *) const()
2989         f->open_object_section("utilization");
2990       if (newmap) {
2991         if (f) {
2992           f->dump_unsigned("moved_pgs", moved_pg);
2993           f->dump_unsigned("total_pgs", total_pg);
2994         } else {
>>>     CID 1397255:  Incorrect expression  (DIVIDE_BY_ZERO)
>>>     In expression "(float)moved_pg * 100. / (float)total_pg",
division by expression "total_pg" which may be zero has undefined
behavior.
2995           ss << "moved " << moved_pg << " / " << total_pg
2996       << " (" << ((float)moved_pg * 100.0 / (float)total_pg) <<
"%)\n";
2997         }
2998       }
2999       if (f) {
3000         f->dump_float("avg_pgs", avg_pg);

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-16 17:28:35 +08:00
huangjun
5915fb3506 osd/PG: simplify the logic of backfill_targets checking
the final state is backfill_targets equals want_backfill,
  and backfill shards should not included in stray_set.
  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 16:58:14 +08:00
huangjun
fd68cf1b80 messages/MOSDPGTrim: add the missed HEAD_VERSION and COMPAT_VERSION
Fixes: http://tracker.ceph.com/issues/18266
  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 16:38:17 +08:00
Yunchuan Wen
52deb168b2 admin-socket: fix potential buffer overflow
Add code to ensure cmd[pos] is valid memory.

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-16 16:12:16 +08:00
huangjun
9897f0c6fc osd/PG: fix the unreadable log in choose_acting
To avoid the log like: failed to fill position ^B
  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-16 15:35:02 +08:00
Li Wang
1f2d54972e JournalingObjectStore: remove misleading comments
Prior to start journal commit, it always needs to wait the ongoing apply
operation to finish, not only needed during journal replay. Between
commit_start() and commit_started(), it always needs to prevent starting
apply, not only needed during journal replay.

Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-16 06:43:14 +00:00