Commit Graph

53589 Commits

Author SHA1 Message Date
John Spray
b6d2b6d1a5 client: report root's quota in statfs
When user is mounted a quota-restricted inode
as the root, report that inode's quota status
as the filesystem statistics in statfs.

This allows us to have a fairly convincing illusion
that someone has a filesystem to themselves, when
they're really mounting a restricted part of
the larger global filesystem.

Fixes: http://tracker.ceph.com/issues/15599
Signed-off-by: John Spray <john.spray@redhat.com>
2016-05-17 13:08:13 +01:00
Kefu Chai
b25ceb02b2 osd,mds: return error if injectargs fails
* test_osd_bench: the injectargs call actually fails due to the spaces
  at the beginning. so remove the spaces in args before sending it to
  injectargs
* update/add some injectargs tests accordingly

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2016-05-17 13:41:50 +08:00
Kefu Chai
b7babd6aa6 common/config: cast OPT_U32 options using uint32_t
the OPT_U32 options was translated using strict_si_cast<int>(), and then
cast the converted result to uint32_t. this could cause integer
underflow. we could have lifted the burden of checking invalid input
from the user of this option to the strict_si_cast<>() function. so in
this change, we use strict_si_cast<uint32_t>() instead, before casting
the converted value into `uint32_t`.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2016-05-17 13:41:50 +08:00
Kefu Chai
529260ffc1 osd: mark some class members as private
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-17 13:30:12 +08:00
Kefu Chai
82b0af7ced osd: reset session->osdmap if session is not waiting for a map anymore
we should release the osdmap reference once we are done with it,
otherwise we might need to wait very long to update that reference with
a newer osdmap ref. this appears to be an OSDMap leak: it is held by an
quiet OSD::Session forever.

the osdmap is not reset in OSD::session_notify_pg_create(), because its
only caller is wake_pg_waiters(), which will call
dispatch_session_waiting() later. and dispatch_session_waiting() will
check the session->osdmap, and will also reset the osdmap if
session->waiting_for_pg.empty().

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-17 13:23:43 +08:00
Kefu Chai
827320cb6d osd,auth: silence "-Wmisleading-indentation" warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-17 13:17:06 +08:00
Kefu Chai
046c38198a Message: make get_orig_*() alias of get_*()
not necessary to construct a entity_inst_t and then throw it away just
for extracting the entity_inst_t::name or entity_inst_t::addr.

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-17 12:45:06 +08:00
Kefu Chai
87850e96ea osd/OpRequest: reset connection upon unregister
this helps to free the resources referenced by the connection, among
other things, in the case of MOSDOp, the OSD::Session and OSDMap. this
helps to free the resource earlier and trim the osdmaps in time.

Fixes: http://tracker.ceph.com/issues/13990
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-17 12:45:06 +08:00
shawn
d07f2cb2fd OSD: erase duplicated header include
especially osd_types.h, maybe affect compile speed.
Signed-off-by: Xiaowei Chen <chen.xiaowei@h3c.com>
2016-05-16 23:05:41 -04:00
Josh Durgin
30af2cd071 test/objectstore/CMakeLists.txt: fix unittes_bit_alloc typoReviewed-by: Josh Durgin <jdurgin@redhat.com>
test/objectstore/CMakeLists.txt: fix unittes_bit_alloc typo
2016-05-16 16:46:01 -07:00
Yehuda Sadeh
a4839c5d4c Merge pull request #9118 from oritwas/wip-rgw-apache-realm-pull
rgw: fix realm pull and period pull for apache frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-05-16 16:41:25 -07:00
Samuel Just
6f9de92910 PrioritizedQueue: let filter_by_predicate use f to accumulate
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-05-16 16:40:56 -07:00
Samuel Just
17baff76e5 test/objectstore/CMakeLists.txt: fix unittes_bit_alloc typo
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-05-16 16:40:55 -07:00
Samuel Just
28cc10f5f7 osd/: move recovery into opwq
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-05-16 16:40:55 -07:00
Yehuda Sadeh
8fd74d1168 rgw: keep track of written_objs correctly
Fixes: http://tracker.ceph.com/issues/15886

Only add a rados object to the written_objs list if the write
was successful. Otherwise if the write will be canceled for some
reason, we'd remove an object that we didn't write to. This was
a problem in a case where there's multiple writes that went to
the same part. The second writer should fail the write, since
we do an exclusive write. However, we added the object's name
to the written_objs list anyway, which was a real problem when
the old processor was disposed (as it was clearing the objects).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-05-16 15:44:31 -07:00
Sage Weil
207e9eee45 Merge pull request #9152 from liewegas/wip-bitmap-allocator
os/bluestore: bitmap allocator

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-16 17:53:02 -04:00
Warren Usui
b09d85d7ab OpenStack setup scripts.
A set of scripts used to bring up an OpenStack instance on one site,
connect a ceph cluster, add pools to store OpenStack glance images,
cinder volumes, nova vms, and cinder backups on rbd, and bring up a nova
compute node.
2016-05-16 14:33:39 -07:00
Ramesh Chander
81acdd1a07 os/bluestore: bitmap allocator
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-05-16 17:32:39 -04:00
Ramesh Chander
fa4133ec05 os/bluestore: pass size to allocator
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-05-16 17:32:37 -04:00
Ramesh Chander
c3d3c512e9 os/bluestore: add config for allocator
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com
2016-05-16 17:31:50 -04:00
Yuri Weinstein
3d785ac585 Merge pull request #7787 from wjwithagen/patch-1
clang: common/config.cc basename() requires libgen.h includes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:43:51 -07:00
Yuri Weinstein
a1cf4771dc Merge pull request #8689 from runsisi/wip-fix-ev-sk
msg/async/EventSocket: fix missing break statement

Reviewed-by: Haomai Wang <yuyuyu101@163.com>
Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
2016-05-16 13:40:48 -07:00
Yuri Weinstein
a44443b3a1 Merge pull request #8717 from ZhenyuLeng/noneed_op_is_discardable
osd: make op_is_discardable check optional

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-16 13:36:58 -07:00
Yuri Weinstein
ba81cff36c Merge pull request #8961 from xiexingguo/xxg-wip-fixepochtrunc
osd: don't get inc osdmap name truncated

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:34:49 -07:00
Yuri Weinstein
a166658940 Merge pull request #8985 from badone/wip-iops-typo
common: obj_bencher.cc add missing ":"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:33:57 -07:00
Yuri Weinstein
f0e1cde9d6 Merge pull request #9011 from stiopaa1/osdmap_removeUnneededIncludeFiles
osd/OSDMap.h: remove unneeded include files

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-16 13:32:41 -07:00
Yuri Weinstein
ca3d00a99c Merge pull request #9075 from runsisi/wip-compute-cost
osd/ReplicatedBackend: reuse the already computed cost

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:30:49 -07:00
Yuri Weinstein
4a05803abb Merge pull request #9077 from liewegas/wip-osd-map-cache
osd: instrument map cache hits and misses

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
2016-05-16 13:27:40 -07:00
Yuri Weinstein
a025148c4b Merge pull request #9078 from liewegas/wip-clean-temps
mon, osdmap: optimize check and cleanup of pg_temp for new osdmaps

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:20:18 -07:00
Kefu Chai
8980f84078 Merge pull request #8298 from wjwithagen/wip-wjw-freebsd-autobuild-2
build: many fixes for freebsd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-17 01:07:17 +08:00
Sage Weil
b58173f96f Merge pull request #8480 from songbaisen/song19
crush: When consider rule size use the correct method.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:02:55 -04:00
Sage Weil
38b8031f62 Merge pull request #8974 from liewegas/wip-addr-cleanup
msg/msg_types: clean up entity_addr_t

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:02:15 -04:00
Sage Weil
934f85c068 Merge pull request #9027 from roidayan/make-debs_avoid_creating_recursive_conf_dir
make-debs.sh: avoid creating recursive conf dir

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 13:01:26 -04:00
Radoslaw Zarzynski
cfde4c42c0 rgw: camelcase names of custom attributes in Swift's responses.
Fixes: http://tracker.ceph.com/issues/15902
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-05-16 18:28:36 +02:00
Jianpeng Ma
e668620df5 os/bluestore/BlueStore: free space of bluestore should reduce spaces which allocate to bluefs.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-05-16 23:46:20 +08:00
Kefu Chai
af902ec962 cmake: enable selinux support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-05-16 23:09:06 +08:00
Kefu Chai
4244c31083 Merge pull request #9144 from vumrao/wip-vumrao-15899
doc : adding explanation of --no-increasing for

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-05-16 20:58:34 +08:00
John Spray
7d5ca75503 Merge pull request #8452 from jcsp/wip-15266
pybind: fix unicode handling in CephFSVolumeClient::purge

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-05-16 07:54:16 -05:00
Vikhyat Umrao
f8eca5e7e7 doc : adding explanation of --no-increasing for
reweight-by-utilization and test-reweight-by-utilization
commands

Fixes: http://tracker.ceph.com/issues/15899

Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
2016-05-16 18:02:41 +05:30
Sage Weil
e93c7b0709 doc/changelog: missed v10.2.1 changelog
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-16 05:57:45 -04:00
Loic Dachary
cd879e887f Merge pull request #9141 from liewegas/wip-10.2.1
doc/release-notes: v10.2.1 release notes

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-05-16 10:50:04 +02:00
Sage Weil
547d9b87e3 doc/release-notes: v10.2.1 release notes
Signed-off-by: Sage Weil <sage@redhat.com>
2016-05-16 04:37:42 -04:00
Yuan Zhou
ecdad4acca rbd: close journal before removing
Otherwise there is some unwanted error message.

Fixes: http://tracker.ceph.com/issues/15863

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2016-05-16 16:18:59 +08:00
Sage Weil
ef3a678911 Merge pull request #9135 from flaf/master
doc: improvement of the "tunables" part

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-16 03:48:48 -04:00
lafont
4cc820812c doc: improvement of the "tunables" part
* Some CRUSH_TUNABLES$N references were false.
* The explanations concerning the warning when tunables are
  non-optimal were false or confusing.
* Make the definition of the "default" profile clearer.

Signed-off-by: François Lafont <francois.lafont@ac-versailles.fr>
2016-05-16 05:15:06 +02:00
ZhenyuLeng
6171ffbced The function op_is_discardable introduces lock overhead which can
The function op_is_discardable introduces lock overhead which can
not be ignored.It would be better to judge if to discard op when
the connection disconnected as a parameter whether the network is
believable or extremely unlikelihood.

add g_conf osd_discard_disconnected_ops to control whether to
discard op when the connection disconnected
Waiting for test

Signed-off-by: ZhenyuLeng <lengzhenyu@ict.ac.cn>
2016-05-16 09:55:24 +08:00
Sage Weil
10f9a1d1b3 Merge pull request #9124 from stiopaa1/osd_someMorePrivate
osd/OSD.h: move some data members under private

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-15 18:47:29 -04:00
Sage Weil
c1e950acf9 Merge pull request #9128 from stiopaa1/osd_constOperatorPGQueueable
osd/OSD: pass op() params by const in PGQueueable

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-15 18:45:59 -04:00
Sage Weil
b759d47aaa Merge pull request #9131 from stiopaa1/compatset_removeConstructor
common: CompatSet.h: Remove unneeded constuctor

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-15 18:43:41 -04:00
Sage Weil
6e03a8da91 Merge pull request #9132 from shinobu-x/wip-shinobu
cls_rbd: fix comment typo

Reviewed-by: Sage Weil <sage@redhat.com>
2016-05-15 18:42:38 -04:00