Commit Graph

60269 Commits

Author SHA1 Message Date
xie xingguo
6b4bee27cc os/bluestore: make fsck() can catch uninitialized sbid too
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-11-15 08:30:13 +08:00
Dan Mick
238fd2ad37 Merge pull request #11973 from ceph/wip-17898-ceph-disk-flake8
ceph-disk: fix flake8 errors

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-11-14 15:42:35 -08:00
Loic Dachary
8b3bc583c0 Merge pull request #11971 from dachary/wip-17898-flake8
tests: pin flake8 to avoid behavior changes

Reviewed-by: Nathan Cutler <ncutler@suse.cz>
2016-11-14 23:08:04 +01:00
Ken Dreyer
9f3403b1e1 ceph-disk: fix flake8 errors
flake8 3.1.1 surfaces the following issues:

ceph_disk/main.py:173:1: E305 expected 2 blank lines after class or
function definition, found 1
ceph_disk/main.py:5011:1: E305 expected 2 blank lines after class or
function definition, found 1

Fixes: http://tracker.ceph.com/issues/17898

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-11-14 14:49:15 -07:00
Gregory Farnum
6a8aa286a3 Merge pull request #11954 from stiopaa1/mds_MDCache_removeUnneededClear
mds/MDCache.h: remove unneeded call to clear func

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-11-14 13:15:25 -08:00
Gregory Farnum
d54b8a2bc4 Merge pull request #11912 from SUSE/wip-17747-followup
doc: drop --journal-check from ceph-mds man page

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-14 13:07:06 -08:00
Samuel Just
033ad5b46c OSDMonitor: only reject MOSDBoot based on up_from if inst matches
If the osd actually restarts, there is no guarrantee that the epoch will
advance past up_from.  If the inst is different, it can't really be a
dup.  At worst, it might be a queued MOSDBoot from a previous inst, but
in that case, the real inst would see itself marked up, and then back
down causing it to try booting again.

Fixes: http://tracker.ceph.com/issues/17899
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-14 11:50:23 -08:00
Loic Dachary
0c6046a111 tests: pin flake8 to avoid behavior changes
Fixes: http://tracker.ceph.com/issues/17898

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-11-14 19:33:13 +01:00
Sage Weil
1d5002705f Merge pull request #11967 from wjwithagen/wip-wjw-buffer-splice
common/buffer.cc: raw_pipe depends on splice(2)

Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-14 11:10:16 -06:00
Iain Buclaw
e74b90e9ca test/librados: Add tests for librados aio_exec
The C test checks the functionality of the new IoCtxImpl::aio_exec
override that accepts a char* buffer. The C++ test does the same action,
but internally uses the other override that accepts a bufferlist*.

Signed-off-by: Iain Buclaw <iain.buclaw@sociomantic.com>
2016-11-14 17:15:59 +01:00
Kefu Chai
1a9c3d6265 Merge pull request #11914 from tchaikov/wip-17857
ReplicatedPG::failed_push: release read lock on failure

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-15 00:02:40 +08:00
Willem Jan Withagen
f44dcc81e9 common/buffer.cc: raw_pipe depends on splice(2)
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-11-14 16:59:17 +01:00
Sage Weil
199b526469 Merge pull request #11919 from liewegas/wip-bluestore-cache-meta
os/bluestore: bluestore_cache_meta_ratio = .5

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2016-11-14 09:56:46 -06:00
Sage Weil
1c6455eaea os/bluestore: precondition enough to write two 256mb buffers
We now match the new bluestore_rocksdb_options.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-14 10:42:53 -05:00
Sage Weil
8addcd4cdc os/bluestore: bluestore_cache_meta_ratio = .5
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-14 10:28:43 -05:00
Dongsheng Yang
a0fccea742 rbd-mirror: configuration overrides for hard coded timers
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2016-11-14 09:41:41 -05:00
Orit Wasserman
6d8f7bfe59 rgw: add recovery procedure for upgrade to older version of jewel
Fixes: http://tracker.ceph.com/issues/17820
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-11-14 15:36:45 +01:00
Kefu Chai
eb8b4c8897 Merge pull request #11842 from ceph/wip-cmake
cmake: librbd cleanup

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-11-14 22:08:36 +08:00
Kefu Chai
e630d74c64 cmake: should link against ${ALLOC_LIBS}
rocksdb references some jemalloc specific symbols (malloc_stats_print()
for example), if jemalloc is enabled. this fails the build. so we need
to link against ${ALLOC_LIBS} when appropriate.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 19:31:02 +08:00
Kefu Chai
b3224a18f6 ReplicatedPG::failed_push: release read lock on failure
and requeue the blocked ops.

Fixes: http://tracker.ceph.com/issues/17857
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 18:52:22 +08:00
Kefu Chai
8eb2c9d1bd cmake:librbd: move common to the end of linked libraries
so the linked libraries are able to find the symbols in libcommon.
and do not `list(APPEND librbd ...)` anymore, which is wrong and not
necessary. librbd does not depends on krbd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 18:38:55 +08:00
Kefu Chai
9f8a311ced cmake: move ContextCompletion.cc into rbd_internal
- ContextCompletion.cc is used by TrimRequest.cc which is included by
  rbd_internal, it's more natural to put ContextCompletion.cc into
  rbd_internal also. as rbd_internal is the only consumer of this
  translation unit.
- librbd/internal.cc is not referencing any symbols from util.cc, so
  remove this include. and also, do not add
  $<TARGET_OBJECTS:common_util_obj> to librbd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 18:38:55 +08:00
Kefu Chai
89d6091535 cmake: let rbd_internal depend on librbd-tp
as librbd/AioCompletion.cc includes "tracing/librbd.h", which is offered
by librbd-tp.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 18:38:55 +08:00
Kefu Chai
12d1d0c1f5 Merge pull request #11906 from tchaikov/wip-11829
ceph-detect-init: FreeBSD introduction of bsdrc

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-14 18:20:30 +08:00
Pan Liu
e71c587ff0 os/filestore: handle EINTR returned by io_getevents()
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-11-14 18:20:09 +08:00
Tianshan Qu
6e1c3dcb21 rgw: fix RGWSimpleRadosLockCR set_description()
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2016-11-14 16:00:37 +08:00
Kefu Chai
a29a3c686e doc: fix the script for rebuild monitor db
- escape the "$" in "$osd", so it won't be expanded by local shell
- fix the permission bits of /var/lib/ceph/mon/mon.0/store.db
- add the doc to explain the step to prepare the keyring

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 15:34:46 +08:00
Pan Liu
83edcd1f8d remove unused get_info_log_level, and unneeded include files
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-11-14 15:05:46 +08:00
Willem Jan Withagen
cea6786413 ceph-detect-init: FreeBSD introduction of bsdrc
ceph-detect-init/ceph_detect_init/freebsd/__init__.py
    New file

ceph_detect_init/__init__.py: Only test FreeBSD after it is not Linux

    If we do it the other way around it will not work during testing on FreeBSD
    because it will always have platform.system() == FreeBSD
    So first test for Linux, and only then check to see if it is FreeBSD.

ceph-detect-init/tests/test_all.py: add tests for FreeBSD
ceph-detect-init/run-tox.sh: ReEnable to run test for FreeBSD

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-14 14:34:47 +08:00
xie xingguo
865b715029 os/bluestore: static apply() method for bluestore internal-use only
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-11-14 11:16:06 +08:00
Patrick Donnelly
0f334f2870
lua: use simpler lua_next traversal structure
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:55:53 -05:00
Patrick Donnelly
b9a63e49ea
doc: clarify mds deactivate purpose
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:51:51 -05:00
Patrick Donnelly
e5a05739ed
doc: remove broken sentence
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:51:29 -05:00
Patrick Donnelly
ef60b1b502
client: use unique_ptr for fsmap_user
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:12:46 -05:00
Patrick Donnelly
c4c3d32a26
client: use unique_ptr for FSMap
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:12:46 -05:00
Patrick Donnelly
25ab2b6dc7
client: use unique_ptr for MDSMap
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:12:46 -05:00
Patrick Donnelly
888910d260
client: remove unnecessary bufferptr[] for writev
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:12:36 -05:00
Kefu Chai
ddcb4a945a Merge pull request #11844 from liupan1111/master
os/bluestore: speedup the performance of multi-replication flow by switc…

Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-14 09:42:50 +08:00
Kefu Chai
7d6fa8d5c5 Merge pull request #11799 from KerLiu/fixdupassignment
osd/OSDMap.cc: fix duplicated assignment for new_blacklist_entries

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-14 09:40:58 +08:00
Kefu Chai
473ae1d539 Merge pull request #11378 from ryneli/watch_notify_add_timeout
librados: add timeout to watch/notify

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-14 09:36:14 +08:00
Michal Jarzabek
e6fa2a7e29 mds/MDCache.h: remove unneeded call to clear func
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-11-13 23:24:52 +00:00
Ryne Li
e3ca1e607e librados: add timeout parameter to rados_watch
Signed-off-by: Ryne Li <lizhenqiangsnake@gmail.com>
2016-11-13 07:21:54 -05:00
Kefu Chai
961a309532 Merge pull request #10221 from Yan-waller/yj-wip-testrados-0709
test/rados: remove unused bufferlist variable

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-13 16:24:05 +08:00
Kefu Chai
6aad9ea173 Merge pull request #11941 from liewegas/wip-envlibrados
qa/workunits/rados/test_envlibrados_for_rocksdb: force librados-dev install

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-13 14:53:29 +08:00
Kefu Chai
c4624271ed Merge pull request #9357 from Aran85/wip-assert-build-push
osd/PGBackend: build_push_op segment fault

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-11-13 14:41:14 +08:00
Kefu Chai
18d27b19d3 Merge pull request #11800 from bassamtabbara/wip-make-leveldb-optional
mon: support for building without leveldb + mon mkfs bug fix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-13 14:39:11 +08:00
Kefu Chai
6638babd6e Merge pull request #11664 from sysnote/wip-17719
mon: fix "OSDs marked OUT wrongly after monitor failover"

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-13 14:38:10 +08:00
Kefu Chai
a87a092038 Merge pull request #10196 from xiaoxichen/fix_16609
log/LogClient: fill seq & who for syslog and graylog

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-13 14:34:24 +08:00
Pan Liu
0cb01c4f4b BlueStore: speedup the performance of multi-replication flow by
switching the callback order in bluestore.

In Bluestore ack callback and commit callback are queued one by one in
the function "BlueStore;:_txc_finish_kv". Therefore, just only one callback
is needed to call, in order to improve performance. We do this by switching
the callback order in bluestore, and the callback work can be done in
sub_op_modify_commit and doesn't need to do it again in sub_op_modify_applied.

Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-11-12 23:22:30 +08:00
Sage Weil
1fdbf4cc99 Merge pull request #11805 from tchaikov/wip-deprecate-readdir-r
deprecate readdir_r() with readdir()

Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-12 07:35:58 -06:00