Commit Graph

60393 Commits

Author SHA1 Message Date
Loic Dachary
f491ea062d tests: facilitate background process debug in ceph-helpers.sh
When displaying the output of a background process, do it on stderr so
that it is not bufferized. Otherwise the output of the background
process may be displayed after it completed.

Prefix the output of a background process with the PID of the process
known to the parent instead of the PID of the awk process processing the
output. When wait_background loops, it will print the process on which
it is waiting and it is confusing that they do not match with the PID
prefixing the process output.

Refs: http://tracker.ceph.com/issues/17830

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-11-24 19:52:14 +01:00
Kefu Chai
44aaeb7fcc Merge pull request #11733 from tchaikov/wip-17762
common: release g_ceph_context before returns

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2016-11-25 01:27:53 +08:00
Kefu Chai
b06557ecb9 Merge pull request #12172 from dachary/wip-17830-eio
tests: osd-scrub-repair.sh abort if add_something fails

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-25 01:24:13 +08:00
Kefu Chai
d305cc51b1 crushtool: do not release g_ceph_context at exit
it is but a work around of occasionally timeout.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-24 22:38:28 +08:00
Kefu Chai
cb1cda9671 common,test: g_ceph_context->put() upon return
prior to this change, global_init() could create a new CephContext
and assign it to g_ceph_context. it's our responsibilty to release
the CephContext explicitly using cct->put() before the application
quits. but sometimes, we fail to do so.

in this change, global_init() will return an intrusive_ptr<CephContext>,
which calls `g_ceph_context->put()` in its dtor. this ensures that
the CephContext is always destroyed before main() returns. so the
log is flushed before _log_exp_length is destroyed.

there are two cases where global_pre_init() is called directly.
- ceph_conf.cc: g_ceph_context->put() will be called by an intrusive_ptr<>
  deleter.
- rgw_main.cc: global_init() is called later on on the success code
  path, so it will be taken care of.

Fixes: http://tracker.ceph.com/issues/17762
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-24 22:38:28 +08:00
Loic Dachary
073240c812 Merge pull request #10296 from songbaisen/b4
mon: small change on the HealthMonitor start_epoch  function

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-24 14:27:10 +01:00
songbaisen
61e01f0674 mon: small change on the HealthMonitor start_epoch function
No need to call start_epoch function each time in the loop.

Signed-off-by: songbaisen <song.baisen@zte.com.cn>
2016-11-24 16:35:44 +08:00
Loic Dachary
d585e92efd Merge pull request #9513 from songbaisen/a5
mon: Forbidden copy and assignment function in monoprequest

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-24 08:32:33 +01:00
Loic Dachary
cca0f59156 Merge pull request #12085 from wjwithagen/wip-freebsd-ceph-helpers-2
workunits/ceph-helpers.sh: Fixes for FreeBSD

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-24 08:01:51 +01:00
Loic Dachary
9ad8ce2839 tests: osd-scrub-repair.sh abort if add_something fails
If the script keeps going after this function fails, it will be non
trivial to find the root cause of the problem.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-11-24 07:52:56 +01:00
Kefu Chai
20c445c84d Merge pull request #11943 from wido/docs-pool-remove
doc: Add documentation about mon_allow_pool_delete before pool remove

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-24 11:53:32 +08:00
Willem Jan Withagen
e4629b3397 workunits/ceph-helpers.sh: Fixes for FreeBSD
- stat(1) does not have '%T'

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-11-24 01:57:05 +01:00
Sage Weil
4af4ef09fe Merge pull request #10402 from ceph/wip-openstack-wusui
qa: Add ceph-ansible installer.
2016-11-23 16:42:34 -05:00
Orit Wasserman
02bf3ba781 Merge pull request #11673 from zhangsw/fix-rgw-initbucketshardsync-bug
rgw: Class member cookie is not initialized correctly in some coroutine's constructor.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-11-23 20:47:59 +01:00
Orit Wasserman
8eb5995508 Merge pull request #11969 from yehudasa/wip-17897
rgw: don't store empty chains in gc
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-11-23 20:46:55 +01:00
Orit Wasserman
fdc92eb11e Merge pull request #11815 from ceph/wip-17792
rgw: remove circular reference in RGWAsyncRadosRequest
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-11-23 20:45:07 +01:00
David Zafman
94bfb853cf Merge pull request #12142 from athanatos/wip-17966
osd: Fix read error propogation in ECBackend

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2016-11-23 11:24:17 -08:00
John Spray
59666c9e82 Merge pull request #11994 from ukernel/wip-17193
mds: force client flush snap data before truncating objects

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-11-23 18:31:54 +00:00
John Spray
ca421e11e2 Merge pull request #11635 from batrick/mds-unique-ptr-20161024
mds: more unique_pointer changes

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-23 18:29:16 +00:00
John Spray
1604d1e46a Merge pull request #11917 from ajarr/wip-17800
ceph_volume_client: set an existing auth ID's default mon caps 

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-23 18:25:21 +00:00
Igor Fedotov
df97766cf1 Merge pull request #11983 from liewegas/wip-bluestore-release
os/bluestore: fix alloc release timing on sync submits

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-11-23 21:13:06 +03:00
Samuel Just
2150fe7f8e Merge pull request #12129 from wjin/fix_backoffthrottle_comment
common/Throttle: fix typo for BackoffThrottle

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-11-23 08:44:15 -08:00
Loic Dachary
bd8554a78d Merge pull request #9643 from wjin/mon
mon: clean legacy code

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-23 17:37:12 +01:00
Samuel Just
c475ebda3e src/test: reenable test-erasure-eio.sh
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-23 07:52:35 -08:00
Gregory Farnum
366e93057d Merge pull request #12000 from jcsp/wip-doc-exports
src/doc: fix class names in exports.txt

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-23 10:34:53 -05:00
Loic Dachary
15433bf1de Merge pull request #10474 from songbaisen/b5
mon:  remove the redudant jugement in LogMonitor tick function

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2016-11-23 16:34:33 +01:00
Loic Dachary
f1b7a061b0 Merge pull request #11631 from wolsen/issues/17689
upstart: start ceph-all after static-network-up

Reviewed-by: James Page <james.page@ubuntu.com>
2016-11-23 16:28:51 +01:00
Kefu Chai
fa5bf9ce6b Merge pull request #12128 from tchaikov/wip-cmake
cmake: add -Wno-unknown-pragmas to CMAKE_CXX_FLAGS

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-11-23 23:21:32 +08:00
Sage Weil
c4623710e9 Merge pull request #12126 from branch-predictor/bp-doc-async-opts
doc/rados/configuration/ms-ref.rst: document a few async msgr options

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-11-23 10:00:44 -05:00
Sage Weil
603ad7663b Merge pull request #12135 from kylinstorage/wip-remove-unneeded-forward-declaration
osd/PG.h: remove unneeded forward declaration

Reviewed-by: Sage Weil <sage@redhat.com>
2016-11-23 09:58:00 -05:00
Sage Weil
0525250a9f Merge pull request #12162 from liewegas/wip-coverity
script/run-coverity: update
2016-11-23 09:15:13 -05:00
Sage Weil
d0356893af script/run-coverity: -x
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-23 09:11:55 -05:00
Loic Dachary
6f4efc12d3 Merge pull request #11848 from javeme/case-CEPH_MSG_POOLOP
mon: move case CEPH_MSG_POOLOP to OSDs group

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2016-11-23 15:05:42 +01:00
Jason Dillaman
c3910309a3 Merge pull request #12160 from vshankar/wip-17973
librbd: mark request as finished after failed refresh
2016-11-23 08:22:16 -05:00
Piotr Dałek
8f9ee150cb doc/rados/configuration/ms-ref.rst: document a few async msgr options
Documentation of a few of Async Messenger configuration options.

Signed-off-by: Piotr Dałek <git@predictor.org.pl>
2016-11-23 14:03:01 +01:00
Wido den Hollander
95ed04a536
doc: Add documentation about mon_allow_pool_delete before pool remove
Tell users they need to set this to true before Monitors will allow
pools to be removed.

Also update the Pending Release Notes so that users can find this change
there.

This was changed with commit 5d7f4ea

Signed-off-by: Wido den Hollander <wido@42on.com>
2016-11-23 12:18:21 +01:00
Kefu Chai
db7533ddce Merge pull request #12055 from liewegas/wip-17942
osdc/Objecter: handle race between calc_target and handle_osd_map

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-11-23 19:05:35 +08:00
Kefu Chai
feefd5ed50 Merge pull request #11178 from stiopaa1/osd_pg_changeStructPGRecoveryStatsToClass
osd/PG.h: change PGRecoveryStats struct to class

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-23 19:02:53 +08:00
Kefu Chai
354e5bfb2e Merge pull request #12009 from 363921219/master
osd: clean up process_peering_events

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-23 19:01:04 +08:00
Kefu Chai
0e5405313b Merge pull request #12031 from liewegas/wip-ceph-abort
common: assert(0) -> ceph_abort()

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-23 19:00:10 +08:00
Venky Shankar
cc2f222a9b librbd: account m_processing when failing request after refresh
AioImageRequestWQ::_void_process() dequeues an item from the
work queue by invoking ThreadPool::_void_process() which also
performs accounting by incrementing ->m_processing which never
gets decremented if an image refresh fails. This is exactly
the flow when running test_lock_fence.sh which blacklists a
client and expects failed I/O operation from the client.

Without this fix, running test_lock_fence.sh in a loop fails
with an assert in PointerWQ dtor within 100 odd runs.

Fixes: http://tracker.ceph.com/issues/17973
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2016-11-23 16:25:17 +05:30
Kefu Chai
6332a20170 Merge pull request #12034 from wjwithagen/wip-wjw-freebsd-strtoll
common/strtol.cc: Get error testing also to work on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-23 18:48:04 +08:00
Kefu Chai
2921d8d576 Merge pull request #12150 from tchaikov/wip-kill-gf-complete-warnings
erasure-code: fix gf-complete warning

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-23 17:03:54 +08:00
Kefu Chai
43f15c612e cmake: regroup CMAKE_CXX_FLAGS and CMAKE_C_FLAGS
- some options are only meaningful for C++, so move them into
  CMAKE_CXX_FLAGS.
- regroup CMAKE_CXX_FLAGS and CMAKE_C_FLAGS, and remove the duplicated
  options.
- do not reset CMAKE_CXX_FLAGS with ${CMAKE_C_FLAGS}, instead, always
  append ${CMAKE_C_FLAGS} to existing ${CMAKE_CXX_FLAGS}. so we don't
  clobber CMAKE_CXX_FLAGS set by command line.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-23 16:45:18 +08:00
Kefu Chai
6e8f3b40df cmake: add -Wno-unknown-pragmas to CMAKE_C_FLAGS
this silences warnings like:

warning: ignoring #pragma clang diagnostic [-Wunknown-pragmas]

and recent clang (3.9 and 4.0) do not complain at seeing
so we only pass this this param to gcc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-23 15:55:17 +08:00
Kefu Chai
b9d4fac7f0 erasure-code: fix gf-complete warning
pick up latest gf-complete submodule

$ git log --no-merges --pretty=%s \
  a6847973cba329ae079d3bd26341a4ec2906f012..c431e1ff76bdce6c3f6c0d0cbdf6a01c68f81071
gf_w32.c: silence the -Wmaybe-uninitialized warning

it silences following warning:

ceph/src/erasure-code/jerasure/gf-complete/src/gf_w32.c: In
function ‘gf_w32_cfmgk_multiply_region_from_single’:

ceph/src/erasure-code/jerasure/gf-complete/src/gf_w32.c:410:5:
warning: ‘a’ may be used uninitialized in this function
[-Wmaybe-uninitialized]
   g = _mm_insert_epi64 (a, g_star, 0);
     ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-23 15:38:14 +08:00
Loic Dachary
335d50f178 Merge pull request #12146 from dzafman/wip-dz-delays
tests: minor make check cleanup

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-23 07:39:44 +01:00
Kefu Chai
bd1eb7aa76 Merge pull request #12136 from dachary/wip-17889-systemd-order
ceph-disk: resolve race conditions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-23 14:36:25 +08:00
Brad Hubbard
e16c64565e Merge pull request #12145 from tchaikov/wip-client-use-after-freed
client: trim_caps() do not dereference cap if it's removed

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-11-23 16:07:28 +10:00
David Zafman
b425290a92 test: Handle terminal width 0 case for running test in emacs
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-22 21:41:17 -08:00