Commit Graph

76238 Commits

Author SHA1 Message Date
Sage Weil
52d1814caf test/smoke.sh: add simple ceph-helpers-based smoke test
This is just enough during make check to know things aren't totally
broken.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:24:52 -04:00
Sage Weil
a98a2619b3 osdc/Objecter: unify disparate EAGAIN handling paths into one
We had two different code paths for EAGAIN that both
seemed to resend the same request again (with a new
tid), but implemneted it in two different ways. Further,
the first one was conditioned on the BALANCE_READS
flag but not LOCALIZED_READS, which should (I think) be
equivalent in this context.

Unify them into a single path.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:13:39 -04:00
Sage Weil
0b5036f072 qa/suites/rados/upgrade: fix upgrade wait for healthy
There is no mgr, so we can't call ceph.healthy.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:10:34 -04:00
Sage Weil
a40d94b163 qa/tasks/ceph: wait for pg stats to flush in healthy check
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:10:27 -04:00
Sage Weil
80978dea8a qa/tasks/ceph_manager: wait_for_all_up -> wait_for_all_osds_up
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:10:26 -04:00
Sage Weil
7648894e55 qa/tasks/ceph_manager: expose flush_all_pg_stats
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 12:10:26 -04:00
Sage Weil
c7430c56cd Merge pull request #16388 from xiexingguo/wip-class-misc-fixes
crush, mon: simplify device class manipulation commands

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-27 11:04:33 -05:00
Josh Durgin
c1a4877da1 Merge pull request #16172 from ivancich/wip-dup-ops
PGLog: store extra duplicate ops beyond the normal log entries

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-07-27 08:57:39 -07:00
Yuri Weinstein
6942e3932b Merge pull request #16558 from hjwsm1989/fix-recovering-hang-with-unfound-objects
osd/PrimaryLogPG: fix recovering hang when have unfound objects

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-07-27 08:37:15 -07:00
Yuri Weinstein
2eaa086c19 Merge pull request #16561 from Yan-waller/wip-walle-0725osddumpclinfo
osd: add dump filter for tracked ops

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-07-27 08:36:23 -07:00
J. Eric Ivancich
a3d2c6b6a0 PGLog: continuation, store extra duplicate ops beyond the normal log entries
This helps us avoid replaying non-idempotent client operations when
the pg log is very short, e.g. in an effort to force OSDs to use
backfill rather than regular recovery. This can be advantageous to
avoid blocking i/o to objects, at the cost of longer total time to
become clean (since backfill requires scanning the objects to see what
is missing).

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2017-07-27 11:09:04 -04:00
Yuri Weinstein
105435a38e Merge pull request #16384 from mikulely/2-checkout-placmenet-target-existness
rgw: check placement target existence during bucket creation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-27 07:29:13 -07:00
Yuri Weinstein
2357dcd23c Merge pull request #16389 from prallabh/wip-20661
rgw: Do not decrement stats cache when the cache values are zero

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-07-27 07:27:37 -07:00
Yuri Weinstein
63a5f60b07 Merge pull request #16463 from cbodley/wip-20708
rgw: fix parse/eval of policy conditions with IfExists

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-07-27 07:25:50 -07:00
Yuri Weinstein
8ff76b7033 Merge pull request #16495 from weiqiaomiao/wip_weiqm_rgw_crash
rgw: fix radosgw will crash when service is restarted during lifecycl…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-07-27 07:22:59 -07:00
Yuri Weinstein
5fc9dfa36f Merge pull request #16531 from rzarzynski/wip-rgw-20757
rgw: fix memory leaks during Swift Static Website's error handling.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-27 07:19:22 -07:00
Yuri Weinstein
b59e577334 Merge pull request #16601 from rzarzynski/wip-rgw-20774
rgw: never let http_redirect_code of RGWRedirectInfo to stay uninitialized

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-07-27 07:18:42 -07:00
Yuri Weinstein
1d4593703b Merge pull request #16604 from rzarzynski/wip-rgw-20779
rgw: fix the UTF8 check on bucket entry name in rgw_log_op().

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-27 07:17:32 -07:00
Sage Weil
203c68ad55 Merge pull request #16575 from liewegas/wip-20693
qa/suites/rados: at-end: ignore PG_{AVAILABILITY,DEGRADED}

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-07-27 08:31:53 -05:00
Sage Weil
e398fd4ee4 qa/suites: more whitelisting
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-27 09:31:24 -04:00
huanwen ren
cfc663726c cephfs/ceph-fuse: add and modify ceph-fuse mount hint
1. "-n" is applied the client authorization feature.
2. "root_directory" misleading to mount the root directory ,
     in fact, here mount should be "sub_directory".
Refer to: http://docs.ceph.com/docs/master/cephfs/client-auth/#cephfs-client-capabilities

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2017-07-27 21:14:38 +08:00
Jason Dillaman
42fabc2e80 Merge pull request #16398 from dillaman/wip-20655
rbd-mirror: guard the deletion of non-primary images

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2017-07-27 08:27:39 -04:00
Xinying Song
e15b2b9cc8 common: use std::move() for better performance
use std::move() to avoid extra copy constructions in src/common/OutputDataSocket.cc.

Signed-off-by: Xinying Song <songxinying@cloudin.cn>
2017-07-27 15:52:54 +08:00
Kefu Chai
2531063c30 Merge pull request #16574 from batrick/rgw-rbd-stripped-build
CMakeLists: trim rbd/rgw forced dependencies

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-27 13:10:07 +08:00
Venky Shankar
3d86277b2e Merge pull request #16603 from dillaman/wip-rbd-mirror-valgrind
rbd-mirror: initialize timer context pointer to null
2017-07-27 08:24:28 +05:30
Kefu Chai
3cab2ce179 kv/RocksDBStore: use vector instead of VLA for holding slices
clang complains:

ceph/src/kv/RocksDBStore.cc:611:32: error: variable length array of
non-POD element type
      'rocksdb::Slice'
    rocksdb::Slice value_slices[to_set_bl.buffers().size()];

and i believe GCC will also complains with: -Wvla or -pedantic. as
to_set_bl.buffers().size() is not a const expr at compile time.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-27 10:44:50 +08:00
Sage Weil
964432b97c Merge pull request #16613 from liewegas/wip-vstart-mgr
vstart.sh: start mgr after mon, before osds

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-07-26 21:04:25 -05:00
Jos Collin
0a8becf8a5 Merge pull request #16584 from gregsfortytwo/wip-deletes-coverity
messages: default-initialize MOSDPGRecoveryDelete[Reply] members

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-07-27 01:11:01 +00:00
Sage Weil
77ba569ac9 vstart.sh: start mgr after mon, before osds
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-26 17:22:25 -04:00
Willem Jan Withagen
d40256d4f1 src/ceph-disk/ceph_disk/main.py: FreeBSD root has wheel for group
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-07-26 22:27:05 +02:00
Mark Nelson
9c15338ad3 kv/RocksDBStore: Add table options for filter and index tuning.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-26 14:03:07 -05:00
David Zafman
e92c953d7b Merge pull request #16610 from dzafman/wip-fix-reg11184
test: reg11184 might not always find pg 2.0 prior to import

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-26 11:42:15 -07:00
Sage Weil
e0bd667320 PendingReleaseNotes: note about put -> set
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-26 14:13:22 -04:00
Sage Weil
5534912daa qa/workunits/cephtool/test.sh: add some config-key tests
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-26 14:13:22 -04:00
Sage Weil
4eb1a518e3 mon: 'config-key put' -> 'config-key set'
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-26 14:10:08 -04:00
Sage Weil
ee06dc6996 Merge pull request #16530 from xiexingguo/wip-fix-pgtemp
mon: prime pg_temp and a few health warning fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-26 13:09:33 -05:00
David Zafman
012ad6ffb1 Merge pull request #16587 from dzafman/wip-20770
Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-26 10:53:16 -07:00
Kefu Chai
609e12e223 Merge pull request #16600 from dingdangzhang/master
bluestore/BlueFS: pass string as const ref

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-27 01:03:12 +08:00
Kefu Chai
31ef1790c1 Merge pull request #16563 from hjwsm1989/readable-thread-info
common/WorkQueue: use threadpoolname + threadaddr for heartbeat_han…

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-27 01:00:31 +08:00
Kefu Chai
c59fd70242 Merge pull request #16576 from liewegas/wip-20371
mon/MonClient: scale backoff interval down when we have a healthy mon session

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-27 01:00:07 +08:00
Sage Weil
59a3a4a40e Merge pull request #16559 from hjwsm1989/dump-stuck
qa/tasks/dump_stuck: fix dump_stuck test bug

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-26 11:59:21 -05:00
Kefu Chai
9f1243b4ad Merge pull request #16516 from Liuchang0812/nit-close-formatter-section
mon/MDSMonitor: close object section of formatter

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-27 00:55:05 +08:00
Kefu Chai
a5300a38a8 Merge pull request #16553 from wumingqiao/wip-leveldb-store-crash
kv: resolve a crash issue in ~LevelDBStore()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-27 00:54:21 +08:00
Sage Weil
efa31408fb Merge pull request #16578 from liewegas/wip-20771
common/common_init: disable default dout logging for UTILITY_NODOUT too

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-26 11:53:17 -05:00
Kefu Chai
3163e9ba52 Merge pull request #16522 from majianpeng/bluestore-remove-unused-code
os/bluestore/BlueStore: remove unused code.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-07-27 00:46:34 +08:00
David Zafman
7c43840399 test: reg11184 might not always find pg 2.0 prior to import
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-07-26 09:46:15 -07:00
Sage Weil
56ffd7a727 Merge pull request #16571 from ceph/wip-cd-bluestore-2
qa/tasks/ceph-deploy: Fix bluestore options for ceph-deploy

Reviewed-by: Tamil Muthamizhan <tmuthami@redhat.com>
2017-07-26 11:43:50 -05:00
Kefu Chai
a7e818f59f common/config: change the element type of lists to "const char*"
there lists holds constant string literals. and they are not changeable
at runtime. so make std::list<const char*> for smaller memory foot
print.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-27 00:09:52 +08:00
Kefu Chai
26941ea40c common/config: accept initialize_list when adding option properties
it's syntax sugar, but more handly this way. and it helps to reduce
memory foot print.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-27 00:07:38 +08:00
Kefu Chai
da4286ee0e Merge pull request #16452 from wjwithagen/wjw-warning-unused
buffer: silence unused var warning on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-26 23:19:57 +08:00