Commit Graph

77041 Commits

Author SHA1 Message Date
Radoslaw Zarzynski
1d6be97861 qa/tasks/tempest: make the Tempest blacklisting configurable.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
1d8a4e5921 qa/tasks/tox: separate tox deployment from Keystone.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
2a845344e7 qa/tasks/keystone: comply wih the CLI interface older openstack-client.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
c1d93e80c8 qa/tasks/keystone: deploy tox.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
979d936ad1 qa/tasks/keystone: the task can be now executed also on remotes.
Initially it was compatible with local_runner only.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
728d642bc4 qa/tasks/tempest: properly update tempest.conf on remotes.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
c1fe31d327 qa/tasks/rgw: add the "frontend_prefix" configurable.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
b6a1533962 qa/tasks/tempest: integrate OpenStack Tempest for testing RadosGW's Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
2ee29a7c6a qa/tasks/keystone: deploy a Keystone instance for testing RadosGW.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Sage Weil
0a8ceaa3a5 Merge pull request #16976 from liewegas/wip-osd-empty
mgr: implement 'osd safe-to-destroy' and 'osd ok-to-stop' commands

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-13 14:02:44 -05:00
Sage Weil
e49ca43d4d Merge pull request #16625 from Yan-waller/wip-walle-0727testlibrados
test/librados: reorder ASSERT_EQ() arguments

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-13 14:02:22 -05:00
Sage Weil
929c11bf16 Merge pull request #16883 from liewegas/wip-20939
crush,mon: fix weight-set vs crush device classes

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-13 13:59:43 -05:00
Sage Weil
d69f0e120b qa/suites/rados/objectstore/objectstore: less debug
Saw an ENOSPC.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-13 14:41:43 -04:00
Haomai Wang
00e8ab3ac9 Merge pull request #17007 from alex-mikheev/wip_rdma_notify_fix
src/msg/rdma: fixes failure on assert in notify()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-08-13 20:13:59 +08:00
Alex Mikheev
44c895ea51
src/msg/rdma: fixes failure on assert in notify()
The commit fixes incorrect eventfd handling introduced in
2e75b876d1

Signed-off-by: Alex Mikheev <alexm@mellanox.com>
2017-08-13 10:55:32 +00:00
Yuri Weinstein
aaf32d8f43 Merge pull request #16978 from gmayyyha/mgr-ms-verify-auth
mgr/DaemonServer.cc: add 'is_valid=false' when decode caps error

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-12 14:45:28 -07:00
Sage Weil
196e7f317c Merge pull request #16906 from liewegas/wip-bluestore-stupid
os/bluestore: switch default allocator to stupid; test both bitmap and stupid in qa

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-12 16:10:31 -05:00
Sage Weil
46ded6eb5b crush/CrushWrapper: fixing timing of removal in remove_item_under
Do it after we reweight, not before

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 15:25:28 -04:00
Sage Weil
061c21786a crush/CrushWrapper: fix iterator invalidation in cleanup_dead_classes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 15:25:28 -04:00
Sage Weil
b3838c83d5 crush/CrushWrapper: keep weights and/or ids null if empty
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 15:25:28 -04:00
Sage Weil
5a982050c1 crush/builder: fix ENOENT when removing last bucket item
We were decrementing size and then breaking out ENOENT condition check.
Fix by decrementing size only after we break out of the loop and verify
we found the item.

Fix a follow-on bug by avoiding realloc when we have 0 items left.  This case
was never exercised before due to the ENOENT issue; now we return explicitly.
It's really not necessary to realloc at all, probably, since these are very
small arrays, but in any case leaving a single item allocation there in place of
a 0-length allocation is fine.  (And the 0-length allocation behvaior on realloc
is undefined.. may either return a pointer or NULL.)

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 15:24:04 -04:00
Sage Weil
ba3602b216 Merge pull request #17005 from liewegas/wip-verify-slowness
qa/suites/rados/verify/validater/valgrind: whitelist PG_
2017-08-12 13:19:23 -05:00
Sage Weil
41e5a85308 qa/suites/rados/verify/validater/valgrind: whitelist PG_
Peering might be slow due to valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 14:18:59 -04:00
Sage Weil
f04360c917 Merge pull request #17004 from liewegas/wip-clock-skew-whitelist
qa/suites/rados/multimon/tasks/mon_lock_with_skew: whitelist PG_
2017-08-12 13:15:50 -05:00
Sage Weil
12007044b1 qa/suites/rados/multimon/tasks/mon_lock_with_skew: whitelist PG_
Default pool pgs not up because mons too broken for OSDs to peer.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-12 14:15:15 -04:00
Sage Weil
5dd89cc17a Merge pull request #15921 from joscollin/wip-CID1411830-Uninitialized-pointer-field
test/osd: Non-static class members not initialized in UnsetRedirectOp

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-12 13:03:58 -05:00
Jos Collin
b1b6688b50 test/osd: Non-static class member not initialized in UnsetRedirectOp
Fixes the coverity scan report:
CID 1411830: Uninitialized pointer field (UNINIT_CTOR)
2. uninit_member: Non-static class member completion is not initialized in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member comp is not initialized in this constructor nor in any functions that it calls.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-08-12 13:36:08 +05:30
Jos Collin
0ec42b03c9 Merge pull request #15922 from joscollin/wip-CID1411829-Uninitialized-scalar-field
test/osd: initialize Non-static class members in WeightedTestGenerator

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
2017-08-12 07:50:05 +00:00
Sage Weil
4f6ae418c0 Merge pull request #16924 from liewegas/wip-20923
os/bluestore: fail early on very large objects

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 21:55:34 -05:00
Sage Weil
ba66977a34 test/osd/safe-to-destroy.sh: test 'osd safe-to-destroy'
This is hard with workunits/cephtool/test.sh because we don't
control the whole cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 22:54:33 -04:00
Sage Weil
bf9380457b mgr: implement 'osd safe-to-destroy' and 'ok-to-stop' commands
An osd is safe to destroy if

- we have osd_stat for it
- osd_stat indicates no pgs stored
- all pgs are known
- no pgs map to it

An osd is ok ot stop if

- we have pg stats
- no pgs will drop below min_size

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 22:54:33 -04:00
Sage Weil
a7612d33d1 mgr/ClusterState: record osd_stat for out osds too
I'm not quite sure why we were doing this. :/

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 22:47:50 -04:00
Sage Weil
c2945479f4 osd/osd_types: include number of locally stored PGs in osd_stat_t
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 22:47:50 -04:00
Sage Weil
6fc33a046b osd/OSDMap: add parse_osd_id_list helper
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 22:47:50 -04:00
Sage Weil
8619fb6a2a Merge pull request #16992 from liewegas/wip-20977
os/bluestore: do not segv on kraken upgrade debug print

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 21:36:53 -05:00
Sage Weil
f1d8a40122 Merge pull request #16993 from liewegas/wip-mimic
common: kick off mimic

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-08-11 21:36:32 -05:00
Sage Weil
ae739b31f1 Merge pull request #16994 from liewegas/wip-20983
os/bluestore: fix clone dirty_range again

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 21:35:35 -05:00
Sage Weil
93b1b5ca49 Merge pull request #16995 from liewegas/wip-20738
os/memstore: memstore_page_set=false

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-08-11 21:34:48 -05:00
Sage Weil
300e395c75 Merge pull request #16996 from liewegas/wip-mgr-vs-clock-skew
qa/suites/rados/multimon: whitelist mgr down vs clock skew test
2017-08-11 21:34:07 -05:00
Gregory Farnum
4e69d80e6b Merge pull request #16898 from amitkumar50/cov-messages-6
messages: Initialization of member variables

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-11 14:25:16 -07:00
Sage Weil
50523a225b os/bluestore: do not segv on kraken upgrade debug print
When loading an onode from kraken we have a compat path that calls
get_ref before the SharedBlob pointer is initialized.  This is fine except
that if debugging is enabled the operator<< on the Blob will segv on
printing *b.shared_blob (which is NULL).

Fix operator<< to print something else if it is NULL.  shared_blob does
get set up right after the call to decode() so having it be NULL at this
point is otherwise harmless.

Fixes: http://tracker.ceph.com/issues/20977
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 16:44:48 -04:00
Sage Weil
ad23d7dc1f qa/suites/rados/multimon: whitelist mgr down vs clock skew test
Clock skew might make us fail the mgr.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 13:42:02 -04:00
Sage Weil
7c96868797 os/memstore: memstore_page_set=false
This regularly returns bad results, see http://tracker.ceph.com/issues/20738

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 13:31:51 -04:00
Sage Weil
d5ba7061ee os/bluestore: fix clone dirty_range again
If we are cloning a blob for a 1 byte logical extent then dirty_range_begin
will equal _end and we won't dirty the source onode (with possibly newly
shared blobs).

Fix by using a separate flag to indicate whether we are dirtying instead
of overloading the begin/end markers for this.  Note that even if they
are equal dirty_range will still dirty the shard in question.

This is a result of 0ae5d92d42.

Fixes: http://tracker.ceph.com/issues/20983
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:46:25 -04:00
Sage Weil
3bcb4b3e8d include/rados: nautilus is next
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:14:59 -04:00
Sage Weil
7d56c7082b include/ceph_features: define SERVER_NAUTILUS
Nautilus will be the next major release after luminous.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:14:59 -04:00
Sage Weil
4a1a15478d include/ceph_features: incarnation 3 can begin!
With all upgrades passing through luminous, we can now start
reusing bits retired in luminous.  Our sentinel bitmask will be the
combination of SERVER_MIMIC and SERVER_JEWEL (i.e.,
CEPH_FEATUREMASK_SERVER_MIMIC).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:14:59 -04:00
Sage Weil
7b81212a6d include/ceph_features: SERVER_M -> SERVER_MIMIC
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:14:59 -04:00
Sage Weil
9cec473e0c ceph_release: kick off mimic 13.y.z
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 12:14:59 -04:00
Matt Benjamin
50724db8e5 Merge pull request #16628 from theanalyst/rgw-policy-list-buckets
rgw: policy: support for s3 conditionals in ListBucket Op
2017-08-11 11:53:01 -04:00