Commit Graph

85249 Commits

Author SHA1 Message Date
David Zafman
007cb45fe5 osd rados command: Change error name snapset_mismatch to snapset_error
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
0c7ac9db3b test: Clean-up test and use local values for number of objects and osds
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
0a8ed0b94b osd: Without snapdir we don't have a head mismatch error anymore
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
982509514c osd rados command: list-inconsistent-obj attribute improvements
System attributes shown as "object_info", "snapset" and "hashinfo"
Only output user attributes as "attrs"
	Drop leading undescore "_" for user attribute keys
Improve logic as to when to show user attributes or specific system attributes

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
01687b052f osd rados command: Change "oi" to "info" in scrub handling errors
data_digest_mismatch_oi -> data_digest_mismatch_info
omap_digest_mismatch_oi -> omap_digest_mismatch_info
size_mismatch_oi -> size_mismatch_info
obj_size_oi_mismatch -> obj_size_info_mismatch

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
273f6213ea osd rados command: Change "oi_attr" to "info" in scrub handling errors
oi_attr_missing -> info_missing
oi_attr_corrupted -> info_corrupted

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
bec67e3d40 osd rados command: Rename ss_attr_missing/ss_attr_corrupted to snapset_missing/snapset_corrupted
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
d713c7dad0 osd rados command: Improve scrub handling of HashInfo (hinfo_key xattr)
Fixes: http://tracker.ceph.com/issues/23364

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
0d4acc55ff osd: Don't crash in get_hash_info() with a corrupt HashInfo
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
be815f9b2b test: Remove check that masks differences (let diff fail)
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
Patrick Donnelly
c10907af02
qa: fix typo in test_full
Cause: 577737d007

Fixes: http://tracker.ceph.com/issues/23643

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-10 11:47:10 -07:00
Patrick Donnelly
bd0c68e085
Merge PR #21321 into master
* refs/pull/21321/head:
	tools/cephfs: instantiate MDSUtility after global_init()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-10 11:33:21 -07:00
Andrew Schoen
f71784ed4d
Merge pull request #21130 from ceph/wip-rm23067
ceph-volume  Implement an 'activate all' to help with dense servers or migrating OSDs

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-04-10 20:31:56 +02:00
Mykola Golub
21e26035d0
Merge pull request #21304 from rjfd/wip-rbd-pybind-fixes
rbd: python bindings fixes and improvements

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-04-10 20:45:42 +03:00
Casey Bodley
e8ca5f01cc
Merge pull request #21272 from cbodley/wip-rgw-beast-experiment
rgw: beast frontend no longer experimental

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-04-10 13:32:50 -04:00
Yehuda Sadeh
776e547956
Merge pull request #21120 from oritwas/wip-rgw-21619
rgw: reshard cancel command should clear bucket resharding flag

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-04-10 10:21:52 -07:00
Casey Bodley
f1e826ad7f rgw: beast frontend no longer experimental
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-10 12:26:37 -04:00
Sage Weil
2f00b8f990 Merge PR #21302 into wip-sage-testing-20180410.153118
* refs/pull/21302/head:
	qa/suites/rados/singleton/all/random-eio: whitelist eio error message

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-04-10 10:31:26 -05:00
Sage Weil
dbdbbbfc89 Merge PR #21315 into wip-sage-testing-20180410.153007
* refs/pull/21315/head:
	qa/tasks/mgr/test_failover: fix for id -> name rename in mgr metadata

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-04-10 10:30:48 -05:00
Sage Weil
f53190a64f githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 10:30:47 -05:00
Josh Durgin
d84f723c57
Merge pull request #21324 from tchaikov/wip-23495
qa/suites: whitelist SLOW_OPS

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-10 08:21:11 -07:00
Tiago Melo
caf7e7a434 mgr/dashboard: Replace toastr calls with notification service
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-04-10 16:07:27 +01:00
Tiago Melo
7c37d8a06b mgr/dashboard: Add notification component
This component is used on the navigation bar and will show the user the 10 most
recent notifications.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-04-10 16:07:27 +01:00
Tiago Melo
89101061d0 mgr/dashboard: Add notification service
This service should be used to display any notification/toast to the user.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-04-10 16:07:26 +01:00
Yehuda Sadeh
63221d9a81
Merge pull request #19283 from yehudasa/wip-rgw-mfa
rgw: mfa support

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-04-10 07:59:10 -07:00
Ricardo Dias
b0d00e18d7
Merge pull request #21327 from LenzGr/dashboard-fork-awesome
mgr/dashboard: Replace font-awesome with fork-awesome

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile vtheile@suse.com
2018-04-10 15:58:26 +01:00
Patrick Donnelly
3c728553cf
Merge PR #21080 into master
* refs/pull/21080/head:
	src: Added const references to various function parameters

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-10 07:54:14 -07:00
Lenz Grimmer
116aa62d3d
Merge pull request #21126 from tspmelo/wip-services
mgr/dashboard: Add Api module

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-04-10 16:47:03 +02:00
Jeff Layton
53b59a3c0b fuse: wire up fuse_ll_access
This gets called during chdir and is currently a no-op. Make sure we
check permissions appropriately.

Tracker: http://tracker.ceph.com/issues/23509
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-04-10 10:06:33 -04:00
Lenz Grimmer
2bc9c7351d mgr/dashboard: Replace font-awesome with fork-awesome
Replaces the dependency on Font Awesome with Fork Awesome
(https://forkawesome.github.io/), which is a plug-in replacement
for font-awesome 4.7.0 and adds a few more icons (see
https://forkawesome.github.io/Fork-Awesome/whats-new/ for
background information about this fork).

It is licensed under the following licenses - see
https://forkawesome.github.io/Fork-Awesome/license/ for details:

Fonts: SIL OFL 1.1
Code: MIT License
Documentation: CC BY 3.0

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-04-10 14:59:46 +02:00
Sage Weil
497a63251b qa/workunits/cephtool: test with valid auth syntax
'allow' is not a valid mon cap; use 'allow *'.  Add some negative tests
to ensure the validation is working.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 07:39:06 -05:00
Sage Weil
fa588730bf mon/AuthMonitor: check caps validity for all cap-related commands
Add a validity check for 'auth add' and 'fs authorize'.  'auth caps' and
'auth get-or-create[-key]' already had the check.

Fixes: http://tracker.ceph.com/issues/22525
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 07:39:06 -05:00
lijing
113fa941e3 mon: expand cap validity check for mgr, osd, mds
Also strenghen the check to declare an unknown cap type as invalid.

Note that this means that in a mixed-version cluster, an older mon
would apply the syntax check for the older caps, even if the (say) OSDs
are newer and could parse something different.  This is judged to be fine:
it is not unreasonable to ask for the mons *and* daemons to be upgraded
before using the new cap syntax or feature.

Signed-off-by: Jing Li <lijing@gohighsec.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 07:39:06 -05:00
Kefu Chai
6623fc26db osd,mds: use map::merge() whenever appropriate
and use explicit std::move() when map::merge() is not available.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 20:27:40 +08:00
Kefu Chai
9c5cb4ea62 osd: resend osd_pgtemp if it's not acked
if the osd_pgtemp message is dropped before monitor receives it, we need
to resend it. otherwise a pg could be stuck in activating state if the
pg creation was withheld by the max-pg-per-osd on the replica, and then
the replica osd removes some existing pg.

Fixes: http://tracker.ceph.com/issues/23610
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 20:27:40 +08:00
Kefu Chai
18571821b5
Merge pull request #21319 from majianpeng/doc-remove-osd-op-threads
doc: remove unused config: "osd op threads"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-10 20:12:08 +08:00
Kefu Chai
acc08559ce qa/suites: whitelist SLOW_OPS
Fixes: http://tracker.ceph.com/issues/23495
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 19:25:47 +08:00
Orit Wasserman
f4dae60d4c rgw: warn user about on going resharding when canceling it
Fixes: http://tracker.ceph.com/issues/21619
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2018-04-10 13:57:58 +03:00
Orit Wasserman
2a68224aa4 rgw: no need to RGWReshard::get before remove
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2018-04-10 13:57:17 +03:00
Kefu Chai
df9cd23605
Merge pull request #21112 from guzhongyan/fix-vlog
src: fix various log messages

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-10 18:51:12 +08:00
Kefu Chai
fa8a435e88
Merge pull request #21028 from rzarzynski/wip-osd-get_rw_locks-norefcnt
osd: avoid unnecessary ref-counting across PrimaryLogPG::get_rw_locks.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-10 18:49:01 +08:00
Kefu Chai
2c3cbc170e
Merge pull request #21235 from xiexingguo/wip-fix-obj-start
osd/osd_types: fix ideal lower bound object-id of pg

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-10 18:47:58 +08:00
Yan, Zheng
c66189f00d mds: properly dirty sessions opened by journal replay
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/23625
2018-04-10 17:23:20 +08:00
xie xingguo
4715594985 crush/CrushWrapper: don't bump up leaf stack if we are already of domain OSD
Assume we have a pool of crush-failure-domain OSD, then the stack will look like:
[
  "0":"8"                  // stack[0]
  "0":"1"                  // stack[1]
]

The above stack is error-prone because when passed to _choose_type_stack(),
iterator **i** shall already point to orig.end() when stack[0] is done
and might still get incremented while we continues to handle stack[1], and
hence produce the following abnormal (**overflowed**) mapping results:

```
   -36> 2018-04-06 23:06:35.041274 7f84692bd700 10  total_deviation 24.6667 overfull 4,5,6,7,8 underfull [2,0,3,9]
   -35> 2018-04-06 23:06:35.041278 7f84692bd700 10  osd.7 move 3
   -34> 2018-04-06 23:06:35.041280 7f84692bd700 10   trying 2.0
   -33> 2018-04-06 23:06:35.041310 7f84692bd700 10   2.0 [3,5,6,4,9,0,7,10] -> [1953720676,1683976050,1919120229,1769238633,838889071,3224629,101,2]
   -32> 2018-04-06 23:06:35.041317 7f84692bd700 10   2.0 pg_upmap_items [3,1953720676,5,1683976050,6,1919120229,4,1769238633,9,838889071,0,3224629,7,101,10,2]
```

See also:
http://pulpito.ceph.com/yuriw-2018-04-06_21:35:03-rados-wip-yuri2-testing-2018-04-06-1946-luminous-distro-basic-smithi/2365151/

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-04-10 16:41:43 +08:00
xie xingguo
4ec24128fd crush/CrushWrapper: fix potential invalid use of iterator
In choose_leaf mode we normally should have a stack of 2 and
hence below here we still need to re-check the iterator against
the stack loop.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-04-10 16:21:49 +08:00
Yan, Zheng
a7db43b5f7 tools/cephfs: instantiate MDSUtility after global_init()
cephfs-foo-tool from current master crashes immediately it starts.

Introduced by commit 6972273d53 "global: output usage on -h, --help,
or no args before contacting mons"

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/23624
2018-04-10 16:15:16 +08:00
Kefu Chai
549fbc6faf rocksdb: sync with upstream
to pick up
- bug fixes since 5.8.0
- crc32c_3way introduced in 5.9.0 for better performance on platforms
with PCLMULQDQ support.
- the fixes for silencing the fallthrough warnings when compiling with
GCC-7

for detailed changelog since 5.8.0, see
https://github.com/facebook/rocksdb/blob/master/HISTORY.md

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 15:22:19 +08:00
Kefu Chai
1d8c043809 ceph: print output of "status" as string not as bytes
in python3, the stuff read from wire is represented as "bytes", but
the output of "ceph -w" is supposed to be consumed by human. so decode
it as utf-8.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 13:31:13 +08:00
Josh Durgin
ee03866b9f
Merge pull request #21313 from ceph/wip-pg-clean-timeout
qa/tasks: Add default timeout for wait for pg clean task

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-09 22:27:16 -07:00
Kefu Chai
3abe420365
Merge pull request #21284 from tchaikov/wip-cmake-libstdcxx
cmake: define HAVE_STDLIB_MAP_SPLICING for both libstdc++ and libc++

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-04-10 13:21:31 +08:00