Commit Graph

72557 Commits

Author SHA1 Message Date
Casey Bodley
2dc585975a Merge pull request #14389 from mingshuaiwang/master
rgw: segment fault when shard id out of range

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-23 13:54:56 -04:00
Casey Bodley
0247770025 Merge pull request #12774 from shashalu/gc-list
rgw: fix 'gc list --include-all' command infinite loop the first items

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-23 13:52:58 -04:00
Haomai Wang
eded0c11b2 Merge pull request #15242 from liupan1111/wip-fix-msg
msg/async: Lower down the AsyncMessenger's standby warning from debug

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-05-24 00:14:03 +08:00
Sage Weil
ae19a960c6 Merge pull request #15218 from liewegas/wip-crush-features
crush/CrushWrapper: fix has_incompat_choose_args

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-05-23 11:06:56 -05:00
Pan Liu
c53d949e7f msg/async: Lower down the AsyncMessenger's standby warning from debug
level 0 to 10.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-05-23 23:15:14 +08:00
John Spray
8d85c52fa2 Merge pull request #14610 from jcsp/wip-17980
#17980: MDS client blacklisting and blacklist on eviction

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-05-23 14:57:01 +01:00
John Spray
e875d7ddf9 Merge pull request #14550 from ukernel/wip-multimds-misc
mds: miscellaneous multimds fixes

Reviewed-by: John Spray <john.spray@redhat.com>
2017-05-23 13:14:43 +01:00
John Spray
3913ed0ba6 qa: refine assert_session_count (don't count killing)
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:18 -04:00
John Spray
ee2683c804 qa: update TestVolumeClient for new blacklisting
Blacklisted clients will now proactively fail
outstanding operations, rather than blocking.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:18 -04:00
John Spray
ab8e328c80 qa: clean up whitespace in test_misc.py
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:18 -04:00
John Spray
c91ccac6f6 qa: remove outdated TODO in TestVolumeClient
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
06935d406b qa: log whitelist for eviction messages
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
45caf26140 mds: improve eviction usability and update docs
The "session ls" and "session evict" are now
"client ls" and "client evict" (the old ones
are still there for backwards compatibility).

The automatic client eviction now emits
cluster logs that call the client by its
friendly name (usually the hostname).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
71229af5ea mds: tidy up 'kill_session' naming
We had two kill_sessions.  Leave Server::kill_session (the
one that actually operates on MDS sessions only), and rename
the MDSRank one to evict_client, because it does more than
just kill the MDS session.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
47a9c9ba67 qa: add test_filelock_eviction
To check that eviction is releasing flocks.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
dd08483bd0 mds: hook up autoclose to blacklisting eviction
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
048e825484 mds: make blacklisting configurable in kill_session
This makes the code a bit awkward because we now have
4x paths through this function (blocking, noblocking, blacklisting,
nonblacklisting).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
4a9386e4e7 client: fix unmounting while blacklisted
Previously, if you ever made it as far as ~Client
with any inodes in your cache, you'd hit the ObjectCacher
is_locked_by_me assertion during release_set on those inode's osets.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
7d8281c805 client: detect blacklisting of myself
EIO all operations when this happens, and do a cut-down
unmount() so that once the user has noticed his mount
is broken, he can unmount it without getting stuck
waiting for flushes/caps/sessions.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
711ee5ee56 mds: update osd epoch barrier when handling blacklist
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
05b171b553 mds: update osdmap epoch barrier on eviction
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
d6ce9d8bc9 mds: blacklist clients on eviction
Fixes: http://tracker.ceph.com/issues/9754
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
John Spray
3610729ca0 mon: permit MDS daemons to do blacklisting
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:15 -04:00
John Spray
dd173bd528 mds: remove stale comment
The code the comment is talking about went
away in 2490a0a1e.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:15 -04:00
John Spray
3fe5e734be mds: apply OSDMap blacklist to CephFS clients
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:15 -04:00
John Spray
fe56a74cd2 osd/OSDMap: std::set version of get_blacklist
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:15 -04:00
John Spray
d98ace137b osdc: expose new blacklist entries from Objecter
For the MDS which needs to know about new blacklist entries
in order to evict corresponding MDS sessions.

Fixes: http://tracker.ceph.com/issues/17980
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:15 -04:00
Jos Collin
309442fac6 Merge pull request #15220 from joscollin/wip-cleanup-rados-typo
include/rados: Fix typo in rados_ioctx_cct() doc
2017-05-23 10:50:27 +05:30
Jos Collin
c969709b20 include/rados: Fix typo in rados_ioctx_cct() doc
This fixes PR#15077.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-05-23 09:33:20 +05:30
Sage Weil
b1e4295570 crush/CrushWrapper: fix has_incompat_choose_args
If the map has *no* choose_args it does not have incompat choose args.
This makes the OSDMap::get_features() check

  if (crush->has_incompat_choose_args())
    features |= CEPH_FEATURE_CRUSH_CHOOSE_ARGS;

happier.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-22 22:51:18 -04:00
Matt Benjamin
2839052174 Merge pull request #15210 from linuxbox2/wip-rgw-rmbuck
rgw_file: remove hidden uxattr objects from buckets on delete
2017-05-22 20:40:09 -04:00
Matt Benjamin
01e15c3ec6 rgw_file: remove hidden uxattr objects from buckets on delete
If a setattr (e.g., chown) has been performed on a bucket, then like
any directory it has a hidden object storing its attributes. This must
be deleted before attempting bucket delete, otherwise, actually empty
buckets will not be removable via NFS.

Fixes: http://tracker.ceph.com/issues/20045

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-05-22 18:16:54 -04:00
Sage Weil
7ebe7c1cfb Merge pull request #15195 from theanalyst/doc/12.0.3-typo-fix
doc: fixing an error in 12.0.3 release notes

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2017-05-22 12:46:43 -05:00
Adam C. Emerson
bba7d0b733 Merge pull request #15186 from adamemerson/wip-clangtastic-mr-clocks
rgw: Remove pessimizing move
common: Forward-declare container I/O overloads

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-22 13:14:06 -04:00
Yehuda Sadeh
34a17d5ff7 Merge pull request #12861 from theanalyst/wip-absolute-urls
rgw: pass authentication domain to civetweb

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-05-22 09:30:53 -07:00
Sage Weil
cea91e0cd6 Merge pull request #15150 from ovh/bp-doc-perf-histograms
doc: document perf historgrams

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-22 10:59:22 -05:00
Piotr Dałek
756b3d59e6 doc: document perf historgrams
Documentation for perf histograms schema and dump.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2017-05-22 15:53:21 +00:00
Adam C. Emerson
ad2dbca06a rgw: Remove pessimizing move
Do not std::move values from returned functions.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-22 11:17:13 -04:00
Adam C. Emerson
a7fefb0ebf common: Forward-declare container I/O overloads
This will allow strict ADL to find the right overload in the case of a
container of containers and unbreak compilation with Clang.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-22 11:17:00 -04:00
Mykola Golub
1367ab2a2d Merge pull request #15162 from dillaman/wip-19970
librbd: reduce potential of erroneous blacklisting on image close

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-22 15:50:57 +03:00
Abhishek Lekshmanan
3cfe612e5d doc: fixing an error in 12.0.3 release notes
Thanks @smithfarm for pointing this out

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-05-22 10:42:19 +02:00
Jos Collin
c89bbd66b6 Merge pull request #15191 from Linbing/modify-note-word-error
mon: Fixed typo in @post of _active()
2017-05-22 07:30:43 +05:30
linbing
e10061ee96 Note word error of _active(), take iif with if
Signed-off-by: Linbing <hawkerous@gmail.com>
2017-05-22 08:32:28 +08:00
Kefu Chai
e3319da51d Merge pull request #15181 from tchaikov/wip-cxx1z-size
common: add ceph::size()

Reviewed-By: Adam C. Emerson <aemerson@redhat.com>
2017-05-20 09:53:45 +08:00
Sage Weil
de6c0bd618 Merge pull request #14946 from dmick/wip-mgr-dashboard
mgr: dashboard GUI module
2017-05-19 16:59:59 -05:00
Casey Bodley
e01fd6846c Merge pull request #14994 from theanalyst/f/tier-fix
rgw_rados: create sync module instances only if run_sync_thread is set

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-19 17:58:46 -04:00
Dan Mick
10b1fa211c test: add mgr/ and smoke test for mgr dashboard
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-05-19 14:47:48 -07:00
Abhishek Lekshmanan
e46fc5022c rgw_rados: create sync module instances only if run_sync_thread is set
This allows for radosgw-admin to run even if there was a
misconfiguration in setting tier types which would otherwise make it
difficult to revert an invalid tier type setting. Since sync modules are
necessary only for rgw and not for the admin itself, this allows for
invalid tier configurations to be corrected as rgw-admin wouldn't fail

Fixes: http://tracker.ceph.com/issues/19830
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-05-19 22:08:13 +02:00
Casey Bodley
e7e7e9403a Merge pull request #15153 from zhangsw/optimize-torrent
rgw: optimize generating torrent file. Object data won't stay in memory  now.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-05-19 15:03:06 -04:00
Casey Bodley
e546f46918 Merge pull request #15001 from chardan/jfw-wip-halflife_atomic_t-kamakuras
rgw: migrate atomic_t to std::atomic<>

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-19 15:02:14 -04:00