Commit Graph

81020 Commits

Author SHA1 Message Date
Jos Collin
6c39818eaf doc: doc for mount.fuse.ceph
Created doc for mount.fuse.ceph.

Fixes: http://tracker.ceph.com/issues/21539
Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-28 15:56:09 +05:30
Kefu Chai
c05e842009 spdk: update SPDK to v17.10
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 18:06:34 +08:00
Yehuda Sadeh
5f84a72989 test_multi: add a test for zone redirect
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-11-28 01:27:43 -08:00
Yehuda Sadeh
d94e9cc973 rgw-admin: add option to configure redirect_zone
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-11-28 01:27:43 -08:00
Yan, Zheng
e4ecf26a8e mds: handle client reconnect gather race
Fixes: http://tracker.ceph.com/issues/22263
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-28 17:07:24 +08:00
rune
93f9007da3 doc: add pre-requisite to enable CephFS snapshot
Signed-off-by: Jian Su <sujian@umcloud.com>
2017-11-28 16:25:17 +08:00
Kefu Chai
b3c159e9fb qa/ceph-disk: enlarge the simulated SCSI disk
100MB will be allocated for journal, and the remaining 100MB is for data
device. taking the inode into consideration, there will be approximately
87988 kB available for the activated OSD. and it will complain with a
"nearfull" state.

Fixes: http://tracker.ceph.com/issues/22136
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
c78deac400 ceph-disk: should throw if fail to read key-management-mode
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
3e8c6f8d03 ceph-disk: fix the logging messages
logging.Logger.warn(format, *args). so no need to prepar a string
for it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
1113ac255a ceph-disk: path_set_context() after rename()
it does not matter if we chown/restorecon before or after the rename,
but the logging message looks better this way: instead of fixing the
.tmp files, we are updating the attributes of the dest files w/o
.${pid}.tmp extension.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:33 +08:00
Kefu Chai
aa34321a4a qa/workunits/ceph-disk: do not redirect stderr to stdout
normally, if we care about the output of ceph-disk, we expect a json
string, and ceph-disk sends the output to stdout, and errors/warnings
to stderr. so everything works as expected. and the test should also
follow this tradition. for example, if deprecated warnings are printed,
the warning message should not be collected along with the json string.

see also: d44334f3

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-28 14:55:19 +08:00
Xiaoxi Chen
d10c6c26f9 mon/PGMap: Fix %USED calculation bug.
Previous code forgot to multiple raw_used_ratio to calculate
used byte.

Fixes: http://tracker.ceph.com/issues/22247
Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-11-27 22:26:35 -07:00
Adam C. Emerson
4489cb58a1 rgw: Expire entries in bucket info cache
To bound the degree to which an RGW instance can go out to lunch if
the watch/notify breaks down, force refresh of any cache entry over a
certain age.

Fifteen minutes by default, and expiration can be turned off entirely.

This is separate from the LRU. The LRU removes entries based on the
last time of access. This expiration patch forces refresh based on the
last time they were updated.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
e397b7e6d0 rgw: Handle stale bucket info in RGWDeleteBucketPolicy
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
1738b4f6b7 rgw: Handle stale bucket info in RGWPutBucketPolicy
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
f4d274248e rgw: Handle stale bucket info in RGWDeleteBucketWebsite
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
b2b7385f19 rgw: Handle stale bucket info in RGWSetBucketWebsite
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
a0a1e7c2ef rgw: Handle stale bucket info in RGWSetBucketVersioning
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
ebb86301b2 rgw: Handle stale bucket info in RGWPutMetadataBucket
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
1a3fcc70c0 rgw: Add retry_raced_bucket_write
If the OSD informs us that our bucket info is out of date when we need
to write, we should have a way to update it.

This template function allows us to wrap relevant sections of code so
they'll be retried against new bucket info on -ECANCELED.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:57:15 -05:00
Adam C. Emerson
9114e5e509 rgw: Add try_refresh_bucket_info function
Sometimes operations fail with -ECANCELED. This means we got raced. If
this happens we should update our bucket info from cache and try again.

Some user reports suggest that our cache may be getting and staying
out of sync. This is a bug and should be fixed, but it would also be
nice if we were robust enough to notice the problem and refresh.

So in that case, we invalidate the cache and fetch direct from the
OSD, putting a warning in the log.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-27 15:28:30 -05:00
Matt Benjamin
4b64756166
Merge pull request #19182 from cbodley/wip-beast-v124
submodule: update Beast to ceph/ceph-master branch
2017-11-27 14:27:34 -05:00
Casey Bodley
efe9076595 submodule: update Beast to ceph/ceph-master branch
pulls beast submodule up from v116 tag to v124, with an additional bug
fix for async_read_some()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 14:17:21 -05:00
Patrick Donnelly
ced416aa64
client: use PATH_MAX for mount path size
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-27 10:43:32 -08:00
Yuri Weinstein
54e51fd3c3
Merge pull request #19175 from liewegas/wip-rest-test
qa/suites/rados/rest: move rest_test from qa/suites/rest/

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-11-27 09:20:44 -08:00
Sage Weil
ddb274669c qa/suites/rados/rest: move rest_test from qa/suites/rest/
...and add more health whitelists.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-27 10:11:51 -06:00
Nathan Cutler
9ecc462956 cmake: mgr: exclude .gitignore
Fixes RPMLINT warning:

ceph-mgr.x86_64: W: version-control-internal-file /usr/lib64/ceph/mgr/.gitignore
ceph-mgr.x86_64: W: version-control-internal-file /usr/lib64/ceph/mgr/dashboard/static/AdminLTE-2.3.7/.gitignore
You have included file(s) internally used by a version control system in the
package. Move these files out of the package and rebuild it.

Note: the backslash has to be doubled up for the regex to make
it through CMake.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-11-27 15:24:38 +01:00
Casey Bodley
41c12b446b
Merge pull request #19109 from mikulely/main-cleanup
rgw: drop useless includes in rgw_{main.cc, common.h}

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 09:16:48 -05:00
Radoslaw Zarzynski
ff28e9a1e1 common: introduce PerfGuard to PerfCounters.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-11-27 15:16:03 +01:00
Casey Bodley
33dbceb366
Merge pull request #18935 from cfanz/cfanz-version-id-wip
rgw:send x-amz-version-id header when upload files

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 09:12:34 -05:00
Casey Bodley
92ca3f52b2
Merge pull request #18981 from yaozongyou/fix-rgw-bi-decode-bug
cls/rgw: mtime in rgw_bucket_dir_entry_meta not really decoded

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 09:09:31 -05:00
Casey Bodley
5ae73cda7d
Merge pull request #18978 from yaozongyou/wip-radosgw-admin-add-check
rgw-admin: check the data extra pool supports omap

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 09:08:59 -05:00
Casey Bodley
437b8ed55e
Merge pull request #18962 from ZVampirEM77/wip-em-readlen
rgw: check read_op.read return value in RGWRados::copy_obj_data

Reviewed-by: Amit Kumar <amitkuma@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-27 09:08:23 -05:00
Jason Dillaman
3ae101edb5
Merge pull request #19130 from trociny/wip-mirror-enable-cleanup
librbd: update mirror::EnableRequest diagram according to code

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-27 09:06:19 -05:00
Boris Ranto
059588e758 qa/restful: Test pg_num/pgp_num modifications
Signed-off-by: Boris Ranto <branto@redhat.com>
2017-11-27 14:35:26 +01:00
Jos Collin
f381ed57e3
Merge pull request #19128 from joscollin/wip-mountfuseceph-typo
mount.fuse.ceph: Fix typo

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-11-27 17:28:21 +05:30
Yingxin
072a25cd6e blkin: fix unconditional tracing
Blkin trace will be triggered unconditionally at OSD `issue_op`, even if
op->pg_trace is not initialized. This issue introduces unnecessary
overhead and confusing tracing records when blkin tracing is ON.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2017-11-27 05:14:11 -05:00
Jos Collin
3865b4872d
Merge pull request #19169 from wwba/fix-ceph-bluestore-tool-man-page
doc: drop duplicate line in ceph-bluestore-tool man page

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-11-27 15:06:10 +05:30
Xiaojun Liao
2b0afa7762 doc: remove duplicate line from ceph-authtool man page
Signed-off-by: Xiaojun Liao <xiaojunliao85@gmail.com>
2017-11-27 15:49:27 +08:00
wangsongbo
35cb7accf1 ceph-dencoder: add support for RGWLifecycleConfiguration
Signed-off-by: Songbo Wang wangsongbo@cloudin.cn
2017-11-27 15:08:58 +08:00
Venky Shankar
156359c9d0 rbd-mirror: ImageMap memory leak fixes
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-27 00:24:36 -05:00
Kefu Chai
764c2c0e1c cmake: silence CMP0054 warning
see https://gitlab.kitware.com/cmake/cmake/issues/17381 and
a8be8b1b54,
so before the updated cmake is released and packaged. we should
add this setting.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-27 12:50:38 +08:00
Shinobu Kinjo
f6c8724357 [cleanup] Remove namespace using directives for std
Signed-off-by: Shinobu Kinjo <shinobu@redhat.com>
2017-11-27 13:46:58 +09:00
Xie Xingguo
993b5f304e
Merge pull request #19154 from Fusl/master
doc: correcting typos in bluestore-config-ref and bluestore-migration

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-27 08:21:56 +08:00
Katie Holly
40e20986cd doc: correcting typos in bluestore-config-ref and bluestore-migration
Signed-off-by: Katie Holly <git@meo.ws>
2017-11-26 17:47:35 +01:00
Kefu Chai
342d1bccac
Merge pull request #18961 from tchaikov/wip-rgw-print-iam-policy
rgw: iam policy printing cleanups

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-26 17:53:18 +08:00
Kefu Chai
e984538c42
Merge pull request #19124 from tchaikov/wip-make-dist-boost
make-dist,cmake: avoid re-downloading boost

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-11-25 08:19:57 +08:00
Kefu Chai
54b528b802
Merge pull request #19081 from smithfarm/wip-ceph-volume-spec
build/ops: rpm: fix systemd macros for ceph-volume@.service

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2017-11-24 23:49:56 +08:00
Kefu Chai
a769b82a00
Merge pull request #19097 from tchaikov/wip-osd-prefix-inc
osd: use prefix increment for non trivial iterator

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-24 23:48:52 +08:00
Kefu Chai
60e8cd615e
Merge pull request #19094 from tchaikov/wip-coverity-cid-1395794
msg/simple: pass a char for reading from shutdown_rd_fd

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-11-24 23:48:14 +08:00