Commit Graph

77841 Commits

Author SHA1 Message Date
Douglas Fuller
8f9a252020 qa/cephfs: support CephFS recovery pools
Add support for testing recovery of CephFS metadata into an alternate
RADOS pool, useful as a disaster recovery mechanism that avoids
modifying the metadata in-place.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-30 09:02:44 -04:00
Douglas Fuller
c85562c94a qa/ceph_test_case: support CephFS recovery pools
Add support for testing recovery of CephFS metadata into an alternate
RADOS pool, useful as a disaster recovery mechanism that avoids
modifying the metadata in-place.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-30 09:02:44 -04:00
Douglas Fuller
5fafc03cb9 qa/cephfs: Allow deferred fs creation
Permit Filesystem objects to be created and settings modified before
calling Filesystem.create().

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-30 09:02:44 -04:00
Douglas Fuller
47318f8ac4 qa/cephfs: Refactor alternate pool test
Remove the alternate pool recovery test from test_data_scan. Newer
commits will place the test in its own file.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-30 09:02:44 -04:00
myoungwon oh
a764f90e88 osd: add multiple objecter finishers
Bluestore and Filestore already adapt multiple finishers to improve IO performance.
But Objecter finisher (for tier approach) is still single thread. This can be a
bottleneck if we generate many IOs as Bluestore and Filestore because most of
completion processes (proxy, writeback) are handled by a objecter finisher.

Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2017-08-30 21:47:42 +09:00
zhangwen
626ff1b3c5 doc: Revise the Example of Bucket Policy
Signed-off-by: Wen Zhang zhangwen1@unionpay.com
2017-08-30 16:53:00 +08:00
Abhishek Lekshmanan
01740c6a6c doc: rgw: mention the civetweb support for binding to multiple ports
We support binding multiple ports in civetweb after the upgrade to 1.8,
clarify this in the documentation as well

Fixes: http://tracker.ceph.com/issues/20942
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-30 10:48:01 +02:00
Kefu Chai
a412990d59 crush: add more constness to CrushWrapper
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-30 15:31:56 +08:00
Kefu Chai
9ec4e216cb crush: get largest bucket id faster
std::map<> is sorted, so we can always get the largest key by reading
it's last element.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-30 15:31:56 +08:00
Haomai Wang
4a3a25dece Merge pull request #17358 from tchaikov/wip-doc-disable-ofp
doc/dev/perf: add doc on disabling -fomit-frame-pointer

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-08-29 23:35:04 -07:00
Kefu Chai
a5198678c5 Merge pull request #16357 from Blackclaws/master
ceph-disk activate unlocks bluestore data partition

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-30 13:44:50 +08:00
Kefu Chai
8f49f7ecf2 Merge pull request #16312 from tchaikov/wip-store-event-if-added
common,mds,mgr,mon,osd: store event only if it's added

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-30 13:43:16 +08:00
Kefu Chai
4f4af6262a doc/dev/perf: add doc on disabling -fomit-frame-pointer
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-30 12:14:37 +08:00
liuchang0812
9d313776a8 os/bluestore: do not core dump when BlueRocksEnv gets EEXIST error
in `rocksdb::repairdb`, rocksdb needs create a directory `lost` to archive all files.
we will get a EEXIST error when there is a `lost` directory already.

Fixes: http://tracker.ceph.com/issues/20871

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-08-30 11:56:50 +08:00
Sage Weil
3cf248c04d Merge pull request #15847 from jan--f/doc-fix-multimds-cmds
doc: add allow_multimds and fs_name parameter

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-08-29 22:19:59 -05:00
Sage Weil
9b056e38dc Merge pull request #16210 from aclamk/fix-radosgw-nfs-sync-hint
rgw,nfs: Add hint to use -o sync when mouting

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-08-29 21:53:49 -05:00
Sage Weil
c0a6353fd4 Merge pull request #16542 from linuxbox2/wip-rados-urls
librados.h:  add LIBRADOS_SUPPORTS_APP_METADATA

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-29 21:34:32 -05:00
Sage Weil
dfe5f05f79 os/bluestore/BlueFS: compact log even when sync_metadata sees no work
It's possible that when sync_metadata() is called there won't be any new
log data to flush because it was already flushed for other reasons (e.g.,
because fsync was called).  However, the log may still be large and in
need of compaction.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-29 22:07:05 -04:00
Jason Dillaman
1b2f1358f7 Merge pull request #17346 from idryomov/wip-krbd-xfstests-update
qa/suites/krbd: rbd_xfstests job overhaul

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-29 18:28:48 -04:00
Sage Weil
3947f91866 Merge pull request #16771 from yanyixing/fix-base
mgr/dashboard: fix pool size base conversion

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-29 17:25:33 -05:00
Sage Weil
ab8ae1221b Merge pull request #16988 from mikulely/wip-mstart
mstart.sh: support read CLUSTERS_LIST from env var

Reviewed-by: Sage Weil <sage@redhat.com.>
2017-08-29 17:17:06 -05:00
Sage Weil
ededa106be Merge pull request #17057 from mikulely/enhance-vstart
vstart.sh: quote cmd params when display executing cmd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-29 17:13:21 -05:00
Sage Weil
9d16f3881a Merge pull request #17092 from Liuchang0812/wip-man-kvstore-tool
doc: add ceph-kvstore-tool's man

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 17:10:12 -05:00
Sage Weil
66838565bd Merge pull request #17119 from nrdmn/wip-dashboard-httproot
pybind/mgr/dashboard: add url_prefix

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-29 17:07:41 -05:00
Sage Weil
26665c37fd Merge pull request #17135 from amitkumar50/cov-tools-1
tools: Initialization of *server, command variables

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 17:06:11 -05:00
Sage Weil
83e9de2f7d Merge pull request #17143 from smithfarm/wip-50-too-short
doc: SubmittingPatches: clarify PR title section
2017-08-29 17:05:08 -05:00
Sage Weil
7abe19e1ba Merge pull request #17177 from liupan1111/wip-fix-rm
osd: allow FULL_TRY after failsafe

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:59:59 -05:00
Sage Weil
8245a8da42 Merge pull request #17220 from amitkumar50/cov-test-2
test: Check to avoid divide by zero

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:59:32 -05:00
Sage Weil
7c02917ecc Merge pull request #17313 from mslovy/wip-fix-storetest
os: kstore fix unittest for FiemapHole

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:58:54 -05:00
Sage Weil
1ae70df392 Merge pull request #17329 from xiexingguo/wip-21162
mon/OSDMonitor: make 'osd crush rule rename' idempotent

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:58:21 -05:00
Sage Weil
741ebd4812 Merge pull request #17296 from amitkumar50/cov-test-4
test: assert check for negative returns

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:38:10 -05:00
Sage Weil
ae5fb0d491 Merge pull request #17297 from amitkumar50/cov-os-2
os: Removing dead code from LFNIndex.cc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:37:31 -05:00
Sage Weil
3474c6bc1b Merge pull request #17334 from chenliuzhong/modify-fault_rang-parameter-in-reshard
os/bluestore: ExtentMap::reshard - fix wrong shard length

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2017-08-29 15:29:14 -05:00
Sage Weil
9d72d6087a include/ceph_features: enable SERVER_MIMIC feature bit
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-29 16:27:23 -04:00
Sage Weil
6207c61988 Merge pull request #17337 from scienceluo/wip-luo-fix-cinder-conf-branch
doc: move glance_api_version option to the right place

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:25:04 -05:00
Sage Weil
98645486f2 Merge pull request #17341 from amitkumar50/cov-common-1
common: logically dead code inside shunique_lock.h

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 15:24:29 -05:00
Sage Weil
1be5a853b8 Merge pull request #16915 from theanalyst/doc-12.2.0-major-changes
doc: 12.2.0 major release announcements
2017-08-29 13:54:01 -05:00
Abhishek Lekshmanan
12b40971ca doc: release notes: changelog for 12.2.0
Amalgamated all the dev & RC changelogs + the changelog we saw post
12.1.4 into one large 12.2.0 changelog.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-29 20:51:19 +02:00
J. Eric Ivancich
643f20ac31 osd: speed up get_key_name
Reduce string manipulation and creation of an extra string by
streamlining code for get_key_name in both eversion_t and
pg_log_dup_t.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2017-08-29 12:46:09 -04:00
Sage Weil
8dbddc4511 Merge pull request #17308 from jcsp/wip-21157
mgr: fix crash in MonCommandCompletion

Reviewed-by: Tim Serong <tserong@suse.com>
2017-08-29 11:34:36 -05:00
Kefu Chai
d24ba40be3 Merge pull request #17312 from cbodley/wip-21155
qa: create_cache_pool no longer runs 'pool application enable'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-30 00:14:21 +08:00
Yuri Weinstein
f4c4a9d90c Merge pull request #17125 from xiexingguo/wip-add-bucket-with-loc
mon/OSDMonitor: add location option for "crush add-bucket" command

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:12:43 -07:00
Yuri Weinstein
29a1236066 Merge pull request #17239 from zmedico/PGPool-update-eliminate-expensive-union_of
osd/PG: PGPool::update: avoid expensive union_of

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:12:25 -07:00
Yuri Weinstein
48453fe7ea Merge pull request #17276 from yuyuyu101/wip-mon-loop
msg/async: don't stuck into resetsession/retrysession loop

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:11:53 -07:00
Yuri Weinstein
0128851efe Merge pull request #17288 from yuyuyu101/wip-21143
msg/async: don't kill connection if replacing

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:11:03 -07:00
amitkuma
c943805438 common: logically dead code inside shunique_lock.h
Fixes the coverity issue:

** 1352097 Structurally dead code

CID 1352097 (#1 of 1): Structurally dead code (UNREACHABLE)
unreachable: This code cannot be reached: return ceph::shunique_lock<...

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-08-29 21:16:50 +05:30
Pan Liu
dcd7e5bb82 rbd-nbd: lower down the log level when return -EINVAL in aio_callback.
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-08-29 23:30:15 +08:00
amitkuma
05050b2f69 osd: Deleting dead code PrimaryLogPG.cc
Fixes the coverity issue:

** 1415775 Logically dead code
Here r cannot be less than 0.
CID 1415775 (#1 of 1): Logically dead code (DEADCODE)
dead_error_line: Execution cannot reach this statement: return r;

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-08-29 20:28:53 +05:30
Casey Bodley
fd2a016d48 Merge pull request #17254 from joscollin/wip-cleanup-rgw-override
rgw: add missing override in list_keys_init()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-08-29 10:10:49 -04:00
Ilya Dryomov
6647c65ebe qa/suites/krbd: new rbd_xfstests job definition
ext4 seems to be a better choice for our purposes -- less test churn,
rather small and reliable exclude list.

All excluded tests but generic/050 fail with no krbd in the mix, most
have popped up on linux-ext4 list at least once.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-08-29 16:09:35 +02:00