1
0
mirror of https://github.com/ceph/ceph synced 2025-03-19 00:45:00 +00:00
Commit Graph

74887 Commits

Author SHA1 Message Date
Kefu Chai
5485e6b470 Merge pull request from ganeshmaharaj/isal-v2.18
isa-l: update isa-l to v2.18

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-07 15:16:09 +08:00
Patrick Donnelly
8f121c70d3
Merge remote-tracking branch 'upstream/pull/15844/head' into master
* commit '47ab651a1f':
  qa: reset journal before cephfs_journal_tool_smoke.sh exits
  qa: remove 'apply' from journal_tool_smoke.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-06 22:16:02 -07:00
Patrick Donnelly
5b87301192
Merge remote-tracking branch 'upstream/pull/15822/head' into master
* upstream/pull/15822/head:
  qa: add timeout/repeat to pool df

Reviewed-by: John Spray <jspray@redhat.com>
2017-07-06 22:14:32 -07:00
Patrick Donnelly
77b707a6ea
Merge remote-tracking branch 'upstream/pull/15950/head' into master
* upstream/pull/15950/head:
  qa: update thrash max mds testing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-06 22:11:18 -07:00
Patrick Donnelly
c1590d7a1f
Merge remote-tracking branch 'upstream/pull/15758/head' into master
* upstream/pull/15758/head:
  mds: repeat dir->is_frozen in rdlock_path_xlock_dentry

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-07-06 21:49:08 -07:00
Patrick Donnelly
bbb0c6e3e1
Merge remote-tracking branch 'upstream/pull/15510/head' into master
* upstream/pull/15510/head:
  mds: improve freeze deadlock detection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-06 21:48:47 -07:00
Patrick Donnelly
64c6079d69
Merge remote-tracking branch 'upstream/pull/15937/head' into master
* upstream/pull/15937/head:
  qa: remove unused quota config option

Reviewed-by: John Spray <jspray@redhat.com>
2017-07-06 21:38:45 -07:00
Patrick Donnelly
56cb636a76
Merge remote-tracking branch 'upstream/pull/15825/head' into master
* upstream/pull/15825/head:
  mds: remove unused MDBalancer member
  Update last_epoch_(over|under) in MDBalaner if mds0 has failed

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-06 21:38:13 -07:00
Patrick Donnelly
b72ac6e857
Merge remote-tracking branch 'upstream/pull/15818/head' into master
* upstream/pull/15818/head:
  mds: assert straydn to silence coverity error

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-07-06 21:37:45 -07:00
Patrick Donnelly
97cdb1e34a
Merge remote-tracking branch 'upstream/pull/15817/head' into master
* upstream/pull/15817/head:
  qa: wait for healthy cluster before testing pins

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-07-06 21:36:34 -07:00
Patrick Donnelly
2cb42a4dbf
Merge remote-tracking branch 'upstream/pull/13770/head' into master
* upstream/pull/13770/head:
  tasks/cephfs: add TestStrays.test_replicated_delete_speed

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-06 21:33:03 -07:00
Sage Weil
145999a497 Merge pull request from markhpc/wip-bluestore-cache-behavior
os/bluestore: cap rocksdb cache size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-07-06 21:59:43 -05:00
Sage Weil
7a923dcf3a Merge pull request from yanghonggang/master
os/filestore/FileJournal: FileJournal::open() close journal file before return error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-06 21:39:00 -05:00
Sage Weil
3a85938487 Merge pull request from wido/mgr-plugin-zabbix
mgr: Zabbix monitoring module

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-06 21:38:01 -05:00
Sage Weil
5870a68c00 Merge pull request from gmayyyha/format-config-show
common,config: OPT_FLOAT and OPT_DOUBLE output format in config show

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-06 21:25:19 -05:00
Sage Weil
4e64eac6eb Merge pull request from yuyuyu101/wip-20330
msg: make listen backlog an option, increase from 128 to 512

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-06 21:24:22 -05:00
Sage Weil
ac494360b8 Merge pull request from kchiu/wip-filejournal-fix
os/filestore: call committed_thru when no journal entries are replayed

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-06 21:23:56 -05:00
Sage Weil
f19ea97706 Merge pull request from liupan1111/wip-precise
msg/async: make recv_stamp more precise

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-07-06 21:22:37 -05:00
Sage Weil
9038bb3d62 Merge pull request from tchaikov/wip-20432
Context: C_ContextsBase: delete enclosed contexts in dtor

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-06 21:21:57 -05:00
Jos Collin
de48170886 Merge pull request from renhwztetecs/renhw-wip-common-dns
common: Update the error string when res_nsearch() or res_search() fails 

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Sage Weil <sweil@redhat.com>
2017-07-07 01:40:52 +00:00
Ganesh Mahalingam
15c338b8c0 Update isa-l to v2.18
This upgrade brings
-  Complete rewrite of DEFLATE optimizations resulting in 5X better
   throughput and compression ratios comapred to  zlib, lz4, lzo and 2X
   better decompression performance when compared to zlib.
-  AVX512 improvements to multi-buffer versions of MD5, SHA-1 and SHA-256
   cryptographic hashing functions resulting in 3X better in performance
   compared to the AVX2 generation.

This update improves bluestore compression and potential to improve
dedup performance.

Testing this patch with objectstore fio yeided a max of 37% increase in
compression performance.

Fio Params:
rw=randwrite,buffer_compress_percentage=50,nr_files=64,direct=1,buffered=0,size=4G,bs=64k

Test			Avg BlueStore Compression Time
			v2.16(us)  v2.18(us)
iodepth=1,jobs=1	241.658    175.476	27.39%
iodepth=2,jobs=2	184.174    145.861	20.80%
iodepth=4,jobs=4	143.617    104.392	27.31%
iodepth=8,jobs=8	146.984    116.505	20.74%
iodepth=16,jobs=8	180.167    112.769	37.41%

Signed-off-by: Ganesh Mahalingam <ganesh.mahalingam@intel.com>
Signed-off-by: Tushar Gohad <tushar.gohad@intel.com>
2017-07-06 14:42:47 -07:00
Mark Nelson
0681743391 common/config_opts: favor bluestore kv cache before meta until max.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-06 14:14:44 -05:00
Sage Weil
2e7353a07b Merge pull request from wjwithagen/wip-wjw-freebsd-nobtrfs
os/filestore: Exclude BTRFS on FreeBSD

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-06 14:07:34 -05:00
Mark Nelson
803e701606 kv/RocksDBStore: explicitly disable block_cache when set to 0.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-06 11:13:13 -05:00
Mark Nelson
7435ddd69f os/bluestore: limit kv cache size.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-06 11:13:13 -05:00
Mark Nelson
d9e078402f common/config_opts: Better rocksdb cache size description.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-06 11:13:13 -05:00
Mark Nelson
814904ae68 kv/RocksDBStore: default to disable row cache.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-07-06 11:13:13 -05:00
Yuri Weinstein
676e1c9b7c Merge pull request from rzarzynski/wip-rgw-postobj-get_params-error-handling
rgw: fix error handling in get_params() of RGWPostObj_ObjStore_S3.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:47:02 -07:00
Yuri Weinstein
4ba3e87ec5 Merge pull request from mikulely/olh-cleanup
rgw: cleanup rgw-admin duplicated judge during OLH GET/READLOG

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:46:33 -07:00
Yuri Weinstein
5bbc50a3d1 Merge pull request from oritwas/wip-rgw-no-log-meta
rgw: log_meta only for more than one zone

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:46:12 -07:00
Yuri Weinstein
e71ae950af Merge pull request from joscollin/wip-CID1412979-uninitialized-members
rgw: Uninitialized member in LCRule

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:45:07 -07:00
Yuri Weinstein
5dea731aee Merge pull request from shashalu/fix-data-sync-run
rgw: fix radosgw-admin data sync run crash

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:44:12 -07:00
Yuri Weinstein
d19ece90ee Merge pull request from joscollin/wip-cleanup-rgw-rest-warning
rgw: silence warning from -Wmaybe-uninitialized

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:43:41 -07:00
Yuri Weinstein
c3ecb0dfb9 Merge pull request from aclamk/fix-rgw-cryptopp-compilation
radosgw: fix compilation with cryptopp

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-06 08:43:25 -07:00
Yuri Weinstein
4057240d02 Merge pull request from mdw-at-linuxbox/signature
rgw: fix s3 object uploads with chunked transfers and v4 signatures.

Reviewed-by:  Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-07-06 08:42:50 -07:00
Kefu Chai
f4d602b1a3 Merge pull request from tchaikov/wip-20524
osd/filestore: Revert "os/filestore: move ondisk in front

Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-07-06 23:00:58 +08:00
Willem Jan Withagen
ac3e817385 filestore: Exclude BTRFS on FreeBSD
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-07-06 14:20:02 +02:00
Kefu Chai
8f8da0e765 Merge pull request from majianpeng/man-rados-add-offset
doc/rados.8: add offset option for put command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-06 17:02:48 +08:00
Jianpeng Ma
82a5e82f73 doc/rados.8: add offset option for put command.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-07-06 21:55:11 +08:00
Kefu Chai
18ff5d6e59 Context: C_ContextsBase: delete enclosed contexts in dtor
there are chances that these contexts are never finished/completed

Fixes: http://tracker.ceph.com/issues/20432
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-06 16:10:02 +08:00
Kefu Chai
41531785ce Merge pull request from tanghaodong25/bluestore-aio-submit
os/bluestore/KernelDevice: batch aio submit

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-06 16:01:49 +08:00
Kefu Chai
903aa4b090 Merge pull request from liewegas/wip-btrfs-experimental
os/filestore: require experimental flag for btrfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-07-06 16:00:48 +08:00
Kefu Chai
797dadc81b Revert "os/filestore: move ondisk in front, so that return oncommit earlier, and improve write op performance."
This reverts commit 21f167cf39.

Fixes: http://tracker.ceph.com/issues/20524
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-06 14:07:29 +08:00
huanwen ren
351a8a82b1 common: add query_str when res_search() failed
I don't know the abort information about DNS Resolver,
if not add "query_str".

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2017-07-06 13:39:34 +08:00
Yehuda Sadeh
08051155a4 Merge pull request from linuxbox2/wip-tag-timeout-secs
rgw: cls: ceph::timespan tag_timeout wrong units

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-07-05 11:22:35 -07:00
Sage Weil
1174a2fbab Merge pull request from ztczll/zl
osd: check queue_transaction return value

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-07-05 10:47:23 -05:00
Sage Weil
294756e457 Merge pull request from Yan-waller/wip-waller-0630mon
mon/mgr: add detail error infomation

Reviewed-by: John Spray <john.spray@redhat.com>
2017-07-05 10:46:55 -05:00
Sage Weil
d02c9a5b01 Merge pull request from tchaikov/wip-qa-warning-msg
qa/tasks/ceph: should be "Waiting for all PGs", not "all osds"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-07-05 10:26:56 -05:00
Kefu Chai
1f47aff086 Merge pull request from majianpeng/bluestore-move-object-exist-in-assign-nid
os/bluestore: move object exist in assign nid

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-05 23:05:23 +08:00
Jianpeng Ma
d34444be01 os/bluestore/BlueStore: move "onode::exists=true" in _assign_nid.
If object  has nid, it always set exists =true in get_onode.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-07-05 23:33:47 +08:00