Commit Graph

80096 Commits

Author SHA1 Message Date
Sage Weil
68f38a0544 osd/osd_types: fix object_stat_sum_t decode
Broken by 71bf04775b

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-25 21:39:23 -05:00
Patrick Donnelly
2bba5d8e0f
Merge PR #18192 into master
* refs/pull/18192/head:
	qa/cephfs: test ec data pool
	qa/suites/fs/basic_functional/clusters: more osds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-25 17:05:38 -07:00
Alfredo Deza
2b7ff497fe ceph-volume lvm.activate consume cluster_name from lvm metadata
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 18:57:28 -04:00
Alfredo Deza
6d38ad987e ceph-volume lvm.prepare persist cluster_name on lvm metadata
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 18:57:03 -04:00
Patrick Donnelly
1e571befcf
Revert "ceph_context: re-expand admin_socket metavariables in child process"
This commit introduces a regression where the admin socket specified in
ceph.conf overrides command line arguments or environment variables.

This reverts commit 1630f4bbef.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-25 13:29:42 -07:00
Sage Weil
92141dc122 Merge pull request #18485 from liewegas/wip-remote-res-preemption
osd: fix recovery reservation bugs, and implement remote reservation preemption

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-10-25 14:47:44 -05:00
Alfredo Deza
fd616acd6a ceph-volume util.prepare bluestore db and wal paths are to devices, not osd dir paths
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 15:30:43 -04:00
Alfredo Deza
80698d2309 ceph-volume lvm.prepare bluestore wal and db links get created with mkfs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 15:30:06 -04:00
Casey Bodley
ac7ffe6ef7 rgw: fix extra_data_len handling in PutObj filters
the RGWPutObj_Compress filter relies on a starting offset of 0 to ensure
that we only compress entire objects

for RGWRados::fetch_remote_obj(), we also fetch object metadata. the
replies come back with a 'Rgwx-Embedded-Metadata-Len' header, which
specifies how many bytes of object metadata are at the front of the
request body. when this is present, the offsets passed from
RGWRadosPutObj down to the RGWPutObjDataProcessor filters are offsets
into the http response body, rather than logical offsets into the object
data itself

this commit adds a transformation to RGWRadosPutObj so that only that
logical offset is visible to the RGWPutObjDataProcessor

Fixes: http://tracker.ceph.com/issues/21895

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-25 14:25:09 -04:00
Neha Ojha
973e21694f qa: add cbt repo parameter
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-10-25 10:22:43 -07:00
Jianpeng Ma
1a6817a507 msg/async: updating l_msgr_running_send_time if write_message failed.
Also for the most time write_message return zero. So avoid checking
"r < 0 or r > 0" every time, it should firstly check "r == 0".

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-26 00:50:29 +08:00
David Zafman
e31075fd1d Merge pull request #18528 from tchaikov/wip-osd-misplaced
osd/PG: fix calc of misplaced objects

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-25 09:36:04 -07:00
Jianpeng Ma
3350b35045 msg/async: only system can accept more data, continue send.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-26 00:34:45 +08:00
Kefu Chai
718496bf72 Merge pull request #18523 from tchaikov/wip-vstart-quoted
vstart.sh: should quote the parameters to get them quoted

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-26 00:18:40 +08:00
Jianpeng Ma
2371b149e0 msg/async: remove redundant condition.
From the code, if out_q[r].is_empty, it already remove.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-26 00:16:45 +08:00
Danny Al-Gaaf
fc2f9bdb1c librbd/test_librbd.cc: fix format qualifiers
Fix for:

[src/test/librbd/test_librbd.cc:2610]: (warning) %lld in format string
 (no. 1) requires 'long long' but the argument type is 'unsigned long long'.
[src/test/librbd/test_librbd.cc:2610]: (warning) %lld in format string
 (no. 2) requires 'long long' but the argument type is 'unsigned long long'.
[src/test/librbd/test_librbd.cc:2610]: (warning) %lld in format string
 (no. 3) requires 'long long' but the argument type is 'unsigned long long'.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
f250b9c32e librbd/test_internal.cc: fix format qualifiers to %lu
Fix for:

[src/test/librbd/test_internal.cc:1054]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1054]: (warning) %ld in format string
 (no. 2) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1063]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1073]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1114]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1121]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1129]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1196]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1196]: (warning) %ld in format string
 (no. 2) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1205]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.
[src/test/librbd/test_internal.cc:1215]: (warning) %ld in format string
 (no. 1) requires 'long' but the argument type is 'unsigned long'.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
e045962cc8 rgw_rados.cc: use compare() instead of find()
Fix for:

[src/rgw/rgw_rados.cc:3752]: (performance) Inefficient usage of
 string::find() in condition; string::compare() would be faster.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
e3f9fa9cc5 rgw_rados.cc: fix format qualifiers
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
ce0fa3564a osd/osd_types.cc: fix sscanf format qualifiers to %u
Fix for:

[src/osd/osd_types.cc:439]: (warning) %d in format string (no. 1) requires
 'int *' but the argument type is 'unsigned int *'.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
bc7cf70458 osd/OSDMap.cc: fix potential null pointer deref
Use the same logic as in OSDMap::pg_to_raw_up().

Fix for:

[src/osd/OSDMap.cc:2071] -> [src/osd/OSDMap.cc:2077]: (warning) Either the
 condition 'if(primary)' is redundant or there is possible null pointer
 dereference: primary.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
f764f258d6 librbd/Watcher.cc: remove redundant if()
Fix for:

[src/librbd/Watcher.cc:131]: (style) Condition 'r>=0' is always true

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
f8cc3e2815 CompatSet.h: fix format qualifier
Fix for:

[src/include/CompatSet.h:112]: (warning) %lld in format string (no. 1)
 requires 'long long' but the argument type is 'unsigned long long'.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
82c815a4b8 Client.cc: fix format qualifiers
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
b2e9c8d8d5 rgw_admin.cc: remove redundant check
Fix for:

[src/rgw/rgw_admin.cc:4228]: (style) Redundant condition:
 If 'ret < 0', the comparison 'ret' is always true.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
d5419143ac rgw_admin.cc: do not compare int with boolean
Fix for:

[src/rgw/rgw_admin.cc:5862]: (warning) Comparison of a boolean
 expression with an integer.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
14697d1285 dpdk/PacketUtil.h: remove consecutive break after abort()
Fix for:

[src/msg/async/dpdk/PacketUtil.h:162]: (style) Consecutive return, break,
 continue, goto or throw statements are unnecessary.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
c6e4ea9cf0 async/Stack.cc: fix conversion specifier
Fix for:

[src/msg/async/Stack.cc:42]: (warning) %d in format string (no. 1)
 requires 'int' but the argument type is 'unsigned int'.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
1ad4a13171 AsyncConnection.cc: init some members in ctor
Fix for:

[src/msg/async/AsyncConnection.cc:122]: (warning) Member variable
 'AsyncConnection::msg_left' is not initialized in the constructor.
[src/msg/async/AsyncConnection.cc:122]: (warning) Member variable
 'AsyncConnection::cur_msg_size' is not initialized in the constructor.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
3f1b2ad2d9 MDSMonitor.cc: use string::compare()
Fix for:

[src/mon/MDSMonitor.cc:1717]: (performance) Inefficient usage of
 string::find() in condition; string::compare() would be faster.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
435b3661fe kv/MemDB.h: init some members in constructor
Fix for:
[src/kv/MemDB.h:59]: (warning) Member variable 'MemDB::m_total_bytes'
 is not initialized in the constructor.
[src/kv/MemDB.h:59]: (warning) Member variable 'MemDB::m_allocated_bytes'
 is not initialized in the constructor.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
606768e8b2 librbd.cc: fix usage of unsigned var
Fix for:

[src/librbd/librbd.cc:3578]: (style) Checking if unsigned variable
 'data_len' is less than zero.
[src/librbd/librbd.cc:3799]: (style) Checking if unsigned variable
 'data_len' is less than zero.
[src/librbd/librbd.cc:3576]: (style) Checking if unsigned variable
 'data_len' is less than zero.
[src/librbd/librbd.cc:3796]: (style) Checking if unsigned variable
 'data_len' is less than zero.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
f24a0289ef LZ4Compressor.h: fix usage of unsigned var
Fix for:

[src/compressor/lz4/LZ4Compressor.h:49]: (style) Checking if
 unsigned variable 'compressed_len' is less than zero.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Danny Al-Gaaf
4d2f8384d0 rgw/rgw_op.cc: fix wrong function order
Fix for:

[src/rgw/rgw_op.cc:3829]: (error) Uninitialized variable: calc_md5

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2017-10-25 18:14:05 +02:00
Igor Fedotov
2aeb7b85c8 mempool: fix lack of pool names in mempool:dump output for JSON formatter.
Signed-off-by: Igor Fedotov <ifed@mail.ru>
2017-10-25 09:05:39 -07:00
Jianpeng Ma
8960e42ae0 msg/async: batch handle out_seq.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-26 00:03:36 +08:00
Alfredo Deza
4970ab5c80 ceph-volume lvm.prepare use wal and db for mkfs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 10:28:43 -04:00
Patrick Donnelly
c9c58c580d
Merge PR #18062 into master
* refs/pull/18062/head:
	client: put MetaSession map container
	client: simplify release context ref mgmt

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-10-25 06:51:45 -07:00
John Spray
1d0a7d1f35 mds: set PRIO_USEFUL on num_sessions counter
This is used by dashboard and status modules,
so let's make sure we're sending it to the mgr.

Fixes: http://tracker.ceph.com/issues/21927
Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-25 09:47:34 -04:00
Matt Benjamin
9f6d3cf3f4 Merge pull request #18381 from cbodley/wip-21832
Revert "radosgw: fix awsv4 header line sort order."
2017-10-25 09:37:06 -04:00
Matt Benjamin
d1fdc2316c Merge pull request #18369 from baixueyu/refcount_bug
rgw: source data in 'default.rgw.buckets.data' may not be deleted after inter-bucket copy
2017-10-25 08:58:07 -04:00
Kefu Chai
410594aed0 Merge pull request #16605 from theanalyst/tools/release-notes-pyfixes
script: ceph-release-notes: minor fixes for split_component

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-25 19:24:53 +08:00
Alfredo Deza
02e1263f06 Merge pull request #18482 from liewegas/wip-luminous-note-fix
doc/release-notes: add jewel->kraken notes

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-10-25 07:24:13 -04:00
Kefu Chai
4b6406b086 Merge pull request #18481 from xiexingguo/wip-choose-acting
osd/PG: miscellaneous choose acting changes and cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-25 19:21:42 +08:00
Kefu Chai
5fc34435dd Merge pull request #18473 from yuyuyu101/wip-objecter-mono
osdc/Objecter: using coarse_mono instead

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-10-25 19:20:59 +08:00
Kefu Chai
68ef19bc3c Merge pull request #18471 from yuyuyu101/wip-omap-stat
osd/ReplicatedPG: add omap write bytes to delta_stats

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-25 19:20:35 +08:00
Kefu Chai
3ceab4ca43 Merge pull request #16332 from badone/wip-warn-about-objects-with-too-many-omap-entries
osd: Warn about objects with too many omap entries

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-25 19:20:00 +08:00
Kefu Chai
022f08362e Merge pull request #18506 from majianpeng/osd-scrub
osd/PrimaryLogPG: add condition "is_chunky_scrub_active" to check object in chunky_scrub

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-25 19:18:50 +08:00
Kefu Chai
0f1e97238c qa: do not "ceph fs get cephfs" w/o a cephfs fs
introduced by 183646c

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-25 19:12:39 +08:00
Abhishek Lekshmanan
35876bb79d script: ceph-release-notes: minor fixes for split_component
make labels a set as intersection would fail otherwise, also sort the
results of prefixes before creating the title

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-10-25 10:43:07 +02:00