Commit Graph

77041 Commits

Author SHA1 Message Date
Sage Weil
b61be07d45 qa/suites/upgrade/kraken-x/stress-split: more whitelisting
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 13:58:55 -04:00
Sage Weil
a6f170bf47 Merge pull request #16828 from liewegas/wip-18209
common/LogClient: assign seq and queue atomically

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-09 12:46:17 -05:00
Sage Weil
7addb82eee Merge pull request #16920 from liewegas/wip-osd-crush-ls
mon/OSDMonitor: implement 'osd crush ls <node>'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-09 12:45:54 -05:00
Sage Weil
1043fca076 Merge pull request #16923 from liewegas/wip-20738
qa/suites/rados/objectstore: logs
2017-08-09 12:45:29 -05:00
Mykola Golub
651b3785e4 Merge pull request #16737 from dillaman/wip-rbd-config
rbd: switched from legacy to new-style configuration options

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-08-09 19:41:42 +03:00
Yuri Weinstein
d8a94bbffc Merge pull request #16796 from rzarzynski/wip-rgw-20897
rgw: honor the tenant part of rgw_bucket during comparisons.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-08-09 08:57:47 -07:00
Yuri Weinstein
e6a959495f Merge pull request #16874 from rzarzynski/wip-rgw-drop-init_anon_user
rgw: drop the unused function init_anon_user()

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 08:57:18 -07:00
Jason Dillaman
f63416615c Merge pull request #16938 from javacruft/32bit-compat-fixes
tools: Align use of uint64_t in service_daemon::AttributeType

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 11:41:36 -04:00
Jos Collin
44784b8239 Merge pull request #16840 from mychoxin/yuanxin_writing_mistake
os/ObjectStore.h: fix mistake in comment TRANSACTION ISOLATION

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 15:26:07 +00:00
Sage Weil
34db3f8a08 Merge pull request #16947 from liewegas/wip-jewel-x
qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
2017-08-09 09:56:15 -05:00
Jason Dillaman
339d3fa3c8 Merge pull request #16917 from trociny/wip-qa-admin-sock
qa/workunits/rbd: use command line option to specify watcher asok

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:06:41 -04:00
Jason Dillaman
7dc82bc08c rbd: switched from legacy to new-style configuration options
Fixes: http://tracker.ceph.com/issues/20737
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:00:02 -04:00
Sage Weil
bbd5fe354c qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 09:18:54 -04:00
Pan Liu
d463bd3f0e bluestore: fixed compilation error when enable spdk with gcc 4.8.5
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-09 21:16:54 +08:00
Orit Wasserman
f88047ae30 Merge pull request #16889 from oritwas/wip-rgw-20177
rgw: Use namespace for lc_pool and roles_pool

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-08-09 15:51:51 +03:00
Alfredo Deza
c866123017 ceph-volume: lvm activate should not ignore exit status codes
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-09 08:22:11 -04:00
John Spray
79491c1547 osd: include front_iface+back_iface in metadata
Fixes: http://tracker.ceph.com/issues/20956
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-09 07:53:26 -04:00
John Spray
687ea10269 common: return iface instead of addr from ipaddr.cc helpers
So that we can use the same helper functions to look
up interface names that we use to look up addresses.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-09 07:53:11 -04:00
Jin Cai
9a1e1af3e3 fix the bug that rdma polling thread uses the same thread name with msg worker
Signed-off-by: Jin Cai <caijin.caij@alibaba-inc.com>
2017-08-09 19:50:04 +08:00
mychoxin
504338ea8b os/ObjectStore: correct mistake in writing
Signed-off-by: mychoxin <mychoxin@gmail.com>
2017-08-09 18:54:09 +08:00
amitkuma
a07edfff6b messages: Initializing members in MOSDPGUpdateLogMissing
Fixes the coverity issues:

** 1355242 Uninitialized scalar field
2. uninit_member: Non-static class member map_epoch is not initialized
in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member min_epoch is not initialized
in this constructor nor in any functions that it calls.
CID 1355242 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
6. uninit_member: Non-static class member rep_tid is not initialized
in this constructor nor in any functions that it calls.

** 1355243 Uninitialized scalar field
2. uninit_member: Non-static class member map_epoch is not initialized
in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member min_epoch is not initialized
in this constructor nor in any functions that it calls.
CID 1355243 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
6. uninit_member: Non-static class member rep_tid is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-09 15:41:59 +05:30
James Page
87fe8e81bc Align use of uint64_t in service_daemon::AttributeType
size_t on a 32-bit architecture is a 32 bit unsigned int which
created ambiguity when casting to bool, uint64_t or std::string
(which are boost::variants for service_daemon::AttributeType).

Align to use of uint64_t to resolve compilation failures in
all 32-bit architectures.

Signed-off-by: James Page <james.page@ubuntu.com>
2017-08-09 10:08:05 +01:00
Mykola Golub
6a575136a7 qa/workunits/rbd: use command line option to specify watcher asok
The previous method to get the watcher admin socket was fragile
and had started to fail after the recent changes to vstart ceph.conf.

Fixes: http://tracker.ceph.com/issues/20954
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-08-09 09:03:00 +02:00
Haomai Wang
2efc7e756b Merge pull request #16927 from optimistyzy/89_ext
bluestore/NVMeDevice: update NVMeDevice code due to SPDK upgrade

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-08-09 13:38:08 +08:00
Yanhu Cao
a5e5420f94 osd/OSD: add 'isvalid=false' when failed to parse caps
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-08-09 13:11:40 +08:00
Ziye Yang
96ae9d861a bluestore,NVMeDevice: update NVMeDevice code due to SPDK upgrade
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-09 11:53:41 +08:00
Adam C. Emerson
dd8aec3cc8 throttle: Do not destroy condition variables with waiters
Destroying a condition variable on which someone is waiting is Undefined
Behavior. it's bad and terrible and awful. On some machines it makes
the destructor just outright hang.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
793ba0443c common: Automatic reference to PerfCounters
PerfCountersRef is a unique_ptr using a deleter that unregisters the
managed PerfCounters on deletion.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
33a1da6eac scope_guard: Support in-place construction and one-shots
Kefu Chai just pointed out this exists so I just rolled the in-place variants of the
'ward' function I'd written into it.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
49f3d58b49 common: Add in_place_t/in_place_type_t from C++17
To better signal in-place construction among other overloads.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
fa99d3f126 {os,mds,common}: Disambiguate std::max and ceph::max
There will be a more thorough reckoning regarding namespaces later.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:39:20 -04:00
Adam C. Emerson
d08191e2da common: Add locking template functions and macros
These infer the type of the unique/shared/shunique lock from the type of
the mutex.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:39:20 -04:00
Sage Weil
8a09edd196 Merge pull request #16900 from liewegas/wip-20925-b
os/bluestore: Revert "os/bluestore: allow multiple DeferredBatches in flight at once"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-08 21:33:55 -05:00
Sage Weil
d8f60f1f82 Merge pull request #16902 from liewegas/wip-health-deprecation
mon: add mon_health_preluminous_compat_warning

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-08 21:29:01 -05:00
Sage Weil
ceca767122 Merge pull request #16916 from jcsp/wip-scrub-logging
mon, osd: turn down non-error scrub message severity

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-08 21:27:52 -05:00
Sage Weil
70f6760d37 os/bluestore: fail early on very large objects
We have a hard 4GB object size limit (although in practice we want
to be *well* below that!).

See http://tracker.ceph.com/issues/20923
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 22:12:35 -04:00
Marcus Watts
a45ab45f74 Test bytes_sent bugs.
Rearrange logic to make it easier to measure accumulation.
Instrument the boto request/response loop to count bytes in and out.
Accumulate byte counts in usage like structure.
Compare actual usage reported by ceph against local usage measured.
Report and assert if there are any short-comings.
Remove zone placement rule that was newly added at end: tests should be rerunable.

Nit: the logic to wait for "delete_obj" is not quite right.

Fixes: http://tracker.ceph.com/issues/19870
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-08-08 21:56:01 -04:00
Marcus Watts
0172aab860 Fix bytes_sent bugs.
log bytes sent/received.
add cct to bufferingfilter
add cct to RGWRestfulIO
AccountingFilter - save cct for debugging output
implement AccountingFilter::complete_request() - account for bytes reported here.
BufferingFilter<T>::complete_request() - ignore counts from send_content_length() complete_header();

Code quality note:
this patch makes "cct" available for a lot of newly added debug
statements.  The debug statements are mostly not very useful (and should
go away in the future) - *But* the "cct" logic should be redone and
incorporated into some base class (such RestfulClient) so that it is
possible to easily add in debug statements such as these in the future.

Fixes: http://tracker.ceph.com/issues/19870
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-08-08 21:54:57 -04:00
Sage Weil
c8d60396c7 qa/suites/rados/objectstore: logs
Hunting http://tracker.ceph.com/issues/20738

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 18:07:18 -04:00
Gregory Farnum
25f1edefbf Merge pull request #16755 from ivancich/wip-pull-new-dmclock
osd: bring in dmclock library changes

Reviewed-by:  J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-08 14:27:28 -07:00
Sage Weil
6127a4c294 Merge pull request #16546 from asomers/openstack_shebang2
qa: Fix shebangs on openstack scripts

Reviewed-by: Amik Kumar <amitkuma@redhat.com>
2017-08-08 15:55:38 -05:00
Jason Dillaman
988c300366 Merge pull request #15579 from ovh/bp-parallel-rbd-lsl
rbd: parallelize "rbd ls -l"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-08 16:54:22 -04:00
Sage Weil
c36a98be97 common/LogClient: make last_log non-atomic
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
bf92a8a269 common/LogClient: fix indentation
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
1f8f58becf common/LogClient: assign seq and queue atomically
The _get_mon_log_message() assumes that log_last and log_queue
are in sync, but it was previously possible to increment log_last
setting e.seq in do_log(), and only later queue it.  If a racing
thread ran get_mon_log_message() in the meantime it would fail
an assertion.

Fix by assigning the seq and queueing it atomically.  If the
cluster log is not enabled, use the get_next_seq() helper so that
graylog or syslog messages still have a seq assigned.

Fixes: http://tracker.ceph.com/issues/18209
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
aeed87945b mon/OSDMonitor: implement 'osd crush ls <node>'
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 15:56:18 -04:00
Abhishek L
d83e1dd79e Merge pull request #16861 from wido/docs-mgr-zabbix-enable
doc: Update mgr doc on how to enable Zabbix module

Reviewed-By: John Spray <jcsp@redhat.com>
2017-08-08 21:07:35 +02:00
John Spray
0443fdb022 osd: downgrade (ok) PG scrub messages to debug
Otherwise someone watching the log at INFO level gets
pelted with potentially millions of log messages
while the system is scrubbing.

Fixes: http://tracker.ceph.com/issues/20947
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-08 19:57:10 +01:00
John Spray
f394ca0bad mon: downgrade "scrub ok" message to debug.
This hides lines like:
[INF]  scrub ok on 0,1,2: ScrubResult(keys {pgmap_pg=13} crc {pgmap_pg=2458062599})

from the normal cluster log views.

Fixes: http://tracker.ceph.com/issues/20947
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-08 19:57:06 +01:00
amitkuma
5012db477c messages: Initialization of is_primary
Fixes the coverity issue:

** 717269 Uninitialized scalar field
CID 717269 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member is_primary is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-08 23:58:06 +05:30