Commit Graph

77057 Commits

Author SHA1 Message Date
Jos Collin
4192435f41 Merge pull request #16888 from gmayyyha/osd-ms-verify-auth
osd/OSD.cc: add 'isvalid=false' when failed to parse caps

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-10 01:16:54 +00:00
Yuri Weinstein
86b5677ab6 Merge pull request #16829 from ivancich/wip-dup-ops-cleanup-1
osd: clean up dup index logic; maintain index flag logic in fewer places

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-08-09 16:37:04 -07:00
Yuri Weinstein
3c80d4a08f Merge pull request #16887 from xiexingguo/wip-mon-count
mon: fix wrong mon-num counting  logic of 'ceph features' command

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-09 16:34:55 -07:00
Yuri Weinstein
c1b87c71e3 Merge pull request #16892 from xiexingguo/wip-clean-pg-temp
mon/OSDMonitor: fix 'osd pg temp' unable to cleanup pg-temp

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-09 16:34:38 -07:00
Gregory Farnum
2e58760e24 Merge pull request #16897 from amitkumar50/cov-MDentryLink-1
messages: Initialization of is_primary

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-09 15:37:18 -07:00
Alfredo Deza
ef4205a6f7 Merge pull request #16919 from ceph/wip-volume-tests
ceph-volume: adds functional CI testing

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-08-09 18:09:39 -04:00
Greg Farnum
bcd3554bc5 mdsmon: don't add pool application metadata until running fully-luminous
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-08-09 14:41:06 -07:00
Neha Ojha
5d69f801ba test/librados: create unique lock names
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-08-09 14:14:21 -07:00
Alfredo Deza
c61aea41f1 ceph-volume: lvm activate should check if the device is mounted to prevent errors from mount
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-09 15:24:15 -04:00
Alfredo Deza
d77d86aae1 ceph-volume util add a helper to check if a device is mounted
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-09 15:10:18 -04:00
Matt Benjamin
0956b3aafd Merge pull request #16834 from mdw-at-linuxbox/policy
radosgw: usage: fix bytes_sent bug.
2017-08-09 14:24:01 -04:00
Sage Weil
ef42537425 mon/Elector: force election epoch bump on start
We are generally careful when bumping the epoch so that we can join
existing rounds.  However, if we restart in the middle of an election,
and change versions, we need to be certain that our previous ACK (as
$version - 1) isn't accepted as truth for the restarted daemon (running
$version) keeping the same epoch.

The conservatism with bumping is to avoid spurious election cycles, but
mon restarts are more rare, and we need them here.

Fixes: http://tracker.ceph.com/issues/20949
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 14:03:13 -04:00
Sage Weil
b61be07d45 qa/suites/upgrade/kraken-x/stress-split: more whitelisting
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 13:58:55 -04:00
Sage Weil
a6f170bf47 Merge pull request #16828 from liewegas/wip-18209
common/LogClient: assign seq and queue atomically

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-09 12:46:17 -05:00
Sage Weil
7addb82eee Merge pull request #16920 from liewegas/wip-osd-crush-ls
mon/OSDMonitor: implement 'osd crush ls <node>'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-09 12:45:54 -05:00
Sage Weil
1043fca076 Merge pull request #16923 from liewegas/wip-20738
qa/suites/rados/objectstore: logs
2017-08-09 12:45:29 -05:00
Mykola Golub
651b3785e4 Merge pull request #16737 from dillaman/wip-rbd-config
rbd: switched from legacy to new-style configuration options

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-08-09 19:41:42 +03:00
Yuri Weinstein
d8a94bbffc Merge pull request #16796 from rzarzynski/wip-rgw-20897
rgw: honor the tenant part of rgw_bucket during comparisons.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-08-09 08:57:47 -07:00
Yuri Weinstein
e6a959495f Merge pull request #16874 from rzarzynski/wip-rgw-drop-init_anon_user
rgw: drop the unused function init_anon_user()

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 08:57:18 -07:00
Jason Dillaman
f63416615c Merge pull request #16938 from javacruft/32bit-compat-fixes
tools: Align use of uint64_t in service_daemon::AttributeType

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 11:41:36 -04:00
Jos Collin
44784b8239 Merge pull request #16840 from mychoxin/yuanxin_writing_mistake
os/ObjectStore.h: fix mistake in comment TRANSACTION ISOLATION

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 15:26:07 +00:00
Sage Weil
34db3f8a08 Merge pull request #16947 from liewegas/wip-jewel-x
qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
2017-08-09 09:56:15 -05:00
Jason Dillaman
339d3fa3c8 Merge pull request #16917 from trociny/wip-qa-admin-sock
qa/workunits/rbd: use command line option to specify watcher asok

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:06:41 -04:00
Jason Dillaman
7dc82bc08c rbd: switched from legacy to new-style configuration options
Fixes: http://tracker.ceph.com/issues/20737
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:00:02 -04:00
amitkuma
233482cf70 librbd: Initializing members image,operation,journal
Fixes the coverity issues:

** 1398907 Uninitialized scalar field
CID 1398907 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member tag_tid is not initialized in
this constructor nor in any functions that it calls.

** 1398906 Uninitialized scalar field
22. uninit_member: Non-static class member m_r_saved is not initialized in
this constructor nor in any functions that it calls.
CID 1398906 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
24. uninit_member: Non-static class member m_mirror_mode is not initialized
in this constructor nor in any functions that it calls.

** 1399592 Uninitialized scalar field
2. uninit_member: Non-static class member m_order is not initialized in this
constructor nor in any functions that it calls.
4. uninit_member: Non-static class member m_size is not initialized in this
constructor nor in any functions that it calls.
6. uninit_member: Non-static class member m_features is not initialized in
this constructor nor in any functions that it calls.
8. uninit_member: Non-static class member m_incompatible_features is not
initialized in this constructor nor in any functions that it calls.
10. uninit_member: Non-static class member m_flags is not initialized in
this constructor nor in any functions that it calls.
CID 1399592 (#1-2 of 2): Uninitialized scalar field (UNINIT_CTOR)
12. uninit_member: Non-static class member m_exclusive_locked is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-09 18:49:34 +05:30
Sage Weil
bbd5fe354c qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 09:18:54 -04:00
Pan Liu
d463bd3f0e bluestore: fixed compilation error when enable spdk with gcc 4.8.5
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-09 21:16:54 +08:00
Orit Wasserman
f88047ae30 Merge pull request #16889 from oritwas/wip-rgw-20177
rgw: Use namespace for lc_pool and roles_pool

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-08-09 15:51:51 +03:00
Alfredo Deza
c866123017 ceph-volume: lvm activate should not ignore exit status codes
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-09 08:22:11 -04:00
John Spray
79491c1547 osd: include front_iface+back_iface in metadata
Fixes: http://tracker.ceph.com/issues/20956
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-09 07:53:26 -04:00
John Spray
687ea10269 common: return iface instead of addr from ipaddr.cc helpers
So that we can use the same helper functions to look
up interface names that we use to look up addresses.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-09 07:53:11 -04:00
Jin Cai
9a1e1af3e3 fix the bug that rdma polling thread uses the same thread name with msg worker
Signed-off-by: Jin Cai <caijin.caij@alibaba-inc.com>
2017-08-09 19:50:04 +08:00
mychoxin
504338ea8b os/ObjectStore: correct mistake in writing
Signed-off-by: mychoxin <mychoxin@gmail.com>
2017-08-09 18:54:09 +08:00
amitkuma
a07edfff6b messages: Initializing members in MOSDPGUpdateLogMissing
Fixes the coverity issues:

** 1355242 Uninitialized scalar field
2. uninit_member: Non-static class member map_epoch is not initialized
in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member min_epoch is not initialized
in this constructor nor in any functions that it calls.
CID 1355242 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
6. uninit_member: Non-static class member rep_tid is not initialized
in this constructor nor in any functions that it calls.

** 1355243 Uninitialized scalar field
2. uninit_member: Non-static class member map_epoch is not initialized
in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member min_epoch is not initialized
in this constructor nor in any functions that it calls.
CID 1355243 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
6. uninit_member: Non-static class member rep_tid is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-09 15:41:59 +05:30
James Page
87fe8e81bc Align use of uint64_t in service_daemon::AttributeType
size_t on a 32-bit architecture is a 32 bit unsigned int which
created ambiguity when casting to bool, uint64_t or std::string
(which are boost::variants for service_daemon::AttributeType).

Align to use of uint64_t to resolve compilation failures in
all 32-bit architectures.

Signed-off-by: James Page <james.page@ubuntu.com>
2017-08-09 10:08:05 +01:00
Mykola Golub
6a575136a7 qa/workunits/rbd: use command line option to specify watcher asok
The previous method to get the watcher admin socket was fragile
and had started to fail after the recent changes to vstart ceph.conf.

Fixes: http://tracker.ceph.com/issues/20954
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-08-09 09:03:00 +02:00
Haomai Wang
2efc7e756b Merge pull request #16927 from optimistyzy/89_ext
bluestore/NVMeDevice: update NVMeDevice code due to SPDK upgrade

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-08-09 13:38:08 +08:00
Yanhu Cao
a5e5420f94 osd/OSD: add 'isvalid=false' when failed to parse caps
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-08-09 13:11:40 +08:00
Ziye Yang
96ae9d861a bluestore,NVMeDevice: update NVMeDevice code due to SPDK upgrade
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-09 11:53:41 +08:00
Adam C. Emerson
dd8aec3cc8 throttle: Do not destroy condition variables with waiters
Destroying a condition variable on which someone is waiting is Undefined
Behavior. it's bad and terrible and awful. On some machines it makes
the destructor just outright hang.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
793ba0443c common: Automatic reference to PerfCounters
PerfCountersRef is a unique_ptr using a deleter that unregisters the
managed PerfCounters on deletion.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
33a1da6eac scope_guard: Support in-place construction and one-shots
Kefu Chai just pointed out this exists so I just rolled the in-place variants of the
'ward' function I'd written into it.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
49f3d58b49 common: Add in_place_t/in_place_type_t from C++17
To better signal in-place construction among other overloads.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:53:12 -04:00
Adam C. Emerson
fa99d3f126 {os,mds,common}: Disambiguate std::max and ceph::max
There will be a more thorough reckoning regarding namespaces later.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:39:20 -04:00
Adam C. Emerson
d08191e2da common: Add locking template functions and macros
These infer the type of the unique/shared/shunique lock from the type of
the mutex.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-08 22:39:20 -04:00
Sage Weil
8a09edd196 Merge pull request #16900 from liewegas/wip-20925-b
os/bluestore: Revert "os/bluestore: allow multiple DeferredBatches in flight at once"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-08 21:33:55 -05:00
Sage Weil
d8f60f1f82 Merge pull request #16902 from liewegas/wip-health-deprecation
mon: add mon_health_preluminous_compat_warning

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-08 21:29:01 -05:00
Sage Weil
ceca767122 Merge pull request #16916 from jcsp/wip-scrub-logging
mon, osd: turn down non-error scrub message severity

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-08 21:27:52 -05:00
Sage Weil
70f6760d37 os/bluestore: fail early on very large objects
We have a hard 4GB object size limit (although in practice we want
to be *well* below that!).

See http://tracker.ceph.com/issues/20923
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 22:12:35 -04:00
Marcus Watts
a45ab45f74 Test bytes_sent bugs.
Rearrange logic to make it easier to measure accumulation.
Instrument the boto request/response loop to count bytes in and out.
Accumulate byte counts in usage like structure.
Compare actual usage reported by ceph against local usage measured.
Report and assert if there are any short-comings.
Remove zone placement rule that was newly added at end: tests should be rerunable.

Nit: the logic to wait for "delete_obj" is not quite right.

Fixes: http://tracker.ceph.com/issues/19870
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-08-08 21:56:01 -04:00