Commit Graph

76836 Commits

Author SHA1 Message Date
Matt Benjamin
0956b3aafd Merge pull request #16834 from mdw-at-linuxbox/policy
radosgw: usage: fix bytes_sent bug.
2017-08-09 14:24:01 -04:00
Sage Weil
a6f170bf47 Merge pull request #16828 from liewegas/wip-18209
common/LogClient: assign seq and queue atomically

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-09 12:46:17 -05:00
Sage Weil
7addb82eee Merge pull request #16920 from liewegas/wip-osd-crush-ls
mon/OSDMonitor: implement 'osd crush ls <node>'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-09 12:45:54 -05:00
Sage Weil
1043fca076 Merge pull request #16923 from liewegas/wip-20738
qa/suites/rados/objectstore: logs
2017-08-09 12:45:29 -05:00
Mykola Golub
651b3785e4 Merge pull request #16737 from dillaman/wip-rbd-config
rbd: switched from legacy to new-style configuration options

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-08-09 19:41:42 +03:00
Yuri Weinstein
d8a94bbffc Merge pull request #16796 from rzarzynski/wip-rgw-20897
rgw: honor the tenant part of rgw_bucket during comparisons.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-08-09 08:57:47 -07:00
Yuri Weinstein
e6a959495f Merge pull request #16874 from rzarzynski/wip-rgw-drop-init_anon_user
rgw: drop the unused function init_anon_user()

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 08:57:18 -07:00
Jason Dillaman
f63416615c Merge pull request #16938 from javacruft/32bit-compat-fixes
tools: Align use of uint64_t in service_daemon::AttributeType

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 11:41:36 -04:00
Jos Collin
44784b8239 Merge pull request #16840 from mychoxin/yuanxin_writing_mistake
os/ObjectStore.h: fix mistake in comment TRANSACTION ISOLATION

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-09 15:26:07 +00:00
Sage Weil
34db3f8a08 Merge pull request #16947 from liewegas/wip-jewel-x
qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
2017-08-09 09:56:15 -05:00
Jason Dillaman
339d3fa3c8 Merge pull request #16917 from trociny/wip-qa-admin-sock
qa/workunits/rbd: use command line option to specify watcher asok

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:06:41 -04:00
Jason Dillaman
7dc82bc08c rbd: switched from legacy to new-style configuration options
Fixes: http://tracker.ceph.com/issues/20737
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-09 10:00:02 -04:00
Sage Weil
bbd5fe354c qa/suites/upgarde/jewel-x/point-to-point-x: disable app warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-09 09:18:54 -04:00
Orit Wasserman
f88047ae30 Merge pull request #16889 from oritwas/wip-rgw-20177
rgw: Use namespace for lc_pool and roles_pool

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-08-09 15:51:51 +03:00
mychoxin
504338ea8b os/ObjectStore: correct mistake in writing
Signed-off-by: mychoxin <mychoxin@gmail.com>
2017-08-09 18:54:09 +08:00
James Page
87fe8e81bc Align use of uint64_t in service_daemon::AttributeType
size_t on a 32-bit architecture is a 32 bit unsigned int which
created ambiguity when casting to bool, uint64_t or std::string
(which are boost::variants for service_daemon::AttributeType).

Align to use of uint64_t to resolve compilation failures in
all 32-bit architectures.

Signed-off-by: James Page <james.page@ubuntu.com>
2017-08-09 10:08:05 +01:00
Mykola Golub
6a575136a7 qa/workunits/rbd: use command line option to specify watcher asok
The previous method to get the watcher admin socket was fragile
and had started to fail after the recent changes to vstart ceph.conf.

Fixes: http://tracker.ceph.com/issues/20954
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-08-09 09:03:00 +02:00
Haomai Wang
2efc7e756b Merge pull request #16927 from optimistyzy/89_ext
bluestore/NVMeDevice: update NVMeDevice code due to SPDK upgrade

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-08-09 13:38:08 +08:00
Ziye Yang
96ae9d861a bluestore,NVMeDevice: update NVMeDevice code due to SPDK upgrade
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-09 11:53:41 +08:00
Sage Weil
8a09edd196 Merge pull request #16900 from liewegas/wip-20925-b
os/bluestore: Revert "os/bluestore: allow multiple DeferredBatches in flight at once"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-08 21:33:55 -05:00
Sage Weil
d8f60f1f82 Merge pull request #16902 from liewegas/wip-health-deprecation
mon: add mon_health_preluminous_compat_warning

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-08 21:29:01 -05:00
Sage Weil
ceca767122 Merge pull request #16916 from jcsp/wip-scrub-logging
mon, osd: turn down non-error scrub message severity

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-08 21:27:52 -05:00
Marcus Watts
a45ab45f74 Test bytes_sent bugs.
Rearrange logic to make it easier to measure accumulation.
Instrument the boto request/response loop to count bytes in and out.
Accumulate byte counts in usage like structure.
Compare actual usage reported by ceph against local usage measured.
Report and assert if there are any short-comings.
Remove zone placement rule that was newly added at end: tests should be rerunable.

Nit: the logic to wait for "delete_obj" is not quite right.

Fixes: http://tracker.ceph.com/issues/19870
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-08-08 21:56:01 -04:00
Marcus Watts
0172aab860 Fix bytes_sent bugs.
log bytes sent/received.
add cct to bufferingfilter
add cct to RGWRestfulIO
AccountingFilter - save cct for debugging output
implement AccountingFilter::complete_request() - account for bytes reported here.
BufferingFilter<T>::complete_request() - ignore counts from send_content_length() complete_header();

Code quality note:
this patch makes "cct" available for a lot of newly added debug
statements.  The debug statements are mostly not very useful (and should
go away in the future) - *But* the "cct" logic should be redone and
incorporated into some base class (such RestfulClient) so that it is
possible to easily add in debug statements such as these in the future.

Fixes: http://tracker.ceph.com/issues/19870
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-08-08 21:54:57 -04:00
Sage Weil
c8d60396c7 qa/suites/rados/objectstore: logs
Hunting http://tracker.ceph.com/issues/20738

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 18:07:18 -04:00
Gregory Farnum
25f1edefbf Merge pull request #16755 from ivancich/wip-pull-new-dmclock
osd: bring in dmclock library changes

Reviewed-by:  J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-08 14:27:28 -07:00
Sage Weil
6127a4c294 Merge pull request #16546 from asomers/openstack_shebang2
qa: Fix shebangs on openstack scripts

Reviewed-by: Amik Kumar <amitkuma@redhat.com>
2017-08-08 15:55:38 -05:00
Jason Dillaman
988c300366 Merge pull request #15579 from ovh/bp-parallel-rbd-lsl
rbd: parallelize "rbd ls -l"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-08 16:54:22 -04:00
Sage Weil
c36a98be97 common/LogClient: make last_log non-atomic
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
bf92a8a269 common/LogClient: fix indentation
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
1f8f58becf common/LogClient: assign seq and queue atomically
The _get_mon_log_message() assumes that log_last and log_queue
are in sync, but it was previously possible to increment log_last
setting e.seq in do_log(), and only later queue it.  If a racing
thread ran get_mon_log_message() in the meantime it would fail
an assertion.

Fix by assigning the seq and queueing it atomically.  If the
cluster log is not enabled, use the get_next_seq() helper so that
graylog or syslog messages still have a seq assigned.

Fixes: http://tracker.ceph.com/issues/18209
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 16:04:42 -04:00
Sage Weil
aeed87945b mon/OSDMonitor: implement 'osd crush ls <node>'
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 15:56:18 -04:00
Abhishek L
d83e1dd79e Merge pull request #16861 from wido/docs-mgr-zabbix-enable
doc: Update mgr doc on how to enable Zabbix module

Reviewed-By: John Spray <jcsp@redhat.com>
2017-08-08 21:07:35 +02:00
John Spray
0443fdb022 osd: downgrade (ok) PG scrub messages to debug
Otherwise someone watching the log at INFO level gets
pelted with potentially millions of log messages
while the system is scrubbing.

Fixes: http://tracker.ceph.com/issues/20947
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-08 19:57:10 +01:00
John Spray
f394ca0bad mon: downgrade "scrub ok" message to debug.
This hides lines like:
[INF]  scrub ok on 0,1,2: ScrubResult(keys {pgmap_pg=13} crc {pgmap_pg=2458062599})

from the normal cluster log views.

Fixes: http://tracker.ceph.com/issues/20947
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-08 19:57:06 +01:00
Sage Weil
a47831fb19 Merge pull request #16908 from dillaman/wip-20701
doc: update rbd-mirroring documentation

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-08 12:48:17 -05:00
Sage Weil
dab64cb7c5 Merge pull request #16910 from liewegas/wip-iana
doc/dev/iana: document our official IANA numbers
2017-08-08 12:46:21 -05:00
Sage Weil
b4473f8f4e Merge pull request #16911 from liewegas/wip-lead
doc/dev/index: update rados lead

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-08-08 12:44:56 -05:00
Sage Weil
5e39bb5ed1 Merge pull request #16879 from smithfarm/wip-release-notes-11-2-1
doc: release-notes.rst: add Kraken v11.2.1 and update releases.rst

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-08-08 12:41:06 -05:00
Sage Weil
b5b61dde38 Merge pull request #16894 from liupan1111/wip-remove-friendly
bluestore: drop unused friend class in SharedDriverQueueData

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-08-08 12:40:15 -05:00
Abhishek L
8388d442eb Merge pull request #16907 from theanalyst/doc/rgw/s3-api-tagging
doc: rgw mention about tagging & bucket policies in s3api

Reviewed-By: Adam Emerson <aemerson@redhat.com>
Reviewed-By: Matt Benjamin <mbenjami@redhat.com>
2017-08-08 19:38:48 +02:00
Sage Weil
f19214687f doc/dev/index: update rados lead
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 13:37:42 -04:00
Sage Weil
dd84361c1e doc/dev/iana: document our official IANA numbers
PEN 50495
port 3300

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-08 13:36:39 -04:00
Jason Dillaman
3ecc35350a doc/release-notes: indicate that rbd-mirror should use unique IDs
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-08 12:46:56 -04:00
Abhishek L
5a00b3905d Merge pull request #16782 from wjwithagen/wip-wjw-FreeBSD-Release
PendingReleaseNotes:Announce FreeBSD availability

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
2017-08-08 18:46:16 +02:00
Yuri Weinstein
1d7d287561 Merge pull request #16734 from theanalyst/rgw-lc-awsv4
rgw_lc: support for AWSv4 authentication

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-08 09:43:57 -07:00
Jason Dillaman
b7ba3f68c3 doc: updated rbd-mirror daemon instructions
Fixes: http://tracker.ceph.com/issues/20701
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-08 12:43:32 -04:00
Yuri Weinstein
93521be2f7 Merge pull request #16821 from theanalyst/rgw-lc-log-drop-oldlc
rgw_op: Drop the Old LifecycleConfiguration from logs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-08-08 09:42:11 -07:00
Jason Dillaman
34ff1ddca1 doc: re-ordered rbd table of contents
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-08 12:40:50 -04:00
Yuri Weinstein
88c1d6b472 Merge pull request #16854 from yaozongyou/fix-rgw-not-responding
rgw: fix not responding when receiving SIGHUP signal.

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-08-08 09:40:31 -07:00