Commit Graph

59562 Commits

Author SHA1 Message Date
Ken Dreyer
be7de7ab0d doc: fix mgr literal block rST syntax
Prior to this change, there were double-colon ("::") characters in the
HTML docs to indicate literal blocks.

The proceeding paragraphs were not pre-formatted because there was no
newline between the double-colon and the to-be-pre-formatted paragraph.

Move the "::" characters inline to simplify the syntax and make Sphinx
properly interpret these texts as literal blocks.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-10-25 19:51:53 -06:00
Yehuda Sadeh
6b966bed79 Merge pull request #11594 from cbodley/wip-rgw-init-bucket-sync
rgw: fix for passing temporary in InitBucketSyncStatus

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:06:54 -07:00
Yehuda Sadeh
574f4fde1f Merge pull request #11505 from cbodley/wip-17571
rgw: clean up RGWShardedOmapCRManager on early return

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:05:27 -07:00
Yehuda Sadeh
3a7546d443 Merge pull request #11504 from cbodley/wip-17568
rgw: RGWSimpleRadosReadCR tolerates empty reads

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:04:02 -07:00
Michael Sevilla
5cc43cf0a7 mantle: re-design and fixes
- fix legacy encoding in mds map and add balancer to dumps
- fix blocking rados read and remove temporary files
- fix beacon message spamming

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
Michael Sevilla
0829028d1c mantle: store balancer in RADOS, balancer version in MDSMap
- add docs and sample balancer (greedy-spill)

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
Michael Sevilla
b44340abf5 mantle: write balancer policies in Lua
Introduces Mantle, a programmable metadata load balancer. Policies for making
migration decisions are written in Lua but the Migrator and Balancer modules
still do fragmentation and migration. If the Lua balancer fails, control falls
back to the original balancer implementation.

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:32 -07:00
John Wilkins
f7a761ac22 Merge pull request #11352 from dachary/wip-17526-rados-bench
doc: document hostname constraints for rados bench

reviewed-by: John Wilkins <jowilkin@redhat.com>
2016-10-25 12:26:31 -07:00
John Wilkins
2e987aef46 Merge pull request #11602 from dillaman/wip-17665
doc: clarify QEMU rbd cache settings

reviewed-by: John Wilkins <jowilkin@redhat.com>
2016-10-25 12:23:31 -07:00
Willem Jan Withagen
05f4be44dc Log: Replace namespace log with loging
- This to avoid a nameing confilct that Clang finds with
   std::log from cmath

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-10-25 19:45:24 +02:00
Kefu Chai
70d2d40233 Merge pull request #9825 from liewegas/wip-addrvec
msg: add entity_addr_t types; add new entity_addrvec_t type

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 01:38:01 +08:00
Radoslaw Zarzynski
573c564c0b rgw: implement buffered HTTP header composition in front-ends.
Without the patch front-ends issueed a lot of small IO operations
leading to increased overhead on syscalls and to the fragmentation
of an HTTP message across multiple TCP segments. The later was
occuring when the Nagle's algorithm hadn't been able to form
a single TCP segment (usually when running on extremely fast
network interfaces like loopback).

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-25 18:28:26 +02:00
Radoslaw Zarzynski
ac4928aa36 rgw: sanitize length of metadata attributes.
std::string and thus boost::string_ref ARE OBLIGED to carry multiple
0x00 and count them to the length of a string. We need to take that
into consideration and sanitize the size of a ceph::buffer::list used
to store metadata values (x-amz-meta-*, X-Container-Meta-*, etags).
Otherwise we might send 0x00 to clients.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-25 18:28:26 +02:00
Jason Dillaman
b2f8ff9301 test: new librbd discard after write test case
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-25 09:55:32 -04:00
John Spray
bbdfd1375e Merge pull request #11517 from ukernel/wip-17562
Fix #17562 (backtrace check fails when scrubbing directory created by fsstress)

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 12:30:42 +01:00
John Spray
1a67328b35 Merge pull request #11593 from ukernel/wip-17275
osdc/ObjectCacher: wake up dirty stat waiters after removing buffers

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-25 12:16:05 +01:00
John Spray
c755d056b2 Merge pull request #11604 from stiopaa1/mds_inotable_addOverride
mds/InoTable.h: add override to virtual functs

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 12:15:30 +01:00
John Spray
32838f72e1 Merge pull request #11613 from stiopaa1/mds_cdir_removeUnneededUseofCount
mds/CDir.cc: remove unneeded use of count

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 12:14:42 +01:00
John Spray
4f1c042c78 Merge pull request #11611 from batrick/i17670
mds: check if down mds is known

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-25 12:14:23 +01:00
John Spray
e5c43e9d90 Merge pull request #11191 from renhwztetecs/renhw-wip-add-libcephfs
libcephfs: add ceph_fsetattr&&ceph_lchmod&&ceph_lutime

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-25 11:59:11 +01:00
John Spray
5b9bc5f908 Merge pull request #11560 from ukernel/wip-mds-context-wrapping
MDS: reduce usage of context wrapper

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-25 11:58:42 +01:00
Kefu Chai
0919de25cb Merge pull request #11345 from jcsp/wip-mgr-assert
messages: fix out of range assertion

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-25 16:02:33 +08:00
Weibing Zhang
a06dac4472 mgr: PyModules.cc: remove duplicated if condition for fs_map
Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>
2016-10-25 15:07:12 +08:00
Kefu Chai
71b1f758a7 test/encoding: fix the build with clang
put the overloaded operator<<() into namespace std, so clang's name
resolution is able to find it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-25 12:40:46 +08:00
Kefu Chai
5f36c080bf cmake: add definitions for glibc
"-D_GNU_SOURCE -D_FILE_OFFSET_BITS=64" is not for gcc, it's for glibc
actually. so enable it on LINUX.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-25 12:40:46 +08:00
Sage Weil
7c06f7a461 include/denc: cast (possible) ints to bool in enable_if
This makes clang happy.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-25 12:40:46 +08:00
Pan Liu
ce26dc2a4e common: make l_finisher_complete_lat more accurate
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-10-25 12:36:28 +08:00
Jason Dillaman
db32d6be7a Merge pull request #11632 from VictorDenisov/group_pool_fix
rbd: fix parsing of group and image specific pools

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-10-24 23:55:17 -04:00
Victor Denisov
c4eee9f196 rbd: fix parsing of group and image specific pools
Signed-off-by: Victor Denisov <denisovenator@gmail.com>
2016-10-24 16:50:19 -07:00
Yuri Weinstein
fc70cd9ac3 Merge pull request #11036 from tomy-ac/wip-tc-rados_append
Added append functionality to rados tool.

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-10-24 14:45:42 -07:00
Yuri Weinstein
a216ff28a6 Merge pull request #11221 from stiopaa1/osd_osdmap_removeUseOfCount
osd/OSDMap.cc: remove unneeded use of count

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-24 14:45:00 -07:00
Yuri Weinstein
73a1b45ec0 Merge pull request #11388 from ukernel/wip-17177
os/ObjectStore: properly clear object map when replaying OP_REMOVE

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-24 14:44:04 -07:00
Casey Bodley
dcff120eda rgw: remove suggestion to upgrade libcurl
Reported-by: Ken Dreyer <kdreyer@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-24 15:02:41 -04:00
Michal Jarzabek
0fffda2ddc mds/DamageTable.cc: remove unneeded use of count
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-10-24 18:21:41 +01:00
Kefu Chai
b0e2028086 Merge pull request #11143 from kylinstorage/wip-fix-write-hang
osd: fix rados write op hang

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-10-25 00:16:17 +08:00
Kefu Chai
57ed9c5a35 Merge pull request #11532 from javeme/run_in_thread-return
pybind: avoid "exception 'int' object is not iterable"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-25 00:15:30 +08:00
Sage Weil
9d8b5027e6 Merge pull request #11610 from liewegas/wip-mon-forward-features
messages/MForward: reencode forwarded message if target has differing features

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-24 11:10:54 -05:00
Sage Weil
e7bf50b27a msg/Message: fix set_middle vs throttler
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-24 11:10:17 -05:00
Sage Weil
a9651282f7 msg: adjust byte_throttler from Message::encode
Normally we never call encode on a message that has a byte_throttler set
because we only use it for messages we received.  However, for forwarded
messages that we clear_payload() before resending, we *do* reencode, and in
that case we need to retake the appropriate number of bytes from the
throttler--just like we release them in clear_payload().

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-24 11:10:17 -05:00
Sage Weil
a433455e59 messages/MForward: reencode forwarded message if target has differing features
This ensures we reencode the payload with the
appropriate set of features if the client, us, or the
target do not have identical features.  Otherwise we
may forward an encoding with more features than the
target can handle.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-24 11:10:17 -05:00
Sage Weil
dcd677213e Merge pull request #11595 from liewegas/wip-move-ranges
os: fix offsets for move_ranges operation

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-24 11:08:06 -05:00
Jason Dillaman
0d81674eee librbd: ensure consistency groups will gracefully fail on older OSDs
Attempting to retrieve the group spec will fail on older OSDs, so it
must be executed as an individual step in the refresh state machine.
Also fixed code style issues for out parameters.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-24 11:56:48 -04:00
Jason Dillaman
e7da810e75 Merge pull request #11160 from VictorDenisov/consistency_groups_namespaces
librbd: add support for snapshot namespaces

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-10-24 11:55:48 -04:00
Jayashree Candadai
db917d50eb ceph-disk: allow using a regular file as a journal
Because of a missing return, ceph-disk prepare would fail if given a
regular file as a journal. If the journal file does not exist, ceph-disk
will create it but fail to ensure that the ceph user owns it. The
symlink to the journal file is not set when the journal file is
specified on the command line and the journal file does not exist at
all. The ceph-osd daemon will silently create it as a file but it will
not be the file given in argument.

Add a test case to verify using a regular file as a journal works as
expected.

Fixes: http://tracker.ceph.com/issues/17662

Signed-off-by: Jayashree Candadai <jayaajay@indiana.edu>
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2016-10-24 15:58:31 +02:00
John Spray
439ca801b3 mds: fix compile error from merges
Two patches both added these definitions
in slightly different places, so git let them
merge without a conflict.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-24 13:36:32 +01:00
John Spray
4f09892a84 Merge remote-tracking branch 'ukernel/wip-mdstypes-split' 2016-10-24 12:02:48 +01:00
John Spray
ba5d61d954 Merge pull request #11576 from ukernel/wip-17636-debug
mds: add debug assertion for issue #17636

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-24 12:00:48 +01:00
John Spray
7001eeef45 Merge pull request #11578 from jcsp/wip-backtrace-repair
mds: repair backtraces during scrub

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-24 11:53:47 +01:00
Sage Weil
9e0b482a8e Merge pull request #11596 from liewegas/wip-osdmap-features
mon/OSDMonitor: encode OSDMap::Incremental with same features as OSDMap

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-24 05:28:44 -05:00
Sage Weil
3b35f2d010 unittest_bluestore_types: fix csum const name
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-24 04:57:42 -05:00