Commit Graph

59393 Commits

Author SHA1 Message Date
Weibing Zhang
32a665e74b client: Client.cc: correct the op type checking for CEPH_MDS_OP_CREATE
Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>
2016-10-28 14:47:42 +08:00
David Zafman
c6cf05b302 global: Always log loading erasure code for tests
Fix for broken test-erasure-code.sh and test-erasure-eio.sh

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:11 -07:00
David Zafman
b4c080b1b4 test.sh: Make check for flags more robust
Low space broke test, saw "flags nearfull,pauserd,pausewr...."

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:11 -07:00
David Zafman
6904529d1b test: Remove extra objectstore_tool call which causes a recovery
Caused by: 70e000a9a4

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:11 -07:00
David Zafman
bfe3ebd94f test: Handle object removals in a non-racey way
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:11 -07:00
David Zafman
73a27533be osd: Fix hang on unfound object after mark_unfound_lost is done
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:11 -07:00
David Zafman
c51d70e1e8 osd: Handle recovery read errors
Fixes: http://tracker.ceph.com/issues/13937

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:10 -07:00
David Zafman
b40ec3fe89 osd: Fix log messages
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:10 -07:00
David Zafman
36fd68c966 osd: CLEANUP: Remove unused pending_read member
Remove unused struct

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:42:10 -07:00
David Zafman
1fceb344be Revert "test: Disable tests due to recovery race"
This reverts commit 5bc55338f5.

Conflicts:
	src/test/Makefile.am (no longer exists)
	src/test/erasure-code/Makefile.am (no longer exists)

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-27 22:40:20 -07:00
Brad Hubbard
a271880ee2 Merge pull request #11582 from batrick/ceph-dumpable
core: set dumpable flag after setuid

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-10-28 14:43:35 +10:00
Michal Jarzabek
c9b4916098 mds/Mutation.h: add const to member functions
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-10-27 21:51:30 +01:00
Malte Fiala
34cd50c4c4 doc: Fixed mapping error in legacy mds command
Signed-off-by: Malte Fiala <maltefiala@produktion.io>
2016-10-27 19:27:19 +02:00
Sage Weil
fb642810c5 Merge pull request #11666 from tchaikov/wip-cmake
cmake: remove include/Makefile.am
2016-10-27 11:37:54 -05:00
Kefu Chai
3eb384ffef cmake: remove include/Makefile.am
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-27 16:37:46 +08:00
Brad Hubbard
a54c86f9df os/filestore: Fix erroneous WARNING: max attr too small
When we read the conf values from the conf file we call handle_conf_change which
calls set_xattr_limits_via_conf but this is before m_fs_type is initialised so
we fall through to the default comaprison with
filestore_max_xattr_value_size_other (1024) and erroneously issue the warning.
This happens at every startup but subsequent calls once the filestore is mounted
proceed as expected. Don't call set_xattr_limits_via_conf unless the filestore
is mounted.

Fixes: http://tracker.ceph.com/issues/17420
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-10-27 16:02:09 +10:00
Kefu Chai
efa03040c5 Merge pull request #11638 from tchaikov/wip-clang
include/enc: make clang happy

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-27 13:01:17 +08:00
Josh Durgin
3d80e609ee Merge pull request #11658 from hjwsm1989/doc
doc: change the osd_max_backfills default to 1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-10-26 16:17:56 -07:00
Michal Jarzabek
f64ae8a28f mds/MDLog: add const to member functions
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-10-26 22:13:48 +01:00
John Spray
32b15e329a Merge pull request #10887 from michaelsevilla/mantle
fs: Mantle: A Programmable Metadata Load Balancer

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-26 20:31:28 +01:00
Jason Dillaman
fdea4404a4 Merge pull request #11641 from vshankar/rbd-data-pool-assert
librbd: possible assert failure creating image when using data pool

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-10-26 11:35:59 -04:00
Kefu Chai
6c4af3c55e common/cmdparse,msg/async: remove unnecessary std::move()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-26 23:30:22 +08:00
Kefu Chai
8b19229df3 librados: postpone cct deletion
RefCountedObject::put() prints log using cct, but RadosClient
relinquishes the reference to cct too early, so when its
`RefCountedObject` member variables print log when they are
destructed, the cct is already freed. hence we have a segfault.

to address this problem, we need postpone destructure of it after all
other RefCountedObject member variables are destroyed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-26 23:20:10 +08:00
Kefu Chai
bdf174f220 Merge pull request #11570 from tchaikov/wip-revise-SubmittingPatches
doc: reformat SubmittingPatches with more rst syntax

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-10-26 22:37:41 +08:00
Orit Wasserman
670fc74c32 Merge pull request #11630 from cbodley/wip-rgw-curl-upgrade
rgw: remove suggestion to upgrade libcurl
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-10-26 15:46:18 +02:00
Haomai Wang
8a53a604f3 osd/PGBackend: fix collection_list shadow return value
Fixes: http://tracker.ceph.com/issues/17713
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-10-26 20:21:34 +08:00
Kefu Chai
d712d20832 Merge pull request #11385 from bassamtabbara/wip-rocksdb-external-project
cmake: use external project for rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 18:48:33 +08:00
Kefu Chai
68ba90d629 doc: remove ending period in section titles
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-26 17:53:22 +08:00
huangjun
e112664bf3 doc: change the osd_max_backfills default to 1
Fixes: http://tracker.ceph.com/issues/17701
  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-10-26 16:55:53 +08:00
Kefu Chai
fe1a6cf72f Merge pull request #11653 from ktdreyer/doc-epel-instructions
doc: standardize EPEL instructions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 15:39:42 +08:00
Bassam Tabbara
418bfd7bb5 cmake: use external project for rocksdb
This commit makes rocksdb an external cmake project. This ensures
that rocksdb is no longer built from src/rocksdb, and that make clean
works correctly.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2016-10-26 09:32:54 +02:00
Bassam Tabbara
5bbcf8547c pickup new rocksdb with support for linux cmake
This picksup a new version of rocksdb with support for
linux cmake.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2016-10-26 09:32:54 +02:00
Kefu Chai
ed9b0d3273 Merge pull request #11619 from dachary/wip-17662-ceph-disk
ceph-disk: allow using a regular file as a journal

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 15:02:51 +08:00
Kefu Chai
2850f1d863 Merge pull request #11652 from ktdreyer/doc-mgr-syntax
doc: fix mgr literal block rST syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 13:53:27 +08:00
huangjun
bf2b50ef95 mon: print the num_pools and num_objects in 'ceph -s -f json/json-pretty'.
Fixes: http://tracker.ceph.com/issues/17703
  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-10-26 11:40:05 +08:00
Venky Shankar
a5fff40be3 librbd: assert failure when using data pool
This fixes a silly assert that's hit during image creation
(cli/api) when the data pool specified is same as the pool
specified by -p/--pool option (or the default).

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2016-10-26 08:11:17 +05:30
Ken Dreyer
9411017fd3 doc: standardize EPEL instructions
Prior to this change, the documentation pages contained different ways
to enable EPEL. Pick a simple, secure (https) way and standardize on
that.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-10-25 20:02:48 -06:00
Ken Dreyer
be7de7ab0d doc: fix mgr literal block rST syntax
Prior to this change, there were double-colon ("::") characters in the
HTML docs to indicate literal blocks.

The proceeding paragraphs were not pre-formatted because there was no
newline between the double-colon and the to-be-pre-formatted paragraph.

Move the "::" characters inline to simplify the syntax and make Sphinx
properly interpret these texts as literal blocks.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-10-25 19:51:53 -06:00
Yehuda Sadeh
6b966bed79 Merge pull request #11594 from cbodley/wip-rgw-init-bucket-sync
rgw: fix for passing temporary in InitBucketSyncStatus

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:06:54 -07:00
Yehuda Sadeh
574f4fde1f Merge pull request #11505 from cbodley/wip-17571
rgw: clean up RGWShardedOmapCRManager on early return

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:05:27 -07:00
Yehuda Sadeh
3a7546d443 Merge pull request #11504 from cbodley/wip-17568
rgw: RGWSimpleRadosReadCR tolerates empty reads

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-25 15:04:02 -07:00
Michael Sevilla
5cc43cf0a7 mantle: re-design and fixes
- fix legacy encoding in mds map and add balancer to dumps
- fix blocking rados read and remove temporary files
- fix beacon message spamming

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
Michael Sevilla
0829028d1c mantle: store balancer in RADOS, balancer version in MDSMap
- add docs and sample balancer (greedy-spill)

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
Michael Sevilla
b44340abf5 mantle: write balancer policies in Lua
Introduces Mantle, a programmable metadata load balancer. Policies for making
migration decisions are written in Lua but the Migrator and Balancer modules
still do fragmentation and migration. If the Lua balancer fails, control falls
back to the original balancer implementation.

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:32 -07:00
John Wilkins
f7a761ac22 Merge pull request #11352 from dachary/wip-17526-rados-bench
doc: document hostname constraints for rados bench

reviewed-by: John Wilkins <jowilkin@redhat.com>
2016-10-25 12:26:31 -07:00
John Wilkins
2e987aef46 Merge pull request #11602 from dillaman/wip-17665
doc: clarify QEMU rbd cache settings

reviewed-by: John Wilkins <jowilkin@redhat.com>
2016-10-25 12:23:31 -07:00
Willem Jan Withagen
05f4be44dc Log: Replace namespace log with loging
- This to avoid a nameing confilct that Clang finds with
   std::log from cmath

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-10-25 19:45:24 +02:00
Kefu Chai
70d2d40233 Merge pull request #9825 from liewegas/wip-addrvec
msg: add entity_addr_t types; add new entity_addrvec_t type

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-26 01:38:01 +08:00
Radoslaw Zarzynski
573c564c0b rgw: implement buffered HTTP header composition in front-ends.
Without the patch front-ends issueed a lot of small IO operations
leading to increased overhead on syscalls and to the fragmentation
of an HTTP message across multiple TCP segments. The later was
occuring when the Nagle's algorithm hadn't been able to form
a single TCP segment (usually when running on extremely fast
network interfaces like loopback).

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-25 18:28:26 +02:00
Radoslaw Zarzynski
ac4928aa36 rgw: sanitize length of metadata attributes.
std::string and thus boost::string_ref ARE OBLIGED to carry multiple
0x00 and count them to the length of a string. We need to take that
into consideration and sanitize the size of a ceph::buffer::list used
to store metadata values (x-amz-meta-*, X-Container-Meta-*, etags).
Otherwise we might send 0x00 to clients.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-25 18:28:26 +02:00