Commit Graph

56083 Commits

Author SHA1 Message Date
Yan, Zheng
25b6011dcf mds: using cap_reconnect_t to track cap recconect
Previous commit extended cap_reconnect_t to include snapflush
related information. This information are needed in various
places

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-07-15 09:11:49 +08:00
Yan, Zheng
dd3963a878 mds: add 'follows' of first pending snapflush to cap reconnect message
This helps the recovering MDS to reconstruct the internal states that
tracking pending snapflush.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-07-15 09:11:49 +08:00
Yan, Zheng
306153b3d0 mds: journal snap inodes that need flush when expiring log segment
Treat snap inodes that need flush in the same way as open files.
When MDS recovers, this make sure that journal replay bring snap
inodes that need flush into the cache

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-07-15 09:11:49 +08:00
Yan, Zheng
4883779935 mds: properly update client_snap_caps when splitting snap inode
update the new snap inode's client_snap_caps according to the old
snap inode.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-07-15 09:11:49 +08:00
Yuri Weinstein
3f6daa90e2 Merge pull request #9491 from Yan-waller/yj-wip-fixbuildpushop
osd/ReplicatedBackend: add sanity check during build_push_op()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-07-14 15:16:22 -07:00
Yuri Weinstein
f748b95966 Merge pull request #9510 from renhwztetecs/renhw-wip-common
common: unknown hash type of judgment modification

Reviewed-by: Sage Weil <sage@redhat.com>
2016-07-14 15:15:18 -07:00
Yuri Weinstein
5d1339bbc5 Merge pull request #9729 from stiopaa1/common_workqueue_addMove
common/WorkQueue: add std move

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-07-14 15:14:39 -07:00
Yuri Weinstein
125c42a452 Merge pull request #9770 from tanghaodong25/submit-transaction-perfcounter
kv/RocksDB: add perfcounter for submit_transaction_sync operation

Reviewed-by: Sage Weil <sage@redhat.com>
2016-07-14 15:13:31 -07:00
Casey Bodley
49001d99ed Merge pull request #10274 from yehudasa/wip-16665
rgw: collect skips a specific coroutine stack

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-07-14 17:06:11 -04:00
Yehuda Sadeh
f01f2190b5 Merge pull request #10187 from dreamhost/wip-16618
rgw: fix multi-delete query param parsing.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-07-14 11:42:37 -07:00
Samuel Just
6785393c04 Merge pull request #10289 from jdurgin/wip-googletest-centos
fix the rpm build for centos

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-07-14 07:48:35 -07:00
Orit Wasserman
a01e32d128 Merge pull request #10271 from linuxbox2/rgw-rename
rgw_file: fix rename cases and unify unlink
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-07-14 15:42:08 +02:00
Orit Wasserman
6a86bfe8b8 Merge pull request #8618 from linuxbox2/rgw-file-setattr
rgw: file setattr
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-07-14 15:16:03 +02:00
Matt Benjamin
4de1c3c260 rgw_file: implement rgw_setattr
Introduce a new RGWSetattrs RGWOp descendant, to create or replace
sets of attrs on buckets or objects.

This version of the change uses the standard RGWRADOS::set_attrs op
(we want attribute changes to (e.g.) sync with other changes).

Previous versions of this changed incorrectly masked the values
of st->st_ino in RGWFileHandle::stat(), now fixed.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-07-14 08:33:11 -04:00
Orit Wasserman
a0ffd6b1d3 Merge pull request #10284 from linuxbox2/rgwfile_write_guard
rgw_file: refuse partial, out-of-order writes
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-07-14 14:31:21 +02:00
Kefu Chai
e5cf8c1a8f Merge pull request #10258 from ukernel/wip-16655
ceph-fuse: link to libtcmalloc or jemalloc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-14 20:26:32 +08:00
John Spray
f8ecf532fb Merge pull request #10168 from batrick/client-inode-des
client: move Inode specific cleanup to destructor

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-14 12:38:48 +01:00
xie xingguo
90676f45c6 kv/MemDB: drop a meaningless assert
The string.clear() is stl method, which shall guarantee
the string will become empty. So this is absolutely
unnecessary.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:34:18 +08:00
xie xingguo
80b398b7f6 kv/MemDB: fix MemDB::_init()
1. mkdir() returns zero on success, or -1 if an error
   occurred (in which case, errno is set appropriately).
2. we shall return the proper error result to caller on failure.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:34:07 +08:00
xie xingguo
20def20fda kv/MemDB: use VOID_TEMP_FAILURE_RETRY wrapper to close fd
Which is safer.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:33:52 +08:00
xie xingguo
b150081d04 kv/MemDB: fix fd leak
Also translate the error message to the output properly.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:33:40 +08:00
xie xingguo
44223489bb kv/MemDB: remove duplicated using statement of std::string
MemDB.h has already done such thing.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:33:23 +08:00
John Spray
f8394a2a5c Merge pull request #10169 from batrick/client-inode-cons
client: note order of member init in cons

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-14 12:33:20 +01:00
xie xingguo
4b5e2d6c40 os/bluestore: use map to tracking writing buffers
By keeping the writing buffers ordered, the finish_write()
process does not need to traverse the whole writing list
each time it is called any more, which is good for performance.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:21:32 +08:00
John Spray
ad86588abe Merge pull request #10265 from tchaikov/wip-ceph-fs-warnings
include/ceph_fs.h: guard `#define CEPH_SETATTR_*` with #ifndef

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-14 12:20:59 +01:00
John Spray
4b7a5cb2da Merge pull request #10142 from batrick/i16042
mds: move Finisher to unlocked shutdown

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-14 12:19:16 +01:00
John Spray
5195c94eb1 Merge pull request #10176 from renhwztetecs/renhw-wip-mon-mds
mon/mds: add err info when load_metadata is abnormal

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-07-14 12:18:14 +01:00
xie xingguo
3325ab02b7 os/bluestore: remove expecting_objects checking for stary bnode/onode
It actually never works for now and there is no easy way to do such check.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-14 19:15:57 +08:00
John Spray
453b69f4ac Merge pull request #10192 from batrick/mon-minor
mon: use clearer code structure

Reviewed-by: songbaisen <song.baisen@zte.com.cn>
2016-07-14 11:56:42 +01:00
John Spray
b8c5647e56 Merge pull request #10200 from renhwztetecs/renhw-wip-mds-journal
osdc/mds: fixup pos parameter in the journaler

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-14 11:55:22 +01:00
Brad Hubbard
73084b3371 doc: peering.rst, fix typo
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-07-14 18:34:06 +10:00
Brad Hubbard
10de0b0d0c doc: perf_counters.rst fix trivial typo
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-07-14 18:33:16 +10:00
Kefu Chai
c5e5ef7179 Merge pull request #9933 from chhabaramesh/master
kv: In memory keyvalue db implementation

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2016-07-14 14:13:08 +08:00
Oleh Prypin
2699b6d89b install-deps: Get the latest virtualenv in a temporary folder
to work around a bug in old virtualenv

Signed-off-by: Oleh Prypin <oleh@pryp.in>
2016-07-13 16:35:07 -07:00
Josh Durgin
f9a829dfca googletest: avoid installing any pieces of it
This makes rpmbuild happy.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-07-13 16:34:47 -07:00
Vaibhav Bhembre
d1f2c557b2 rbd: add rbd_resize2 for allow_shrink option 2016-07-13 15:50:04 -04:00
Ali Maredia
0f58056188 Merge pull request #10286 from ceph/wip_leftover_with_mds
Removes remaining reference to WITH_MDS

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-07-13 14:44:28 -04:00
Yehuda Sadeh
5a2e8f0526 rgw: collect skips a specific coroutine stack
Fixes: http://tracker.ceph.com/issues/16665

Instead of drain_all_but() that specifies number of stacks to leave behind,
added drain_all_but_stack() that has a specific stack specified. This is needed
so that we don't call wakeup() through lease_cr->go_down() on a cr stack that
was already collected.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-07-13 11:39:43 -07:00
J. Eric Ivancich
d0baaae825 Not all references to WITH_MDS were removed (see PR #10186). This
removes the final one (dependency of vstart on ceph-mds).

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2016-07-13 14:36:37 -04:00
Yehuda Sadeh
8912e0ef5b Merge pull request #10120 from oritwas/bz16412
rgw: remove bucket index objects when deleting the bucket

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-07-13 10:56:13 -07:00
Kefu Chai
b8c5cf0889 Merge pull request #10161 from ceph/wip-dang-cmake
CMake - stop pip checking for updates

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-14 00:52:17 +08:00
Samuel Just
b4144fb329 Merge pull request #10170 from ceph/wip-pg-log-errors-11
include write error codes in the pg log

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-07-13 09:46:16 -07:00
Josh Durgin
113efffa44 Merge branch 'googletest'
Update Ceph to use Google Test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-07-13 08:06:29 -07:00
Noah Watkins
26868ed4a2 objclass: implement 'osd class default list'
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2016-07-13 08:03:26 -07:00
Matt Benjamin
12aded803e rgw_file: refuse partial, out-of-order writes
A single file object may be opened only once per gateway
instance, and writes to that object must be complete, and in-order.
Enforce this.

If an invalid write is seen, deletes the current write transaction.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-07-13 10:40:03 -04:00
Casey Bodley
1af398f48b Merge pull request #10282 from ceph/wip-cmake-cxx-flags
cmake: fix the FTBFS introduced by dc8b3ba

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-07-13 09:56:05 -04:00
Kefu Chai
4b73cdc019 cmake: fix the FTBFS introduced by dc8b3ba
the flags are not list

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-13 21:50:54 +08:00
Kefu Chai
d49ce27a74 Merge pull request #10279 from ceph/wip-cmake
cmake changes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-07-13 21:31:27 +08:00
Haomai Wang
3fd4397115 Merge pull request #9784 from ceph/wip-ms-async-fixes
msg/async: connect authorizer fix + recv_buf size

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-07-13 21:28:53 +08:00
Mykola Golub
09710c46d3 test: fsx: fix rbd-nbd daemon logging
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-07-13 15:40:03 +03:00