Commit Graph

49109 Commits

Author SHA1 Message Date
Haomai Wang
4f868ee49e NVMEDevice: use nvme_probe to simply init
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-02-21 18:22:12 +08:00
Haomai Wang
61ef7d4ea0 spdk: update spdk submodule
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-02-21 18:18:52 +08:00
Haomai Wang
525927044b NVMEDevice: use nvme zero command instead of writing zero
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-02-21 18:18:37 +08:00
Haomai Wang
398e331ea9 NVMEDevice: cleanup task iterator process
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-02-21 18:16:18 +08:00
Kefu Chai
9540769da4 Merge pull request #7646 from dachary/wip-ceph-disk-flake8
ceph-disk: flake8 fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-15 15:19:56 +08:00
Loic Dachary
d476ff65d8 ceph-disk: flake8 fixes
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-15 12:43:36 +07:00
Yehuda Sadeh
5542c6e55e Merge pull request #7634 from ceph/rgw-nfs-5
nfs for rgw (Matt Benjamin, Orit Wasserman)

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-12 14:51:59 -08:00
Sage Weil
a88076415d Merge pull request #7350 from ddiss/tracker14499_enotconn_rados_monitor_log
librados: check connection state in rados_monitor_log

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-12 15:45:37 -05:00
Sage Weil
56d3e94bed Merge pull request #7584 from ifed01/wip-14511
osd: fix lack of object unblock when flush fails

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-12 15:40:33 -05:00
Sage Weil
50b45ccfa8 Merge pull request #7593 from ifed01/wip-no-blockedpromote-return-fix
osd: fix return value from maybe_handle_cache_detail()

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-12 15:39:58 -05:00
Sage Weil
bd17b5f427 Merge pull request #7587 from cbodley/wip-pageset-align
osd: memstore: fix alignment of Page for test_pageset

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-02-12 15:39:30 -05:00
Sage Weil
a00e835817 Merge pull request #7595 from liewegas/wip-hobject-stringify
osd: ghobject_t: use ! instead of @ as a separator
2016-02-12 15:38:18 -05:00
Sage Weil
9be30dbe9f Merge pull request #7596 from dachary/wip-erasure-code-corpus
tests: sync ceph-erasure-code-corpus for mktemp -d

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-12 15:37:31 -05:00
Sage Weil
eec65d035a Merge pull request #7608 from liewegas/wip-warnings
tests: fix a few build warnings

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-12 15:36:35 -05:00
Matt Benjamin
cb9cfb7291 librgw: fix rpm packaging
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:29 -05:00
Matt Benjamin
85e4febb17 librgw: fix new Debian control entries
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:28 -05:00
Matt Benjamin
e18c6890f9 librgw: remove junk files
Files accidentally added.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:27 -05:00
Matt Benjamin
5f0fcdba56 librgw: don't compare a string_ref with "" (use empty())
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:26 -05:00
Matt Benjamin
244ad79f6c librgw: fix boost::basic_string_ref template instantiation
The commit adding Seastar sstring.h replaced a part of the interface
which used an internal string-view type, with an equivalent using
basic_string_ref from Boost.  I relied on a default template argument
not present in older versions.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:25 -05:00
Matt Benjamin
de0f86691b librgw: add debian and rpm packaging
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:24 -05:00
Matt Benjamin
2f706ef084 librgw: consolidate S3 bucket name validation
There is more cleanup potential here, but it is intrusive, as the
validators for bucket and object names have been factored through
the handler inheritance hierarchy.

This change just deletes the S3 validate_bucket_name for now, as
that method was large.  The corresponding object name validator was
not defined in RGWHandler_REST_S3, so I've left it as is, for now.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 13:07:08 -05:00
Kefu Chai
7496dd9f0c Merge pull request #7626 from tchaikov/wip-fix-automake
Makefile: workaround an automake bug for "make check"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-02-13 01:33:12 +08:00
Matt Benjamin
cfb8c81eee librgw: fix copyright in src/include/rados/rgw_file.h
This file originated at Red Hat.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:29 -05:00
Yehuda Sadeh
195185d403 librgw: initialize RGWLib pointer members
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:28 -05:00
Matt Benjamin
a293c529e6 librgw: remove slo, dlo, and supplied-md5 logic in RGWWriteRequest
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:27 -05:00
Matt Benjamin
3d7fa4f725 librgw: remove RGWLibRequest "magic" numbers added for debugging
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:26 -05:00
Matt Benjamin
303f542055 librgw: comment rgw_nfs config_ops.h tunables
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:25 -05:00
Matt Benjamin
48c0f5b438 cohort_lru: remove #if 0 section
The declaration being skipped was meant as a placeholder for future
optimization work, moved to a comment.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:24 -05:00
Yehuda Sadeh
165079de10 {rgw,common}/Makefile.am: add a few more missing .h files
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:23 -05:00
Yehuda Sadeh
acadd09b86 common: add xxhash.h to Makefile.am
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:22 -05:00
Yehuda Sadeh
47a5c0cf0f rgw: fix null dereference
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:21 -05:00
Matt Benjamin
1f6799df67 librgw/rgw: fix librgw.la linkage
Ensure that key symbols from global are satisfied in the library.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:20 -05:00
Matt Benjamin
c38e3cbb6f librgw/rgw: reorganize autotools linkage
Adds the RGW-NFS library to the radosgw build, with unit tests.
Adds -fPIC to compile flags to satisfy the linker, but should have
been evident to automake/libtool.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:19 -05:00
Matt Benjamin
269d90a46f librgw: call obj_rec::sync() on dirs1_b
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:18 -05:00
Matt Benjamin
77a403971d librgw_file_nfsns: create readf_out_name, if needed
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:17 -05:00
Matt Benjamin
fa9cd660c9 librgw: remove deprecated/unused librgw personality
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:15 -05:00
Matt Benjamin
4b42c57bde librgw: properly detect RGWRados init failure
Unit tests correctly see fail result from librgw_create.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:14 -05:00
Matt Benjamin
aa969585d6 librgw: remove deprecated librgw methods
Remove unused routines:

 * librgw_acl_bin2xml
 * librgw_free_xml
 * librgw_acl_xml2bin
 * librgw_free_bin(librgw_t rgw, char* bin)

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:13 -05:00
Matt Benjamin
e43eb4d634 librgw: temporary fix RGWWrite
The current behavior of put_data_and_throttle leads to data
curruption, because the supplied buffer is apparently still being
written when the call returns--regardless of the value of
need_to_wait.

For now, do a buffer::copy of the supplied buffer, rather than the
original buffer::static, since that will at least be released
when no longer needed.

Probably this improves apparent rgw_write performance, but is not
what was originally intended.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:12 -05:00
Matt Benjamin
8aa4378106 librgw: cleanup rgw_write
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:11 -05:00
Matt Benjamin
6b9b3d8f98 librgw: add new rgw_write unit test
WRITEF1 writes back data wread in READF1.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:10 -05:00
Matt Benjamin
0eda995ca4 librgw: fix RGWReadRequest send_response_data
In hindsight, it seems clear how to consume the available bytes and
account for the bytes written into the caller's buffer.

Verified by unit test on data from S3, with a 6M file read in 1M
chunks, the preferred max read in modern Linux kernel NFS.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:09 -05:00
Matt Benjamin
06aff87308 librgw: add cross-bucket rgw_rename test
It passes.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:08 -05:00
Matt Benjamin
b35de4796c librgw: fix intra-bucket rename
Avoid hopeless fail due to binding const::std::string& to a
temporary.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:07 -05:00
Matt Benjamin
ca6e93bb35 librgw: add support for rgw_rename tests
Implements intra-bucket rgw_rename test, which unfortunately fails
currently.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:06 -05:00
Matt Benjamin
2e109ec3d2 librgw: fix rgw_unlink and delete atomicity
Move internal unlink logic into new RGWLibFS::unlink method, fix
logic for files and directories.

Use RGWFileHandle::mtx and  RGWFileHandle::FLAG_DELETED to ensure
atomicity of handle creates and deletes.

Remove handles for unlinked objects from cache.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:05 -05:00
Matt Benjamin
ad3a22dacb librgw: implement object rename
The implementation uses currently does a copy, followed by a
delete operation (if successful).

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:04 -05:00
Matt Benjamin
2a860f422b librgw: fix timestamp on create (another case)
In the rgw_create regular file case, the timestamp and size update
logic (though present) was being bypassed because the "FLAG_CREATE"
indicator which formerly propagated up from RGWLibFS::lookup_fh
was lost in the LRU change, which refactored the code for creating
new RGWFileHandle objects.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:03 -05:00
Matt Benjamin
e68600bef5 librgw: cleanup, move 3 prints to log channel
Save a pointer to CephContext in RGWProcess for use by logger--
using the existing pointer in ThreadPool would be an intrusive
change.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:01 -05:00
Matt Benjamin
7ef64851b1 librgw: add missing RGWFileHandle::stat in rgw_mkdir
The lack of stat here induced a serious memory corruption, due to
the organization of Ganesha file attributes (and their reliance on
the FSAL to initialize the memory).

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-12 12:08:00 -05:00