Commit Graph

42909 Commits

Author SHA1 Message Date
Yehuda Sadeh
abd46b1f92 Merge pull request #5183 from zhouyuan/rgw_max_put_size_configurable
rgw: Make RGW_MAX_PUT_SIZE configurable

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-07-13 15:47:56 -07:00
Yehuda Sadeh
3ec58ee216 Merge pull request #5213 from wido/wip-rgw-keepalive
rgw: If the client sends a Connection: close header respond accordingly.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-07-13 15:30:24 -07:00
Josh Durgin
b67d3e05d0 Merge pull request #5210 from tweenk/docs-improvements
Document librbd::parent_spec and librbd::parent_info.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-07-13 13:41:34 -07:00
Ken Dreyer
57fdafbf11 Merge pull request #5215 from SUSE/wip-fdupes
ceph.spec.in: do not run fdupes, even on SLE/openSUSE

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2015-07-13 10:26:30 -06:00
Nathan Cutler
53072b9019 ceph.spec.in: do not run fdupes, even on SLE/openSUSE
In openSUSE there is a policy to use %fdupes in the spec file if RPMLINT
complains about duplicate files wasting space in the filesystem.

However, RPMLINT is not so complaining, so drop fdupes.

http://tracker.ceph.com/issues/12301 Fixes: #12301

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-07-13 18:17:22 +02:00
Gregory Farnum
d5dbf02202 Merge pull request #5102 from ceph/wip-mds-refactor-small
Minor MDS:: refactor

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-07-13 16:01:40 +01:00
Sage Weil
9d2efcc737 Merge pull request #5209 from zhouyuan/rgw_swift_user
rgw: Make vstart.sh print out swift user info

Reviewed-by: Sage Weil <sage@redhat.com>
2015-07-13 10:15:07 -04:00
John Spray
cd6ead3583 packaging: add cephfs-data-scan
Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
John Spray
1c00b45166 tools/cephfs: add cephfs-data-scan
For scraping cephfs data pools for metadata in
backtraces, and injecting that metadata into
the cephfs metadata pool (initially offline).

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
John Spray
8eaa2f263d doc: add some docs about cephfs-data-scan
These are deliberately fairly sparse, because:
 * These tools are for experts
 * These tools may well be wrapped in a higher
   level recovery tool that orchestrates parallel
   workers at some stage.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
John Spray
ae570255dd include/ceph_fs.h: define magic LOST+FOUND ino
So that recovery tools can create this dir without
having to consult/modify InoTable.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
John Spray
ec9b4793b4 cls: add CephFS object class
For use in cephfs-data-scan for file size and mtime
recovery, by doing a set-if-greater for size/mtime
xattrs on the 0th object of a file.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
John Spray
e07a0da84a mds: include damage_flags in inter-mds encoding
...and correspondingly bump the cluster protocol
version as these structures are not versioned
themselves.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
47f6f1eda2 mds: bump required version on fnode_t encoding
So that older MDS instances can't miss/ignore
the damage flags.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
d44c7844e5 mds: add damage_flags_t to inode+frag
Used to mark inodes+fnodes with flags indicating
that particular types of damage have either
been detected (scrub/fetch) or caused (cephfs-data-scan
inject).

This should serve as a cue to the MDS to do online
repair of stats for the nodes that have been injected.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
007c39e799 mds/CInode: move hash_dentry_name up into InodeStore
Because it only depends on the data in the store, not
anything from a live MDS, and it's useful when
we're dealing with fragmented directories from
an offline tool.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
56d6be8548 tools: fix journal reset error handling
When we failed and prompted for --force, it still
looked like a success.  ::reset never had any
proper error handling since it was lifted out
of the MDS, so add it now.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
bb70a33549 client: fix typo
s/bye/byte/

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
40d047683f mds: correct typo in log message
s/issueing/issuing/

Silly, but it annoyed me every time I saw it...

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:16 +01:00
John Spray
387f728070 Merge pull request #5164 from ceph/wip-12088
client: reference counting 'struct Fh'

Reviewed-by: John Spray <john.spray@redhat.com>
2015-07-13 13:35:54 +01:00
Wido den Hollander
79197d3711 rgw: If the client sends a Connection: close header respond accordingly.
HTTP/1.1 assumes Keep-Alive by default, but if a Connection: close header is send
the server should respond with it as well.

This makes the client close the connection after the request.

Fixes: #12298
2015-07-13 12:56:57 +02:00
John Spray
1b0842ba10 Merge pull request #5201 from ceph/wip-12272
tools: Fix rados export to use io_ctx in the right way

Reviewed-by: John Spray <john.spray@redhat.com>
2015-07-13 08:35:44 +01:00
Yuan Zhou
ea012fde23 rgw: Make vstart.sh print out swift user info
Currently vstart.sh only print out S3 user info. This patch updates it
to print swift user info too. Also changes the swift account/user/password
to test/tester/testing which align with openstack-swift better:
https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L270

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2015-07-13 12:41:00 +08:00
guce
c604dd97fc Fixes: #12286 radosgw-admin: after subuser modify print only once user info.
remove rgw_admin.cc OPT_SUBUSER_MODIFY, show_user_info code block.

switch (opt_cmd) {
...
case OPT_SUBUSER_MODIFY:
show_user_info(info, formatter);       //show first time (remove this)
break;
...
}

// output the result of a user operation
if (output_user_info) {
...
show_user_info(info, formatter);       //show second time
}

test fix:
before: after subuser modify print twice user info.
after changes, do the same procedure, print only once user info.

Signed-off-by: guce guce@h3c.com
2015-07-11 15:28:21 +08:00
Yuan Zhou
4aa102f911 rgw: Make RGW_MAX_PUT_SIZE configurable
The 5GB limit of a single operation uploading was part of S3 spec.
However some private setups may have some special requirements
on this limit. It's more convinent to have a configurable value.

Fixes: #6999

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2015-07-11 13:38:15 +08:00
David Zafman
ce02801b4c tools: Fix rados export to use io_ctx in the right way
Cause by: 868f6b7626

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 14:59:45 -07:00
David Zafman
661205899b Merge pull request #5197 from ceph/wip-cot-meta
Wip cot meta

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-07-10 14:31:10 -07:00
Loic Dachary
7ec0b917e6 Merge pull request #5198 from tchaikov/wip-doc-erasure-fix
doc/erasure-code: fix couple typos

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-07-10 21:34:58 +02:00
Kefu Chai
cb03f81b61 doc/erasure-code: fix couple typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-07-11 01:47:48 +08:00
David Zafman
127a5f191d tools, test: Some ceph-objectstore-tool error handling fixes
Improve various error messages generated with invalid syntax
Add test cases for most of these error messages

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
a3b14ede9e test: Add debug argument to the ceph-objectstore-tool test
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
d8460714fa tools: Check for valid --op earlier so we can get a better error message
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
31fa89f249 tools, test: Add ceph-objectstore-tool to operate on the meta collection
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
6aec38b51f tools: Fix newlines in output of --op list
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
fd1772e0ac tools: Fix dump-super which doesn't require pgid
A valid pgid had to be specified in order for superblock to be displayed,
but it was otherwise ignored.
Fix message that didn't include dump-super

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
David Zafman
5534bc8648 tools: Check and specify commands that require the pgid specification
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 10:10:43 -07:00
Yehuda Sadeh
4a179eea52 Merge pull request #4404 from rzarzynski/wip-11431
rgw: fix lack of account name attribute in XML-formatted bucket listing of Swift account

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-07-10 09:30:24 -07:00
Yehuda Sadeh
014353ded2 Merge pull request #5078 from rzarzynski/wip-12158
rgw: send Content-Length in response for GET on Swift account.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-07-10 09:06:08 -07:00
Sage Weil
b30610c5bc Merge branch 'wip-temp'
Conflicts:
	src/osd/ReplicatedPG.cc
	src/test/osd/RadosModel.h

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2015-07-10 11:35:23 -04:00
David Zafman
557c6530a5 osd, tools: Always filter temp objects since not being exported
Can't use object_locator_to_pg() directly with a temp object
because the pool is negative.

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 11:30:17 -04:00
David Zafman
4fcf5dd370 tools: Don't export temporary objects until we have persistent-temp objects
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 11:30:14 -04:00
David Zafman
fb22a9fa2f osd: fix temp clearing in OSD
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-07-10 11:30:11 -04:00
Krzysztof Kosiński
1a8e7a78cb Document librbd::parent_spec and librbd::parent_info.
Add an explanatory comment to parent_types.h that explains what
the "overlap" member in parent_info means. This was not exactly easy
to figure out.

Signed-off-by: Krzysztof Kosiński <krzysztof.kosinski@intel.com>
2015-07-10 11:49:45 +02:00
Yan, Zheng
d934c1319b Merge pull request #5175 from david-z/wip-mds-dump-crash
Fix mds dump_ops_in_flight crashing ocassionally
2015-07-10 17:24:41 +08:00
zhangzhi
f9378a9abf Fix mds dump_ops_in_flight crashing ocassionally 2015-07-10 17:10:30 +08:00
Loic Dachary
61d5043844 Merge pull request #4977 from theanalyst/rados/wip-9737
rados/tool: handle --snapid correctly

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-07-10 10:00:11 +02:00
Haomai Wang
b3002dd0d9 Merge pull request #5185 from yuyuyu101/wip-store-test-zero
StoreTest: Add zero test for SyntheticTest
2015-07-10 09:50:36 +08:00
Samuel Just
fbfa5ab2f6 Merge pull request #3273 from majianpeng/fix4
cleanup code for RecoveyMessages

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-07-09 17:13:43 -07:00
Samuel Just
6763dcdad3 Merge pull request #4143 from majianpeng/ec-notsupp-omap
fix bugs about cache tier.

Reviewed-by: Sage Weil <sage@redhat.com>
2015-07-09 17:12:28 -07:00
Samuel Just
086ad186ae Merge pull request #4329 from majianpeng/filestore-copy
Filestore copy:using splice instead read/write for clone

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2015-07-09 17:10:57 -07:00