Commit Graph

27487 Commits

Author SHA1 Message Date
Christophe Courtaut
3a20b06938 rgw: admin: Add --shard-id option to help
http://tracker.ceph.com/issues/5324 fixes #5324
Explains operations dependency,
which is more important than the semantic.

Signed-off-by: Christophe Courtaut <christophe.courtaut@gmail.com>
2013-07-02 15:24:02 +02:00
Yehuda Sadeh
08123b6a13 Merge pull request #387 from ceph/wip-5346
rgw: add RGWFormatter_Plain allocation to sidestep cranky strlen()

Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-01 21:00:02 -07:00
Sage Weil
49ff63b175 rgw: add RGWFormatter_Plain allocation to sidestep cranky strlen()
Valgrind complains about an invalid read when we don't pad the allocation,
and because it is inlined we can't whitelist it for valgrind.  Workaround
the warning by just padding our allocations a bit.

Fixes: #5346
Backport: cuttlefish
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-01 18:21:01 -07:00
John Wilkins
94742d4c69 doc: Minor fix.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-07-01 17:06:22 -07:00
Yehuda Sadeh
2ad4ff69a1 rgw: metadata, data logs can be turned on / off
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-01 15:55:46 -07:00
Joao Eduardo Luis
935c27842e mon: Paxos: update first_committed on first paxos proposal
We were adding this update to a transaction that would only be applied
on the leader.  The peons would never see a first_committed > 0.

Fixes: #5484

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-07-01 15:20:51 -07:00
Sage Weil
847465fffd librados: fix test warning on 32-bit platforms
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-01 14:30:03 -07:00
Sage Weil
6d90dad45e os/FileStore: automatically enable 'filestore xattr use omap' as needed
Automatically enable the 'filestore xattr use omap' option if the fs
does not appear to handle large xattrs on its own.

This makes for a more pleasant use experience as they are not told to
enable something that we already know they must enable in order to
continue.

Fixes: #5137
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-01 13:45:25 -07:00
Sage Weil
1b578a804b librados: add test for large and many xattrs
Verify that we can set large and large numbers of attrs on an object.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-01 13:45:25 -07:00
Sage Weil
8694d296de osd/PGLog: populate log_keys_debug from read_old_log()
Fixes: #5470
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-07-01 13:42:25 -07:00
Yehuda Sadeh
cfc1f2ee1f rgw: modify RGWBucketInfo::creation_time encoding / decoding
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-01 11:01:39 -07:00
Yehuda Sadeh
1fbd50b1ca Merge pull request #385 from kri5/wip-1779
rgw: Fix return value for swift user not found

Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-01 07:08:05 -07:00
Christophe Courtaut
4089001de1 rgw: Fix return value for swift user not found
http://tracker.ceph.com/issues/1779 fixes #1779

Adjust the return value from rgw_get_user_info_by_swift call
in RGW_SWIFT_Auth_Get::execute() to have the correct
return code in response.
2013-07-01 14:57:17 +02:00
Yehuda Sadeh
c73a24be07 rgw: end-marker serves as last value, not as upperbound
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 21:00:05 -07:00
Yehuda Sadeh
c4140303b7 rgw: relax marker requirements for log apis
Don't require start-time, start-marker.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 20:59:34 -07:00
Yehuda Sadeh
b21a41ab58 rgw: update log APIs to use markers
a few APIs were missing markers, fixed that.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 20:39:00 -07:00
Yehuda Sadeh
ce7d816d9f rgw: cls_log_entry has id field
The id field can be used as the marker for log list / trim
operations.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 20:39:00 -07:00
Yehuda Sadeh
064e92f000 Makefile.am: some more makefile rules fixes
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 20:39:00 -07:00
Yehuda Sadeh
c2a56e524d rgw: date string parsing also parses seconds fraction
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 20:38:52 -07:00
Yehuda Sadeh
a6bbc91c9d Makefile.am: some more makefile rules fixes
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 17:41:04 -07:00
Yehuda Sadeh
26423b929e rgw: date string parsing also parses seconds fraction
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 16:13:15 -07:00
Yehuda Sadeh
0335905d4c rgw: fix cli test
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 15:28:15 -07:00
Yehuda Sadeh
5314e3fe85 Makefile.am: add missing rule
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-29 15:28:01 -07:00
Sage Weil
09e374f162 osd: set maximum object attr size
Make a well-defined maximum size of an object attribute.  Since Linus has
a 64KB limit, and that is what we normally use to back this, use that as
the limit.  This means that even when leveldb is backing large xattrs
(as ext4 users must do) we will return EFBIG on >64KB setxattr attempts.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-28 18:29:12 -07:00
Yehuda Sadeh
e56ef07eb1 rgw: initialize sent_header in RGWOp_Opstate_List
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-28 14:47:43 -07:00
Sage Weil
e235958fb1 mds: log before respawning when standby-replay falls behind
Call into an MDS method so that we can write to the log.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-28 14:25:12 -07:00
Sage Weil
946a838cff Merge remote-tracking branch 'gh/wip-5381' into wip-mds
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-28 14:24:08 -07:00
Yehuda Sadeh
e75057fc2c rgw-admin: restructure replicalog commands
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-28 13:17:26 -07:00
Sage Weil
87217e1e3c client: send all request put's through put_request()
Make sure all MetaRequest reference put's go through the same path that
releases inode references, including all of the error paths.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-28 12:21:58 -07:00
Sage Weil
9af3b86b25 client: fix remaining Inode::put() caller, and make method psuedo-private
Not sure I can make this actually private and make Client::put_inode() a
friend method (making all of Client a friend would defeat the purpose).
This works well enough, though!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-28 11:50:11 -07:00
Yehuda Sadeh
12ab4f881d Merge remote-tracking branch 'enovance/wip-rgw-geo-2-opstate' into wip-rgw-geo-2
Conflicts:
	src/Makefile.am
	src/rgw/rgw_admin.cc
	src/rgw/rgw_common.h

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-28 11:26:30 -07:00
Sage Weil
2e857a4df6 librados: fix cmd OSDCommand test
If we get ENXIO, buflen will be 0.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-28 06:54:18 -07:00
Yehuda Sadeh
72ac281d7a rgw: don't remove bucket index when removing a bucket
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-27 23:21:51 -07:00
Yehuda Sadeh
10a2b60f33 rgw: bilog list by bucket instance (RESTful api)
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-27 23:12:09 -07:00
Sage Weil
81bee6487f client: use put_inode on MetaRequest inode refs
When we drop the request inode refs, we need to use put_inode() to ensure
they get cleaned up properly (removed from inode_map, caps released, etc.).
Do this explicitly here (as we do with all other inode put() paths that
matter).

Fixes: #5381
Backport: cuttlefish
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-27 21:39:35 -07:00
Yehuda Sadeh
977df7781b ceph_json: reset values
Call the default constructor if entry not found. Also,
reset containers before inserting new data.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-27 21:13:12 -07:00
Yehuda Sadeh
674bbabe85 rgw: user param in access key is not manadatory
for json decoding

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-27 21:13:12 -07:00
Yehuda Sadeh
9d702e5894 rgw: advance ptr when sending data
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-27 21:13:08 -07:00
John Wilkins
13f9c184c4 doc: Created an install page for Calxeda development packages.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-27 16:31:44 -07:00
Greg Farnum
8f0fbc22c8 Merge branch 'next' 2013-06-27 15:23:00 -07:00
Greg Farnum
9e604ee694 ceph-disk: s/else if/elif/
Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Joao Luis <joao.luis@inktank.com>
(cherry picked from commit bd8255a750de08c1b8ee5e9c9a0a1b9b16171462)
2013-06-27 15:21:44 -07:00
João Eduardo Luís
d83006064b Merge pull request #372 from ceph/wip-mon-pgmap
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-06-27 15:09:50 -07:00
Babu Shanmugam
b4ee7cac1f changes to accomodate review comments on previous version
Signed-off-by: Babu Shanmugam <anbu@enovance.com>
2013-06-27 20:10:28 +05:30
Yehuda Sadeh
8f1da8f3d4 rgw: fix regionmap json decoding
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-06-26 22:39:07 -07:00
Sage Weil
68c013d790 Merge remote-tracking branch 'gh/next' 2013-06-26 22:19:32 -07:00
Sage Weil
61a0436035 Merge pull request #378 from ceph/wip-init-rbd
Reviewed-by: Sage Weil <sage@inktank.com>
2013-06-26 22:15:11 -07:00
Sage Weil
cd7510f26c qa/workunits/misc/multiple_rsync: put tee output in /tmp
2013-06-25T10:29:15.811 INFO:teuthology.task.workunit.client.0.err:+ rsync -auv --exclude local/ /usr/ usr.2
2013-06-25T10:29:15.811 INFO:teuthology.task.workunit.client.0.err:+ tee a
2013-06-25T10:29:15.902 INFO:teuthology.task.workunit.client.0.out:sending incremental file list
2013-06-25T10:29:48.738 INFO:teuthology.task.workunit.client.0.out:
2013-06-25T10:29:48.740 INFO:teuthology.task.workunit.client.0.out:sent 1449972 bytes  received 7477 bytes  43505.94 bytes/sec
2013-06-25T10:29:48.740 INFO:teuthology.task.workunit.client.0.out:total size is 3205268241  speedup is 2199.23
2013-06-25T10:29:48.740 INFO:teuthology.task.workunit.client.0.err:+ hexdump -C a
2013-06-25T10:29:48.741 INFO:teuthology.task.workunit.client.0.out:00000000  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
2013-06-25T10:29:48.741 INFO:teuthology.task.workunit.client.0.out:00000010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 0a 73  |...............s|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000020  65 6e 74 20 31 34 34 39  39 37 32 20 62 79 74 65  |ent 1449972 byte|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000030  73 20 20 72 65 63 65 69  76 65 64 20 37 34 37 37  |s  received 7477|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000040  20 62 79 74 65 73 20 20  34 33 35 30 35 2e 39 34  | bytes  43505.94|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000050  20 62 79 74 65 73 2f 73  65 63 0a 74 6f 74 61 6c  | bytes/sec.total|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000060  20 73 69 7a 65 20 69 73  20 33 32 30 35 32 36 38  | size is 3205268|
2013-06-25T10:29:48.742 INFO:teuthology.task.workunit.client.0.out:00000070  32 34 31 20 20 73 70 65  65 64 75 70 20 69 73 20  |241  speedup is |
2013-06-25T10:29:48.743 INFO:teuthology.task.workunit.client.0.out:00000080  32 31 39 39 2e 32 33 0a                           |2199.23.|
2013-06-25T10:29:48.743 INFO:teuthology.task.workunit.client.0.out:00000088

This passes consistently when the output is in /tmp, but fails after a few
iterations when on cephfs+kclient.  Avoid the bug with this test.

See: #5453

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-26 22:11:07 -07:00
Yehuda Sadeh
e1f9fe58d2 rgw: fix radosgw-admin buckets list
Fixes: #5455
Backport: cuttlefish
This commit fixes a regression, where radosgw-admin buckets list
operation wasn't returning any data.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-06-26 21:30:49 -07:00
David Zafman
fe6633172e Handle non-existent front interface in maps from older MONs
Fix OSDService::get_con_osd_hb() to not try to get_connection() without front interface
Fix OSD::handle_osd_map() to check for missing front interface

Fixes: #5460

Signed-off-by: David Zafman <david.zafman@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-06-26 21:06:59 -07:00
Sage Weil
867ead91e4 qa/workunits/rbd/simple_1tb: add simple rbd read/write test on large image
Motivated by #5454.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-26 20:41:58 -07:00