Commit Graph

30945 Commits

Author SHA1 Message Date
Samuel Just
bf9390f3e2 hobject_t/ReplicatedPG: tempness is now an hobject thing
PGBackend implmentations will have complete control over the temp
collection.  Rather than specifying the collection when sending
ops into the PGBackend, hobjects themselves will be temp or not.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:15 -08:00
Samuel Just
c60185c01a PGBackend: add PGTransaction
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:15 -08:00
Samuel Just
d3c8e85a44 ReplicatedBackend: update the collection_list mechanisms to skip stashed objects
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
4d56e3c831 test/osd/: verify length of buffer returned in read
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
0885880b30 test/osd/TestRados.cc: skip 0 weight ops
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
d0933eef60 test/osd: add append support to WriteOp
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
ca91fb4c5d test/osd: adapt RadosModel to not do omap ops on ec_pools
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
7fe22da29f test/osd: restructure Object/RadosModel in prep for append
Attribute handling no longer has special support in ContentsGenerator.
The most recent operation information is now stored in a special
attr rather than at the beginning of the object.  ObjectDesc layers
include their own ContentsGenerators to allow more flexibility.

Also, writes truncate to the new object size rather than simply
causing reads to stop at that object size.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
69ad880eed test/osd/Object: create encoders for ContDesc
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
8494aa84d5 src/test/osd: remove tmap test
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
03c5344f74 PGLog: allow for empty pg log in update_range if log_tail == eversion_t()
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
1b0335ed66 common: add option to disable filestore sharded object check
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
1b5992b0f0 FileStore::lfn_link: handle link within a collection
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:14 -08:00
Samuel Just
6d05fa23be PG: prefer older last_update for ec_pool
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:13 -08:00
Samuel Just
393a035b86 OSDMonitor: add debug_fake_ec_pool
This flag will cause ReplicatedPG to act as though the
pool were actually an EC pool in that operations will
be restricted to operations which can be locally rolled
back thereby allowing us to test the ReplicatedPG local
log rollback mechanisms independent of EC.  It will also
cause ReplicatedPG to use the async read mechanism on
the PGBackend implementation once it is implemented.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:13 -08:00
Samuel Just
a1ee1ee716 PGLog::rewind_divergent_log: we can rewind to tail, fix assert
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:26 -08:00
Samuel Just
a2006507a0 PGLog: don't move up log.tail
Moving up log.tail unnecessarily risks backfilling
a replica after a split.  Also, it disrupts the
property that replicas from the most recent interval
which performed writes must have overlapping logs.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Samuel Just
1f9457c53f ReplicatedBackend: remove pushing entry for each object as it completes
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Samuel Just
b7d100b697 FileStore::_collection_move_rename: remove source before closing guard
Fixes a bug in _collection_move_rename replays.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Samuel Just
06f7a98a03 ReplicatedBackend.h: don't need to be active for pushes
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Samuel Just
518774dc0c ObjectStore: improve name of the queue_transaction which cleans up the transaction
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Samuel Just
c03d027cf8 hobject: admit that gen_t is actually version_t
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:38:25 -08:00
Gregory Farnum
d6b592c087 Merge pull request #1079 from ceph/wip-tier-bits
osd: a few tiering fixes

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-01-22 13:44:46 -08:00
Sage Weil
8eaef4140b Merge pull request #1126 from ceph/wip-osdmapenc-fix
MOSDMap: reencode maps if target doesn't have OSDMAP_ENC

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-22 08:20:08 -08:00
Ilya Dryomov
8060afd77c MOSDMap: reencode maps if target doesn't have OSDMAP_ENC
Reencode both full and incremental maps if target doesn't know how to
decode OSDMAP_ENC maps (CEPH_FEATURE_OSDMAP_ENC bit is not set).  This
fixes a compatibility bug that was introduced in 3d7c69fb09 ("OSDMap:
add a CEPH_FEATURE_OSDMAP_ENC feature, and use new encoding").

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-01-22 17:34:31 +02:00
tamil
54caa0192b removing rgw_tests.sh
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-21 18:44:57 -08:00
tamil
4550fb5ff9 Merge branch 'master' of github.com:ceph/ceph 2014-01-21 17:50:22 -08:00
tamil
8b8ede7a13 modified the port to 7280 in the script instead of the default 80
Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>
2014-01-21 17:50:00 -08:00
Sage Weil
81ff12ec70 Merge pull request #1124 from ceph/wip-cache-mode-fix
mon/MonCommands: 'invalidate+forward' -> 'forward'

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-21 17:30:34 -08:00
tamil
850b4f426f script for rgw bucket quota testing
Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>
2014-01-21 15:56:37 -08:00
Ilya Dryomov
339bed1b3b mon/MonCommands: 'invalidate+forward' -> 'forward'
Commit 4e439857a6 introduced invalidate+forward cache mode, commit
81279e3bb6 renamed it to forward, but missed the CLI.  Fix it.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-01-22 00:27:09 +02:00
John Wilkins
ed2decb149 doc: Fixed end string from '' to `` to stop warnings. Enforced 80 char line.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-21 11:51:15 -08:00
Sage Weil
7a2d7f13ab Merge pull request #1120 from xylv/wip-op-process-latency-squashed
osd: Add op_process_latency in perf counter

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-20 21:34:09 -08:00
Ray Lv
78150bd9fe osd: Add op_process_latency in perf counter
Fixes: #7167

Signed-off-by: Ray Lv <xiangyulv@gmail.com>
2014-01-21 11:11:57 +08:00
Sage Weil
368f17362d Merge pull request #1117 from jcsp/wip-7187
Fix #7187: Include all summary items in JSON health output

Backport: emperor, dumpling
Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-20 12:07:09 -08:00
John Spray
fdf3b5520d Fix #7187: Include all summary items in JSON health output
Signed-off-by: John Spray <john.spray@inktank.com>
2014-01-20 11:10:29 +00:00
Sage Weil
63a77f4656 Merge pull request #1112 from kazhang/wip-7180
Fix #7180 in ceph_rest_api

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-19 12:00:07 -08:00
Kai Zhang
20cf41d6ce Missing a key for perm 'w' in permmap (src/pybin/ceph_rest_api.py:277)
It leads to a 500 error when getting mds help info via rest api.
Changed "w" to "rw" in MonCommands.h

Fixes: #7180
Signed-off-by: Kai Zhang <kazhang2@cisco.com>
2014-01-18 23:58:26 -08:00
Sage Weil
8ef7268a73 Merge pull request #1111 from ceph/wip-osdmap-7177
OSDMap: Populate primary_temp values a little more carefully

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-18 21:06:09 -08:00
Greg Farnum
7e7eda4764 OSDMap: Populate primary_temp values a little more carefully
In _get_temp_osds(), we populate temp_pg from the list in the OSDMap,
but we also skip anybody in the list who's down. We need to account
for those skips when setting the primary. It's easy enough to do -- just
look at the output pg_temp list instead of the OSDMap's starting one.

Fixes: #7177

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-17 21:04:30 -08:00
tamil
47bc71a7b4 fixed the syntax for test maxmds=2
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-17 15:56:36 -08:00
tamil
a13ebd370a fix for the test maxmds=2
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-17 15:41:48 -08:00
John Wilkins
ad203d5988 doc: Fixed ruleset typo.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-17 13:33:48 -08:00
Yehuda Sadeh
6a19daa2a5 Merge pull request #1106 from ceph/wip-rgw-contention
Wip rgw contention

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 13:17:48 -08:00
Yehuda Sadeh
6b7f27c015 librados: use rwlock for lookup pool, cache results
Use rwlock to read cahed results, only use regular lock if
results are not cached.
Invalidate cache on new osdmap.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 12:52:02 -08:00
Yehuda Sadeh
4b31456b81 rgw: add .h file to Makefile rule
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 12:34:29 -08:00
Sage Weil
7f61d2492f Merge pull request #1082 from dachary/wip-ceph-disk
ceph-disk: larger timeout in the test script

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 11:59:00 -08:00
Sage Weil
be5ac2b7c2 Merge pull request #1088 from christian-marie/wip-c-atomic-writes
librados: Add C API coverage for atomic write operations

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 11:47:26 -08:00
John Wilkins
d1de32cfb5 doc: Added default-placement to list of placement targets. Added SSL commentary.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-17 11:23:40 -08:00
John Wilkins
80212eaaf4 doc: Added additional comment about port number.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-17 11:22:39 -08:00