Commit Graph

47130 Commits

Author SHA1 Message Date
Sage Weil
7cb901c2e8 os/bluestore/BlueFS: fix a few leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
64b80f320a ceph_test_objectstore: close cct on shutdown
This lets us do leak checking.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
3f8e2bd8f1 os/bluestore/BlueRocksEnv: fix several leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
3f4bd46735 os/bluestore/BlueFS: fix leak of iocs in writer
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
ef26205582 kv/RocksDBStore: fix leak of custom Env
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
acc8217aea os/bluestore/BlockDevice: fix FS leak
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
a3ef0ec6a2 vstart.sh: no need for 'quit' to ceph cli
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
fc9d95224a vstart.sh: k=2 for ec
It didn't like k=1 with the default profile.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
3fa09f02d7 os/bluestore: be tolerant of collection_list bounds
In particular, we may get a shard specified along with hobject_t min or
max (from PGBackend::objects_list_range()).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
88c3ee8129 CMakeLists: update for os/ reorg
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
491e2ce4c8 os/Makefile: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
645b535042 os/kstore: cache in-flight stripe updates in memory
The write process may do a read/modify/write on a stripe.  In order to
allow multiple writes to coexist within the same transaction, we need to
be able to "see" our writes.

Clear the "cached" stripe values when the last TransContext touching an
onode is finished.  In theory we could pin memory with a constant stream
of updates to an object; we may need to address that later.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
5c6269081e common/buffer: make hexdump look like 'hexdump -C ...'
...the better to diff them with.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
e4e1a7f41a os/kstore: debug nid
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
b57fcf6089 os/kstore: fix bugs in read stripe logic
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
5950eae87b ceph_test_objectstore: clean out test dir for each test
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
81243c0533 os/kstore: clear coll_map on umount
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
97373a7723 osd: do not catch mkfs exceptions
We either want to take a clean error path, or dump core.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
34a0f30bbd os/bluestore/StupidAllocator: be less stupid about alloc_unit
Make sure the extent we return is aligned to alloc_unit.  If the first
extent isn't suitable, try the next one.

Keep bin 0 for things that are smaller than min_alloc_size.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
602b8de834 unittest_bluestore_types: fix warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
893bfc7eda os/bluestore/bluestore_types: fix bluestore_extent_ref_map_t test inst
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
b16f591b1d os/Makefile: cosmetic
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
d2b5e926b8 os/fs: move btrfs_ioctl.h to os/fs
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
8fc65e1b40 os/ZFS: move to os/fs
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
98a0e107aa os/keyvaluestore: move KeyValueStore into os/keyvaluestore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
82cbc079d7 os/memstore: move MemStore into os/memstore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
ba2cc1eb6e os/filestore: move FileStore to os/filestore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
e07ab3e223 ceph:small_io_bench_dumb: drop unused include
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
6c1ef47574 ceph-objectstore-tool: drop unused FileSTore include
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
f941642ce6 remove ceph_streamtest
This is an ancient obsolete test that is never used.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
5b57b098e6 os/bluestore: allocate shouldn't fail if reserve succeeded
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
6641482ce8 os/bluestore/Allocator: add unreserve()
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
2b2cc88d33 os/bluestore/StupidAllocator: fix reservation release on allocate
Use up the amount we allocated, not the amount we asked for.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
193d25f786 os/bluestore/StupidAllocator: add reservation assertions
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00
Sage Weil
624e9968ff os/kstore: do not include header in omap iterator result
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
b25a2428a1 os/bluestore: do not include header in iterator result
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
0f85d86ca6 osd/ReplicatedPG: print omap_digest in debug log
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
0cde5890e5 ceph_test_objectstore: add omap iterator test
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
5f87bab2f9 ceph-objectstore-tool: add fsck command
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
da9266d0ef os/ObjectStore: add fsck to interface
Only bluestore and kstore implement this currently.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:28 -05:00
Sage Weil
789e99cf45 os/kstore: clear onode on _do_remove
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
9aca4ad9eb os/bluestore: clear onode in _do_remove
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
fd2659ddcb osd/PGBackend: fix omap digest error message
Print the *omap* digest, not *data* digest.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
56375c596b os: remove {get,set}_allow_sharded_objects from interface
We've already forced everyone to upgrade through hammer, so everyone
supports this.  Just unconditionally set the feature if it is not set
(for consistency's sake).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
93964a72f2 os/bluestore/BlueFS: do not flush metadata on flush()
That's what fsync is for.  Moreover, this can lead to some squirreliness
if we trigger this from _flush_log().

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
cff5dc5d12 os/bluestore/BlockDevice: helpful error when aio cannot init
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:27 -05:00
Sage Weil
d48a2ba9f7 os/bluestore/FreelistManager: audit
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:26 -05:00
Sage Weil
5662bd8b2e os/bluestore/BlueFS: implement invalidate_cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:26 -05:00
Sage Weil
225d3cdb27 os/bluestore/BlockDevice: add invalidate_cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:26 -05:00
Sage Weil
8e965db8e4 os/bluestore: simplify _do_remove
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:26 -05:00