Commit Graph

47161 Commits

Author SHA1 Message Date
Sage Weil
2533f876b1 Merge pull request #7016 from xiexingguo/xxg-wip-14151
osd: fix sparse-read result code checking logic

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-01-03 13:20:01 -05:00
Sage Weil
ddfa31bc3c Merge pull request #7031 from wonzhq/log-monitor-2
mon: fix the can't change subscribe level bug in monitoring log

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-01-03 13:19:30 -05:00
Sage Weil
62c584fba2 Merge pull request #7009 from majianpeng/osd-scrub-sleep-cause-thread-suicide
osd: avoid osd_op_thread suicide because osd_scrub_sleep

Reviewed-by: Sage Weil <sage@redhat.com>
2016-01-03 13:19:10 -05:00
Sage Weil
d5ad57cd26 Merge pull request #7007 from tchaikov/wip-13990
osd: do not keep ref of old osdmap in pg

Reviewed-by: Sage Weil <sage@redhat.com>
2016-01-03 13:18:54 -05:00
Sage Weil
8cdde3d7d4 Merge pull request #6977 from stiopaa1/msg_override
msg: add override to virutal methods

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-01-03 13:18:39 -05:00
Sage Weil
1cdb2a64ea Merge pull request #6916 from xiexingguo/xxg-wip-14072
osd: fix null pointer access and race condition

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-01-03 13:17:51 -05:00
Sage Weil
9b6b5f6882 Merge pull request #7028 from yuyuyu101/wip-async-emplace
msg/async: don't use shared_ptr to manage EventCallback

Reviewed-by: Sage Weil <sage@redhat.com>
2016-01-03 13:16:01 -05:00
Sage Weil
fbd056bb0b Merge pull request #6896 from liewegas/wip-bluestore
bluestore: latest and greatest
2016-01-03 13:15:13 -05:00
Sage Weil
45024464fe qa/workunits/rados/test_rados_tool.sh: fix path
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-03 13:05:22 -05:00
Sage Weil
1097bd256e qa/workunits/rados/test_rados_tool: adapt to new buffer hexdump
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-02 21:14:35 -05:00
Ning Yao
bc1cf95fe7 uniform the type format
Signed-off-by: Ning Yao <zay11022@gmail.com>
2016-01-01 13:17:05 -05:00
YiQiang Chen
757152f94d os/bluestore/BlueStore: fix overlay keys
Signed-off-by: YiQiang Chen <cyqsign@163.com>
2016-01-01 13:09:17 -05:00
xie.xingguo
d6043d9a69 fs: fix unclosed formatter session
Fixes: #14210
Signed-off-by: xie.xingguo <xie.xingguo@zte.com.cn>
2016-01-01 13:09:17 -05:00
Sage Weil
37c6390a77 qa/workunits/cephtool/test.sh: leave sortbitwise set
New backends don't work if it's off.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:09:17 -05:00
Sage Weil
e7a84fecb9 os/bluestore/BlueFS: remove deleted file from dirty list
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:09:17 -05:00
Jianpeng Ma
20dc14bf58 os/bluestore: Don't forget close fd in _setup_block_symlink_or_file.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-01-01 13:09:17 -05:00
Sage Weil
56a964b7ed os/bluestore: write 'type' file
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:09:17 -05:00
Sage Weil
ee01a7a662 ceph-objectstore-tool: don't require journal path
Assume journal symlink is present.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:09:16 -05:00
Sage Weil
7dddecb845 ceph-objectstore-tool: get store type from 'type' file, if present
Just like ceph-osd.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:09:16 -05:00
Sage Weil
198b156ce6 os/bluestore/BlueFS: wait for flush aios to complete before returning
This makes all the IOs effectively synchronous (while holding the lock),
which isn't great, but at least it's correct.  We can contemplate async
later..

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
7172a7e297 os/bluestore/BlockDevice: clean up aio completion a bit
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
0336279639 os/bluestore/BlueFS: delay IOContext dtor until after io completes
It's possible for the IO to be in flight when the caller closes the
writer handle (although dangerous of them).  Queue the IOContext for
async cleanup when we sync everything to disk.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
7cb901c2e8 os/bluestore/BlueFS: fix a few leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
64b80f320a ceph_test_objectstore: close cct on shutdown
This lets us do leak checking.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:56 -05:00
Sage Weil
3f8e2bd8f1 os/bluestore/BlueRocksEnv: fix several leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
3f4bd46735 os/bluestore/BlueFS: fix leak of iocs in writer
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
ef26205582 kv/RocksDBStore: fix leak of custom Env
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
acc8217aea os/bluestore/BlockDevice: fix FS leak
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
a3ef0ec6a2 vstart.sh: no need for 'quit' to ceph cli
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
fc9d95224a vstart.sh: k=2 for ec
It didn't like k=1 with the default profile.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
3fa09f02d7 os/bluestore: be tolerant of collection_list bounds
In particular, we may get a shard specified along with hobject_t min or
max (from PGBackend::objects_list_range()).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:55 -05:00
Sage Weil
88c3ee8129 CMakeLists: update for os/ reorg
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
491e2ce4c8 os/Makefile: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
645b535042 os/kstore: cache in-flight stripe updates in memory
The write process may do a read/modify/write on a stripe.  In order to
allow multiple writes to coexist within the same transaction, we need to
be able to "see" our writes.

Clear the "cached" stripe values when the last TransContext touching an
onode is finished.  In theory we could pin memory with a constant stream
of updates to an object; we may need to address that later.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
5c6269081e common/buffer: make hexdump look like 'hexdump -C ...'
...the better to diff them with.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
e4e1a7f41a os/kstore: debug nid
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
b57fcf6089 os/kstore: fix bugs in read stripe logic
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
5950eae87b ceph_test_objectstore: clean out test dir for each test
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:54 -05:00
Sage Weil
81243c0533 os/kstore: clear coll_map on umount
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
97373a7723 osd: do not catch mkfs exceptions
We either want to take a clean error path, or dump core.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
34a0f30bbd os/bluestore/StupidAllocator: be less stupid about alloc_unit
Make sure the extent we return is aligned to alloc_unit.  If the first
extent isn't suitable, try the next one.

Keep bin 0 for things that are smaller than min_alloc_size.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
602b8de834 unittest_bluestore_types: fix warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
893bfc7eda os/bluestore/bluestore_types: fix bluestore_extent_ref_map_t test inst
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
b16f591b1d os/Makefile: cosmetic
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
d2b5e926b8 os/fs: move btrfs_ioctl.h to os/fs
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:53 -05:00
Sage Weil
8fc65e1b40 os/ZFS: move to os/fs
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
98a0e107aa os/keyvaluestore: move KeyValueStore into os/keyvaluestore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
82cbc079d7 os/memstore: move MemStore into os/memstore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
ba2cc1eb6e os/filestore: move FileStore to os/filestore/*
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:08:52 -05:00
Sage Weil
e07ab3e223 ceph:small_io_bench_dumb: drop unused include
Signed-off-by: Sage Weil <sage@redhat.com>
2016-01-01 13:07:29 -05:00