Commit Graph

46453 Commits

Author SHA1 Message Date
Josh Durgin
9e07b8afdf Merge pull request #6665 from trociny/wip-librbd-journal
rbd: journal: configuration via conf, cli, api and some fixes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-04 09:20:03 -08:00
Josh Durgin
a5d3370bbd Merge pull request #6800 from dillaman/wip-13969
librbd: fix known test case race condition failures

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-04 09:13:51 -08:00
Jason Dillaman
6cbf128b94 tests: wait for mocked requests to complete
Fixes: #13969
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-04 10:39:15 -05:00
Sage Weil
b91cd9d495 Merge pull request #6641 from aclamk/wip-log-alloc-predictor
common: log: predict log message buffer allocation size

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:37:48 -05:00
Sage Weil
89435f21b9 Merge pull request #6642 from 0003ydlom/decode_reorder
osd: move newest decode version of MOSDOp and MOSDOpReply to the front

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:34:44 -05:00
Jason Dillaman
fde9f785cd librbd: do not complete AIO callbacks within caller's thread context
Avoid rare, racy issues when individual requests associated with an AIO
completion can complete prior to marking the completion as ready-to-fire.
Pre-calculate the expected number of individual requests to avoid the
potential re-entrant callback.

Fixes: #13969
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-04 10:25:24 -05:00
Sage Weil
375137bf8b Merge pull request #6696 from Ved-vampir/wip_common_plugin
common: add generic plugin infrastructure

Reviewed-by: Varada Kari <varada.kari@sandisk.com>
2015-12-04 10:19:11 -05:00
Sage Weil
8d5e05a5cd Merge pull request #6779 from ceph/wip-librados-xattr
librados: avoid malloc(0) (which can return NULL on some platforms)

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:15:54 -05:00
Sage Weil
43268f20ba Merge pull request #6759 from liewegas/wip-bdev-probe
osd: make backend and block device code a bit more generic

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Varada Kari <varada.kari@sandisk.com>
2015-12-04 10:14:34 -05:00
Sage Weil
ff699d7dd0 Merge pull request #6686 from stiopaa1/namespace_buffer
common: use namespace instead of subclasses for buffer

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:13:47 -05:00
Sage Weil
7643ce9cfd Merge pull request #6535 from mslovy/wip-crc-cache-tracker
common: buffer: add cached_crc and cached_crc_adjust counts to perf dump

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:13:07 -05:00
Sage Weil
97e74a1d82 Merge pull request #6058 from guangyy/wip-pg-query
osd: dump number of missing objects for each peer with pg query

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-04 10:10:19 -05:00
Sage Weil
c3e3ee05d8 Merge pull request #5953 from guangyy/wip-13121
osd: support pool level recovery_priority and recovery_op_priority

Reviewed-by: David Zafman <dzafman@redhat.com>
2015-12-04 10:09:13 -05:00
Sage Weil
673d852115 Merge pull request #5670 from david-z/master
osd: FileJournal: reduce locking scope in write_aio_bl

Reviewed-by: Haomai Wang <haomai@xsky.com>
2015-12-04 10:00:54 -05:00
Jason Dillaman
1fffb25e29 Merge pull request #6798 from trociny/fix-rbd_mirror-bool
librbd: include missing header for bool type

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-12-04 08:40:26 -05:00
Mykola Golub
32597cab43 librbd: include missing header for bool type
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 15:10:51 +02:00
Mykola Golub
5622d3ff7d rbd: alow to specify options for created journal
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:18:30 +02:00
Mykola Golub
47f561082f librbd: journal options on image create/clone/copy
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:18:30 +02:00
Mykola Golub
89c716ffcd librbd: output operator for image options
It is going to be used for diagnostic.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:18:30 +02:00
Mykola Golub
e72fc02cbd librbd: journal: mark entry committed after replay
After replying a journal entry we have to call committed(). Otherwise,
the entries remain with flag committed=false in JournalMetadata
m_pending_commit_tids forever, which prevents commit position update.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:18:30 +02:00
Mykola Golub
e8a584ffc1 rbd: add new journal rbd commands
Also, extend 'rbd info' to output journal spec if journaling is enabled.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:18:30 +02:00
Mykola Golub
7311185ace librbd: humanize ImageWatcher and Journal states in debug log
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:15:02 +02:00
Mykola Golub
bb10815ff0 librbd: add image pool ID to journal object names.
The data objects are named "journal_data.<pool id>.<image id>.<num>".
This is to avoid conflict when a journal objects pool is used for
several image pools.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:15:02 +02:00
Mykola Golub
61ad15c732 librbd: allow alternate pool for journal objects
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:15:02 +02:00
Mykola Golub
ebadfefaea librbd: debug: log journal metadata
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:15:02 +02:00
Mykola Golub
7248fb5ab9 librbd: new config options to tweak journal settings
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-12-04 13:15:02 +02:00
Josh Durgin
77131e0b73 Merge pull request #6129 from dillaman/wip-13292
RBD pool mirroring configuration API + CLI

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-04 00:16:03 -08:00
Loic Dachary
15a81bb712 Merge pull request #6780 from smithfarm/wip-index-20151201
doc/dev/index.rst: fix headings

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-03 22:40:17 +01:00
Yehuda Sadeh
46493d4eba Merge pull request #6786 from oritwas/wip-cmake-fix-radosgw
cmake: add rgw_basic_types.cc to librgw.a

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-12-03 09:41:50 -08:00
Nathan Cutler
6807b35a21 doc/dev/index.rst: fix links
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-12-03 18:11:37 +01:00
Nathan Cutler
f3366401eb doc/dev/index.rst: Flesh out the IRC section
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-12-03 18:11:25 +01:00
Nathan Cutler
8d281bc5f0 doc/dev/index.rst: Make Issue tracker a separate chapter
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-12-03 18:11:09 +01:00
Josh Durgin
42c6ef446e Merge pull request #6789 from dillaman/wip-13969
librbd: partial revert of commit 9b0e359

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-03 06:55:51 -08:00
Loic Dachary
ed6792ba06 Merge pull request #6748 from liewegas/wip-fix-cephtool
qa/workunits/cephtool/test.sh: no ./

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-03 15:23:44 +01:00
Yan, Zheng
72691dd9a0 Merge pull request #5941 from jcsp/wip-12137
#12137: cephfs-data-scan scan_frags
2015-12-03 22:10:26 +08:00
Josh Durgin
157ef2e8a0 Merge pull request #6777 from dillaman/wip-librbd-lockdep
librbd: journaling-related lock dependency cleanup

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-03 05:38:50 -08:00
Josh Durgin
e2b7bc522a Merge pull request #6762 from dillaman/wip-13924
journal: fire replay complete event after reading last object

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-03 05:26:07 -08:00
Josh Durgin
111f6a6f5e Merge pull request #6703 from dillaman/wip-tests-librbd-gmock-state-machines
librbd: initial collection of state machine unit tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-03 05:23:10 -08:00
Jason Dillaman
91f01bdbd6 librbd: partial revert of commit 9b0e359
Fixes: #13969
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-03 07:55:16 -05:00
Nathan Cutler
6e7f9c8ed3 doc/dev/index.rst: start writing Bugfixing chapter
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-12-03 13:31:28 +01:00
Sage Weil
91e4a1c713 Merge pull request #6690 from branch-predictor/bp-smaller-pglog-2
osd: slightly reduce actual size of pg_log_entry_t

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-03 06:40:40 -05:00
Sage Weil
a93fdb6e6f Merge pull request #6689 from 0003ydlom/doubled_cond
osd: avoid duplicate op->mark_started in ReplicatedBackend

Reviewed-by: xinxin shu <xinxin.shu@intel.com>
2015-12-03 06:40:13 -05:00
Sage Weil
71e172fbc6 Merge pull request #6681 from ifed01/wip-objstore-bench-stabilization
ceph_objectstore_bench: fix race condition, bugs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-12-03 06:39:09 -05:00
Sage Weil
c80945fb60 Merge pull request #6677 from jack-changtao/test-bench
rados: bench: fix off-by-one to avoid writing past object_size

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-12-03 06:38:19 -05:00
Sage Weil
eb82a85236 Merge pull request #6555 from mslovy/wip-reduce-omap-transaction
osd: don't update epoch and rollback_info objects attrs if there is no need

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-03 06:37:11 -05:00
Orit Wasserman
b3281316a2 cmake: add rgw_basic_types.cc to librgw.a
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2015-12-03 11:58:28 +01:00
Nathan Cutler
002d26b097 doc/dev/index.rst: rewrite introductory material
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-12-03 09:53:35 +01:00
Yehuda Sadeh
39ba840fce Merge pull request #6784 from ceph/wip-5073
rgw multitenancy

Buckets and users can now have a tenant associated with them. Buckets can be specified as [<tenant>:]<bucket> and users can be specified as [<tenant>$]<uid>. The existing users and buckets are part of the default global tenant.
This is first phase. Future work will add tighter integration (e.g., swift tenant mapping, s3 subdomain tenant mapping, etc.)

Reviewed-by: Pete Zaitcev <zaitcev@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-12-02 21:52:00 -08:00
Guang Yang
ba346bf432 qa: add a test for the recovery_priority/recovery_op_priority pool settings.
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>
2015-12-03 02:16:52 +00:00
Guang Yang
f0cc7220d6 mon: support recovery_priority and recovery_op_priority with monitor commands
Fixes: 13121
Signed-off-by: Guang Yang yguang@yahoo-inc.com
2015-12-03 02:10:51 +00:00