Commit Graph

79770 Commits

Author SHA1 Message Date
Yuri Weinstein
5f763bf137 Merge pull request #18396 from xiexingguo/wip-scrub-mismatch
osd/osd_types.cc: copy extents map too while making clone

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-20 14:47:14 -07:00
Sage Weil
b8ba9334d9 ceph_test_objectstore: disable filestore_fiemap for tests
This option was enabled in 87f33376d9 but
causes ObjectStore/StoreTest.Synthetic/1 (filestore) to fail.  Revert that
bit for now until we fix fiemap properly.

See http://tracker.ceph.com/issues/21880

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 16:32:59 -05:00
Yuri Weinstein
9b18093892 Merge pull request #16958 from mikulely/fix-full-uri
rgw: fix opslog uri as per Amazon s3

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-20 13:49:29 -07:00
Yuri Weinstein
7ccd491953 Merge pull request #17546 from mikulely/rgw-cleanup-min
rgw: cleanup MIN macro with std::min

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-10-20 13:47:34 -07:00
Yuri Weinstein
8f2f0f0fc0 Merge pull request #17934 from joke-lee/rgw_list_objecst_wrong_result_with_marker_when_enable_versioning
rgw:fix list objects with marker wrong result  when bucket is enable versioning

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-10-20 13:46:09 -07:00
Ali Maredia
2e477f3c05 Merge pull request #17673 from mogeb/blkin
blkin: link against lttng-ust-fork
2017-10-20 15:52:55 -04:00
Alfredo Deza
1b671a8602 ceph-volume util.system use strings for comparison in py3
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 15:18:20 -04:00
Alfredo Deza
3ddcd3c2f1 f ceph-volume tests update changes from the help menu in lvm
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 15:10:08 -04:00
Kefu Chai
9970342d58 Merge pull request #18414 from majianpeng/pmem-work
libmpem: Revert "submodule: make libmpem as a submodule."

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-21 02:58:01 +08:00
Sage Weil
b50ee3e795 osd: add numpg_removing metric
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 13:34:20 -05:00
Ashish Singh
2a5755e076 doc: Added CHAP cofiguration instructions for iSCSI
Added details to specify the CHAP username and password while
discovering/login the iSCSI target.

Signed-off-by: Ashish Singh <assingh@redhat.com>
2017-10-20 23:52:14 +05:30
Alfredo Deza
a8282e9a58 ceph-volume lvm.common --journal-size doesn't accept a volume group
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 14:12:02 -04:00
Alfredo Deza
3653f10592 ceph-volume lvm.prepare filestore does not require a volume group
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 14:04:31 -04:00
Alfredo Deza
526c0aa81a ceph-volume lvm.common volume groups are no longer required
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 14:04:05 -04:00
Alfredo Deza
8788fe3721 doc/ceph-volume activate workflow mention tmpfs in osd dirs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:11:40 -04:00
Alfredo Deza
288a312479 doc/ceph-volume update activation to include bluestore support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:11:40 -04:00
Alfredo Deza
61ce8b4b84 doc/ceph-volume update create to indicate bluestore support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:11:39 -04:00
Alfredo Deza
9f1a562739 doc/ceph-volume update prepare with bluestore workflow
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:08 -04:00
Alfredo Deza
c93603e576 doc/ceph-volume update filestore to indicate it is not the only/default objectstore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:08 -04:00
Alfredo Deza
1dc24d1a70 doc/ceph-volume elaborate on env vars for interval and tries in activation
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:08 -04:00
Alfredo Deza
c9693fb3f8 ceph-volume lvm.common update cli flags help for bluestore support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
e3b5663f79 ceph-volume util.disk st_mode is needed for stat()
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
cb3533a725 ceph-volume decorators always log to the file with exceptions
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
adabbd462b ceph-volume tests verify behavior of get_lv_from_argument
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
f209c9d4d5 ceph-volume api.lvm return result of get_lv when using arguments
If the argument is an absolute path it is fine to just return whatever
get_lv finds since it is a "safe" call, it will return a None if nothing
is found

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
6a5b89a475 ceph-volume lvm.listing support bluestore, not only filestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
8d257101b1 ceph-volume api.lvm allow full paths to detect lv from arguments
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
4674da9c07 ceph-volume tests add support for bluestore list verification
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:07 -04:00
Alfredo Deza
5b9f0853f7 ceph-volume tests activate with fsid works for bluestore and filestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:06 -04:00
Alfredo Deza
15586715f5 ceph-volume tests arg validator can accept absolute paths
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:06 -04:00
Alfredo Deza
39bdc2e3f6 ceph-volume tests update changes from the help menu in lvm
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:06 -04:00
Alfredo Deza
9be1012072 ceph-volume tests update to get_lv from get_journal_lv
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:06 -04:00
Alfredo Deza
d5984bad97 ceph-volume tests.util new path/device mount interface
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:10:06 -04:00
Alfredo Deza
e8a1863753 ceph-volume tests update api.lvm tests
The create_lv signature changed to require full size description and
tags need to be an actual dictionary (vs. keyword args)

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-20 12:09:43 -04:00
Casey Bodley
1a2db61de2 Merge pull request #18335 from linuxbox2/wip-rgw-readdir2
rgw_file: implement variant offset readdir processing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-20 11:55:17 -04:00
Jason Dillaman
a3a40413f7 common/common_init: disable ms subsystem log gathering for clients
The log gathering causes large performance degradation to clients
with high message throughputs. This is hopefully a short-term
workaround until per-message logging can be replaced with an
efficient data recording system for post-incident analysis
use-cases.

Fixes: http://tracker.ceph.com/issues/21860
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-20 11:15:07 -04:00
Sage Weil
4324c8bc7e os/bluestore/BlueFS: fix race with log flush during async log compaction
During async log compaction we rely on _flush-and_sync_log to update the
log_writer to jump_to.  However, if racing threads are also trying to flush
the log and manage to flush our new log events for us, then our flush will
turn into a no-op, and we won't update jump_to correctly at all.  This
results in a corrupted log size a bit later one.

Fix by ensuring that there are no in-progress flushes before we add our
log entries.  Also, add asserts to _flush_and_sync_log to make sure we
never bail out early if jump_to is set (which would indicate this or
another similar bug is still present).

Fixes: http://tracker.ceph.com/issues/21878
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 08:51:17 -05:00
Kefu Chai
38e789dc3b Merge pull request #18392 from tchaikov/wip-21842
os/bluestore: implement BlueRocksEnv::AreFilesSame()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-20 21:37:44 +08:00
Jason Dillaman
eca4fafbcf osdc/Objecter: delay initialization of hobject_t in _send_op
Fixes: http://tracker.ceph.com/issues/21845
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-20 09:32:14 -04:00
Enming Zhang
7b8502c9a2 rgw: copy object add response error message
Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
2017-10-20 20:20:24 +08:00
Sage Weil
9b92d87d37 buffer: remove list _mempool member
This broke the C++ ABI by changing the list structure size.  Also, it's
not necessary as we can infer the mempool by looking at the other list
contents.  We don't (currently) have a need to map an empty list to a
particular mempool and have that state stick.

Fixes: http://tracker.ceph.com/issues/21573
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-20 07:16:22 -05:00
John Spray
8c45855325 Merge pull request #18251 from jan--f/mgr-py-module-constants
pybind/mgr_module: move PRIO_* and PERFCOUNTER_* to MgrModule class

Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-20 12:58:22 +01:00
John Spray
bd8814bf58 Merge pull request #18021 from jcsp/wip-prometheus-disk-occupation
mgr/prometheus: add ceph_disk_occupation series

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2017-10-20 12:28:12 +01:00
Jianpeng Ma
73fb6eef73 Revert "submodule: make libmpem as a submodule."
This reverts commit 6a14159ee4.
Using ExternalProject_Add::GIT to download nvml source .

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-20 17:55:48 +08:00
Yan, Zheng
edd76fc883 mds: disable early reply for dir layout and quota related requests
These requests impacts whole subtree tree, replaying them when
mds recovers may break order of requests in multimds cluster.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-20 17:13:31 +08:00
Mykola Golub
8eeae328cb Merge pull request #18250 from dillaman/wip-21763
doc/rbd: tweaks for the LIO iSCSI gateway

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-20 11:55:44 +03:00
Kefu Chai
5d31a5aee4 os/bluestore: implement BlueRocksEnv::AreFilesSame()
it is used by the "repair" feature to dedup the files to be searched for
MANIFEST-* files. the default implementation is the POSIX one, which
tries to look at the local fs, but we should be looking for the files in
the bluefs. in this very use case, wal and db do not share the same device,
so we can just compare the paths. actually, it should aways return
"false". as the files being compared are always "db" and "db.wal".

Fixes: http://tracker.ceph.com/issues/21842
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-20 12:25:14 +08:00
Kefu Chai
d7244dc030 Merge pull request #18387 from tchaikov/wip-dmclock-client-info-ptr
osd,dmclock: use pointer to ClientInfo instead of a copy of it

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2017-10-20 11:47:59 +08:00
Kefu Chai
e956c9a195 Merge pull request #18350 from ovh/bp-ceph-conf-dump-all
tools/ceph-conf: dump parsed config in plain text or as json

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-20 11:46:26 +08:00
Kefu Chai
7425a8830c Merge pull request #18367 from zealoussnow/wip-10180
ceph-bluestore-tool: create out_dir before create full path  of kvdb

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-20 11:45:38 +08:00