Commit Graph

98272 Commits

Author SHA1 Message Date
Kefu Chai
7eb6c2d557
Merge pull request #28092 from tchaikov/wip-dashboard-package
mgr/dashboard: Update tar to v4.4.8

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-15 18:58:31 +08:00
Laura Paduano
278f5de412
Merge pull request #28043 from jan--f/update-grafana-dashboards
Update grafana dashboards

Reviewed-by: kmurarka@redhat.com
Reviewed-by: epuertat@redhat.com
2019-05-15 10:09:18 +02:00
Patrick Donnelly
8e7be2cc4a
Merge PR #27377 into master
* refs/pull/27377/head:
	qa: fs Ignore getfattr errors for ceph.dir.pin

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 13:14:21 -07:00
Patrick Donnelly
d01d7e80b9
Merge PR #27594 into master
* refs/pull/27594/head:
	mgr/volumes: allow creation/deletion of FS subvolume group snapshots
	mgr/volumes: allow creation/deletion of FS subvolume groups
	mgr/volumes: allow creation/deletion of snapshots of FS subvolumes
	mgr/volumes: allow fetching path of FS subvolumes
	mgr/volumes: use the fs_subvolume module
	mgr/volumes: add fs_subvolume module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 13:07:59 -07:00
Patrick Donnelly
cc18e6c0db
Merge PR #27483 into master
* refs/pull/27483/head:
	cephfs-shell: add quota management

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:52:54 -07:00
Patrick Donnelly
f9ada93bd5
Merge PR #27753 into master
* refs/pull/27753/head:
	cephfs-shell: Add stat command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:51:45 -07:00
Patrick Donnelly
d35396ca07
Merge PR #27872 into master
* refs/pull/27872/head:
	cephfs-shell: teuthology tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:50:28 -07:00
Ramana Raja
8b0c5267a0 mgr/volumes: allow creation/deletion of FS subvolume group snapshots
... using `ceph fs subvolumegroup snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
b2ff4d534a mgr/volumes: allow creation/deletion of FS subvolume groups
... using `ceph fs subvolumegroup create/rm` commands.
FS subvolume groups are parent directories of FS subvolumes. They
can be directly mapped to OpenStack Manila share groups.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a02b58e0a9 mgr/volumes: allow creation/deletion of snapshots of FS subvolumes
... using `ceph fs subvolume snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a47239b7f2 mgr/volumes: allow fetching path of FS subvolumes
... using `ceph fs subvolume getpath` command.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
9d273603b3 mgr/volumes: use the fs_subvolume module
... instead of src/pybind/ceph_volume_client.py to manage CephFS
subvolumes using `ceph fs subvolume` set of commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
f37cca105d mgr/volumes: add fs_subvolume module
fs_subvolume module provisions and manages CephFS subvolumes, which are
CephFS subdirectories with a desired layout and quota. Its code is
heavily borrowed from, src/pybind/ceph_volume_client.py

Fixes: http://tracker.ceph.com/issues/39610
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:40 +05:30
Jan Fajerski
e7a4437fdc monitoring: update Grafana dashboards
Fix various panels that used outdated metric names, cluncky or
unnecessary label_replace calls. Also unify the style of many panels.

Fixes: http://tracker.ceph.com/issues/39652

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-05-14 13:47:55 +02:00
Kefu Chai
203557035d mgr/dashboard: Update tar to v4.4.8
This update fixes an Arbitrary File Overwrite issue (CVE-2018-20834).
see https://nvd.nist.gov/vuln/detail/CVE-2018-20834

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 18:30:09 +08:00
Kefu Chai
6997586414
Merge pull request #28085 from rzarzynski/wip-crimson-no-atomics-in-refcntobj
crimson, common: RefCountedObj doesn't use atomics in Seastar builds.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-14 09:15:28 +08:00
Jason Dillaman
99826fbe75
Merge pull request #27999 from trociny/wip-rbd-sparse_copyup
librbd: clone copy-on-write operations should preserve sparseness

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:15:51 -04:00
Kefu Chai
5a79b4c822
Merge pull request #28071 from tchaikov/wip-crimson-perf-regres
crimson,osd: performance fixes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-14 00:00:00 +08:00
Radoslaw Zarzynski
8889b14792 crimson, common: RefCountedObj doesn't use atomics in SeaStar builds.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-13 17:57:12 +02:00
Casey Bodley
782be351c8
Merge pull request #27270 from theanalyst/beast-fe-ipv6
rgw: normalize v6 endpoint behaviour for the beast frontend

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 10:02:21 -04:00
Nathan Cutler
cfa2c5fb4d
Merge pull request #26281 from smithfarm/wip-git-describe-long
make-dist: set version number only once

Reviewed-by: Tim Serong <tserong@suse.com>
2019-05-13 15:10:20 +02:00
Casey Bodley
d39f6a5008
Merge pull request #28045 from cbodley/wip-39635
cls/user: cls_user_set_buckets_info overwrites creation_time

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:09:17 -04:00
Casey Bodley
f1f223d103
Merge pull request #27980 from cbodley/wip-24991
rgw: delete_obj_index() takes mtime for bilog

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-13 09:07:04 -04:00
Casey Bodley
cd236e7a42
Merge pull request #28031 from ivancich/wip-rgw-admin-unordered
rgw: allow radosgw-admin to list bucket w --allow-unordered

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:05:29 -04:00
Casey Bodley
b59fcb0c95
Merge pull request #27676 from mkogan1/wip-rgw-39380
rgw: fix default_placement containing "/" when storage_class is standard

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 08:53:58 -04:00
Casey Bodley
1ad2cb777d
Merge pull request #27984 from cbodley/wip-test-rgw-multisite-sh
test/rgw: fix test-rgw-multisite.sh script for creating multisite clusters

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2019-05-13 08:51:47 -04:00
Kefu Chai
e8da9e1e13
Merge pull request #27807 from cyb70289/utf8-encode
common: optimize encode_utf8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-13 20:42:24 +08:00
Mykola Golub
76e4f2ce24
Merge pull request #28051 from dillaman/wip-39521
librbd: fix issues with object-map/fast-diff feature interlock

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-13 15:25:09 +03:00
Mykola Golub
b2c799e7d0
Merge pull request #28063 from dillaman/wip-39656
qa/workunits/rbd: use https protocol for devstack git operations

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-13 15:24:39 +03:00
Kefu Chai
a09a4f342c cmake: define BOOST_SP_DISABLE_THREADS for crimson
because we are single-threaded

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-12 22:41:02 +08:00
Radoslaw Zarzynski
0291178ede osd/osd_internal_types: bring moving semantics to ObjectState.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-12 22:40:43 +08:00
Radoslaw Zarzynski
d2b49dae15 crimson/osd: simplify write handling in PG::do_osd_ops.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-12 22:40:35 +08:00
Mykola Golub
750e61ac91 librbd: clone copy-on-write operations should preserve sparseness
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-12 09:03:25 +01:00
J. Eric Ivancich
ce1df3ceef
Merge pull request #27870 from theanalyst/rgw-objexp-fixes-cli
rgw: object expirer fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-11 09:10:54 -04:00
Kefu Chai
93ba1a31df
Merge pull request #27926 from tchaikov/wip-38627
pybind/mgr: convert str to int using "int()"

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-05-11 09:37:39 +08:00
David Zafman
624d1172c3
Merge pull request #27914 from dzafman/wip-39304
osd: Include dups in copy_after() and copy_up_to()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-10 17:41:31 -07:00
David Zafman
09fb7a5a12
Merge pull request #27961 from dzafman/wip-39582
osd: Output Base64 encoding of CRC header if binary data present

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-10 15:46:16 -07:00
David Zafman
f526c6d55c osd: Fix merge_log_dups() not remove dup corresponding to log.tail
The log tail is not inclusive of the log, so not an overlap
Fix unittest_pglog to verify proper operation

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-10 15:31:51 -07:00
David Zafman
d0d244d222 test: unittest_pglog: Additional test cases for trim, copy_up_to and copy_after
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-10 15:31:51 -07:00
David Zafman
a008bd8c18 test: unittest_pglog: Remove irrelevant config values
osd_min_pg_log_entries and osd_max_pg_log_entries are not involved
in the log handling code being tested.

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-10 15:31:51 -07:00
David Zafman
7959159e83 test: Adding standalone test of log copy handling
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-10 15:31:51 -07:00
Sage Weil
62e241e4da Merge PR #27782 into master
* refs/pull/27782/head:
	os/bluestore: protect BlueFS::FileReader::buf
	os/bluestore: log 'buffered' in KernelDevice::read_random
	os/bluestore: support RocksDB prefetching at BlueFS
	os/bluestore: call BlueFS::_init_logger earlier.
	tools/ceph-objectstore-tool: dump perf counters on competion.
	os/bluestore: optimize mapping offset to extent in BlueFS.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-10 16:29:35 -05:00
Sage Weil
5229e1ec7f Merge PR #27928 into master
* refs/pull/27928/head:
	mon/OSDMonitor: require nautilus to set pg_autoscale_mode
	mon/OSDMonitor: allow pg_num to increase when require_osd_release < N

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-10 16:22:40 -05:00
Sage Weil
4982bd58fc Merge PR #27877 into master
* refs/pull/27877/head:
	mon: paxos: introduce new reset_pending_committing_finishers for safety

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-10 16:21:58 -05:00
Neha Ojha
de5c5d8468
Merge pull request #21722 from mslovy/wip-parial-recovery
osd: partial recovery strategy based on PGLog

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-10 11:48:23 -07:00
Alfredo Deza
d362301306
Merge pull request #28060 from ceph/wip-bz1666822
ceph-volume: use the Device.rotational property instead of sys_api

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-05-10 14:37:35 -04:00
Andrew Schoen
f1db0a8648 ceph-volume: skip missing interpreters when running tox tests
This will skip tests for versions of python that don't exist on the node
that's running the tests.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2019-05-10 11:04:35 -05:00
Andrew Schoen
8ebff475df ceph-volume: use the Device.rotational property instead of sys_api
Resolves: https://bugzilla.redhat.com/show_bug.cgi?id=1666822

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2019-05-10 10:41:49 -05:00
Jason Dillaman
fb4f9a8a08 qa/workunits/rbd: use https protocol for devstack git operations
Fixes: http://tracker.ceph.com/issues/39656
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-10 11:09:54 -04:00
Sage Weil
d2c591a142 mon/OSDMonitor: require nautilus to set pg_autoscale_mode
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-10 09:31:03 -05:00