Commit Graph

98299 Commits

Author SHA1 Message Date
Ali Maredia
d25d6ee0af qa: remove mon valgrind check in rgw verfiy suite
memory leaks in the monitor are causing a significant
percentage of jobs run in the rgw verify suite to
fail even though the jobs succeeded before hand.

See: http://tracker.ceph.com/issues/38827 for
root cause

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-05-17 15:59:30 -04:00
Ricardo Marques
7d4a5fc429
Merge pull request #27653 from tspmelo/wip-nfs-pseudo
mgr/dashboard: Improve NFS Pseudo pattern message

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-05-17 15:15:10 +01:00
Nathan Cutler
f27af32e4a
Merge pull request #28023 from rjfd/wip-fix-ceph-mgr-systemd
systemd: ceph-mgr: set MemoryDenyWriteExecute to false

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-05-17 15:57:28 +02:00
Mykola Golub
7a8dda859b
Merge pull request #28044 from dillaman/wip-librbd-io-perf
librbd: tweaks to increase IOPS and reduce CPU usage

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-17 09:03:13 +03:00
Yuri Weinstein
31e8cd9aeb
Merge pull request #28067 from yuriw/wip-yuriw-crontab-master
qa/tests: added new client-upgrade-*-nautilus suites for jewel, luminous, mimic
2019-05-16 13:14:53 -07:00
Ricardo Marques
da7f380caf
Merge pull request #27681 from tspmelo/wip-charts
mgr/dashboard: Unify the look of dashboard charts

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-05-16 16:55:18 +01:00
Kefu Chai
0e5a237a84
Merge pull request #28113 from hjwsm1989/fix-krb-compile-error
auth/krb: fix Kerberos compile error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-16 23:32:32 +08:00
huangjun
4d5db77274 auth/krb: fix Kerberos compile error
Fixes: http://tracker.ceph.com/issues/39948

Signed-off-by: huangjun <huangjun@xsky.com>
2019-05-16 08:49:05 +08:00
Patrick Donnelly
2fc991b6b4
Merge PR #28080 into master
* refs/pull/28080/head:
	cephfs-shell: Remove whitespace after '('
	cephfs-shell: Remove unused 'flag' variable
	cephfs-shell: Fix flake8 invalid escape sequence warning
	cephfs-shell: Remove unnecessary empty lines
	cephfs-shell: Fix flake8 bare 'except' warnings

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-15 15:48:15 -07:00
Patrick Donnelly
bdff0ef48c
Merge PR #27822 into master
* refs/pull/27822/head:
	cephfs-shell: Fix mkdir relative path error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-15 15:46:39 -07:00
Yuri Weinstein
659f41e77b qa/tests: added new client-upgrade-*-nautilus suites for jewel, luminous, mimic
NOTE:

!!!! three suites below MUST use --suite-branch jewel, luminous, mimic (see https://tracker.ceph.com/issues/24021)
ref: https://github.com/ceph/ceph/pull/27983; https://github.com/ceph/ceph/pull/27934; https://github.com/ceph/ceph/pull/28027
--filter "ubuntu_16.04,centos_7.6,rhel_7.6" - test ONLY supported distro BEFORE mimic
--filter "ubuntu_16.04,ubuntu_18.04,centos_7.6,rhel_7.6" - test ONLY supported distro AFTER mimic

Merge after https://github.com/ceph/ceph/pull/28027

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-05-15 07:48:57 -07:00
Tiago Melo
bcbc0edba6 mgr/dashboard: Unify the look of dashboard charts
Fixes: http://tracker.ceph.com/issues/39384

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-05-15 12:01:52 +00:00
Kefu Chai
7eb6c2d557
Merge pull request #28092 from tchaikov/wip-dashboard-package
mgr/dashboard: Update tar to v4.4.8

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-15 18:58:31 +08:00
Laura Paduano
278f5de412
Merge pull request #28043 from jan--f/update-grafana-dashboards
Update grafana dashboards

Reviewed-by: kmurarka@redhat.com
Reviewed-by: epuertat@redhat.com
2019-05-15 10:09:18 +02:00
Patrick Donnelly
8e7be2cc4a
Merge PR #27377 into master
* refs/pull/27377/head:
	qa: fs Ignore getfattr errors for ceph.dir.pin

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 13:14:21 -07:00
Patrick Donnelly
d01d7e80b9
Merge PR #27594 into master
* refs/pull/27594/head:
	mgr/volumes: allow creation/deletion of FS subvolume group snapshots
	mgr/volumes: allow creation/deletion of FS subvolume groups
	mgr/volumes: allow creation/deletion of snapshots of FS subvolumes
	mgr/volumes: allow fetching path of FS subvolumes
	mgr/volumes: use the fs_subvolume module
	mgr/volumes: add fs_subvolume module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 13:07:59 -07:00
Patrick Donnelly
cc18e6c0db
Merge PR #27483 into master
* refs/pull/27483/head:
	cephfs-shell: add quota management

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:52:54 -07:00
Patrick Donnelly
f9ada93bd5
Merge PR #27753 into master
* refs/pull/27753/head:
	cephfs-shell: Add stat command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:51:45 -07:00
Patrick Donnelly
d35396ca07
Merge PR #27872 into master
* refs/pull/27872/head:
	cephfs-shell: teuthology tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:50:28 -07:00
Ramana Raja
8b0c5267a0 mgr/volumes: allow creation/deletion of FS subvolume group snapshots
... using `ceph fs subvolumegroup snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
b2ff4d534a mgr/volumes: allow creation/deletion of FS subvolume groups
... using `ceph fs subvolumegroup create/rm` commands.
FS subvolume groups are parent directories of FS subvolumes. They
can be directly mapped to OpenStack Manila share groups.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a02b58e0a9 mgr/volumes: allow creation/deletion of snapshots of FS subvolumes
... using `ceph fs subvolume snapshot create/rm` commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a47239b7f2 mgr/volumes: allow fetching path of FS subvolumes
... using `ceph fs subvolume getpath` command.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
9d273603b3 mgr/volumes: use the fs_subvolume module
... instead of src/pybind/ceph_volume_client.py to manage CephFS
subvolumes using `ceph fs subvolume` set of commands.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
f37cca105d mgr/volumes: add fs_subvolume module
fs_subvolume module provisions and manages CephFS subvolumes, which are
CephFS subdirectories with a desired layout and quota. Its code is
heavily borrowed from, src/pybind/ceph_volume_client.py

Fixes: http://tracker.ceph.com/issues/39610
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:40 +05:30
Jan Fajerski
e7a4437fdc monitoring: update Grafana dashboards
Fix various panels that used outdated metric names, cluncky or
unnecessary label_replace calls. Also unify the style of many panels.

Fixes: http://tracker.ceph.com/issues/39652

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-05-14 13:47:55 +02:00
Kefu Chai
203557035d mgr/dashboard: Update tar to v4.4.8
This update fixes an Arbitrary File Overwrite issue (CVE-2018-20834).
see https://nvd.nist.gov/vuln/detail/CVE-2018-20834

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 18:30:09 +08:00
Kefu Chai
6997586414
Merge pull request #28085 from rzarzynski/wip-crimson-no-atomics-in-refcntobj
crimson, common: RefCountedObj doesn't use atomics in Seastar builds.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-14 09:15:28 +08:00
Jason Dillaman
a786cfd0ab librbd: avoid bl manipulation on single object read/writes
If a read or write only spans a single object and buffer extent,
there isn't any need to build a new bufferlist from a full sub-bl.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
cac640c564 librbd: switch to lightweight striper for hot IO path
Optimize non-complex IO requests using the new lightweight object
striper that avoids heap allocations for small requests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
f5a93d6802 librbd: drop data oid parameter from IO path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
10bebfcac0 librbd: helper method to generate data object OIDs on-demand
The new generator avoids multiple string length and copy operations
that are currently required in the Striper.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:07:04 -04:00
Jason Dillaman
58bbb87c5c osdc/Striper: implemented a lightweight version of StripedReadResult
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:07:04 -04:00
Jason Dillaman
a3448eda33 osdc/Striper: implemented a lightweight version of file_to_extents
The previous versions of file_to_extents resulted in numerous heap
allocations for maps, vectors, and strings -- in addition to using
a CPU inefficient oid name formater.

librbd doesn't require the use of object_t and it would be better to
avoid any heap allocations on the IO path for the common case.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:38:13 -04:00
Jason Dillaman
cc7ec3e18d common/Finisher: avoid memory re-allocations for finisher queue
Since there is only a single thread associated with the Finisher,
swap between two queues to avoid the need to re-allocate a new
vector for each iteration through the loop. Also replace the
condition broadcast with a signal since there is only a single
thread to wake up.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:38:12 -04:00
Jason Dillaman
99826fbe75
Merge pull request #27999 from trociny/wip-rbd-sparse_copyup
librbd: clone copy-on-write operations should preserve sparseness

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:15:51 -04:00
Kefu Chai
5a79b4c822
Merge pull request #28071 from tchaikov/wip-crimson-perf-regres
crimson,osd: performance fixes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-14 00:00:00 +08:00
Radoslaw Zarzynski
8889b14792 crimson, common: RefCountedObj doesn't use atomics in SeaStar builds.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-13 17:57:12 +02:00
Tiago Melo
6f3f8f158e mgr/dashboard: Improve NFS Pseudo pattern message
Fixes: http://tracker.ceph.com/issues/39327

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-05-13 15:06:41 +00:00
Casey Bodley
782be351c8
Merge pull request #27270 from theanalyst/beast-fe-ipv6
rgw: normalize v6 endpoint behaviour for the beast frontend

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 10:02:21 -04:00
Nathan Cutler
cfa2c5fb4d
Merge pull request #26281 from smithfarm/wip-git-describe-long
make-dist: set version number only once

Reviewed-by: Tim Serong <tserong@suse.com>
2019-05-13 15:10:20 +02:00
Casey Bodley
d39f6a5008
Merge pull request #28045 from cbodley/wip-39635
cls/user: cls_user_set_buckets_info overwrites creation_time

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:09:17 -04:00
Casey Bodley
f1f223d103
Merge pull request #27980 from cbodley/wip-24991
rgw: delete_obj_index() takes mtime for bilog

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-13 09:07:04 -04:00
Casey Bodley
cd236e7a42
Merge pull request #28031 from ivancich/wip-rgw-admin-unordered
rgw: allow radosgw-admin to list bucket w --allow-unordered

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:05:29 -04:00
Casey Bodley
b59fcb0c95
Merge pull request #27676 from mkogan1/wip-rgw-39380
rgw: fix default_placement containing "/" when storage_class is standard

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 08:53:58 -04:00
Casey Bodley
1ad2cb777d
Merge pull request #27984 from cbodley/wip-test-rgw-multisite-sh
test/rgw: fix test-rgw-multisite.sh script for creating multisite clusters

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2019-05-13 08:51:47 -04:00
Kefu Chai
e8da9e1e13
Merge pull request #27807 from cyb70289/utf8-encode
common: optimize encode_utf8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-13 20:42:24 +08:00
Varsha Rao
2136530dab cephfs-shell: Remove whitespace after '('
This patch fixes flake8 whitespace error.

Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:04:09 +05:30
Varsha Rao
20c31ea239 cephfs-shell: Remove unused 'flag' variable
This patch fixes flake8 unused local variable error.

Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:04:02 +05:30
Varsha Rao
c7d217c2af cephfs-shell: Fix flake8 invalid escape sequence warning
Backslash-character pair is not a valid escape sequence, since Python 3.6
version. Prefixing character 'r' to the escape sequence, fixes the warning.

Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:03:56 +05:30