Patrick Donnelly
d35396ca07
Merge PR #27872 into master
...
* refs/pull/27872/head:
cephfs-shell: teuthology tests
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-14 12:50:28 -07:00
Kefu Chai
f52d69ea92
install-deps.sh: use gcc-8 on xenial and trusty
...
to be consistent with #27183 and https://github.com/ceph/ceph-build/pull/1286
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 22:39:48 +08:00
Ramana Raja
8b0c5267a0
mgr/volumes: allow creation/deletion of FS subvolume group snapshots
...
... using `ceph fs subvolumegroup snapshot create/rm` commands.
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
b2ff4d534a
mgr/volumes: allow creation/deletion of FS subvolume groups
...
... using `ceph fs subvolumegroup create/rm` commands.
FS subvolume groups are parent directories of FS subvolumes. They
can be directly mapped to OpenStack Manila share groups.
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a02b58e0a9
mgr/volumes: allow creation/deletion of snapshots of FS subvolumes
...
... using `ceph fs subvolume snapshot create/rm` commands.
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
a47239b7f2
mgr/volumes: allow fetching path of FS subvolumes
...
... using `ceph fs subvolume getpath` command.
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
9d273603b3
mgr/volumes: use the fs_subvolume module
...
... instead of src/pybind/ceph_volume_client.py to manage CephFS
subvolumes using `ceph fs subvolume` set of commands.
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:42 +05:30
Ramana Raja
f37cca105d
mgr/volumes: add fs_subvolume module
...
fs_subvolume module provisions and manages CephFS subvolumes, which are
CephFS subdirectories with a desired layout and quota. Its code is
heavily borrowed from, src/pybind/ceph_volume_client.py
Fixes: http://tracker.ceph.com/issues/39610
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-05-14 19:40:40 +05:30
Nathan Cutler
f8aac6f69b
pybind/tox: handle possible WITH_PYTHON3 values other than "3"
...
WITH_PYTHON3 might be set to "ON" or to the python3 RPM version number
prevailing on the system - e.g. "3", "36"
Fixes: 9426f1f204
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-05-14 15:19:57 +02:00
Jan Fajerski
e7a4437fdc
monitoring: update Grafana dashboards
...
Fix various panels that used outdated metric names, cluncky or
unnecessary label_replace calls. Also unify the style of many panels.
Fixes: http://tracker.ceph.com/issues/39652
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-05-14 13:47:55 +02:00
Kefu Chai
203557035d
mgr/dashboard: Update tar to v4.4.8
...
This update fixes an Arbitrary File Overwrite issue (CVE-2018-20834).
see https://nvd.nist.gov/vuln/detail/CVE-2018-20834
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 18:30:09 +08:00
Wido den Hollander
0ec7bc491d
mgr/zabbix: Fix typo in key name for PGs in backfill_wait state
...
Fixes: http://tracker.ceph.com/issues/39666
Signed-off-by: Wido den Hollander <wido@42on.com>
2019-05-14 07:45:41 +02:00
Kefu Chai
6997586414
Merge pull request #28085 from rzarzynski/wip-crimson-no-atomics-in-refcntobj
...
crimson, common: RefCountedObj doesn't use atomics in Seastar builds.
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-14 09:15:28 +08:00
Jason Dillaman
a786cfd0ab
librbd: avoid bl manipulation on single object read/writes
...
If a read or write only spans a single object and buffer extent,
there isn't any need to build a new bufferlist from a full sub-bl.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
cac640c564
librbd: switch to lightweight striper for hot IO path
...
Optimize non-complex IO requests using the new lightweight object
striper that avoids heap allocations for small requests.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
f5a93d6802
librbd: drop data oid parameter from IO path
...
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:30:09 -04:00
Jason Dillaman
10bebfcac0
librbd: helper method to generate data object OIDs on-demand
...
The new generator avoids multiple string length and copy operations
that are currently required in the Striper.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:07:04 -04:00
Jason Dillaman
58bbb87c5c
osdc/Striper: implemented a lightweight version of StripedReadResult
...
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 13:07:04 -04:00
Jason Dillaman
a3448eda33
osdc/Striper: implemented a lightweight version of file_to_extents
...
The previous versions of file_to_extents resulted in numerous heap
allocations for maps, vectors, and strings -- in addition to using
a CPU inefficient oid name formater.
librbd doesn't require the use of object_t and it would be better to
avoid any heap allocations on the IO path for the common case.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:38:13 -04:00
Jason Dillaman
cc7ec3e18d
common/Finisher: avoid memory re-allocations for finisher queue
...
Since there is only a single thread associated with the Finisher,
swap between two queues to avoid the need to re-allocate a new
vector for each iteration through the loop. Also replace the
condition broadcast with a signal since there is only a single
thread to wake up.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:38:12 -04:00
Jason Dillaman
99826fbe75
Merge pull request #27999 from trociny/wip-rbd-sparse_copyup
...
librbd: clone copy-on-write operations should preserve sparseness
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-13 12:15:51 -04:00
Kefu Chai
9813f7d623
crimson/osd: add crimson_debug_pg_always_active option
...
before crimson is able to peer, we should leave this option ON.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 00:02:19 +08:00
Kefu Chai
ee796ade48
crimson/osd: add preliminary delete support
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 00:02:19 +08:00
Kefu Chai
bd8f87665c
crimson/osd: add pgnls support
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-14 00:02:19 +08:00
Kefu Chai
5a79b4c822
Merge pull request #28071 from tchaikov/wip-crimson-perf-regres
...
crimson,osd: performance fixes
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-14 00:00:00 +08:00
Radoslaw Zarzynski
8889b14792
crimson, common: RefCountedObj doesn't use atomics in SeaStar builds.
...
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-13 17:57:12 +02:00
Tiago Melo
6f3f8f158e
mgr/dashboard: Improve NFS Pseudo pattern message
...
Fixes: http://tracker.ceph.com/issues/39327
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-05-13 15:06:41 +00:00
Tiago Melo
a055f96325
mgr/dashboard: Add multi root support in CRUSH map
...
Fixes: http://tracker.ceph.com/issues/39647
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-05-13 14:56:46 +00:00
Casey Bodley
782be351c8
Merge pull request #27270 from theanalyst/beast-fe-ipv6
...
rgw: normalize v6 endpoint behaviour for the beast frontend
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 10:02:21 -04:00
Nathan Cutler
cfa2c5fb4d
Merge pull request #26281 from smithfarm/wip-git-describe-long
...
make-dist: set version number only once
Reviewed-by: Tim Serong <tserong@suse.com>
2019-05-13 15:10:20 +02:00
Casey Bodley
d39f6a5008
Merge pull request #28045 from cbodley/wip-39635
...
cls/user: cls_user_set_buckets_info overwrites creation_time
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:09:17 -04:00
Casey Bodley
f1f223d103
Merge pull request #27980 from cbodley/wip-24991
...
rgw: delete_obj_index() takes mtime for bilog
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-13 09:07:04 -04:00
Casey Bodley
cd236e7a42
Merge pull request #28031 from ivancich/wip-rgw-admin-unordered
...
rgw: allow radosgw-admin to list bucket w --allow-unordered
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-13 09:05:29 -04:00
Casey Bodley
b59fcb0c95
Merge pull request #27676 from mkogan1/wip-rgw-39380
...
rgw: fix default_placement containing "/" when storage_class is standard
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-13 08:53:58 -04:00
Casey Bodley
1ad2cb777d
Merge pull request #27984 from cbodley/wip-test-rgw-multisite-sh
...
test/rgw: fix test-rgw-multisite.sh script for creating multisite clusters
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2019-05-13 08:51:47 -04:00
Kefu Chai
e8da9e1e13
Merge pull request #27807 from cyb70289/utf8-encode
...
common: optimize encode_utf8
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-13 20:42:24 +08:00
Varsha Rao
2136530dab
cephfs-shell: Remove whitespace after '('
...
This patch fixes flake8 whitespace error.
Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:04:09 +05:30
Varsha Rao
20c31ea239
cephfs-shell: Remove unused 'flag' variable
...
This patch fixes flake8 unused local variable error.
Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:04:02 +05:30
Varsha Rao
c7d217c2af
cephfs-shell: Fix flake8 invalid escape sequence warning
...
Backslash-character pair is not a valid escape sequence, since Python 3.6
version. Prefixing character 'r' to the escape sequence, fixes the warning.
Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:03:56 +05:30
Varsha Rao
f322affda0
cephfs-shell: Remove unnecessary empty lines
...
This patch fixes flake8 too many blank lines error.
Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:03:48 +05:30
Varsha Rao
e6b6cf4ba5
cephfs-shell: Fix flake8 bare 'except' warnings
...
Instead of bare 'except', catch just libcephfs exceptions.
Fixes: https://tracker.ceph.com/issues/39717
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-13 18:03:24 +05:30
Mykola Golub
76e4f2ce24
Merge pull request #28051 from dillaman/wip-39521
...
librbd: fix issues with object-map/fast-diff feature interlock
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-13 15:25:09 +03:00
Mykola Golub
b2c799e7d0
Merge pull request #28063 from dillaman/wip-39656
...
qa/workunits/rbd: use https protocol for devstack git operations
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-13 15:24:39 +03:00
Sebastian Wagner
bc340c402a
scripts/kubejacker: Fix mgr_plugins target for centos
...
Also use the latest master as default FROM
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-05-13 12:26:14 +02:00
Kefu Chai
a09a4f342c
cmake: define BOOST_SP_DISABLE_THREADS for crimson
...
because we are single-threaded
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-12 22:41:02 +08:00
Radoslaw Zarzynski
0291178ede
osd/osd_internal_types: bring moving semantics to ObjectState.
...
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-12 22:40:43 +08:00
Radoslaw Zarzynski
d2b49dae15
crimson/osd: simplify write handling in PG::do_osd_ops.
...
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-12 22:40:35 +08:00
Mykola Golub
750e61ac91
librbd: clone copy-on-write operations should preserve sparseness
...
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-12 09:03:25 +01:00
J. Eric Ivancich
ce1df3ceef
Merge pull request #27870 from theanalyst/rgw-objexp-fixes-cli
...
rgw: object expirer fixes
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-11 09:10:54 -04:00
Kefu Chai
93ba1a31df
Merge pull request #27926 from tchaikov/wip-38627
...
pybind/mgr: convert str to int using "int()"
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-05-11 09:37:39 +08:00