Commit Graph

110740 Commits

Author SHA1 Message Date
Shilpa Jagannath
0270dc4aaa qa/rgw: some basic reshard tests
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:09 +05:30
Shilpa Jagannath
40e232ad06 minor fix: pass bucket_info as const ref in bi_list()
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:09 +05:30
Shilpa Jagannath
48cae3f866 rgw: parameterized bucket_index_layout_generation in BucketShard::init()
for better flexibility.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:08 +05:30
Shilpa Jagannath
3f6e071f65 rgw: more multisite dynamic resharding pieces.
rados object names of bi shard to take a unique id called
generation number.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:08 +05:30
Kefu Chai
d8084806fb
Merge pull request #34752 from tchaikov/fix-test-perf-counters-mgr-get
mgr/dashboard: fix API tests to be py3 compatible

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-04-27 12:00:40 +08:00
Kefu Chai
d9ca5e5d7b
Merge pull request #34292 from cbodley/wip-bufferlist-comparison
bufferlist: use iterators for comparison operators

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:38:16 +08:00
Kefu Chai
f0a4fc14f0
Merge pull request #34090 from trociny/wip-ceph-erasure-code-tool
tools/erasure-code: new tool to encode/decode files

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:37:00 +08:00
Kefu Chai
fcf8bd7c4d
Merge pull request #34683 from ifed01/wip-ifed-fix-freelist-label
os/bluestore: fix freelist's meta usage when bdev label is unsupported

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-04-27 11:35:37 +08:00
Kefu Chai
a8733598ed
Merge pull request #34588 from ifed01/wip-ifed-lower-spinner-mas
os/bluestore:  set bluestore_min_alloc_size to 4K for spinners

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-04-27 11:34:14 +08:00
Kefu Chai
b76f4d0687
Merge pull request #34006 from aclamk/wip-rocksdb-sharding
kv/RocksDBStore,os/blustore: shard rocksdb database using column families

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-27 11:31:53 +08:00
Kefu Chai
6ad027c63e
Merge pull request #33790 from bstillwell/add_conf_option_zstd_compression_level
compressor: Add a config option to specify Zstd compression level

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:28:05 +08:00
Kefu Chai
8ae1c578b5
Merge pull request #34635 from tchaikov/wip-mgr-py3
mgr: drop python2 support

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-04-27 11:27:19 +08:00
Kefu Chai
28c7ba68ae
Merge pull request #34732 from lxbsz/fs_fix_new
qa: misc fixes to run for cephfs qa test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-26 01:46:30 +08:00
Kefu Chai
dea86fd3a0
Merge pull request #31912 from zjcmszh/cmpext
pybind/rados: add Ioctx::cmpext()

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-04-25 22:29:57 +08:00
zhangjiao
5838730828 test/pybind/test_rados.py: test Ioctx::cmpext()
Signed-off-by: Zhang Jiao <zhangjiao@cmss.chinamobile.com>
2020-04-25 18:53:50 +05:30
zhangjiao
1787a3bd6d pybind/rados: add Ioctx:cmpext()
Signed-off-by: Zhang Jiao <zhangjiao@cmss.chinamobile.com>
2020-04-25 18:52:52 +05:30
Kefu Chai
d07960ef7a
Merge pull request #34578 from lxbsz/volume_client_py3
qa/volume_client: be python3 compatible

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-25 18:58:43 +08:00
Xiubo Li
dd4fc808a8 qa/tasks/cephfs: switch to StringIO to fix byte-like errors
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-25 06:21:55 -04:00
Xiubo Li
8921c8e1dc qa/cephfs: switch to mount_wait() to avoid possible umounted assert
For the fuse mount, it sometime will need to wait to a moment to let
the client get ready.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-25 06:21:55 -04:00
Xiubo Li
211c3fbb4b qa/tasks/cephfs/fuse_mount: fix possible chmod 1777 error
INFO:teuthology.orchestra.run.smithi13a2:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2)
INFO:teuthology.orchestra.run.smithi132.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.2': Permission denied
DEBUG:teuthology.orchestra.run:got remote process result: 1

Here just wait and rety for 10 times.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-25 06:21:55 -04:00
Xiubo Li
bf10478294 qa/tasks/vstart_runner: remove the stdin str type check
For the "ceph-dencoder" it will use the byte type data.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-25 06:21:54 -04:00
Xiubo Li
7f57576123 qa/cephfs: fix AssertionError: CommandFailedError not raised under py3
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-25 06:21:54 -04:00
Mykola Golub
b0133c12ce
Merge pull request #34697 from dillaman/wip-44596
rbd-mirror: skip snapshot image-sync for newly created/cloned images

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-25 10:29:01 +03:00
Kefu Chai
16efdd62b5
Merge pull request #34751 from tchaikov/wip-doc-fix
doc/releases/mimic.rst: add title underline

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-04-25 10:58:40 +08:00
Kefu Chai
b152e498a0
Merge pull request #34741 from tchaikov/wip-teuthology-cronjobs-mimic
qa/tests: pass "-t 2" to teuthology-suite when testing mimic

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-25 10:23:08 +08:00
Alfonso Martínez
0ac296430f mgr/dashboard: fix API tests
* test_perf_counters_mgr_get
* test_selftest_cluster_log

Fixes: https://tracker.ceph.com/issues/45170
Fixes: https://tracker.ceph.com/issues/45246
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-04-25 09:50:19 +08:00
Kefu Chai
2de78c3bd9 qa/tasks/vstart_runner.py: use StringIO for capturing text
to be consistent with 8bfe977854

Fixes: https://tracker.ceph.com/issues/45246
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-25 09:50:14 +08:00
Kefu Chai
2994fba70b doc/releases/general.rst: add mising link targets
they are referenced by 60c8254869

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-25 09:38:33 +08:00
Kefu Chai
598b39e949 doc/releases: silence sphinx warnings
* mimic.rst: add title underline

to address sphinx warning like:
```
WARNING: Title underline too short.
```

* octopus.rst: use consistent underline

to address following sphinx warning:
```
doc/releases/octopus.rst:49: WARNING: Title level inconsistent:
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-25 09:33:43 +08:00
Sebastian Wagner
cc5b263941
Merge pull request #34698 from matthewoliver/cephadm_check_pool_exists
cephadm: Check for pool existence for iscsi And NFS

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-24 18:39:10 +02:00
Sebastian Wagner
bc164a07ee
Merge pull request #34676 from sebastian-philipp/cephadm-inventory-class
mgr/cephadm: add Inventory class
2020-04-24 18:26:55 +02:00
Sebastian Wagner
fb830a37af
Merge pull request #34695 from mgfritch/cephadm-iscsi-container-image
mgr/cephadm: allow config for an iscsi `container_image`

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-24 18:26:22 +02:00
Sebastian Wagner
5bb5a35581
Merge pull request #34718 from mgfritch/cephadm-mgr-is-available
cephadm: catch Exception during is_mgr_available

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-04-24 18:25:11 +02:00
Sebastian Wagner
d240d23b09
Merge pull request #34619 from sebastian-philipp/qa-adopt-specific-commit
qa/cephadm: make test_adoption checkout a specific commit
2020-04-24 18:01:18 +02:00
Sebastian Wagner
9dcab04380
Merge pull request #34693 from sebastian-philipp/cephadm-warn-master-improvement
cephadm: improve warn message

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-04-24 18:00:42 +02:00
Sebastian Wagner
affb6018b1
Merge pull request #34675 from sebastian-philipp/cephadm-service-rm-feedback
mgr/cephadm: remove_service: Feedback, if spec not found

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-04-24 18:00:18 +02:00
Kefu Chai
5c8e43c171 qa/tests: pass "-t 2" to teuthology-suite when testing mimic
it's an oversight in 21dacc823b

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-24 23:09:03 +08:00
Lenz Grimmer
88cb9f7adc
Merge pull request #34142 from rhcs-dashboard/wip-44667-fix-reload-issues
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-24 15:58:17 +02:00
Abhishek L
934d1010b8
Merge pull request #34730 from theanalyst/docs/release-updates-04-20
docs: release updates for nautilus,mimic,octopus 

Reviewed-By: Nathan Cutler <ncutler@suse.com>
2020-04-24 14:57:28 +02:00
Adam Kupczyk
aa1a116f9e os/bluestore: Enable sharding by default
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-24 14:36:05 +02:00
Sebastian Wagner
5bef4cbf34
Merge pull request #34673 from sebastian-philipp/cephadm-man
doc/man: add cephadm

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-04-24 14:06:57 +02:00
Kefu Chai
7b38f01438
Merge pull request #34725 from lxbsz/_type_equality_funcs
qa/tasks/cephfs/test_scrub: fix self.assertEqual no attribute '_type_equality_funcs'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-24 18:59:31 +08:00
Abhishek Lekshmanan
60c8254869 doc: update release.yml with octopus, nautilus & mimic
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-24 12:35:21 +02:00
Abhishek Lekshmanan
4238833653 doc: releases: add release notes for v14.2.9
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-24 12:34:59 +02:00
Kefu Chai
4e7bf15108
Merge pull request #34726 from lxbsz/dict_key_error
qa/tasks/cephfs/cephfs_test_case: switch 'dict_keys' object to list

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-24 18:33:33 +08:00
Abhishek Lekshmanan
a9d303118c doc: release notes for v13.2.10 mimic
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-24 12:28:44 +02:00
Abhishek Lekshmanan
d8d2d76c94 doc: releases: release notes for v13.2.9 mimic
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-24 12:28:22 +02:00
Abhishek Lekshmanan
3f4da44062 doc: releases: v15.2.1 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-24 12:20:32 +02:00
Xiubo Li
afe19f24ba qa/tasks/cephfs/test_volumes: to make sure the size is int type
Fix "Error EINVAL: invalid size option '4915200.0'".

In pytho2 int/2 will get a int type result, but in python3 it maybe
a float type.

Fixes: https://tracker.ceph.com/issues/45247
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-24 05:05:54 -04:00
Xiubo Li
65f97690af qa/tasks/cephfs/mount: to make sure that the count/seek are int type
To fix "stderr:dd: invalid number: '5.0'".

Fixes: https://tracker.ceph.com/issues/45247
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-24 05:05:54 -04:00