RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-21 01:47:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
111,644 Commits 216 Branches 395 Tags 1.3 GiB
5446298339
Commit Graph

111644 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kiefer Chang
5446298339 mgr/cephadm: refactor templating in services 
Using Jinja2 to render configs for services:
- Grafana
- Alertmanager
- Prometheus
- NFS
- iSCSI

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2020-06-04 16:23:42 +08:00
Kiefer Chang
64bb27f2f6 mgr/cephadm: add template engine Jinja2 
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2020-06-04 16:23:39 +08:00
Mykola Golub
64aa6910df
Merge pull request #35301 from dillaman/wip-45715 
librbd: Watcher should not attempt to re-watch after detecting blacklisting

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2020-05-30 14:46:49 +03:00
Jason Dillaman
7236845b0e
Merge pull request #35138 from maydaycc/wip-45313 
librbd: support duration controllable continuous burst

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2020-05-29 16:32:05 -04:00
Jason Dillaman
be5309faf4
Merge pull request #35173 from trociny/wip-group-quiesce 
librbd: quiesce/unquiesce support for group_snap_create

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2020-05-29 15:46:34 -04:00
Wencong Wan
86b082bd94 librbd: support duration controllable continuous burst 
Modify the design of token bucket to save more tokens than burst value,
so as to support continuous burst. The desired burst duration can be
controlled by rbd_qos_XYZ_burst_seconds.

Fixes: https://tracker.ceph.com/issues/45313
Signed-off-by: wencong wan <wanwc@chinatelecom.cn>
 2020-05-29 15:44:33 -04:00
Jason Dillaman
1521908830
Merge pull request #35303 from hansbogert/patch-3 
doc: rbd-mirroring: Explain snapshot mirroring

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2020-05-29 09:25:37 -04:00
Sebastian Wagner
a66fb9231b
Merge pull request #35287 from gekios/wip-cephadm-bootstrapped-fix 
qa/tasks/cephadm: Add check for already set image

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2020-05-29 14:04:16 +02:00
Sebastian Wagner
3ef8f1d3df
Merge pull request #35006 from zdover23/wip-doc-45411-contain-latest-tag 
[doc/install]: Add note warning against the :latest tag.

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2020-05-29 13:43:48 +02:00
Zac Dover
f0fe087077 Add note warning against the :latest tag. 
Signed-off-by: Zac Dover <zac.dover@gmail.com>

Incorporating mgfritch's improvements.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

s/docker/podman/ -- as per mgfritch's suggestion

Signed-off-by: Zac Dover <zac.dover@gmail.com>

s/: latest/:latest/

Signed-off-by: Zac Dover <zac.dover@gmail.com>

s/image ids/image IDs/ -- as per Alex Settle's suggestion.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Add note warning against the :latest tag.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

s/image ids/image IDs/ -- as per Alex Settle's suggestion.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Linked to container page from cephadm install page.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Clarified the note directing readers to the container documentation.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
 2020-05-29 14:54:21 +10:00
Kefu Chai
33b4b62229
Merge pull request #35302 from neha-ojha/wip-45619 
qa/suites/rgw, qa/suites/rados: whitelist PG_AVAILABILITY

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-29 12:11:01 +08:00
Neha Ojha
dde9760b5c
Merge pull request #35304 from neha-ojha/wip-45760 
qa/standalone/scrub/osd-scrub-snaps.sh: fix grep pattern

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2020-05-28 20:58:15 -07:00
Kefu Chai
355ab7a850
Merge pull request #34622 from changchengx/libblkdrv 
os/bluestore: extract common backend driver library to access device

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Review-by: Kefu Chai <kchai@redhat.com>
 2020-05-29 10:20:41 +08:00
Neha Ojha
3a06af5af5 qa/standalone/scrub/osd-scrub-snaps.sh: fix grep pattern 
The error looks like this:

2020-05-28T20:56:30.214+0000 7f66cdecf700 -1 log_channel(cluster) log [ERR] : scrub 1.0 1:ab946124:::obj15:head : can't decode 'snapset' attr void SnapSet::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 97: Malformed input

Fixes: https://tracker.ceph.com/issues/45760
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 22:41:38 +00:00
Hans Bogert
6cb0fe6d61 doc: rbd-mirroring: Explain snapshot mirroring 
* Rectify that snapshot based mirroring is point-in-time consistent
* Reword slightly s.t. there is less repetition.

Based on the discussion in https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/G6ZW5OP4IXGUBAJTKZDPABK7HCKYISQH/

Signed-off-by: Hans van den Bogert <hansbogert@gmail.com>
 2020-05-29 00:11:54 +02:00
Neha Ojha
6d6c4eb016
Merge pull request #35280 from neha-ojha/wip-45660 
qa/standalone/scrub/osd-scrub-repair.sh: fix grep pattern to match decode exception

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2020-05-28 14:14:40 -07:00
Jason Dillaman
6be1d49c35 librbd: Watcher should not attempt to re-watch after detecting blacklisting 
Currently, the Watcher state machine will spin as fast as it can sending
re-watch requests to the OSD and then retrying after it fails with the
EBLACKLISTED error. Treat a blacklisting similarly to how removal of the
object is treated: stop attempting to re-watch.

Fixes: https://tracker.ceph.com/issues/45715
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2020-05-28 16:38:40 -04:00
Neha Ojha
b162541ac2 qa/suites/rgw/verify/tasks/cls.yaml: whitelist PG_AVAILABILITY 
The balancer was turned on by default in
d4fbaf7ea9, as a result of which we might see
PG_AVAILABILITY health warnings when pg-upmap-items are applied.

Fixes: https://tracker.ceph.com/issues/45619
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 19:30:46 +00:00
Neha Ojha
794f25affd qa/*/tasks/rados_cls_all.yaml: whitelist PG_AVAILABILITY 
The balancer was turned on by default in
d4fbaf7ea9, as a result of which we might see
PG_AVAILABILITY health warnings when pg-upmap-items are applied.

Fixes: https://tracker.ceph.com/issues/45619
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 19:21:37 +00:00
Georgios Kyratsas
fabcbeab2c qa/tasks/cephadm: Add check fox already set image 
Adding a check for already bootstrapped clusters where the image is
already set to avoid overriding it.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
 2020-05-28 17:15:59 +02:00
Kefu Chai
07f9d8b5b2
Merge pull request #35222 from smithfarm/wip-45606 
osd: make "missing incremental map" a debug log message

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-28 15:17:34 +08:00
Kefu Chai
698fe28e77
Merge pull request #35194 from bk201/wip-45625 
mgr/cephadm: config service_url in Dashboard for Prometheus and Alert…

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2020-05-28 15:12:21 +08:00
Kefu Chai
f94d9bccec
Merge pull request #33872 from majianpeng/osd-remove-duplicated-assert 
osd/OSD: remove useless ceph_assert.

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-28 15:06:37 +08:00
Kefu Chai
9cfa834216
Merge pull request #35221 from tchaikov/wip-22052 
qa/valgrind.supp: less specific when suppressing issues/22052

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 15:04:52 +08:00
Kefu Chai
8f740b2b28
Merge pull request #34835 from jschmid1/osdspec_affinity 
osd: add --osdspec-affinity flag

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2020-05-28 15:00:22 +08:00
Kefu Chai
f8bf4783b7
Merge pull request #35259 from tchaikov/wip-fmt-mingw 
fmt: pickup change for adding MinGW support

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 14:59:01 +08:00
Changcheng Liu
b734735a0d src: extract backend driver from bluestore to access device 
1. Both bluestore or other component e.g. rbd could use the same
   driver to access storage device. It's better to use one library
   to integrate the driver.
2. os and crimson-alienstore are static libraries. Link blk library into
   them.

Main changes are below:
1. move backend driver into src/blk
   src/$ mkdir -p blk/{aio,kernel,spdk,pmem,zns}
   src/$ mv os/bluestore/{BlockDevice.h,BlockDevice.cc} blk
   src/$ mv os/bluestore/{ceph_aio.h} aio/aio.h
   src/$ mv os/bluestore/{aio.cc} aio/
   src/$ mv os/bluestore/{KernelDevice.h,KernelDevice.cc} kernel/
   src/$ mv os/bluestore/{ceph_io_uring.h} kernel/io_uring.h
   src/$ mv os/bluestore/{io_uring.cc} kernel_drv/
   src/$ mv os/bluestore/{NVMEDevice.h,NVMEDevice.cc} spdk/
   src/$ mv os/bluestore/{PMEMDevice.h,PMEMDevice.cc} pmem/
   src/$ mv os/bluestore/{HMSMRDevice.h,HMSMRDevice.cc} zns/
2. customize macro name in header file to remove bluestore specific text
3. adjust header file patch in source code
4. create cmake rule blk/CMakeLists.txt to build blk
5. modify src/CMakeLists.txt to integrate blk
6. modify other CMakeLists.txt to adapt to new file structure.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
Co-authored-by: Kefu Chai <kefu@redhat.com>
 2020-05-28 10:20:55 +08:00
Kiefer Chang
c336d60393 mgr: include retval in MonCommandFailed exception 
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2020-05-28 09:27:50 +08:00
Kiefer Chang
a6135429b9 mgr/cephadm: config service_url in Dashboard for Prometheus and AlertManager 
Calling Dashboard's CLI to set service URLs after deploying Prometheus
and AlertManager Daemons.

Fixes: https://tracker.ceph.com/issues/45625
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2020-05-28 09:27:48 +08:00
Neha Ojha
f72b19d09c qa/standalone/scrub/osd-scrub-repair.sh: fix grep pattern to match decode exception 
We fail because the error message in the log looks like:

2020-05-27T21:02:48.447+0000 7fbfc4e60700 -1 log_channel(cluster) log [ERR] : scrub 3.0 3:5c7b2c47:::ROBJ16:head : can't decode 'snapset' attr void SnapSet::decode(ceph::buffer::v15_2_0::list::const_iterator&) no longer understand old encoding version 3 < 97: Malformed input

Fixes: https://tracker.ceph.com/issues/45660
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2020-05-28 00:38:17 +00:00
Patrick Donnelly
7afd5b3d2f
Merge PR #35197 into master 
* refs/pull/35197/head:
	os/Transaction: do not use anonymous aggregate with member having ctor
	include/interval_set: no need to check if an unsigned greater or equal to 0
	include/ceph_fs: do not use anonymous aggregate with member having ctor

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-05-27 10:08:12 -07:00
Sebastian Wagner
30961b9776
Merge pull request #35229 from ricardoasmarques/wip-45696 
cephadm: Validate bootstrap "--dashboard-{key|crt}" path

Reviewed-by: Daniel-Pivonka <dpivonka@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
 2020-05-27 18:14:01 +02:00
Sebastian Wagner
61847ab200
Merge pull request #35106 from p-se/wip-pse-cephadm-custom-monitoring-images 
mgr/cephadm: allow custom images for grafana, prometheus, alertmanager and node_exporter
 2020-05-27 18:12:05 +02:00
Sebastian Wagner
d45c6fab70
Merge pull request #35159 from batrick/i45632 
pybind/mgr/cephadm: remove mds auth cap for nfs recovery db cred
 2020-05-27 18:08:07 +02:00
Sebastian Wagner
2a01d3330f
Merge pull request #35266 from jschmid1/fix_previews_for_multimatch 
mgr/cephadm: fix host matching when multiple hosts match

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2020-05-27 18:06:08 +02:00
Sebastian Wagner
571b868f1f
Merge pull request #35195 from ricardoasmarques/allow-specify-ssh 
cephadm: Allow users to provide ssh keys during bootstrap

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
 2020-05-27 18:05:14 +02:00
Sebastian Wagner
ab953a4151
Merge pull request #35273 from sebastian-philipp/qa-cephadm-mirror-ubuntu 
qa/cephadm: Docker doesn't ship a registries.conf

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-27 18:01:17 +02:00
Patrick Donnelly
b63ae14927
Merge PR #35267 into master 
* refs/pull/35267/head:
	vstart_runner: set mounted to True at the end of mount()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
 2020-05-27 08:32:59 -07:00
Kefu Chai
9e9a9259ee
Merge pull request #34974 from dungdm93/patch-1 
pybind/ceph_volume_client: Fix PEP-8 SyntaxWarning

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-27 22:00:47 +08:00
Kefu Chai
b01b58c45f
Merge pull request #35012 from tchaikov/wip-45147 
qa/tasks/mgr: skip test_diskprediction_local on python>=3.8

Reviewed-by: Yuri Weinstein <yuriw@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2020-05-27 21:59:37 +08:00
Kefu Chai
1b72cb4b6a
Merge pull request #35033 from badone/wip-test-the-right-rocksdb-version 
qa/workunits/rados/test_envlibrados_rocksdb: Build correct rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-27 21:58:16 +08:00
Kefu Chai
1f037ac189
Merge pull request #35032 from badone/wip-update-rocksdb-to-v6.8.1 
rocksdb: Updated to v6.8.1

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
 2020-05-27 21:56:49 +08:00
Kefu Chai
857f55dee8
Merge pull request #35111 from agayev/hm-smr 
os/bluestore: Enable writing data to HM-SMR hard drives.

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2020-05-27 21:55:50 +08:00
Kefu Chai
3b333f010d
Merge pull request #35097 from matthewoliver/cephadm_iscsi_api_user_password 
cephadm: Make ceph-iscsi api user and password mandatory

Reviewed-by: Michael Fritch <mfritch@suse.com>
 2020-05-27 21:54:42 +08:00
Kefu Chai
a4107f2c25
Merge pull request #35079 from liewegas/wip-dedup-tool 
ceph-dedup-tool: add new FastCDC chunker, and make estimate test a range of chunk sizes

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
 2020-05-27 21:52:58 +08:00
Kefu Chai
8ffdde3188
Merge pull request #35198 from varshar16/wip-cephadm-module-error 
qa/tasks/mgr: Don't disable cephadm module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2020-05-27 21:49:27 +08:00
Yuval Lifshitz
248eeca109
Merge pull request #35128 from yuvalif/fix-amqp-urls-with-vhosts 
rgw/url: fix amqp urls with vhosts
 2020-05-27 16:09:30 +03:00
Sage Weil
c828e5d77c common/rabin: remove 
The implementation is buggy, and slower than FastCDC.

Signed-off-by: Sage Weil <sage@newdream.net>
 2020-05-27 07:48:18 -05:00
Sage Weil
a5bcaa46a3 ceph-dedup-tool: default to fastcdc 
Signed-off-by: Sage Weil <sage@newdream.net>
 2020-05-27 07:47:28 -05:00
Sage Weil
264cce3139 common/FastCDC: better behavior if TARGET_WINDOW_BITS==0 
Skip the middle scan call entirely in that case.

Signed-off-by: Sage Weil <sage@newdream.net>
 2020-05-27 07:47:28 -05:00