Commit Graph

110503 Commits

Author SHA1 Message Date
Kefu Chai
c6e48ef0f0 doc/dev/developer_guide: use python3 to launch vstart_runner.py
as vstart_runner.py is compatible with python3, and so is the tests
under `qa/` directory.

and use `pip` to install teuthology, simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 18:31:37 +08:00
Mykola Golub
5e540f1191
Merge pull request #34615 from dillaman/wip-45072
rbd-mirror: image replayer stop might race with instance replayer shut down

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-19 10:57:49 +03:00
Kefu Chai
c4a0acd91d
Merge pull request #34576 from jdurgin/wip-object-corpus
ceph-object-corpus: update to octopus

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-18 11:59:55 +08:00
Kefu Chai
b557467df0
Merge pull request #34535 from changchengx/refine_build_liburing
cmake: refactor liburing support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-18 11:39:32 +08:00
Sebastian Wagner
138018eddc
Merge pull request #34584 from bk201/wip-45108
mgr/test_orchestrator: fix error when listing services

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-17 18:55:21 +02:00
Sebastian Wagner
fe91dfad74
Merge pull request #32951 from matthewoliver/cephadm_rgw_ssl
cephadm: add RGW SSL support

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-17 18:54:50 +02:00
Gregory Farnum
c17f4d9262
Merge pull request #34410 from lxbsz/mds_dirty_parent
tools/cephfs: add accounted_rstat/rstat when building file dentry

Reviewed-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-17 08:27:40 -07:00
Gregory Farnum
62dadb2a33
Merge pull request #33928 from mchangir/cephfs-journal-tool-cannot-set-dry_run-arg
cephfs-journal-tool: correctly parse --dry_run argument

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-17 08:26:52 -07:00
Changcheng Liu
36918d7f78 cmake: use cmake module to integrate liburing
1. WITH_LIBURING is used to set HAVE_LIBURING to decide
   use liburing in KernelDevice or not.
2. WITH_SYSTEM_LIBURING is to choose use system installed
   liburing or build the liburing from source code.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-04-17 23:22:56 +08:00
Gregory Farnum
2e84275947
Merge pull request #32612 from rishabh-d-dave/fs-qa-UnicodeDecodeError
test_cephfs_shell: fix UnicodeDecodeError

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-17 08:21:42 -07:00
Gregory Farnum
9231c73b2b
Merge pull request #33169 from moningchao/master
client: fix blacklist removal failed

Reviewed-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-17 08:20:42 -07:00
Gregory Farnum
b274265acd
Merge pull request #33711 from lxbsz/qa_umount_failed
qa/tasks/cephfs: umount the mountpoints when tearDown

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-04-17 08:20:30 -07:00
Gregory Farnum
4e6fd23bc7
Merge pull request #34533 from fanjunwei/fix_fuse_bug
client: fix ceph-fuse parse command line failed

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-17 08:18:52 -07:00
Jason Dillaman
31140a940e rbd-mirror: track in-flight start/stop/restart in instance replayer
The shut down waits for in-flight ops to complete but the
start/stop/restart operations were previously not tracked. This
could cause a potential race and crash between an image replayer
operation and the instance replayer shutting down.

Fixes: https://tracker.ceph.com/issues/45072
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-17 11:17:05 -04:00
Yuri Weinstein
44bfcfd188
Merge pull request #34601 from yuriw/wip-yuriw-crontab-master
qa/tests: added octopus-p2p upgrade tests to the mix
2020-04-17 07:47:06 -07:00
Jason Dillaman
64f8d9c30c rbd-mirror: switch to common C_TrackedOp context class
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-17 10:20:44 -04:00
Jason Dillaman
4bd9d1501f common: add helper C_TrackerOp context class
This wraps the functionality of starting and finishing a tracked op
into the standard context interface.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-17 10:02:10 -04:00
Kefu Chai
2ebb6fa236
Merge pull request #34604 from tchaikov/wip-cmake-fuse
cmake: check for FUSE version and cleanups

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-04-17 21:31:44 +08:00
Kefu Chai
c9b38a5210 cmake: detect fuse3 as well
Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-17 14:31:17 +08:00
Kefu Chai
220fa91d80 cmake: check for FUSE version
and refactor FindFUSE.cmake a little bit to conditionalize OSX support

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-17 14:10:55 +08:00
Kefu Chai
b823952d24 cmake: link against FUSE::FUSE
instead of specifying the include directory and linkage separately

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-17 14:10:55 +08:00
Kefu Chai
2b3adb5c5e cmake: rename Findfuse.cmake to FindFUSE.cmake
so its name is consistent with upstream name, and with the variables
exposed by FindFUSE.cmake.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-17 14:10:55 +08:00
Yuri Weinstein
a20f41f225 qa/tests: added octopus-p2p upgrade tests to the mix
Signed-off-by: Yuri Weinstein <yweinste@gmail.com>
2020-04-16 14:18:43 -07:00
Mykola Golub
0f2305d127
Merge pull request #34573 from dillaman/wip-44938-2
test: tx-only peer from heartbeat can race w/ CLI

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-16 18:50:47 +03:00
Sebastian Wagner
c5f0a2e718
Merge pull request #34346 from jschmid1/osd_id_claims
mgr/cephadm: add support for osd_id_claims

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-16 16:37:34 +02:00
Kefu Chai
9959612854
Merge pull request #34517 from tchaikov/wip-qa-dashboard-telemetry
qa/tasks/mgr/dashboard: set last_opt_revision when setting enabled

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-04-16 22:12:56 +08:00
Venky Shankar
2132cf6ee0
Merge pull request #34210 from kotreshhr/cephfs-subvolume-info
mgr/volumes: Add interface to get subvolume metadata
2020-04-16 18:38:08 +05:30
Kiefer Chang
223c8d816f
mgr/test_orchestrator: fix error when listing services
- Adapting attribute change of ServiceSpec.
- Update dummy data.

Fixes: https://tracker.ceph.com/issues/45108
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-04-16 17:55:40 +08:00
Kefu Chai
08bec918f7 qa/tasks/mgr/dashboard: set last_opt_revision when setting enabled
telemetry requires user to re opt-in when opt_revision is bumped up

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-16 16:14:47 +08:00
Kiefer Chang
45fd5ee275
mgr/orch: Fixes some deserialization errors
Fixes errors when calling `from_json` of these classes:
- InventoryHost: parsing labels
- ServiceDescription: `last_refresh` and `created` fields should be parsed
  to datetime type.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-04-16 15:30:24 +08:00
Josh Durgin
fb3c6bd0cd doc: add object corpus to release checklist
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-04-16 00:53:17 -04:00
Josh Durgin
09d928ff90 ceph-object-corpus: pick up octopus 15.2.1-40-ga838bb1aae
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-04-16 00:53:14 -04:00
Kefu Chai
d65516a020
Merge pull request #34577 from tchaikov/wip-doc-dev-corpus
doc/dev/corpus.rst: tweak formatting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-16 12:37:25 +08:00
Kefu Chai
a1f42101cf doc/dev/corpus.rst: tweak formatting
* use `shell` lexer, otherwise the Python one is used, and the rendered
  result does not look right
* be consistent when indenting -- either use tab or spaces, otherwise
  the indent in code block would be wrong.
* double quote the variables in text

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-16 11:12:25 +08:00
Matthew Oliver
8204b1d524 cephadm: add RGW SSL support
This patch adds SSL support to RGW when using cephadm.
If an SSL certificate is provided, inside the json supplied with:

  cpeh orchestrator rgw create -i rgw.json

Then the SSL cert and/or key will be added to pushed into the mon config-key database
using the key `rgw/cert/<rgw_realm>/<rgw_zone>.[crt|key]`.
Which will then be referenced in the config:

  rgw_frontends = beast port=80 ssl_port=443 ssl_certificate=config://rgw/cert/<rgw_realm>/<rgw_zone>.crt

And if an ssl key is also supplied this becomes something like:

  rgw_frontends = beast port=80 ssl_port=443 ssl_certificate=config://rgw/cert/<rgw_realm>/<rgw_zone>.crt ssl_key=config://rgw/cert/<rgw_realm>/<rgw_zone>.key

Of course you could also just upload the cert and key yourself to
config-key location, and ssl will be enabled as well. But this patch
let's you either supply them via `-i` or as a manual upload step.

Co-Authored-By: Michael Fritch <mfritch@suse.com>
Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
Signed-off-by: Matthew Oliver <moliver@suse.com>
2020-04-16 02:31:02 +00:00
Josh Durgin
06e862bc68 include/denc: replace bufferlist::copy with iterator version
This version was only compiled as part of ceph-object-corpus
generation, when ENCODE_DUMP_PATH is defined, so it was missed
when bufferlist::copy() was removed.

Fixes: https://tracker.ceph.com/issues/45023
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-04-15 21:26:52 -04:00
Neha Ojha
61ad12e6ad
Merge pull request #34541 from neha-ojha/wip-balancer-on
mgr: turn on balancer in upmap mode by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-15 15:03:28 -07:00
Jason Dillaman
fb4311f597 qa/workunits/rbd: retry the addition of a mirror pool peer
We might race with the remote rbd-mirror daemon creating a
tx-only peer when adding a new peer. Therefore, delete the
tx-only peer and attempt to re-create it.

Fixes: https://tracker.ceph.com/issues/44938
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-15 16:27:07 -04:00
Jason Dillaman
ef68f686be librbd: mirror peer add error message should include site name
It previously included the pointer to string holding the generated
uuid (neither of which would mean much to an end user).

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-15 16:26:09 -04:00
Jason Dillaman
74cded6b0d rbd: improved error message when adding a duplicate mirror pool peer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-15 16:25:48 -04:00
Lenz Grimmer
1576cc309c
Merge pull request #32747 from Exotelis/wip-40702-collapse
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-04-15 17:33:50 +02:00
Casey Bodley
b62e0c262b
Merge pull request #34094 from cbodley/wip-rgw-data-sync-cache
rgw multisite: data sync optimizations

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2020-04-15 11:00:29 -04:00
Joshua Schmid
e670b1ea83 mgr/cephadm: add replacement flag to _create_osd
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-04-15 15:56:45 +02:00
Mykola Golub
256ac4b46d
Merge pull request #34549 from dillaman/wip-qa-rbd-read-balance
qa/suites/rbd: tweak 'require_osd_release' to 'pacific'

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-15 16:08:08 +03:00
Mykola Golub
34986728bd
Merge pull request #34496 from dillaman/wip-44105
rbd-mirror: clean-up unnecessary non-primary snapshots

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-15 15:30:48 +03:00
Sebastian Krah
d2d0efdc05
mgr/dashboard: Add expand/collapse datatable feature
Adds expand/collapse feature to every datatable with details.

Fixes: https://tracker.ceph.com/issues/40702
Signed-off-by: Sebastian Krah <skrah@suse.com>
2020-04-15 14:02:27 +02:00
Joshua Schmid
fa88483f66 mgr/cephadm: use --osd-ids instead of --osd-id
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-04-15 13:12:03 +02:00
Joshua Schmid
5b32c3e51b mgr/cephadm: add support for osd_id_claims
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-04-15 13:12:02 +02:00
Sebastian Wagner
a07f2d6ebe
Merge pull request #34529 from maran/master
cephadm: warn when no valid version arguments are supplied to add-repo

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-15 12:56:03 +02:00
Sebastian Wagner
91d0b5a318
Merge pull request #34490 from sebastian-philipp/cephadm-command_add_repo-no-podman
cephadm: add-repo: Don't test for podman

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-04-15 12:54:41 +02:00