Commit Graph

115467 Commits

Author SHA1 Message Date
Casey Bodley
b15dadac70
Merge pull request #36997 from linuxbox2/wip-rgwlc-mtime
rgwlc:  fix (post-parallel) non-current expiration

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-09-14 10:19:25 -04:00
Casey Bodley
461f4a5f78
Merge pull request #37125 from tchaikov/wip-rgw-const-char
rgw: convert string constant to string_view

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-09-14 10:15:31 -04:00
Sebastian Wagner
0bcd29a247 mgr/cephadm: fix RemoveUtil.load_from_store()
* Run `json.loads` only once
* `nodename` -> `hostname`
* Remove network calls from `repr(OSD(...)`

Fixes: https://tracker.ceph.com/issues/47438

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 15:25:14 +02:00
Jason Dillaman
2fa9442dcc qa/workunits/mon: fixed excessively large pool PG count
Fixes: https://tracker.ceph.com/issues/47405
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-09-14 08:58:52 -04:00
Sebastian Wagner
245cf50132 mgr/cephadm: CephadmService.create -> CephadmService.prepare_create
Refactored this to simplify the control flow. It became obvious that

* `CephadmService.make_daemon_spec`
* `CephadmService.prepare_create`
* `CephadmService.generate_config`

are basically the same thing. They're all called directly
before the deployment of a daemon. All of them should be
unified. This PR makes this refactorization simpler

By renaming `create` to `prepare_create`, we make `create`
no longer being the entrypoint to call
`create_daemon`. Thus all the functions above
return some data structures.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 13:38:15 +02:00
Sebastian Wagner
72e3990382 mgr/cephadm: Fix race between host_add and _apply_all_specs
This mitigates a potential race, where new host was added *after*
``_refresh_host_daemons()`` was called, but *before*
``_apply_all_specs()`` was called. thus we end up with a hosts
where daemons might be running, but we have not yet detected them.

Imagine:

1. the initial MGR was deployed manually
2. `serve()` is called
3. `_refresh_hosts_and_daemons()` is called
4. `add_host()` is called with the initial host
5. `apply_all_specs()` now deploys an additional MGR on the initial host

Fixes: https://tracker.ceph.com/issues/45093
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 12:17:43 +02:00
Lenz Grimmer
4432903f00
Merge pull request #37044 from votdev/update_on_demand
mgr/dashboard: Update datatable only when necessary

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-09-14 11:50:19 +02:00
Lenz Grimmer
856d9de394
Merge pull request #36845 from bk201/wip-44803
mgr/dashboard: allow getting fresh inventory data from the orchestrator

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-09-14 11:48:22 +02:00
Sebastian Wagner
7b7aeafad1 python-common: deprecate filter_matching_hosts
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 11:34:32 +02:00
Sebastian Wagner
5750f32e9d mgr/cephadm: Simplified test_scheduling
Removed `get_hosts_func`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 11:29:51 +02:00
Sebastian Wagner
908bd443f3 mgr/cephadm: Simplify HostAssignment arguments
`get_hosts_func` -> `hosts`, as `get_hosts_func` is
only called once in __init__

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 11:27:02 +02:00
Sebastian Wagner
3b841fc7fa mgr/cephadm: Scheduler: fetch hosts only once
Otherwise we might be prone to races, e.g.
a new hosts gets added in between calls to
`get_hosts_func`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-14 11:18:38 +02:00
Lenz Grimmer
42a32baaaa
Merge pull request #36365 from bk201/wip-44637
mgr/dashboard: add e2e tests for Orchestrator components

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-09-14 10:56:41 +02:00
Kefu Chai
a2cc67f563
Merge pull request #37127 from tchaikov/wip-crimson-errorator
crimson/common: add specialization for futurize::invoke(Func, monostate)

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-09-14 13:19:47 +08:00
Yanhu Cao
8a54e03f29 mds: fix purge_queue's _calculate_ops is inaccurate
No need to account for removing (or zeroing) backtrace,
because if item.size is 0, num is already set to 1.

Fixes: https://tracker.ceph.com/issues/47353
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2020-09-14 11:19:17 +08:00
Greg Farnum
d02625331c Merge remote-tracking branch 'origin/master' into wip-stretch-mode 2020-09-14 02:32:19 +00:00
Kefu Chai
ac58f85e13 crimson/common: add comment to explain the partial specialization
it might be confusing why we don't use explicit specialization for
defining errorator::futurize::stored_to_future.

quote from item 16, § 17.7.3, n4659:

In an explicit specialization declaration for a member of a class
template or a member template that appears in namespace scope, the
member template and some of its enclosing class templates may remain
unspecialized, except that the declaration shall not explicitly
specialize a class member template if its enclosing class templates are
not explicitly specialized as well.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-14 10:14:05 +08:00
Kefu Chai
1dbafcb43d
Merge pull request #37098 from tchaikov/wip-47179
common/admin_socket: always validate the parameters

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-14 09:44:35 +08:00
Kefu Chai
47e88cd7c3 crimson/common: add specialization for futurize::invoke(Func, monostate)
this is a leftover of 260a702ba9. where we
bumped up the Seastar API level to 5, in which seastar::internal::monostate
is used to represent the stored state of a future instead of a tuple<>.

to address FTBFS with GCC-9.2.1

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-14 09:03:44 +08:00
Patrick Donnelly
aa7f399148
Merge PR #36987 into master
* refs/pull/36987/head:
	mgr: PyModuleRegistry::unregister_client() can run endlessly

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-13 13:24:13 -07:00
Kefu Chai
3cb1e73075
Merge pull request #37069 from tchaikov/wip-seastar-lv5
crimson/common: use seastar API level 5

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-09-14 00:37:38 +08:00
Willem Jan Withagen
6180bb1516 mgr/dashboard: Report the missing path in error message
Otherwise the error message only reports that something is missing.
No what it is missing, helps debugging when this occurs.
As it sometimes does on FreeBSD because we insert the prebuild rpm
instead of building it from source.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-09-13 18:02:02 +02:00
Kefu Chai
747b6e69bb test/crimson: use ASSERT_EQ() for verify critial results
the following EXPECT_EQ() statements actually depends on this test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 23:59:25 +08:00
Kefu Chai
eddd709529 test/crimson: use better names than ret
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 23:58:08 +08:00
Kefu Chai
4cd5c9df14 test/crimson: use range-based loop when appropriate
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 23:52:00 +08:00
Kefu Chai
de91ba68c4 test/crimson: remove unused variables
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 23:46:33 +08:00
Kefu Chai
48dae7010e rgw: convert string constant to string_view
instead of converting string constant to char*, construct string_views
from string constants

to silence GCC warnings like:

src/rgw/services/svc_sys_obj_cache.cc:512:7: warning: ISO C++ forbids converting a string constant to 'char*' [-Wwrite-strings]
  512 |     { "cache list name=filter,type=CephString,req=false",
      |       ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 23:32:10 +08:00
Kefu Chai
06da7b182e seastar: pickup alien fixes
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-13 22:54:18 +08:00
Mykola Golub
4d969cd508 rbd-nbd: initialize quiesce state variable
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-09-12 18:16:51 +01:00
Kefu Chai
85b5db0cce
Merge pull request #37097 from tchaikov/wip-buffer-offsetof
common/buffer: use homebrew BUF_OFFSETOF to replace offsetof()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-09-12 23:13:39 +08:00
Kefu Chai
043603ab6f
Merge pull request #37117 from bstillwell/zstd-upgrade-v1_4_5
zstd: upgrade to v1.4.5

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-12 23:12:36 +08:00
Kefu Chai
ad895eed3a
Merge pull request #37096 from majianpeng/osd-pg-remove-unused-ocde
osd/PG: remove unused function.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-12 19:31:13 +08:00
Kefu Chai
c1b98cac4b pybind/rados: add more type hintings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-12 13:49:00 +08:00
Kefu Chai
ae4fd30ffc
Merge pull request #36918 from tchaikov/wip-pybind-type-annotations
pybind/rados: use PEP484 style type annotations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-09-12 06:49:58 +08:00
Kefu Chai
075cc0ffd6
Merge pull request #37105 from tchaikov/wip-47404
mgr/zabbix: indent the output of "zabbix config-show"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-12 06:27:51 +08:00
Jason Dillaman
c55e2c8706
Merge pull request #37012 from trociny/wip-46803
librbd: track complete async operation requests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-09-11 18:14:46 -04:00
Bryan Stillwell
7f23cd611f zstd: upgrade to v1.4.5
Since the v1.4.0 release there have been a few improvements to Zstandard
including improved compression ratios, faster compression, and faster
decompression.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2020-09-11 15:54:56 -06:00
Josh Durgin
05efc0a3ac
Merge pull request #37114 from yuriw/wip-yuriw-crontab-master
qa/tests: running rados with -p 80 to produce better test results on …

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-11 14:42:24 -07:00
Abhishek Lekshmanan
62baa7653f doc: releases: notes for v15.2.5 octopus
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-09-11 22:13:14 +02:00
Casey Bodley
1d65153885 rgw: return success on existing bucket
RGWRadosStore::create_bucket() only returns EEXIST errors when a
conflict is detected and the recreation should fail. in other cases,
return success and use the 'bool *existed' flag to notify the caller of
its prior existence

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-09-11 15:54:33 -04:00
Sebastian Wagner
0f90e60faa
Merge pull request #35543 from sebastian-philipp/qa-cephadm-iscsi
qa/cephadm: Add iSCSI

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Georgios Kyratsas <gkyratsas@suse.com>
Reviewed-by: Matthew Oliver <moliver@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-09-11 21:10:37 +02:00
Sebastian Wagner
3a59cd7971
Merge pull request #36936 from mgfritch/cephadm-keyring-rm
mgr/cephadm: remove keyring during daemon post-remove

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-11 21:09:19 +02:00
Ramana Raja
4b2911fc70
Merge pull request #32581 from rishabh-d-dave/wip-djf-15070
mon, cephfs: Add auth caps for CephFS fsids

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-09-12 00:00:52 +05:30
Ishan Rai
40b5cad9e4 mgr/dashboard: display description on mouse hover
Fixes: https://tracker.ceph.com/issues/36607

Signed-off-by: Ishan Rai <ishanrai05@gmail.com>
2020-09-11 18:27:02 +00:00
Yuri Weinstein
c261f662c4 qa/tests: running rados with -p 80 to produce better test results on master
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-09-11 10:49:35 -07:00
Kefu Chai
a728b9dbbd
Merge pull request #37021 from tchaikov/wip-osd-pass-by-ref
osd: pass pg_log_t by lvalue reference

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-09-12 01:38:09 +08:00
Casey Bodley
068d46c126
Merge pull request #37011 from tchaikov/wip-rgw-cache-list
rgw: set command desc for "cache list"

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-09-11 13:04:00 -04:00
Kefu Chai
2f2914da5d
Merge pull request #37002 from tchaikov/wip-alpine-cleanup
alpine: remove .editorconfig

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-09-12 00:43:36 +08:00
Jason Dillaman
ec580007a9 librbd: ensure local site is included in mirror image global status
Ensure we always return local status for a mirrored image. The Python
bindings expect it to be included for backwards compatibility. Previously
the local status was not included if at least one remote site was reporting
status.

Fixes: https://tracker.ceph.com/issues/47390
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-09-11 12:41:44 -04:00
Kefu Chai
d9c4be0c0e pybind/rados: do not encode bytes
the annotations ensures the type of input parameter, so no need to
encode a bytes object anymore

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-12 00:30:55 +08:00