Commit Graph

114040 Commits

Author SHA1 Message Date
Sebastian Wagner
f500b8fc74 mgr/cephadm: Add test_daemon_action_fail
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-05 12:51:28 +02:00
Sebastian Wagner
6fd599bd4d mgr/cephadm/tests: Split test_daemon_action
Into:

* `test_list_daemons`
* `test_daemon_action` (now without listing daemons)

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-05 12:51:28 +02:00
Sebastian Wagner
313e091fee mgr/cephadm: guard _check_daemons
Continue with other daemons, if one fails

Fixes: https://tracker.ceph.com/issues/46748
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-05 12:51:28 +02:00
Sebastian Wagner
ea29db3c62
Merge pull request #36446 from sebastian-philipp/mgr-cephadm-pep8-remotes.py
mgr/cephadm: PEP8tify a few files

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-08-05 11:46:28 +02:00
Or Ozeri
b6d377281a librbd: add a crypto object dispatch layer
This commit adds a new object dispatch layer to enable encryption of RBD images.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2020-08-05 12:44:34 +03:00
Kefu Chai
d639166997
Merge pull request #36148 from athanatos/sjust/wip-lba-pin
crimson: pin LogicalExtentRef lba tree ancestors

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-05 15:34:28 +08:00
Tim Serong
8112949851 cephadm: don't add ceph-volume lvm activate for adopted simple OSDs
This changes the logic in deploy_daemon_units() to add either `chown` calls
for simple (ceph-disk style) OSDs, or to add `ceph-volume lvm activate` calls
for LVM OSDs, rather than always adding both.  When I was working on
https://github.com/ceph/ceph/pull/34703, I'd originally added an "osd_simple"
flag to figure out what type of OSD was being adopted/deployed, but passing
that around was kinda ugly, so was removed from that PR.  This time around
I'm checking if /etc/ceph/osd/$OSD_ID-$OSD_FSID.json.adopted-by-cephadm
exists, which seems pretty safe IMO.  My only concern with this method is:
what happens if someone adopts a simple OSD, then later wants to migrate it
to LVM.  Presumably that's a destroy and recreate, keeping the same OSD ID?
If that's true, then the JSON file probably still exists, so the subsequent
create will do the wrong thing, i.e. will add `chown` calls, not `ceph-volume
lvm activate` calls.  Any/all feedback appreciated...

Fixes: https://tracker.ceph.com/issues/46833
Signed-off-by: Tim Serong <tserong@suse.com>
2020-08-05 16:55:25 +10:00
Samuel Just
8e48bc0a4f crimson/os/seastore: link in LBAPin after read
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 23:17:55 -07:00
Samuel Just
164faa270d crimson/os/seastore: initialize dirty extents after replay
lba_manager needs to preload BtreeLBAPin and parent nodes.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 23:17:55 -07:00
Samuel Just
d2fd28b3a0 crimson/os/seastore/lba_manager/btree: improved debugging
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 23:17:55 -07:00
Samuel Just
5269043b2f crimson/os/seastore/lba_manager/btree: wire in btree pin set
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 23:17:53 -07:00
Samuel Just
247926ad87 crimson/os/seastore/lba_manager/btree: add lba pin structure
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 23:17:51 -07:00
Kefu Chai
8c203e7eac
Merge pull request #36458 from drunkard/master
doc: fix typo in output of osdmaptool example

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-05 11:18:53 +08:00
Jason Dillaman
bb2594200b
Merge pull request #36145 from orozery/object_dispatch_read_extents_with_version
librbd: add read extents with version to object dispatch interface

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-08-04 16:53:29 -04:00
Samuel Just
0f7e8973e1 crimson/os/seastore: actually use LBAManager::complete_transaction
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 09:19:58 -07:00
Samuel Just
4750ca539f crimson/: add a meta field to FixedKVNodeLayout and use in LBANode*
Also removes LBANode::depth.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 09:19:58 -07:00
Samuel Just
1fa4c11b1b crimson/os/seastore/lba_manager/btree: move BtreeLBAPin to btree_range_pin.h
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-08-04 09:19:54 -07:00
Sebastian Wagner
c38309f0c2
Merge pull request #36371 from votdev/issue_46775_alertmanagerspec
mgr/cephadm: Enhance AlertManagerSpec to allow adding additional webhook receiver URLs

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-04 16:38:28 +02:00
Sebastian Wagner
eb2b45280e
Merge pull request #36433 from votdev/issue_46814_alertmanager
cephadm: Deploying alertmanager image is broken

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-08-04 15:41:45 +02:00
Ricardo Marques
7ee7fb98d3 mgr/dashboard: Unable to edit iSCSI logged-in client
Fixes: https://tracker.ceph.com/issues/46818

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-08-04 14:41:41 +01:00
Sebastian Wagner
f79f5a740e
Merge pull request #36441 from Daniel-Pivonka/cephadm-46819
mgr/orchestrator: fix placement of '1' activating dry-run bug

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-08-04 15:40:04 +02:00
Sebastian Wagner
24dd5d1638
Merge pull request #36391 from jschmid1/followup_fix_36151
mgr/cephadm: correct to_json output from str->dict

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-08-04 15:38:20 +02:00
Sebastian Wagner
c34bf6ed5f
Merge pull request #36388 from sebastian-philipp/cephadm-inventory-get_daemons_by_service
mgr/cephadm: get_daemons_by_service should use dd.service_name
2020-08-04 15:37:53 +02:00
Sebastian Wagner
5846ca6cae
Merge pull request #36383 from mgfritch/orch-nfs-rados-url
python-common: don't assert when building rados url

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-08-04 15:37:15 +02:00
Kefu Chai
2533c1b411
Merge pull request #36405 from tchaikov/wip-heartbeat-atomic
common/HeartbeatMap: use std::atomic<time_point> for timeout

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-08-04 21:27:31 +08:00
Tiago Melo
e12702a6c7 mgr/dashboard: Extract documentation link to a component
Fixes: https://tracker.ceph.com/issues/36565
Fixes: https://tracker.ceph.com/issues/43375

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-08-04 11:56:24 +00:00
Sebastian Wagner
17db7ba7df mgr/cephadm: PEP8tify
Those files should generate fewer conflicts for now.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-04 12:25:33 +02:00
Nizamudeen A
166681df08 mgr/dashboard: Fix for CrushMap viewer items getting compressed vertically
Intents to fix the crushmap viewer tree children getting compressed vertically when more osd's are added.

Fixes: https://tracker.ceph.com/issues/46826

Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-08-04 15:28:21 +05:30
Sebastian Wagner
ffc1fd65c6 mgr/cephadm: PEP8tify upgrade.py
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-04 11:13:49 +02:00
Sebastian Wagner
3072b1d8cb mgr/cephadm: Add UpgradeState class
My resons are:

* This increase mypy coverage
* Makes the code more discoverable.
* Allowes us to have intelligent UpgradeState properties

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-04 11:12:59 +02:00
Kefu Chai
ec12f6f735
Merge pull request #36408 from tchaikov/wip-33725
tools/rados: Set locator key when exporting or importing a pool

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-04 16:47:14 +08:00
Kefu Chai
ffab1cddf7
Merge pull request #36443 from tchaikov/wip-crimson-asok
crimson/admin: read non-string settings as well

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-08-04 16:45:51 +08:00
Kefu Chai
67874aeb0c crimson/admin: do not validate params of ConfigSetHook
validate_cmd() should have taken care of this

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 15:28:47 +08:00
Kefu Chai
55f8900ebf crimson/admin: read non-string settings as well
before this change, we were using

local_conf().get_val<std::string>(var);

for reading a setting when serving a "config get" command even if the
setting being queried is a non-string. so without this change, a failure
is returned complaining "unrecognized option..."

in this change:

* use get_val(string,string*) for querying the string representation
  of the queried setting
* drop the check for existence of "var" parameter, validate_cmd()
  always take care of this.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 15:28:47 +08:00
Kefu Chai
793e515658 crimson/admin: drop prefix from cmd desc
there is no need to repeat the prefix in the command's description,
validate_cmd() skips it anyway.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 15:28:47 +08:00
Kefu Chai
98eb401025 crimson/admin: move config hooks into admin_socket.cc
they are not specific to OSD, let's move them into admin_socket.cc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 15:28:47 +08:00
Lenz Grimmer
8a805f3eac
Merge pull request #36438 from rhcs-dashboard/wip-pull_request_template_api-master
github: replace trigger phrase for api tests

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-By: Patrick Donelly <pdonell@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-08-04 09:14:15 +02:00
Drunkard Zhang
2496ba7c7f doc: typo fix on output of osdmaptool example
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2020-08-04 13:50:03 +08:00
Iain Buclaw
ecb2df9177 tools/rados: Set locator key when exporting or importing a pool
Fixes the following error when exporting a pool that contains objects
with a locator key set:

        error getting xattr set [object name]: (2) No such file or directory
        error from export: (2) No such file or directory

Fixes: https://tracker.ceph.com/issues/46824
Signed-off-by: Iain Buclaw <iain.buclaw@dunnhumby.com>
2020-08-04 12:46:30 +08:00
Kefu Chai
d3db045ddc common/HeartbeatMap: use relaxed order
use memory_order_relaxed instead of memory_order_seq_cst, as the
ordering of storing of `timeout` and `suicide_timeout` does not matter,
and we don't need to synchorinize the cache for the consistent memory
view of local core. what we need is but the atomic read/write operation
of these individual variables.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 11:20:49 +08:00
Kefu Chai
c11594a479 common/WorkQueue,librbd,rgw: use ceph::timespan for representing interval
better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-04 11:20:49 +08:00
Kefu Chai
69c70bd96f
Merge pull request #36442 from rzarzynski/wip-crimson-op_truncate
crimson/osd: add support for CEPH_OSD_OP_TRUNCATE.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-04 10:37:12 +08:00
Josh Durgin
2ec09274f8
Merge pull request #36398 from jdurgin/wip-pg-log-doc
osd/PGLog: improve documentation

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-03 19:12:41 -07:00
Kiefer Chang
d208d67f9f
mgr/dashboard: fix tasks.mgr.dashboard.test_rbd.RbdTest.test_move_image_to_trash error
The API call is a task and the response status is determined by whether
the call is completed within a pre-defined duration (2 seconds) or not.
We should also allow the status when the call takes longer.

Fixes: https://tracker.ceph.com/issues/46812
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-08-04 10:12:14 +08:00
Josh Durgin
20363b1834 common/options: update pg log bound descriptions to reflect current code
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-08-03 17:38:40 -04:00
Josh Durgin
8877270052 common/options: make pg log options dev-level
Changing these has performance and correctness implications, and is
rarely needed.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-08-03 17:38:40 -04:00
Josh Durgin
3fdc4b6e69 common/options: describe osd_pg_log_trim_min
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-08-03 17:38:40 -04:00
Daniel-Pivonka
9f7c8f71fc mgr/orchestrator: fix placement of '1' activating dry-run bug
when applying a placement of '1' for mon, mgr, rbd-mirror, crash, alertmanager, grafana, node-exporter, prometheus, or mds a dry-run was activated

Fixes: https://tracker.ceph.com/issues/46819
Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
2020-08-03 16:37:02 -04:00
Radoslaw Zarzynski
dca8467764 crimson/osd: add support for CEPH_OSD_OP_TRUNCATE.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-08-03 21:51:05 +02:00
Ernesto Puerta
541ad5a060
github: replace trigger phrase for api tests
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2020-08-03 20:26:54 +02:00