Commit Graph

127116 Commits

Author SHA1 Message Date
Sebastian Wagner
64c6fa2d84
Merge pull request #43253 from guits/fix_orch_ls_osd
cephadm: fix osd size reported in 'orch ls'

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-14 16:28:03 +02:00
Sebastian Wagner
9e68e27ce6
Merge pull request #43339 from adk3798/volume-chunk
mgr/cephadm: use json-pretty for ceph-volume calls

Reviewed-by: Sage Weil <sage@newdream.net>
2021-10-14 16:27:10 +02:00
Patrick Donnelly
6e589e5080
Merge PR #43517 into master
* refs/pull/43517/head:
	doc / cephfs: health message codes should be permalinks

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-14 10:08:18 -04:00
Kefu Chai
a948322275
Merge pull request #43538 from rzarzynski/wip-crimson-net-actual-bind-failure
crimson/osd: print the actual reason on bind failure.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-14 22:00:27 +08:00
Ernesto Puerta
90bbcab09f
Merge pull request #42557 from ceph/feature-50336-cluster-creation-wizard
mgr/dashboard: Cluster Creation/Expansion Wizard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: Volker Theile <vtheile@suse.com>
2021-10-14 15:12:42 +02:00
Ernesto Puerta
9f2fd685fa
Merge pull request #43453 from rhcs-dashboard/e2e-host-fix-teuth
mgr/dashboard: Fix orchestrator/01-hosts.e2e-spec.ts failure

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-10-14 13:26:44 +02:00
Radoslaw Zarzynski
bba537988b crimson/osd: print the actual reason on bind failure.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-14 09:53:48 +00:00
Yuval Lifshitz
d009895a6b
Merge pull request #43308 from TRYTOBE8TME/wip-rgw-post-object-upload
src/rgw: HTTP POST object upload
2021-10-14 10:41:15 +03:00
Venky Shankar
3d97d6d98f doc / cephfs: health message codes should be permalinks
... so that such links can be included in alert warnings.

Additionally, document some other health warnings. Credit to @pcuzner
to point out that not all health warnings have been documented.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-10-14 10:21:07 +05:30
adk3798
c7419c8c43
Merge pull request #43526 from adk3798/disable-agent-default
mgr/cephadm: disable agent by default

Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-10-13 17:45:42 -04:00
Sage Weil
e94ba142f0 Merge PR #43049 into master
* refs/pull/43049/head:
	mgr/rook: apply mds using placement spec and osd_pool_default_size
	mgr/rook: factor out replica/failureDomain calc

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-10-13 17:08:20 -04:00
Adam King
7120d5dc6f mgr/cephadm: disable agent by default
to avoid issues while it is stabilized

Signed-off-by: Adam King <adking@redhat.com>
2021-10-13 12:33:47 -04:00
Sebastian Wagner
dc855b4431
Merge pull request #43490 from Daniel-Pivonka/cephadm-doc-adopt-sshuser
doc/cephadm: document setting ssh-user during adopt

Reviewed-by: Adam King <adking@redhat.com>
2021-10-13 18:11:36 +02:00
Daniel Pivonka
bafbeb6fca doc/cephadm: document setting ssh-user during adopt
Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
2021-10-13 11:38:01 -04:00
Ernesto Puerta
9b40c9df26
Merge pull request #43377 from rhcs-dashboard/fix-clients-connection-query
mgr/dashboard: replace "Ceph-cluster" Client connections with active-standby MGRs

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-13 13:37:51 +02:00
Nizamudeen A
3276147049 mgr/dashboard: Cluster expansion e2e cleanups
Fixes: https://tracker.ceph.com/issues/52645
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-13 16:02:51 +05:30
Avan Thakkar
6644a00a2c mgr/dashboard: introduce gather facts in host list
Fixes: https://tracker.ceph.com/issues/52017
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-10-13 16:02:51 +05:30
Aashish Sharma
b914f59ff1 mgr/dashboard: Cluster Creation Add Services Section
Add Services section in cluster creation wizard
Create Cluster OSD Section Followups

1. The device preview disappearing when going to next step and coming back to the previous step
2. Even when clearing the device preview, the Storage Capacity count and the drive group spec doesn't get cleared.
3. Expanding the cluster without selecting any devices gives a 400
   error.
4. Renamed "Delete Host" to "Remove Host"
5. Generalizing most of the sub component code

Fixes: https://tracker.ceph.com/issues/52499
Fixes: https://tracker.ceph.com/issues/51991
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-13 16:01:21 +05:30
Nizamudeen A
ad1535eea4 mgr/dashboard: Cluster Creation Create OSDs Section
Create OSDs section in cluster creation wizard

Fixes: https://tracker.ceph.com/issues/51991
Fixes: https://tracker.ceph.com/issues/52298
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-13 15:56:09 +05:30
Avan Thakkar
2e31ba5427 mgr/dashboard: Review Section for the Create Cluster Workflow
Fixes: https://tracker.ceph.com/issues/50566
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-10-13 15:56:09 +05:30
Nizamudeen A
59cbf97e6c mgr/dashboard: Cluster Creation Add Host Section and e2es
Add host section of the cluster creation workflow.

1. Fix bug in the modal where going forward one step on the wizard and coming back opens up the add host modal.
2. Rename Create Cluster to Expand Cluster as per the discussions
3. A skip confirmation modal to warn the user when he tries to skip the
   cluster creation
4. Adapted all the tests
5. Did some UI improvements like fixing and aligning the styles,
   colors..
- Used routed modal for host Additon form
- Renamed the Create to Add in Host Form

Fixes: https://tracker.ceph.com/issues/51517
Fixes: https://tracker.ceph.com/issues/51640
Fixes: https://tracker.ceph.com/issues/50336
Fixes: https://tracker.ceph.com/issues/50565
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-13 15:55:23 +05:30
Avan Thakkar
b9f38cadc4 mgr/dashboard: Create Cluster Workflow welcome screen and e2e tests
A module option called CLUSTER_STATUS has two option. INSTALLED
AND POST_INSTALLED. When CLUSTER_STATUS is INSTALLED it will allow to show the
create-cluster-wizard after login the initial time.  After the cluster
creation is succesfull this option is set to POST_INSTALLED
Also has the e2e codes for the Review Section

Fixes: https://tracker.ceph.com/issues/50336
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-13 15:52:14 +05:30
Kalpesh Pandya
ffe7de8853 src/test: HTTP POST object upload
This solves the tracker: https://tracker.ceph.com/issues/51724
Basically it is using 'generate_presigned_post()' boto3 API.
This is verified under AMQP endpoint.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-10-13 11:09:51 +05:30
Samuel Just
7d74578ab0
Merge pull request #43500 from rzarzynski/wip-crimson-interruptible-condalias
crimson: osd operations respect interruptor's InterruptCondition.

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-12 14:39:38 -07:00
Samuel Just
5a99bb8fc7
Merge pull request #43501 from rzarzynski/wip-crimson-parse-env
crimson: respect the CEPH_ARGS environment variable.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-12 14:38:47 -07:00
Sebastian Wagner
53382d70eb
Merge pull request #43274 from pcuzner/add-mib
monitoring:Adding the Ceph MIB

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-12 22:29:06 +02:00
Gregory Farnum
4dd8ed2578
Merge pull request #43509 from ceph/revert-43462-wip-test-erasure-code-for-aarch64
Revert "qa: support isal ec test for aarch64"

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2021-10-12 12:00:56 -07:00
Zack Cerza
b57539dc94 Revert "qa: support isal ec test for aarch64"
This commit has been causing scheduled jobs to request e.g. aarch64
smithi machines, which don't exist. The dispatcher then tries to find them forever, requiring the dispatcher to be killed and restarted. The queue
will sit idle until someone notices the problem.

Signed-off-by: Zack Cerza <zack@redhat.com>
2021-10-12 12:53:58 -06:00
Samuel Just
79a5deda62
Merge pull request #43492 from xxhdx1985126/wip-52894
crimson/os/seastore: set ExtentPlacementManager::allocated_to before rolling segments

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-10-12 08:09:58 -07:00
Nizamudeen A
db5cfb15e5 mgr/dashboard: Fix orchestrator/01-hosts.e2e-spec.ts failure
The test is failing on deleting a host because the agent daemon is
present in that host. Its not possible to simply delete a host. We need
to drain it first and then delete it.

Fixes: https://tracker.ceph.com/issues/52764
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-12 20:30:12 +05:30
Radoslaw Zarzynski
7b75040d25 crimson: respect the CEPH_ARGS environment variable.
Rook uses `CEPH_ARGS` to convey the `mon_host` configurable. Lack of
support for it was the root cause of inability to reach out to monitors.

See: https://gist.github.com/rzarzynski/95746aa73a48e811749a3b0aaeb31680#gistcomment-3924233.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-12 13:47:38 +00:00
Radoslaw Zarzynski
f41676bee5 crimson/osd: rectify a coding style issue in PglogBasedRecovery::do_recovery().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-12 11:31:33 +00:00
Radoslaw Zarzynski
e3ad392fd0 crimson: osd operations respect interruptor's InterruptCondition.
For the sake of DRY.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-12 11:31:33 +00:00
Avan Thakkar
f41eae16af cephadm: expose gather-facts api method
Fixes: https://tracker.ceph.com/issues/51209

This PR intends to expose host metadata(gather-facts) api method

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-12 11:30:47 +05:30
Ali Maredia
8ca0012e47
Merge pull request #42052 from TRYTOBE8TME/wip-rgw-dpp-3
rgw: DPP addition 4

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-10-12 01:31:00 -04:00
Samuel Just
c349666838
Merge pull request #43181 from xxhdx1985126/wip-extent-placement-manager-multi-device-3
crimson/os/seastore: add multi-device support

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 22:17:52 -07:00
Xuehan Xu
460f6ca047 crimson/os/seastore: set ExtentPlacementManager::allocated_to before rolling segments
There are circumstances in which a transaction that are supposed to roll the current segment
is invalidated after it finished writing and before it rolls the segment. If we don't set
ExtentPlacementManager::allocated_to in this situation, another transaction can try to write
to the old "allocated_to" position, which would cause an invalid write error

Fixes: https://tracker.ceph.com/issues/52894
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-12 12:43:22 +08:00
Samuel Just
c7e262fa83
Merge pull request #43449 from rzarzynski/wip-crimson-interruptible-peeringevent
crimson/osd: implement interruptions in PeeringEvent.

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 18:28:42 -07:00
Samuel Just
caafbf090f
Merge pull request #43483 from cyx1231st/wip-seastore-record-header-fullness
crimson/os/seastore: measure inline/ool record header fullness

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 18:25:35 -07:00
Joseph Sawaya
1a67d3e559 mgr/rook: apply mds using placement spec and osd_pool_default_size
This commit changes the apply_mds command in the rook orchestrator
to support some placement specs and also sets the replica size according
to the osd_pool_default_size ceph option.

This commit also adds `orch apply mds` to the QA to test if the command
runs.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-10-11 12:06:37 -05:00
Sage Weil
e517882f21 mgr/rook: factor out replica/failureDomain calc
Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-11 11:58:00 -05:00
Sebastian Wagner
100a466e3f
Merge pull request #43471 from liewegas/fix-rook-1-node
qa/suites/orch/rook: replicate across osds for 1-node clusters

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 18:47:35 +02:00
Avan Thakkar
d388c5e958 mgr/dashboard: replace Client connections with active-stdby mgrs
Fixes: https://tracker.ceph.com/issues/52121
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-10-11 21:53:23 +05:30
Sebastian Wagner
76b0657e21
Merge pull request #43376 from Daniel-Pivonka/cephadm-apply-health
mgr/cephadm: set HEALTH warnings during apply phase in serve

Reviewed-by: Melissa Li <mingkli@redhat.com>
2021-10-11 16:45:58 +02:00
Sebastian Wagner
1be6dc174f
Merge pull request #43455 from liewegas/qa-nvme-loop
qa: use nvme_loop devices for (some) cephadm tests

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 16:43:10 +02:00
Sebastian Wagner
b7ce9d0d6f
Merge pull request #43450 from guits/fix_selinux_apply_spec
cephadm: shell --mount shouldnt enforce ':z' option

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-10-11 16:40:39 +02:00
Sebastian Wagner
146cf96af6
Merge pull request #43458 from mgfritch/cephadm-scp
mgr/cephadm: use `asyncssh.scp` to write remote files

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 16:38:35 +02:00
Sage Weil
0e7c0a81d8 mgr/rook: specify failureDomain on CephObjectStore CR
Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-11 08:55:18 -05:00
Ernesto Puerta
e7cbf30387
Merge pull request #43473 from rhcs-dashboard/wip-pr_deps-master
.github: check if PR deps are merged/closed

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-11 14:52:02 +02:00
Ernesto Puerta
bbe2e6505c
Merge pull request #43485 from rhcs-dashboard/fix-pr_triage-master
.github/pr-triage: rename GH token

Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-11 14:45:45 +02:00