Commit Graph

128996 Commits

Author SHA1 Message Date
Venky Shankar
206d444d37
Merge pull request #44279 from jtlayton/wip-50235
cephfs-shell: add the ability to mount a named filesystem

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-05 17:46:01 +05:30
Sebastian Wagner
dc8f3bedbb
Merge pull request #44158 from adk3798/agent-failed
mgr/cephadm: don't include agents in CEPHADM_FAILED_DAEMON

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 12:28:34 +01:00
Alfonso Martínez
bb56e84c71
Merge pull request #44388 from rhcs-dashboard/02-host-inventory-fix
mgr/dashboard: fix orchestrator/02-hosts-inventory.e2e failure

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-01-05 11:32:22 +01:00
Prashant D
658dbf4528 doc/rados/operations: Document health check OSD_FILESTORE
Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Sridhar Seshasayee
e65c4bcd96 osd, mon/OSDMonitor: Force the scheduler type to 'wpq' for filestore OSDs
The 'mclock_scheduler' is not supported for filestore OSDs. Enforce the
usage of 'wpq' scheduler for such OSDs to avoid issues.

Also, in this scenario, the override of various config settings for the
'mclock_scheduler' are not performed.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-01-05 10:08:25 +00:00
Prashant D
39f5a61a3a mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.

Fixes: https://tracker.ceph.com/issues/49275

Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Xiubo Li
bbc4f4461f qa: add test for dumpping subtrees
Fixes: https://tracker.ceph.com/issues/53726
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-01-05 17:58:53 +08:00
Sebastian Wagner
bcae00e5d4
Merge pull request #44193 from adk3798/agent-upgrade
mgr/cephadm: speed up upgrade when using agent

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:27:21 +01:00
Sebastian Wagner
2a450f68a1
Merge pull request #44266 from adk3798/http-reconfig
mgr/cephadm: reconfig agents over http

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:26:01 +01:00
Sebastian Wagner
303843b476
python-common: move test_valid_snmp_gateway_spec from mgr/cephadm
We have to validate to_json() now as well, as we have spcial enums.
Otherwiese we might end up with !!python... representations.

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:24:42 +01:00
Sebastian Wagner
c652ae7479
python-common: move test_invalid_snmp_gateway_spec from mgr/cephadm
Let's keep the tests in the same package where the class is defined.

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:24:42 +01:00
Sebastian Wagner
3f47c2293b
mgr/cephadm: SNMP: don't write urls manually
this just broken for non-trivial urls. Don't be a bad example

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:23:05 +01:00
Sebastian Wagner
5e3cc4d6c1
mgr/cephadm: SNMP: Don't write default values into the store
Enable us to chage defaults in the future

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:23:04 +01:00
Sebastian Wagner
0039accb2c
mgr/cephadm: SNMP: use of python3 enums
Little reason to duplicate things ourselves

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:23:01 +01:00
Sebastian Wagner
9f197f7cd0
Merge pull request #44367 from sebastian-philipp/osd-count-fix-again
mgr/cephadm: Fix count for OSDs with OSD specs

Reviewed-by: Adam King <adking@redhat.com>
2022-01-05 10:21:03 +01:00
Sebastian Wagner
4b5b32b57f
Merge pull request #44374 from fmount/ingress_vip
mgr/cephadm: spec.virtual_ip  param should be used by the ingress daemon

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-05 10:19:43 +01:00
Waad AlKhoury
8f99e18380 doc/mgr: Add cli api documentation
Signed-off-by: Waad AlKhoury <walkhour@redhat.com>
2022-01-05 10:11:58 +01:00
Waad AlKhoury
12ff5ec9b7 mgr/cli Redo cli api mgr module.
Signed-off-by: Waad AlKhoury <walkhour@redhat.com>
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-05 10:11:58 +01:00
Pere Diaz Bou
15dfa71cf7 mgr: TTLCache basic implementation
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Fixes: https://tracker.ceph.com/issues/48388
2022-01-05 10:11:58 +01:00
Pere Diaz Bou
69aa388d90 doc/mgr: Add cache documentation
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-05 10:11:58 +01:00
Waad AlKhoury
4667338036 mgr/cli lightweight get method api call
Fixes: https://tracker.ceph.com/issues/50311
Signed-off-by: Waad AlKhoury <walkhour@redhat.com>
2022-01-05 10:11:57 +01:00
Xiubo Li
cc80cea0db mds: dump tree '/' when the path is empty
The `get subtrees` will return the path '' for the '0x1', and if
we pass '' to the `dump tree ''` command, the MDS will crash.

Fixes: https://tracker.ceph.com/issues/53726
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-01-05 17:08:20 +08:00
Alfonso Martínez
7de6d81f04
Merge pull request #44442 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-simplebar-angular-2.3.6
mgr/dashboard: bump simplebar-angular from 2.3.0 to 2.3.6 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-01-05 10:04:58 +01:00
Aashish Sharma
15aa4dffa9 mgr/dashboard: monitoring:Implement BlueStore onode hit/miss counters into the dashboard
Provide the details pulled from Bluestore stats in order to display the onode hit/miss counters

Fixes: https://tracker.ceph.com/issues/53577
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2022-01-05 14:22:53 +05:30
Samuel Just
6ba110f321
Merge pull request #44361 from xxhdx1985126/wip-53612
crimson/os/seastore/cache: add lba nodes' logical begin addresses to extent_info_t

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-04 21:53:24 -08:00
Nikhilkumar Shelke
a00893fbba qa: test cases for ceph fs perf stats command
Fixes: https://tracker.ceph.com/issues/48473
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-01-05 10:45:05 +05:30
Nikhilkumar Shelke
72b4eb981a mgr/stats: exception handling for ceph fs perf stats command
Fixes: https://tracker.ceph.com/issues/48473
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-01-05 10:45:05 +05:30
Samuel Just
e2ec3bbef6
Merge pull request #44458 from cyx1231st/wip-seastore-cleanup-with-empty-transactions
crimson/os/seastore: cleanup with empty transactions

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-01-04 20:53:50 -08:00
Venky Shankar
03a21a520f
Merge pull request #44268 from lxbsz/mds-fix1
mds: set hb to NULL after the memory released

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-05 09:53:25 +05:30
Yingxin Cheng
e10dabab54 crimson/os/seastore: cleanup with empty transactions
* Add logs to identify OSD operation that submits transaction;
* Mark empty transactions as debug log;
* Misc cleanup;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-05 10:22:10 +08:00
Yuri Weinstein
8b90fe979f
Merge pull request #44329 from ljflores/wip-telemetry-last-additions
mgr/telemetry: add heap stats and pool application to the perf channel

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-04 14:43:05 -08:00
Yuri Weinstein
3f21194f13
Merge pull request #43716 from kamoltat/wip-ksirivad-autoscale-global-flag
mgr/autoscaler: Introduce noautoscale flag

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-04 14:42:41 -08:00
Matt Benjamin
16c8b64b7f rgwlc: format event.eventName with to_event_string(...)
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 15:40:46 -05:00
yuval Lifshitz
06eb0df290 rgwlc: add integration tests for lc triggered bucket notifications
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-01-04 15:40:27 -05:00
Matt Benjamin
dca0ab8f34 rgwlc: temporary logic to compensate for rgw::sal::Bucket::get_owner() always nullptr
(Acked by Daniel.)  Now with less use-after-free.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 15:30:40 -05:00
Adam Kupczyk
a091ea714d os/bluestore/bluefs: Add tags and comments for locks
Add function tags and comments related to locks.
Fixed locking graph documentation.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2022-01-04 19:03:16 +01:00
Laura Flores
f60e086072
Merge pull request #44433 from sebastian-schmid/master
docs/start: fixes typo in hardware recommendation docs
2022-01-04 11:21:59 -06:00
Matt Benjamin
cc1e812a00 rgwlc: remove lc entry on bucket delete
Buckets with lifecycle policies installed have a state entry that
must also be deleted when the bucket is removed.

Fixes: https://tracker.ceph.com/issues/46728

N.b., should really be generic, not specific to the RADOS store, but
there doesn't seem to be a clean model for implementing generic side
effects in Zipper, currently.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 11:51:44 -05:00
Jeff Layton
c8c341860f mount.ceph: fix the handling of new-syntax device names
With the new mount device syntax, the mount helper will end up
prepending "client." to whatever device string is passed down. If you
then go to recreate that mount later from the info in /proc/mounts,
you'll end up getting back an error because it'll try to prepend
"client." again.

There is no reason to send a fully-qualified principal name down to the
kernel since it can only use client.* principals anyway. Fix the mount
helper to track the unqualified name internally and only fully-qualify
it when we're scraping the config for info.

Fixes: https://tracker.ceph.com/issues/53765
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-01-04 11:25:03 -05:00
Alfonso Martínez
dae1b27022
Merge pull request #43580 from rhcs-dashboard/cephadm_box-docs
cephadm/box: DiD box documentation

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: sebastian-philipp <sewagner@redhat.com>
2022-01-04 17:24:44 +01:00
Alfonso Martínez
9600c73d48
Merge pull request #43763 from rhcs-dashboard/cephadm_box
cephadm/box: Cephadm Docker in Docker dev box

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-01-04 17:22:56 +01:00
Alfonso Martínez
74cd6245b8
Merge pull request #44449 from rhcs-dashboard/api-docs-e2e-test
mgr/dashboard: add test coverage for API docs (SwaggerUI)

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-04 17:19:48 +01:00
Sebastian Schmid
4842140311 docs/start: fixes typo and empty headline in hardware recommendation docs
Signed-off-by: Sebastian Schmid <mail@sebastian-schmid.de>
2022-01-04 17:15:51 +01:00
Alfonso Martínez
cc63753b8a
Merge pull request #44428 from rhcs-dashboard/e2e-improvement
mgr/dashboard: stabilizing the cephadm dashboard e2e 

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-04 17:15:26 +01:00
Sebastian Wagner
aed3dcad5b
Merge pull request #44453 from sebastian-philipp/mypy-cheroot-import-ssl-fix
mgr/dashboard: cheroot now ships type hints

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-04 16:11:54 +01:00
Jeff Layton
e77b44cf5a spec: fix URL for RPM docs
The old one gives a 404 error now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-01-04 09:57:26 -05:00
Yuval Lifshitz
306d8bede6 notify: fix a use-after-move crash, unconstify res_id
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 09:26:26 -05:00
Matt Benjamin
7b74603513 rgwlc: harmonize lifecycle notifications with the others
After working with notification configurations, it seemed to make
more sense to organize the different lifecycle notification sub-types
along the same lines as the official AWS ones.  So, there are now
ObjectExpirationCurrent and ObjectExpirationNoncurrent types, and
an ObjectExpiration wildcard.  Similarly, ObjectTransition
contains Current and Noncurrent sub-types.

Note that I have defined an ObjectExpirationAbortMPU notification
sub-type, but do not currently generate it--this is to avoid changing
the rgw::sal interface, but most likely we would support this in
future.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 09:26:16 -05:00
Matt Benjamin
35a4eb4410 rgwlc: optionally support notifications on object expiration
Most of the work is to remove direct knowledge of req_state from
methods in rgw_notify.

I've chosen to create new notification types matching the different
expire actions (but not transition).  The new event types are not
nested under Delete.  Notifications are sent iff rgw_lc_notify is true
(default false).

Adjusted per comments in initial review, in particular, notification from
lifecycle is no longer conditional on a config setting, and constness
is restored.

Fixes: https://tracker.ceph.com/issues/49068
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 09:26:09 -05:00
Nizamudeen A
fbc9f46459 mgr/dashboard: stabilizing the cephadm dashboard e2e
Reordering the tests and adding some more tests to verify the cluster is
healthy before proceeding to do some complex tasks like maintenance and
drain host

Fixes: https://tracker.ceph.com/issues/53742
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-01-04 19:41:13 +05:30