Commit Graph

130259 Commits

Author SHA1 Message Date
J. Eric Ivancich
20e9121fdc rgw: bucket index transaction instrumentation clean-ups
Add a series of clean-ups to the instrumentation code. Keep this as a
separate commit so it will be easier to reconcile other code streams.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-03-24 22:24:13 -04:00
J. Eric Ivancich
85f4ee7811 rgw: additional configurable CLS instrumentation on bucket index TXs
This supplements an earlier commit to add additional instrumentation
on bucket index transactions on the CLS side.

The instrumentation is triggered by setting the configuration option
rgw_bucket_index_transaction_instrumentation in the [global] section.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-03-24 22:24:13 -04:00
Venky Shankar
6abcf97a8c
Merge pull request #45115 from mchangir/mgr-snap_schedule-restart-old-schedules-on-startup
mgr/snap_schedule: restart old schedules

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-25 07:24:05 +05:30
Adam King
81f31fdba1
Merge pull request #45399 from adk3798/no-firewall
cephadm: respect --skip-firewalld flag

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-03-24 15:21:32 -04:00
Adam King
f5d0e61ecd
Merge pull request #45401 from adk3798/legacy-config
cephadm: verify config file exists when inferring it

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-03-24 15:20:32 -04:00
Adam King
cdb55ba418
Merge pull request #45527 from adk3798/eca-osd-allowed
python-common/drive_group: add extra_container_args to supported features

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-03-24 15:19:14 -04:00
Yuri Weinstein
0891b824ca
Merge pull request #45250 from ifed01/wip-ifed-get-bluest-extents-cleanup
os/bluestore: refactor bluefs get_block_extents interface


Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-03-24 09:49:46 -07:00
J. Eric Ivancich
cdfc29ff5a rgw: configurable instrumentation on bucket index transactions
In order to better understand corner cases with bucket index
operations, extra instrumentation is now added and controlled by a
boolean configuration variable
("rgw_bucket_index_transaction_instrumentation").

When set to true, there is extra logging during all CLS operations
involving bucket index transactions. Additionally, all these log
entries are tagged with "BITX" to make them easier to find in the
logs. This is preferable to setting all OSD logging at a high level
due to the log size issues.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-03-24 12:17:37 -04:00
J. Eric Ivancich
6e17a50497 rgw: make bucket index pending op expiration configureable
Bucket index operations are transactional with data object
manipulation. The operation is prepared by adding a pending operation
record. And when the data object side is complete, the bucket index
operation is committed.

If it fails to be committed, later bucket listings will compare the
pending ops with the current data object state and see whether it
completed or not and then either commit or expire the op. The time
span for expiration is currently hard-coded as 120 seconds (unless
overridden in the bucket header, which can happen during "bucket
check").

This commit allows that expiration time to be configured.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-03-24 12:16:17 -04:00
J. Eric Ivancich
3877c1e37f osd: add new CLS call to retrieve global configuration
Currently there is no easy way to gain access to global configuration
from CLS (objclass) code. This adds a new call to the CLS interface
that returns a "const ConfigProxy&" from which configuration can be
accessed.

NOTE: Working code to do provide this functionality in crimson is not
provided.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-03-24 12:15:32 -04:00
Kefu Chai
78dc720504
Merge pull request #45393 from rzarzynski/wip-crimson-fix-throw-in-plugins
build, crimson/osd: do not let Seastar to interfere with ELF's program headers

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-03-24 21:47:24 +08:00
Milind Changire
ac6c7240d3 qa: test snap_schedule with mgr restart
Scheduled snaps should follow the created schedule even across mgr
restart.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-03-24 18:01:44 +05:30
Milind Changire
dca7fdb600 mgr/snap_schedule: restart old schedules
Old schedules were not picked up from database when mgr was restarted.
Restart old schedules on mgr restart.

Fixes: https://tracker.ceph.com/issues/54052
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-03-24 18:01:44 +05:30
Milind Changire
24915c8ee9 mgr/util: add function to list all fs names
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-03-24 18:01:44 +05:30
Sridhar Seshasayee
0511a8eadc PendingReleaseNotes: Add mclock config reference link to an existing note
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:19 +05:30
Sridhar Seshasayee
afe3a7543c doc: Improvements to mClock configuration reference documentation
Improve the documentation around.
 - mclock client types.
 - Describe in greater detail about mclock config profiles.
 - Add notes about manually benchmarking OSDs and tuning bluestore throttle
   parameters.
 - Include a couple of missing mclock configuration options.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:13 +05:30
Redouane Kachach
dadbd72996
mgr/cephadm: fixing natsort dependencies on debian
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-03-24 09:47:49 +01:00
Redouane Kachach
28314cebef
mgr/cephadm: Adding support for natural sorting
Fixes: https://tracker.ceph.com/issues/54026

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-03-24 09:47:49 +01:00
Venky Shankar
87aa88e30b
Merge pull request #45472 from vshankar/revert-45307
Revert "mds: kill session when mds do ms_handle_remote_reset"

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-24 12:09:50 +05:30
Venky Shankar
a22b1cfc6d Revert "mds: kill session when mds do ms_handle_remote_reset"
This reverts commit 3651deb4e0b0c102adcaddce79ee4e053f033418.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-03-24 09:58:31 +05:30
Neha Ojha
2f593596e5
Merge pull request #45340 from benhanokh/disable_ncb_rotational
os/bluestore: Disable NCB functionality on rotational drives

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-03-23 14:49:23 -07:00
Radosław Zarzyński
1c6841e6fd build, crimson/osd: do not let Seastar to interfere with ELF's program headers.
For the sake of avoiding locking on the `__cxa_throw` paths, Seastar
hijacks `dl_iterate_phdr` of the dynamic linker. Unfortunately, this
has a nasty side effect: it makes impossible to catch an exception in
in a plugin (a DSO loaded via the `dlopen()` machinery).

For mote details please consult:
  * https://gist.github.com/rzarzynski/3abe9ed6b50cfa1893d34988e1628bfc,
  * `seastar/src/core/exception_hacks.cc`.

This patch deals with the problem by simply disabling the problematic
workaround which could be iatrogenic too. If that would be the case,
we can consider:

  * preloading all our Ceph Classes before reaching `smp::configure()`,
  * statically linking them.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2022-03-23 22:10:45 +01:00
Samuel Just
0859cb8ea7
Merge pull request #45551 from liu-chunmei/crimson-string-view
crimson: keep string alive during string_view lifetime

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-03-23 13:49:01 -07:00
Casey Bodley
63895ee106
Merge pull request #44696 from cbodley/wip-arrow-submodule-ext
cmake: add submodule for Apache Arrow at v6.0.1

Reviewed-by: Gal Salomon <gsalomon@redhat.com>
2022-03-23 15:43:38 -04:00
Samuel Just
e61ca97ef5
Merge pull request #45550 from liu-chunmei/crimson-fix-read-error-return
crimson: return read error code in MOSDOpReply

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-03-23 12:02:27 -07:00
Yuri Weinstein
f91885eba7
Merge pull request #45246 from aclamk/wip-bluefs-sync-compaction-fix
Fix BlueFS sync compaction

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2022-03-23 10:18:31 -07:00
Laura Flores
ea290a4025
Merge pull request #45230 from ljflores/wip-github-actions-stale
.github/workflows: replace probot-stale with equivalent github action
2022-03-23 11:37:38 -05:00
Yuri Weinstein
502ce262ff
Merge pull request #45466 from neha-ojha/wip-54592
osd/PrimaryLogPG.cc: CEPH_OSD_OP_OMAPRMKEYRANGE should mark omap dirty

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-03-23 08:45:15 -07:00
Yuri Weinstein
9e090fb02b
Merge pull request #45366 from NitzanMordhai/wip-nitzan-test-librados-watchnotify-watch2delete
tests: ceph_test_rados_api_watch_notify: watch2Delete reconnect

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2022-03-23 08:35:28 -07:00
Ilya Dryomov
85e7075d5f librbd: make diff-iterate in fast-diff mode sort and merge reported extents
Various users, the most notable example being the QEMU driver, assume
that extents are reported in image offset order.

Fixes: https://tracker.ceph.com/issues/53885
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-23 16:26:45 +01:00
Yuri Weinstein
42053fbd43
Merge pull request #45468 from idryomov/wip-pool-reverse-lookup-osdmap
librados: check latest osdmap on ENOENT in pool_reverse_lookup()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-03-23 07:45:42 -07:00
Nitzan Mordechai
07302d5e41 osd/OSD: osd_fast_shutdown_notify_mon not quite right
When osd_fast_shutdown and osd_fast_shutdown_notify_mon set as true, OSD marked as Down
it should be marked as Dead,

Fixed: https://tracker.ceph.com/issues/53327

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>

nd

nd
2022-03-23 14:37:01 +00:00
Sarthak0702
d7d5937bba mgr/dashboard: Remove padding in search highlighted text
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-03-23 19:56:50 +05:30
Ernesto Puerta
9aa5c79363
Merge pull request #45429 from votdev/issue_54591_language_dropdown
mgr/dashboard: Language dropdown box is partly hidden on login page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-03-23 12:50:41 +01:00
Jos Collin
8e0ce34ea5
Merge pull request #45577 from wxypro/mgr-stat-fix
mgr/stats: fix a typo in comment

Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-03-23 16:36:42 +05:30
Adam King
8eb1397d77
mgr/cephadm: fixing prometheus port handling
Fixes: https://tracker.ceph.com/issues/51072

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-03-23 10:27:38 +01:00
Ilya Dryomov
cb0d0fec3f
Merge pull request #44579 from asm0deuz/fix_pids_limits_bug_52898
cephadm: Remove containers pids-limit

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-23 08:44:13 +01:00
wangxinyu
1dda0aa686 mgr/stats: fix an typo in comment
fix an typo in comment

Signed-off-by: wangxinyu <wangxinyu@inspur.com>
2022-03-23 15:31:01 +08:00
Nizamudeen A
c11096e407 mgr/dashboard: extend daemon actions to host details
The daemon actions are only available in the service details section but
not on the host details. This takes care of that.

Fixes: https://tracker.ceph.com/issues/54559
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-03-23 12:04:14 +05:30
wangxinyu
8f822b6ee0 common/options: fix typos: smarctl -> smartctl
fix typos: smarctl -> smartctl

Signed-off-by: wangxinyu <wangxinyu@inspur.com>
2022-03-23 14:34:14 +08:00
Nizamudeen A
05750a975d mgr/dashboard: Hide hostname column of daemon table in host details
Fixes: https://tracker.ceph.com/issues/53355
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-03-23 12:01:17 +05:30
Chunmei Liu
e0d18b7964 crimson: keep string alive during string_view lifetime
Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
2022-03-22 22:21:24 -07:00
Chunmei Liu
07756ec06e crimson:return read error code in MOSDOpReply
Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
2022-03-22 21:52:29 -07:00
wangxinyu
d75121c14b tools/cephfs-shell: fix typos in comments
fix typos in comments

Signed-off-by: wangxinyu <wangxinyu@inspur.com>
2022-03-23 10:15:15 +08:00
Josh Durgin
fe41f0bf7d
Merge pull request #45512 from zdover23/wip-doc-2022-03-18-master-to-main
ceph/admin: s/master/main

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-03-22 16:38:40 -07:00
Adam King
1568875a28 cephadm: verify config file exists when inferring it
Fixes: https://tracker.ceph.com/issues/54571

Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 19:29:18 -04:00
Adam King
d97057f8d7 cephadm: respect --skip-firewalld flag
Fixes: https://tracker.ceph.com/issues/54137

Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 19:09:26 -04:00
Adam King
9febc21c14 mgr/cephadm: Reschedule nfs daemons from offline hosts
In order to improve nfs availability, if there are other
hosts we can place an nfs daemon on or if there is a host
with a lower rank nfs daemon when a higher rank one is on
an offline host, we should reschedule the nfs daemons

Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 18:57:21 -04:00
Adam King
73f8d0fdcd
Merge pull request #45286 from adk3798/ssh-offline
mgr/cephadm: add keep-alive requests to ssh connections

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-03-22 18:00:22 -04:00
Adam King
5301c3737c
Merge pull request #45333 from s0nea/config-fqdn
mgr/cephadm: try to get FQDN for configuration files

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2022-03-22 17:58:28 -04:00