Commit Graph

128996 Commits

Author SHA1 Message Date
Clément Péron
96a8b4d846 cmake: dpdk: only append common dir if it has been found
Signed-off-by: Clément Péron <peron.clem@gmail.com>
2022-01-13 14:40:17 +01:00
Clément Péron
c37f15f54d cmake: dpdk: use STREQUAL and not EQUAL when comparing strings
Signed-off-by: Clément Péron <peron.clem@gmail.com>
2022-01-13 14:32:34 +01:00
Clément Péron
a24a4a0563 cmake: dpdk: fix typo in HINTS when looking for DPDK
Signed-off-by: Clément Péron <peron.clem@gmail.com>
2022-01-13 14:32:30 +01:00
Venky Shankar
6028ffbad8
Merge pull request #43286 from lxbsz/improve_setattr
client: buffer the truncate if we have the Fx caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:23:27 +05:30
Venky Shankar
c1c1669527
Merge pull request #44229 from lxbsz/mds-buffix
mds: remove the duplicated or incorrect respond

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:16:13 +05:30
Venky Shankar
6b59fe1bec
Merge pull request #44397 from lxbsz/wip-53726
mds: dump tree '/' when the path is empty

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:15:24 +05:30
Venky Shankar
b52f86c8a5
Merge pull request #44422 from lxbsz/wip-51705
qa: do not use any time related suffix for *_op_timeouts

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:14:14 +05:30
Yuval Lifshitz
b709091d81
Merge pull request #43995 from TRYTOBE8TME/wip-rgw-kafka-teuth-cleanup
qa/tasks: Checking for kafka cleanup
2022-01-13 11:57:03 +02:00
Yuri Weinstein
10be79e6c4
Merge pull request #43299 from markhpc/wip-age-binning-rebase-20210923
common/PriorityCache: Updated Implementation of Cache Age Binning

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-01-12 16:54:23 -08:00
Ilya Dryomov
651f0fbc08
Merge pull request #43494 from majianpeng/enable-test-librbd-BlockGuard
test/librbd: re-enable BlockGuard test

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-12 21:50:00 +01:00
Samuel Just
39e0e7b8a3
Merge pull request #44478 from cyx1231st/wip-crimson-improve-log-3
crimson/os/seastore/../segment_manager: improve logs and validations

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2022-01-12 12:27:14 -08:00
Casey Bodley
d01ee1122f
Merge pull request #44536 from yuvalif/wip-yuval-dynamic-reshard
rgw: fix dynamic reshard happening during user stats sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-12 14:14:41 -05:00
Yuri Weinstein
a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Daniel Gryniewicz
cca74fa8dd
Merge pull request #41778 from felixhuettner/fix_subdir_name
rgw: RGWSwiftWebsiteHandler::is_web_dir checks empty subdir_name
2022-01-12 09:22:04 -05:00
Daniel Gryniewicz
be54d5f681
Merge pull request #38234 from inspur-wyq/wip-copy-obj-check-size
rgw : check the object size when copy obj
2022-01-12 09:21:48 -05:00
Daniel Gryniewicz
2645ff5ab7
Merge pull request #38532 from Rjerk/wip-empty-tagset
rgw: an empty tagset is allowed by S3
2022-01-12 09:21:35 -05:00
Daniel Gryniewicz
72e1208321
Merge pull request #40573 from Huber-ming/rgw_admin
rgw: delete abbreviation for option "--new-uid"
2022-01-12 09:21:15 -05:00
Daniel Gryniewicz
8d2b3d578f
Merge pull request #40575 from Huber-ming/rgw_admin-f
radosgw-admin: delete the abbreviation of option "--infile"
2022-01-12 09:20:49 -05:00
Ilya Dryomov
966830f651
Merge pull request #44500 from idryomov/wip-rbd-test-group-leak
test/librbd: fix group_info.name leaks in TestGroup.add_image

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-01-12 12:56:09 +01:00
Liu-Chunmei
5fe65bc92b
Merge pull request #44490 from liu-chunmei/crimson-fix-aligned
crimson: fix assert_aligned(size) in trim_data_reservation

reviewed by: Samuel Just <sjust@redhat.com> , Yingxin <yingxin.cheng@intel.com>
2022-01-11 22:05:22 -08:00
Yingxin Cheng
8aaaeea814 crimson/os/seastore/../segment_manager: add more validations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 13:43:52 +08:00
Yingxin Cheng
90ce0f046d crimson/os/seastore/../segment_manager: consolidate logs with structured level and format
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 13:43:52 +08:00
Yingxin Cheng
ecad0f8d68 crimson/os/seastore/../segment_manager: cleanup device_id usage
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 13:43:52 +08:00
Yingxin Cheng
d5b0cd1392 crimson/os/seastore/../segment_manager: pretty print data structures
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 13:43:43 +08:00
Yingxin Cheng
549036edd8 crimson/os/seastore/../segment_manager: convert to seastore logging
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 09:29:08 +08:00
Yingxin Cheng
3405661fec crimson/os/seastore/../segment_manager: suppress compile warning about unused logger
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-01-12 09:29:08 +08:00
Yingxin
f77aae9731
Merge pull request #44532 from rzarzynski/wip-crimson-fix-test-runner
test/crimson: fix a race condition in SeastarRunner

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-01-12 09:23:53 +08:00
Neha Ojha
c365b8da55
Merge pull request #43593 from ljflores/wip-rocksdb
mgr: expose rocksdb version number for use in telemetry

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-11 16:31:41 -08:00
chunmei-liu
7594b61826 crimson: fix assert_aligned(size) in trim_data_reservation
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
signed-off-by: Samuel Just <sjust@redhat.com>
2022-01-11 15:16:16 -08:00
Laura Flores
394cbf98e6 mgr/telemetry: add the rocksdb version number to telemetry
Capturing the RocksDB version number in Telemetry would allow us to check that users are using the appropriate RocksDB version for their Ceph cluster. For instance, if a user is working in a Pacific cluster, but their RocksDB version is meant for Nautilus, that might be a problem.

It is strucured as "rocksdb_stats" --> "version" in anticipation of more stats that can will be added under "rocksdb_stats".

Signed-off-by: Laura Flores <lflores@redhat.com>
2022-01-11 23:04:01 +00:00
Laura Flores
7a4e747536 mgr: expose rocksdb version number in the mgr module
It is only necessary here to link the rocksdb include directory
since the mgr simply needs access to the rocksdb version numbers.

Signed-off-by: Laura Flores <lflores@redhat.com>
Co-authored-by: Kefu Chai <tchaikov@gmail.com>
Co-authored-by: Adam Kupczyk <akupczyk@redhat.com>
2022-01-11 23:03:54 +00:00
Neha Ojha
e76e994bb2
Merge pull request #43794 from aclamk/wip-bluefs-fine-grain-locking-4
os/bluestore: BlueFS fine grain locking

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2022-01-11 13:59:16 -08:00
Mark Nelson
5635183833 common/PriorityCache: Implement Cache Age Binning
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2022-01-11 21:01:19 +00:00
Casey Bodley
de40e940c5
Merge pull request #44537 from pdvian/wip-typo-fix
rgw: Fix typo error for stat_remote_obj

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 15:50:34 -05:00
Ilya Dryomov
69ac8a4476
Merge pull request #44496 from idryomov/wip-diff-iterate-parent-fix
librbd: restore diff-iterate include_parent functionality in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-01-11 20:28:19 +01:00
Prashant D
d7eb5ed2c6 rgw: Fix typo error for stat_remote_obj
Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-11 14:00:27 -05:00
Yuval Lifshitz
0ff5a6e777 rgw: fix dynamic reshard happening during user stats sync
this is a regression caused by the following commit:
72d1a36326

to verify use the following instructions:
https://gist.github.com/yuvalif/d526c0a3a4c5b245b9e951a6c5a10517

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-01-11 20:38:26 +02:00
Ilya Dryomov
0da1f1cc31
Merge pull request #44483 from idryomov/wip-diff-iterate-offset-fix
librbd: diff-iterate reports incorrect offsets in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-01-11 18:59:12 +01:00
Yuri Weinstein
85fad22d10
Merge pull request #44355 from sseshasa/wip-fix-enhance-mclock-logging
osd:  Enhance mclockscheduler logging and formatted dump information.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-11 09:32:12 -08:00
Yuri Weinstein
ba92927fa4
Merge pull request #44482 from sebastian-philipp/nfs-upgrade-port-conflict
mgr/cephadm: nfs migration: avoid port conflicts

Reviewed-by: Adam King adking@redhat.com
2022-01-11 09:31:35 -08:00
Matt Benjamin
a04e0ab1f4
Merge pull request #36308 from linuxbox2/wip-rgwlc-bcktdel
rgwlc:  remove lc entry on bucket delete
2022-01-11 12:17:22 -05:00
Casey Bodley
81d3517bde
Merge pull request #42891 from ofriedma/wip-ofriedma-rgw-qos-finale
rgw: Add rgw rate limiting per user and per bucket

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 11:35:05 -05:00
Casey Bodley
3413886230
Merge pull request #38774 from linuxbox2/wip-doc-replsupport
rgw: document S3 bucket replication support

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 11:13:24 -05:00
Kalpesh Pandya
6135747a06 qa/tasks: Checking for kafka cleanup
Adding a sleep after running ./kafka-server-stop.sh and ./zookeeper-server-stop.sh
scripts so that nothing gets logged into the kafka logs after the sleep time.
And finally killing the process.

This resolves: https://tracker.ceph.com/issues/53220

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2022-01-11 21:14:15 +05:30
Radoslaw Zarzynski
83e25cc28f test/crimson: fix a race condition in SeastarRunner
This patch is supposed to fix the following problem:

```
        Start 234: unittest-seastar-errorator
216/258 Test #234: unittest-seastar-errorator ................Child aborted***Exception:   0.95 sec
WARNING: debug mode. Not for benchmarking or production
WARN  2022-01-11 10:01:32,973 [shard 0] seastar - Creation of perf_event based stall detector failed, falling back to posix timer: std::system_error (error system:13, perf_event_open() failed: Permission denied)
unittest-seastar-errorator: ../src/test/crimson/seastar_runner.h:45: int SeastarRunner::init(int, char **): Assertion `begin_signaled == true' failed.
Aborting.
Backtrace:
  0xb3397a
  0x1d19430
  0x1d1905d
  0x1b72332
  0x1b9dd95
  0x1c75fe9
  0x1c76231
  0x1c7605a
  0x7f20b7aee3bf
  /lib/x86_64-linux-gnu/libc.so.6+0x4618a
  /lib/x86_64-linux-gnu/libc.so.6+0x25858
  /lib/x86_64-linux-gnu/libc.so.6+0x25728
  /lib/x86_64-linux-gnu/libc.so.6+0x36f35
  0xc8bb88
  0xc7ec71
  /lib/x86_64-linux-gnu/libc.so.6+0x270b2
  0xafc95d
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-01-11 13:04:02 +00:00
Ernesto Puerta
310e8f5571
Merge pull request #43404 from rhcs-dashboard/angular-12-upgradee
mgr/dashboard: Update Angular version to 12 

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2022-01-11 13:02:07 +01:00
Ernesto Puerta
f5237e8b4a
Merge pull request #44088 from ceph/feature-48388-cache
mgr: TTL cache implementation

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
2022-01-11 12:52:41 +01:00
Ernesto Puerta
978d5829f2
Merge pull request #44294 from rhcs-dashboard/feature-bluestore-onode
mgr/dashboard: monitoring:Implement BlueStore onode hit/miss counters into the dashboard

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-11 11:24:21 +01:00
Venky Shankar
8059673f81
Merge pull request #44456 from jtlayton/wip-53765
mount.ceph: fix the handling of new-syntax device names

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-11 14:39:16 +05:30
Sridhar Seshasayee
a875a76b8d osd: Display scheduler specific info when dumping an OpSchedulerItem
Implement logic to dump information relevant to the scheduler type being
employed when dumping details about an OpSchedulerItem. For e.g., the
'priority' field is relevant for the 'wpq' scheduler, but for the
'mclock_scheduler', the 'qos_cost' gives more information during debugging.

A couple of additional fields called 'qos_cost' and 'is_qos_request' are
introduced in OpSchedulerItem class. These are mainly used to facilitate
dumping of relevant information depending on the scheduler type. The
interesting points are when an item is enqueued and dequeued.

For the 'mclock_scheduler', the 'class_id' and the 'qos_cost' fields are
dumped during enqueue and dequeue op respectively. For the 'wpq' scheduler
things remain the same as before.

An additional benefit of this change is to help immediately identify the
type of scheduler being used for a given shard depending on what is dumped
in the debug messages while debugging.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-01-11 10:00:14 +05:30