Commit Graph

130723 Commits

Author SHA1 Message Date
Rishabh Dave
d3b9543624 qa/cephfs: print cmd debug info when it fails
Print return code, stdout and stderr for the command that launches
xfstests-dev tests against CephFS when it fails.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:44:37 +05:30
Rishabh Dave
09d5e07d16 qa/cephfs: use StringIO instead of BytesIO
StringIO can be operated on without extra hassles of converting. So
replace BytesIO by StringIO in test_acls.py and xfstests_dev.py

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Rishabh Dave
1423f959e8 qa/cephfs: set omit_sudo to False in test_acls.py
When running "sudo ./check generic/099" in test_acls.py's test method
named test_acls(), set omit_sudo to False because without it
vstart_runner.py will remove "sudo" from command arguments and so the
command will fail unnecessarily.

Fixes: https://tracker.ceph.com/issues/55374
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Rishabh Dave
b60b73c0fe qa/cephfs: just import getLogger instead of whole module
Import just the necessary object instead of importing entire module.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Samuel Just
7abc382bfb
Merge pull request #46012 from liu-chunmei/crimson-osd_op.rval
crimson/osd: still need set error code value in osd_op.rval

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-04-26 16:22:38 -07:00
Adam King
11fde3303c
Merge pull request #45598 from rkachach/fix_issue_55008
mgr/cephadm: Adding image tag and date to cephadm startup messages

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-04-26 15:48:03 -04:00
Adam King
b16ff1b0a0
Merge pull request #45855 from rkachach/fix_issue_55265
mgr/cephadm: fixing call method timeout handling

Reviewed-by: Adam King <adking@redhat.com>
2022-04-26 15:11:34 -04:00
Adam King
0b7ed08d80
Merge pull request #45877 from rkachach/fix_issue_55185
mgr/cephadm: Adding support to store ceph conf per cluster fsid

Reviewed-by: Adam King <adking@redhat.com>
2022-04-26 15:10:26 -04:00
Adam King
9268e32047
Merge pull request #45899 from rkachach/fix_issue_53527
mgr/cephadm: fixing upgrade candidate versions listing

Reviewed-by: Adam King <adking@redhat.com>
2022-04-26 15:09:37 -04:00
Daniel Gryniewicz
c60a9c77ea
Merge pull request #45623 from dang/wip-dang-zipper-objctx
RGW: Zipper - zonegroup, placement tier

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-04-26 14:03:11 -04:00
Neha Ojha
cf78cf4980
Merge pull request #46010 from gregsfortytwo/wip-55419-blocklist-test
test: Fix a blocklist API test

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-04-26 10:59:07 -07:00
Venky Shankar
76b33670b5
Merge pull request #44958 from rishabh-d-dave/qa-cephfs-timeout
qa/cephfs: change default timeout from 900 secs to 300

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-26 22:30:43 +05:30
Casey Bodley
7bc93fcae7
Merge pull request #45737 from cbodley/wip-rgw-ops-log-defaults
rgw: change default ops log backend from rados to file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-04-26 12:43:44 -04:00
Casey Bodley
197e9ea347
Merge pull request #46007 from cbodley/wip-49302
rgw: RGWCoroutine::set_sleeping() checks for null stack

Reviewed-by: Or Friedmann <ofriedma@redhat.com>
2022-04-26 12:25:36 -04:00
Casey Bodley
bab8b96a7a
Merge pull request #46027 from cbodley/wip-55432
rgw: OpsLogFile::stop() signals under mutex

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-04-26 12:24:35 -04:00
Casey Bodley
ece51d5a6a
Merge pull request #45784 from cbodley/wip-rgw-multisite-configurables
rgw multisite: configurable polling intervals and concurrency windows

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-04-26 12:22:43 -04:00
Rishabh Dave
ac5de474cf qa/cephfs: change default timeout from 900 secs to 300
15 minutes is unnecessarily large as a default value for timeout for a
command. Not having to wait unnecessarily on a crash of a command will
reduce teuthology's testing queue and will save individual developer's
time while running tests locally.

Whatever lines are modified for this purpose are also modified to follow
the stlye guideline, specfically wrapping at 80 characters.

Fixes: https://tracker.ceph.com/issues/54236
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-26 18:34:42 +05:30
Ernesto Puerta
5ba7d8520d
Merge pull request #45830 from rhcs-dashboard/cephadm-logs-save
mgr/dashboard: save mgr logs inside a folder 

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-04-26 12:50:43 +02:00
Venky Shankar
210bae76a4
Merge pull request #45370 from lxbsz/wip-54411
client: add option to disable collecting and sending metrics

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-26 09:55:04 +05:30
chunmei-liu
b7401f1959 crimson/osd: still need set error code value in osd_op.rval
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-04-25 19:43:24 -07:00
Yuri Weinstein
f6d1cb6e30
Merge pull request #45904 from cfsnyder/fix_rocksdb_iter_perf
os/bluestore: set upper and lower bounds on rocksdb omap iterators

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2022-04-25 15:58:45 -07:00
Neha Ojha
11bf4e8adc
Merge pull request #46028 from ceph/revert-43413-bluestore-bufferbloat-mitigation
Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation"

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-04-25 15:07:38 -07:00
Casey Bodley
5473ae7527 rgw: OpsLogFile drops lock before flush()
flush() acquires the same lock, so lockdep complains about recursive
locking here

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-25 16:32:36 -04:00
Or Friedmann
3f0f831d66 rgw: RGWCoroutine::set_sleeping() checks for null stack
users of the RGWOmapAppend coroutine don't manage the lifetime of its
underlying coroutine stack, so end up making calls on RGWOmapAppend
after its stack goes away. this null check is a band-aid, and there are
still several other calls in RGWCoroutine that don't check for null
stack

Fixes: https://tracker.ceph.com/issues/49302

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-25 16:18:26 -04:00
Samuel Just
f6a9ee72d7 bluestore: Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation"
Merge caused: https://tracker.ceph.com/issues/55433

Signed-off-by: Samuel Just <sjust@redhat.com>
2022-04-25 12:33:45 -07:00
Casey Bodley
a9cb584d3f
Merge pull request #44989 from Ejdesgaard/patch-1
radosgw-admin zone deletion uses zone delete

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-04-25 14:26:08 -04:00
Casey Bodley
279d664f8b rgw: remove unnecessary OpsLogFile::flush_mutex
this mutex was only held by one function, OpsLogFile::flush(). this
private member function is only ever called from the background thread,
so doesn't need to be protected by a mutex

as a further cleanup, i renamed 'cond' and 'mutex' now that we don't
need to differentiate between different locks

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-25 14:12:53 -04:00
Casey Bodley
cf6f99e67a rgw: OpsLogFile::stop() signals under mutex
this shuts up ceph::debug_condition_variable's assertion that the
associated mutex is held during notify_one(). this is not strictly
required for correct use, but is a common source of bugs

Fixes: https://tracker.ceph.com/issues/55432

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-25 14:12:53 -04:00
Venky Shankar
132d0cb79f
Merge pull request #45407 from vshankar/wip-54046
mds: include encoded stray inode when sending dentry unlink message to replicas

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-25 19:48:57 +05:30
Venky Shankar
fbbe1126da
Merge pull request #45243 from lxbsz/mdslog_bz
mds: flush mdlog if locked and still has wanted caps not satisfied 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-25 17:56:27 +05:30
Venky Shankar
09704afe8c
Merge pull request #45307 from lxbsz/wip54461
mds: notify clients if the session has already opened

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-25 17:54:06 +05:30
Ilya Dryomov
29941e306f
Merge pull request #45887 from bluikko/patch-3
doc: replace spaces with underscores in config option names

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-23 10:53:31 +02:00
Ville Ojamo
fb5981efb8 doc: remove spaces at line ends and doubles, fix wrapping
Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-04-23 09:35:28 +02:00
Ville Ojamo
98ac8e1130 doc: replace spaces with underscores in config option names
Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-04-23 09:35:27 +02:00
Yingxin
ae34743e09
Merge pull request #45948 from cyx1231st/wip-seastore-cleaner-work
crimson/os/seastore/segment_cleaner: cleanup segment_info_set_t

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-04-23 12:07:09 +08:00
Greg Farnum
63db714890 test: use the same address input format as output will generate
Otherwise, our grep fails!

Fixes: https://tracker.ceph.com/issues/55419

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2022-04-23 00:00:59 +00:00
Samuel Just
78ffeb71a0
Merge pull request #43413 from esmaeil-mirvakili/bluestore-bufferbloat-mitigation
os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-04-22 14:37:04 -07:00
Redouane Kachach
55d42d0c31
mgr/cephadm: fixing call method timeout handling
Fixes: https://tracker.ceph.com/issues/55265

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 17:11:39 +02:00
Redouane Kachach
2ea76173a1
mgr/cephadm: Adding support to store ceph conf per cluster fsid
Fixes: https://tracker.ceph.com/issues/55185

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 16:48:48 +02:00
Redouane Kachach
671442c4b4
mgr/cephadm: fixing upgrade candidate verions listing
Fixes: https://tracker.ceph.com/issues/53527

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 15:54:57 +02:00
Redouane Kachach
6e7c048838
mgr/cephadm: Using '.ID' instead of '.Id' which is only supported by podman
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 15:53:34 +02:00
Adam King
5720cca2f8
Merge pull request #45920 from adk3798/stop-mgr-nfs-upgrade-fail
qa/suites/orch/cephadm: stop upgrade tests if failures are seen

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 09:28:35 -04:00
Adam King
413df90429
Merge pull request #45931 from rkachach/fix_issue_51671
mgr/cephadm: fixing logging output for rm-cluster operation

Reviewed-by: Adam King <adking@redhat.com>
2022-04-22 09:27:47 -04:00
Adam King
e7aac1334f
Merge pull request #45982 from rkachach/fix_issue_52727
mgr/cephadm: do not add _admin label when no-minimize-config is provided

Reviewed-by: Adam King <adking@redhat.com>
2022-04-22 09:23:31 -04:00
Ernesto Puerta
0a39731332
Merge pull request #45934 from ceph/fix-github_triage-master
.github/pr-triage: reorder milestone step

Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-04-22 14:02:24 +02:00
Venky Shankar
a8bcefc60f
Merge pull request #45631 from Rethan/feat-mds-slow-ops
mds: add a perf counter to record slow replies

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-22 17:26:52 +05:30
Kefu Chai
8e7f49c256
Merge pull request #45978 from tchaikov/wip-cmake-python3-exact
cmake/modules: use exact version of python3 when finding cython

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-04-22 07:10:02 +08:00
Cory Snyder
55ef16f6cc kv/RocksDBStore: simplify RocksDBStore::get_cf_handle(string, IteratorBounds)
Adds a precondition to RocksDBStore::get_cf_handle(string, IteratorBounds)
to avoid duplicating logic of the only caller (RocksDBStore::get_iterator).
Assertions will fail if preconditions are not met.

Signed-off-by: Cory Snyder <csnyder@iland.com>
2022-04-21 15:56:09 -04:00
Cory Snyder
ca3ccd9559 bluestore: add config option to allow rocksdb iterator bounds to be disabled
Add osd_rocksdb_iterator_bounds_enabled config option to allow rocksdb iterator bounds to be disabled.
Also includes minor refactoring to shorten code associated with IteratorBounds initialization in bluestore.

Signed-off-by: Cory Snyder <csnyder@iland.com>
2022-04-21 13:28:09 -04:00
Gregory Farnum
6536d0c1af
Merge pull request #44151 from gregsfortytwo/wip-cidr-blocklist
Implement CIDR blocklisting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-04-21 08:31:16 -07:00