Commit Graph

128065 Commits

Author SHA1 Message Date
Patrick Donnelly
402919cbe6
mds: test connections to bootstrapping MDS
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-23 09:23:09 -05:00
Patrick Donnelly
8dc54deed9
mds: correct whitespace
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-23 09:21:34 -05:00
Ernesto Puerta
60171326fa
Merge pull request #43992 from rhcs-dashboard/flaky-inventory-test-fix
mgr/dashboard: fix flaky inventory e2e test

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-22 20:39:50 +01:00
Ernesto Puerta
7a5c906c9a
Merge pull request #43958 from rhcs-dashboard/daemon-event-padding
mgr/dashboard: Daemon Events listing using bootstrap class

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-11-22 19:43:11 +01:00
Ernesto Puerta
b81e9ecfeb
Merge pull request #43866 from rhcs-dashboard/add-hint-provisioned-images
mgr/dashboard: provisioned values is misleading in RBD image table

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-11-22 19:41:04 +01:00
Casey Bodley
1f8bdd2ddf
Merge pull request #43843 from cbodley/wip-test-cls-rgw-stats
test/cls/rgw: add index transaction simulator to model bucket stats

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-22 10:59:39 -05:00
Sebastian Wagner
d5c652f07c
Merge pull request #43888 from mgfritch/cephadm-expect-hostname
cephadm: fixup expect-hostname message

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-22 12:00:20 +01:00
Sebastian Wagner
548f9e1930
Merge pull request #43873 from guits/add_shared_folder_shell_cmd
cephadm: add --shared_ceph_folder to shell cmd

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-22 11:59:19 +01:00
Sebastian Wagner
84f88eaec4
Merge pull request #43876 from sebastian-philipp/all-osd-at-once
mgr/cephadm: create osds at all hosts at once

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-11-22 11:27:13 +01:00
Ernesto Puerta
2e1c4e590a
Merge pull request #44033 from ljflores/wip-update-email-id
mailmap: add Laura Flores

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: neha-ojha <NOT@FOUND>
2021-11-22 09:14:07 +01:00
Samuel Just
070e54178a
Merge pull request #43795 from myoungwon/wip-paddr-split
seastore: generalize paddr_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-21 22:17:04 -08:00
Nizamudeen A
cdce5f78ad mgr/dashboard: fix flaky inventory e2e test
When `inventory.getTableCount('total').should('be.eq', totalDiskCount);`
this line is executed the table was not loaded properly and hence the
getTableCount returns 0 on the first try but on second try it passes
since the table is loaded. But in orch e2es the retries are set to 0. I
am not sure if it makes sense to set it to 1. Anyway I am adapting the
test a bit to expect the count to be equal to totalDiskCount so that the
test will wait a bit.

Fixes: https://tracker.ceph.com/issues/53353
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-11-22 11:12:32 +05:30
Deepika Upadhyay
5b1eae6953
Merge pull request #43524 from Rethan/feat-expiration-time
rbd: when trash mv, show expiration time if it's not now

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-11-22 06:52:31 +05:30
Deepika Upadhyay
048c8e6f4a
Merge pull request #43852 from hualongfeng/show_feature
tools/rbd: make rbd info display dirty-cache feature

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-11-22 06:51:51 +05:30
Deepika Upadhyay
17f4da9df2
Merge pull request #43907 from cybozu/rbd-correct-encoding-of-snap-protection-record-in-exporting
rbd: correct encoding of snap protection record in exporting image

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
2021-11-21 22:33:41 +05:30
myoungwon oh
1601345824 seastore: generalize paddr_t
Due to necessity to support both segment and rbm addrs,
paddr_t needs to be generlized.
To do so, this commits introduces seg_paddr_t---
seg_paddr_t inherits paddr_t, and deals with common_addr
according to the semantic of segment.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-11-20 10:11:57 +09:00
Neha Ojha
0f9ed11e67
Merge pull request #43999 from kamoltat/wip-autoscale-profile-scale-up-default
pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-19 16:55:43 -08:00
Patrick Donnelly
860518bcb6
Merge PR #43974 into master
* refs/pull/43974/head:
	qa: disable metrics on kernel client during upgrade

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-11-19 18:43:48 -05:00
Laura Flores
41b44abfe6 mailmap: add Laura Flores
Signed-off-by: Laura Flores <lflores@redhat.com>
2021-11-19 23:22:16 +00:00
Ernesto Puerta
515af762bb
Merge pull request #43987 from rhcs-dashboard/53123-dashboard-nfs-cleanup
mgr/dashboard: NFS non-existent files cleanup

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-19 20:40:41 +01:00
Ernesto Puerta
d67302fcf4
Merge pull request #43983 from rhcs-dashboard/rgw-add-realm-column
mgr/dashboard: rgw daemon list: add realm column

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
2021-11-19 20:14:19 +01:00
J. Eric Ivancich
08adeae354
Merge pull request #43824 from cbodley/wip-qa-rgw-upgrade-octopus-multisite-cv
qa/upgrade: rgw multisite upgrade test excludes ceph-volume

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-19 14:11:39 -05:00
Deepika Upadhyay
742e6cbd5f
Merge pull request #43764 from gregsfortytwo/wip-rbd-crash-consistency
doc: fix up rbd snapshot docs around crash consistency

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-11-20 00:29:16 +05:30
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
5c2210d9e7 test/rgw: model multipart uploads in ceph_test_cls_rgw_stats
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
b3f1c52896 test/rgw: add ceph_test_cls_rgw_stats simulator
a simulator that generates lots of create/delete operations against a
set of object names, and tracks the expected bucket stats for comparison

each operation has a 70% chance to complete successfully, a 10% chance to
cancel, 10% chance to suggest update, and 10% chance to suggest removal

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:33 -05:00
Casey Bodley
c81f2fedf2 cls/rgw: add some missing equality comparisons
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:40:57 -05:00
Casey Bodley
3c0621b6ca cls/rgw: RGWObjCategory to string
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:40:55 -05:00
Casey Bodley
6d445a8ed7 cls/rgw: RGWModifyOp <-> string conversions
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
ca2d1b37d9 cls/rgw: move stream operator from rgw_common.h
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
a69389aa2a cls/rgw: input parameters are const
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
b5b006843a cls/rgw: add rgw_bucket_dir_stats alias
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Igor Fedotov
32be8d7873
Merge pull request #41557 from ifed01/wip-ifed-better-daemonperf
os/bluestore: improve usability for bluestore/bluefs perf counters

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
Reviewed-by: Laura Flores lflores@redhat.com
2021-11-19 18:48:52 +03:00
Venky Shankar
93054a3fa9
Merge pull request #43886 from nmshelke/doc-fix-53054
doc: prerequisites fix for cephFS mount

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-19 10:10:59 +05:30
Samuel Just
32eb463c94
Merge pull request #44008 from rzarzynski/wip-crimson-leaky-objectcontextregistry
crimson/osd: fix leaks of ObjectContext in the registry.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-11-18 17:36:30 -08:00
Neha Ojha
e76a9f4045
Merge pull request #43326 from pdvian/wip-doc-config-correction
doc/dev/config: Replace invalid config debug-pg

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 17:03:11 -08:00
Liu-Chunmei
ef9adc6959
Merge pull request #43980 from liu-chunmei/crimson-peerevent-nested
crimson: add delay for peering_event start when nested

reviewed-by : Samuel Just <sjust@redhat.com>, 
                       Kefu Chai <tchaikov@gmail.com>, 
                       Xuehan Xu <xxhdx1985126@gmail.com>,
                       Radoslaw Zarzynski <rzarzyns@redhat.com>.
2021-11-18 15:04:34 -08:00
Radoslaw Zarzynski
9ae3774bac crimson/osd: fix leaks of ObjectContext in the registry.
The patch is supposed to fix the following problems (extra
debugs onboard):

```
NFO  2021-11-16 01:18:38,713 [shard 0] osd - ~OSD: OSD dtor called
INFO  2021-11-16 01:18:38,713 [shard 0] osd - Heartbeat::Peer: osd.6 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - Heartbeat::Peer: osd.5 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - Heartbeat::Peer: osd.2 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ShardServices: ShardServices dtor called
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: ShardServices dtor called; unref_size=3, size=3
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000115380
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000114980
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000112680
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000114980
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000115380
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000112680
INFO  2021-11-16 01:18:38,738 [shard 0] osd - crimson shutdown complete

=================================================================
==33351==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 2808 byte(s) in 3 object(s) allocated from:
    #0 0x7fe10c0327b0 in operator new(unsigned long) (/lib64/libasan.so.5+0xf17b0)
    #1 0x55accbe8ffc4 in ceph::common::intrusive_lru<ceph::common::intrusive_lru_config<hobject_t, crimson::osd::ObjectContext, crimson::osd::obc_to_hoid<crimson::osd::ObjectContext> > >::get_or_create(hobject_t const&) (/usr/bin/ceph-osd+0x3b000fc4)

Objects leaked above:
0x619000112680 (936 bytes)
0x619000114980 (936 bytes)
0x619000115380 (936 bytes)
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-11-18 17:40:52 +00:00
Sebastian Wagner
2048eaac80
mgr/cephadm: use asyncio.gather to parallelize things
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:19:42 +01:00
Sebastian Wagner
b97894f4cd
mgr/cephadm: make OSDService.create_from_spec_one async
And gather all results. Plus a lot of mechanical adjustments

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:19:42 +01:00
Sebastian Wagner
9cce01a8db
mgr/cephadm: Add CephadmOrchestrator.wait_async()
less typing

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:16:09 +01:00
Casey Bodley
e3f0fc7f7f
Merge pull request #43409 from linuxbox2/wip-rgwadmin-logtest
qa/rgw: use local runner with cmdline radosgw_admin.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 10:06:56 -05:00
Casey Bodley
483b1b7487
Merge pull request #35100 from soumyakoduri/cloudtiering
rgw/CloudTransition: Transition objects to cloud endpoint

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 09:27:46 -05:00
Ronen Friedman
df658feae2
Merge pull request #42780 from ronen-fr/wip-ronenf-unique-scrub
osd/scrub: mark PG as being scrubbed, from scrub initiation to Inactive state

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 16:08:07 +02:00
Sage Weil
1d1cd65cb9 Merge PR #43880 into master
* refs/pull/43880/head:
	mgr/cephadm: turn off asyncssh debug output

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 08:35:41 -05:00
zdover23
bf1ba269e0
Merge pull request #43093 from zdover23/wip-doc-2021-09-09-rados-bootstrap-options-2
doc/rados: update mon_host & friends options

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 22:54:58 +10:00
Nizamudeen A
1bad306efd mgr/dashboard: Daemon Events listing using bootstrap class
Fixes: https://tracker.ceph.com/issues/53282
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-11-18 17:29:57 +05:30
Sebastian Wagner
fa37ef0f32
Merge pull request #43969 from sebastian-philipp/core
doc/cephadm: core dumps

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-11-18 10:52:36 +01:00