Commit Graph

128072 Commits

Author SHA1 Message Date
Ronen Friedman
20dd022715 qa/standalone: osd-scrub-repair.sh: fix expected "not scrubbed since" warnings count
Following PR#43244, the 'ceph tell pg deep_scrub' now sets both
deep-scrub and "regular" scrub time-stamps. This necessitated a modification
to TEST_scrub_warning, as more PGs in this test are late for their regular scrubbing.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-23 16:43:21 +00:00
Ronen Friedman
f600acbba1
Merge pull request #43244 from ronen-fr/wip-rf-scrub-command
osd: make 'pg deep-scrub' command initiate a scrub

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-23 15:19:33 +02:00
Venky Shankar
c152264b31
Merge pull request #43722 from lxbsz/caps_doc
doc: update the capabilities doc for cephfs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-23 18:17:22 +05:30
Guillaume Abrioux
b93262f2e1
Merge pull request #43982 from guits/refactor_cv_human_readable_func
ceph-volume: human_readable_size() refactor
2021-11-23 06:12:22 +01:00
Kefu Chai
292b9a3ce2
Merge pull request #44007 from tchaikov/wip-cmake-python3.10
cmake: check for python(\d)\.(\d+) when building boost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-23 10:59:54 +08:00
Ernesto Puerta
60171326fa
Merge pull request #43992 from rhcs-dashboard/flaky-inventory-test-fix
mgr/dashboard: fix flaky inventory e2e test

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-22 20:39:50 +01:00
Ernesto Puerta
7a5c906c9a
Merge pull request #43958 from rhcs-dashboard/daemon-event-padding
mgr/dashboard: Daemon Events listing using bootstrap class

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-11-22 19:43:11 +01:00
Ernesto Puerta
b81e9ecfeb
Merge pull request #43866 from rhcs-dashboard/add-hint-provisioned-images
mgr/dashboard: provisioned values is misleading in RBD image table

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-11-22 19:41:04 +01:00
Casey Bodley
1f8bdd2ddf
Merge pull request #43843 from cbodley/wip-test-cls-rgw-stats
test/cls/rgw: add index transaction simulator to model bucket stats

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-22 10:59:39 -05:00
Sebastian Wagner
d5c652f07c
Merge pull request #43888 from mgfritch/cephadm-expect-hostname
cephadm: fixup expect-hostname message

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-22 12:00:20 +01:00
Sebastian Wagner
548f9e1930
Merge pull request #43873 from guits/add_shared_folder_shell_cmd
cephadm: add --shared_ceph_folder to shell cmd

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-22 11:59:19 +01:00
Sebastian Wagner
84f88eaec4
Merge pull request #43876 from sebastian-philipp/all-osd-at-once
mgr/cephadm: create osds at all hosts at once

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-11-22 11:27:13 +01:00
Ernesto Puerta
2e1c4e590a
Merge pull request #44033 from ljflores/wip-update-email-id
mailmap: add Laura Flores

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: neha-ojha <NOT@FOUND>
2021-11-22 09:14:07 +01:00
Samuel Just
070e54178a
Merge pull request #43795 from myoungwon/wip-paddr-split
seastore: generalize paddr_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-21 22:17:04 -08:00
Nizamudeen A
cdce5f78ad mgr/dashboard: fix flaky inventory e2e test
When `inventory.getTableCount('total').should('be.eq', totalDiskCount);`
this line is executed the table was not loaded properly and hence the
getTableCount returns 0 on the first try but on second try it passes
since the table is loaded. But in orch e2es the retries are set to 0. I
am not sure if it makes sense to set it to 1. Anyway I am adapting the
test a bit to expect the count to be equal to totalDiskCount so that the
test will wait a bit.

Fixes: https://tracker.ceph.com/issues/53353
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-11-22 11:12:32 +05:30
Deepika Upadhyay
5b1eae6953
Merge pull request #43524 from Rethan/feat-expiration-time
rbd: when trash mv, show expiration time if it's not now

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-11-22 06:52:31 +05:30
Deepika Upadhyay
048c8e6f4a
Merge pull request #43852 from hualongfeng/show_feature
tools/rbd: make rbd info display dirty-cache feature

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-11-22 06:51:51 +05:30
Deepika Upadhyay
17f4da9df2
Merge pull request #43907 from cybozu/rbd-correct-encoding-of-snap-protection-record-in-exporting
rbd: correct encoding of snap protection record in exporting image

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
2021-11-21 22:33:41 +05:30
myoungwon oh
1601345824 seastore: generalize paddr_t
Due to necessity to support both segment and rbm addrs,
paddr_t needs to be generlized.
To do so, this commits introduces seg_paddr_t---
seg_paddr_t inherits paddr_t, and deals with common_addr
according to the semantic of segment.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-11-20 10:11:57 +09:00
Neha Ojha
0f9ed11e67
Merge pull request #43999 from kamoltat/wip-autoscale-profile-scale-up-default
pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-19 16:55:43 -08:00
Patrick Donnelly
860518bcb6
Merge PR #43974 into master
* refs/pull/43974/head:
	qa: disable metrics on kernel client during upgrade

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-11-19 18:43:48 -05:00
Laura Flores
41b44abfe6 mailmap: add Laura Flores
Signed-off-by: Laura Flores <lflores@redhat.com>
2021-11-19 23:22:16 +00:00
Ernesto Puerta
515af762bb
Merge pull request #43987 from rhcs-dashboard/53123-dashboard-nfs-cleanup
mgr/dashboard: NFS non-existent files cleanup

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-19 20:40:41 +01:00
Ernesto Puerta
d67302fcf4
Merge pull request #43983 from rhcs-dashboard/rgw-add-realm-column
mgr/dashboard: rgw daemon list: add realm column

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
2021-11-19 20:14:19 +01:00
J. Eric Ivancich
08adeae354
Merge pull request #43824 from cbodley/wip-qa-rgw-upgrade-octopus-multisite-cv
qa/upgrade: rgw multisite upgrade test excludes ceph-volume

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-19 14:11:39 -05:00
Deepika Upadhyay
742e6cbd5f
Merge pull request #43764 from gregsfortytwo/wip-rbd-crash-consistency
doc: fix up rbd snapshot docs around crash consistency

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-11-20 00:29:16 +05:30
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
5c2210d9e7 test/rgw: model multipart uploads in ceph_test_cls_rgw_stats
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
b3f1c52896 test/rgw: add ceph_test_cls_rgw_stats simulator
a simulator that generates lots of create/delete operations against a
set of object names, and tracks the expected bucket stats for comparison

each operation has a 70% chance to complete successfully, a 10% chance to
cancel, 10% chance to suggest update, and 10% chance to suggest removal

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:33 -05:00
Casey Bodley
c81f2fedf2 cls/rgw: add some missing equality comparisons
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:40:57 -05:00
Casey Bodley
3c0621b6ca cls/rgw: RGWObjCategory to string
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:40:55 -05:00
Casey Bodley
6d445a8ed7 cls/rgw: RGWModifyOp <-> string conversions
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
ca2d1b37d9 cls/rgw: move stream operator from rgw_common.h
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
a69389aa2a cls/rgw: input parameters are const
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Casey Bodley
b5b006843a cls/rgw: add rgw_bucket_dir_stats alias
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 11:07:46 -05:00
Igor Fedotov
32be8d7873
Merge pull request #41557 from ifed01/wip-ifed-better-daemonperf
os/bluestore: improve usability for bluestore/bluefs perf counters

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
Reviewed-by: Laura Flores lflores@redhat.com
2021-11-19 18:48:52 +03:00
Venky Shankar
93054a3fa9
Merge pull request #43886 from nmshelke/doc-fix-53054
doc: prerequisites fix for cephFS mount

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-19 10:10:59 +05:30
Samuel Just
32eb463c94
Merge pull request #44008 from rzarzynski/wip-crimson-leaky-objectcontextregistry
crimson/osd: fix leaks of ObjectContext in the registry.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-11-18 17:36:30 -08:00
Neha Ojha
e76a9f4045
Merge pull request #43326 from pdvian/wip-doc-config-correction
doc/dev/config: Replace invalid config debug-pg

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 17:03:11 -08:00
Liu-Chunmei
ef9adc6959
Merge pull request #43980 from liu-chunmei/crimson-peerevent-nested
crimson: add delay for peering_event start when nested

reviewed-by : Samuel Just <sjust@redhat.com>, 
                       Kefu Chai <tchaikov@gmail.com>, 
                       Xuehan Xu <xxhdx1985126@gmail.com>,
                       Radoslaw Zarzynski <rzarzyns@redhat.com>.
2021-11-18 15:04:34 -08:00
Radoslaw Zarzynski
9ae3774bac crimson/osd: fix leaks of ObjectContext in the registry.
The patch is supposed to fix the following problems (extra
debugs onboard):

```
NFO  2021-11-16 01:18:38,713 [shard 0] osd - ~OSD: OSD dtor called
INFO  2021-11-16 01:18:38,713 [shard 0] osd - Heartbeat::Peer: osd.6 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - Heartbeat::Peer: osd.5 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - Heartbeat::Peer: osd.2 removed
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ShardServices: ShardServices dtor called
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: ShardServices dtor called; unref_size=3, size=3
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000115380
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000114980
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: unreferenced p=0x619000112680
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000114980
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000115380
INFO  2021-11-16 01:18:38,714 [shard 0] osd - ~ObjectContextRegistry: set p=0x619000112680
INFO  2021-11-16 01:18:38,738 [shard 0] osd - crimson shutdown complete

=================================================================
==33351==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 2808 byte(s) in 3 object(s) allocated from:
    #0 0x7fe10c0327b0 in operator new(unsigned long) (/lib64/libasan.so.5+0xf17b0)
    #1 0x55accbe8ffc4 in ceph::common::intrusive_lru<ceph::common::intrusive_lru_config<hobject_t, crimson::osd::ObjectContext, crimson::osd::obc_to_hoid<crimson::osd::ObjectContext> > >::get_or_create(hobject_t const&) (/usr/bin/ceph-osd+0x3b000fc4)

Objects leaked above:
0x619000112680 (936 bytes)
0x619000114980 (936 bytes)
0x619000115380 (936 bytes)
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-11-18 17:40:52 +00:00
Kefu Chai
66b1e8cecd cmake: check for python(\d)\.(\d+) when building boost
now that python3.10 has two digits as its minor version, we should be
able to match it.

this change fixes the build with python3.10. without this change, we'd
have

error: wrong library name 'python310' in the --with-<library> option.

when building with python3.10

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2021-11-19 00:27:34 +08:00
Sebastian Wagner
2048eaac80
mgr/cephadm: use asyncio.gather to parallelize things
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:19:42 +01:00
Sebastian Wagner
b97894f4cd
mgr/cephadm: make OSDService.create_from_spec_one async
And gather all results. Plus a lot of mechanical adjustments

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:19:42 +01:00
Sebastian Wagner
9cce01a8db
mgr/cephadm: Add CephadmOrchestrator.wait_async()
less typing

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-18 16:16:09 +01:00
Casey Bodley
e3f0fc7f7f
Merge pull request #43409 from linuxbox2/wip-rgwadmin-logtest
qa/rgw: use local runner with cmdline radosgw_admin.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 10:06:56 -05:00
Casey Bodley
483b1b7487
Merge pull request #35100 from soumyakoduri/cloudtiering
rgw/CloudTransition: Transition objects to cloud endpoint

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 09:27:46 -05:00
Ronen Friedman
df658feae2
Merge pull request #42780 from ronen-fr/wip-ronenf-unique-scrub
osd/scrub: mark PG as being scrubbed, from scrub initiation to Inactive state

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 16:08:07 +02:00