Commit Graph

124397 Commits

Author SHA1 Message Date
Kefu Chai
abce58d203 pybind/ceph_argparse: add more type annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 10:18:47 +08:00
Kefu Chai
41a4167db0 pybind/ceph_argparse: do not set self.typeargs in ctor of CephArgtype
self.typeargs is never referenced, so let's just drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-27 15:04:42 +08:00
Kefu Chai
8533dbe4f9
Merge pull request #41977 from rzarzynski/wip-crimson-common-print-more-on-crash
crimson/common: dump more on faults

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-26 09:08:34 +08:00
Ernesto Puerta
62e3a5c41c
Merge pull request #41838 from p-se/grafana-clean-up
monitoring: Clean up Grafana dashboards

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: jan--f <NOT@FOUND>
Reviewed-by: p-se <NOT@FOUND>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
2021-06-25 20:45:28 +02:00
Ernesto Puerta
26df5df247
Merge pull request #41721 from aaryanporwal/telemetry-ident-fix
mgr/dashboard: telemetry activate: show ident fields when checked

Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-06-25 18:48:34 +02:00
Daniel Gryniewicz
806480eaa0
Merge pull request #41991 from dang/wip-dang-bucket-delete
RGW - Bucket Remove Op: Pass in user

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-06-25 12:00:37 -04:00
Neha Ojha
4b6619a41d
Merge pull request #41993 from ronen-fr/wip-ronenf-50346
osd/scrub: replace a ceph_assert() with a test

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-06-25 08:48:45 -07:00
Kefu Chai
82b78ab27e
Merge pull request #42024 from rzarzynski/wip-crimson-load_obc_nocpy
crimson/osd: don't extra copy hobject in PG::load_head_obc().

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-25 21:02:47 +08:00
Radoslaw Zarzynski
45a173f79a crimson/osd: don't extra copy hobject in PG::load_head_obc().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-25 11:45:13 +00:00
Kefu Chai
74df5af8e2
Merge pull request #41615 from tchaikov/wip-avl-alloc-ff
os/bluestore/AvlAllocator: introduce bluestore_avl_alloc_ff_max_* options

Reviewed-by: Igor Fedotov <ifedotov@suse,com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-06-25 17:01:11 +08:00
Kefu Chai
7b07baf457
Merge pull request #38939 from ronen-fr/wip-ronenf-scrub-blocked
osd: issue a warning if the scrubber blocks for too long on an object

Reviewed-by: David Zafman <dzafman@redhat.com>
2021-06-25 14:57:31 +08:00
Kefu Chai
2eca09ef5f
Merge pull request #40850 from varshar16/wip-vstart-support-cephadm-rgw
src/vstart: deploy rgw service with cephadm and create rgw user with system flag

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-25 14:51:25 +08:00
Samuel Just
daf27534fe
Merge pull request #42020 from athanatos/sjust/wip-cache-assert
crimson/os/seastore: transaction conflict handling improvements

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-24 23:08:02 -07:00
Kefu Chai
174aa6b163
Merge pull request #42003 from cyx1231st/wip-seastore-fix-onode-tree
crimson/onode-staged-tree: fix ref-counter assert failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-25 12:52:23 +08:00
Radoslaw Zarzynski
16dd71bdab crimson/common: dump entire siginfo on segmentation fault.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-25 04:16:30 +00:00
Radoslaw Zarzynski
9250882347 crimson/common: FatalSignal::signaled() takes siginfo by a reference.
There is no point in having the distincted `nullptr` value.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-25 04:16:30 +00:00
Radoslaw Zarzynski
231a5e7e5c crimson/common: dump /proc/self/maps on crash.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-25 04:16:04 +00:00
Kefu Chai
423f8d3c23
Merge pull request #41889 from ChenFanTony/mkfs_wait_complete
osd/OSD: mkfs need wait for transcation completely finish

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-25 10:59:55 +08:00
Yingxin Cheng
d2454022f0 crimson/onode-staged-tree: reset root node after lookup
Otherwise there could be unexpected references that will break the
asserts when remove nodes during insert/delete.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-25 10:40:28 +08:00
Yingxin Cheng
be96437157 crimson/onode-staged-tree: add missing mutable keyword
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-25 10:37:21 +08:00
Kefu Chai
d45f9e469e
Merge pull request #42004 from tchaikov/wip-crimson-osd-fsm
crimson/osd: shutdown if osdmap forces us to do so

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-25 08:27:41 +08:00
Samuel Just
6df608159e seastore/.../staged_fltree/node: check for conflict in Node::load
This will be unnecessary once converted to interruptible_future.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 16:30:15 -07:00
Samuel Just
9a514cccaa crimson/os/seastore/lba_manager/btree/lba_btree_node_impl: add debugging
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 16:30:15 -07:00
Samuel Just
0cb483303c seastore/.../node_extent_manager/seastore: detect transaction conflicts in read_extent
This won't be necessary once converted to interruptible_future.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 16:29:52 -07:00
Samuel Just
2bc257beb2 crimson/os/seastore/cache: mark conflict in get_extent
After wait_io, the extent may have been mutated again, so it may be
invalid.  Check in the caller and mark the transaction conflicted as
needed.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 16:29:23 -07:00
Samuel Just
add641a286 crimson/os/seastore/transasction: expose is_conflicted
Useful for components not yet converted to use interruptible_future.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 16:29:23 -07:00
Samuel Just
94d5650157
Merge pull request #41963 from athanatos/sjust/wip-interruptible-tm
crimson/os/seastore: refactor transaction_manager and below to use interruptible_future

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-24 13:19:47 -07:00
Samuel Just
45f42b82a3 test/crimson/test_interruptible_future: disable handle_error
Seems to cause a linker hang with gcc-9 in bionic.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 11:49:27 -07:00
Samuel Just
3ef4040c41 crimson/os/seastore/transaction_manager: pass t by ref to submit_transaction
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-24 11:49:25 -07:00
Casey Bodley
d7a6c47026
Merge pull request #39934 from Jeegn-Chen/wip-tracker-49128
rgw: write meta of a MP part to a correct pool

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-06-24 12:17:53 -04:00
Casey Bodley
6c75be40fd
Merge pull request #41739 from liewegas/rgw-realm-metadata
radosgw: include realm_{id,name} in service map

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-06-24 12:16:19 -04:00
Daniel Gryniewicz
a77775caa4 RGW - Bucket Remove Op: Pass in user
When a bucket remove op is called on the non-master zone, the op is
forwarded to the master zone, but this needs a user, so pass the user
in.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-06-24 11:42:45 -04:00
zdover23
5dce141b79
Merge pull request #41994 from anthonyeleven/anthonyeleven/adjust-rados-operations-pools
doc/rados/operations: Update pools.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-06-24 23:51:30 +10:00
Ilya Dryomov
7641537c7d
Merge pull request #42005 from trociny/wip-51342
test/librbd: use really invalid domain

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-06-24 14:48:13 +02:00
Mykola Golub
7a2a3fed4c test/librbd: use really invalid domain
in TestMockMigrationHttpClient.OpenResolveFail

Fixes: https://tracker.ceph.com/issues/51342

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-06-24 12:25:09 +01:00
Kefu Chai
827c6631a0
Merge pull request #41828 from tchaikov/wip-btree-alloc
os/bluestore: add BtreeAllocator

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-06-24 19:10:22 +08:00
Kefu Chai
c0239b798a crimson/osd: document fsm of crimson osd
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-24 16:07:29 +08:00
Kefu Chai
27388d055f crimson/osd: mark more OSD methods private
they are internal helpers, not part of the public interface of the OSD
class.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-24 16:07:29 +08:00
Kefu Chai
632f9acade crimson/osd: shutdown if osdmap forces us to do so
mirror the change introduced by 5dbae13ce0
in classic osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-24 16:07:29 +08:00
Kefu Chai
20e02b0045 crimson/osd: use discard_result() in stop()
we don't care about the result of shutdown() of messengers, when
shutting down the daemon actually, and we don't handle the failures.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-24 16:07:29 +08:00
Patrick Donnelly
9145d9c809
Merge PR #41935 into master
* refs/pull/41935/head:
	mds: avoid journaling overhead for ceph.dir.subvolume for no-op case

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-06-23 13:24:58 -07:00
Samuel Just
c0aeb3ac53 crimson/os/seastore: convert transaction_manager internally to use interruptible_future
Consumers of TransactionManager use wrapper classes InterruptedTransactionManager
and InterruptedTMRef for now until we convert them.

Also converts users of InterruptedCache etc and removes.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:40 -07:00
Samuel Just
337745c17a test/crimson/seastore/test_seastore_cache: use cache directly
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:40 -07:00
Samuel Just
98fd17bbe4 crimson/os/seastore/lba_manager/btree: convert to use interruptible_future
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
9a840daa4a crimson/os/seastore/cache: convert to use interruptible future
Introduces InterruptedCache wrapper for now for components not yet
converted.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
4eec23ba80 crimson/os/seastore/transaction: introduce TransactionConflictCondition interruptor
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
4b32daa0af crimson/os/seastore/cache.h: remove unused get_extents
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
5cdcaf5d2a crimson/os/seastore: invalidate transaction referencing invalid extents
Modify read_set to retain a reverse mapping from extents back to
transactions and use it to update Transaction::conflicted upon
invalidation.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
28a9016634 test/crimson/test_interruptible_future: add tests for errorated behavior
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00
Samuel Just
2a4b178dca crimson/common/interruptible_future: add interruptor::base_ertr
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-23 11:37:37 -07:00