Commit Graph

116441 Commits

Author SHA1 Message Date
David Zafman
d3cc647583 osd: Eliminate day of weeek 7 and hour 24
Add test case for permitted hours to make sure scrub doesn't start
Remove permitted hours in extended sleep test

Fixes: https://tracker.ceph.com/issues/48077

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-09 22:47:00 +00:00
David Zafman
ef47a3e708 test: set mon_allow_pool_size_one for consistency with original test intention
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-03 21:49:00 +00:00
Lenz Grimmer
161b7e118b
Merge pull request #37287 from pcuzner/dashboard-goals
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-11-02 19:27:40 +01:00
Patrick Donnelly
a8d31b0ed4
Merge PR #37878 into master
* refs/pull/37878/head:
	doc/mgr/orchestrator: Update about "{mds, rgw} add" status in rook

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-02 09:00:09 -08:00
Patrick Donnelly
788282ed75
Merge PR #37732 into master
* refs/pull/37732/head:
	osdc: restart read on truncate/discard

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-02 08:24:04 -08:00
Mykola Golub
8f393c0fc1
Merge pull request #37898 from lxbsz/nbd_reexpandmeta
rbd-nbd: reexpand the conf meta in child process

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-02 14:53:26 +02:00
Igor Fedotov
27953f49e3
Merge pull request #37547 from ifed01/wip-ifed-fix-bmap-alloc
os/bluestore: fix segfault on out-of-bound offset provided to  claim_…

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-11-02 15:26:04 +03:00
Kefu Chai
ef12ea6bae
Merge pull request #37879 from tchaikov/wip-seastar-v6
crimson: use Seastar API v6

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-02 18:27:54 +08:00
Mykola Golub
903c798a29
Merge pull request #37894 from dillaman/wip-48035
librbd: global config overrides do not apply to in-use images

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-02 11:02:59 +02:00
Kefu Chai
59c170e7c6
Merge pull request #37907 from athanatos/sjust/wip-fix-init-weak
crimson/os/seastore/.../lba_btree_node_impl: hold reference to *this during lookup

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-02 16:38:23 +08:00
Samuel Just
7230aac40c crimson/os/seastore/.../lba_btree_node_impl: hold reference to *this during lookup
4f2f4f modified TransactionManager::mount() to use a weak_transaction
while calling init_cached_extents.  This is fine, but lookup() needs
to hold a reference to *this until the child lookup completes in order
to ensure residence in the lba pinning set.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-11-02 00:05:37 -08:00
Paul Cuzner
16c449280d doc/dev/dashboard: typo fix
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-11-02 17:50:42 +13:00
Paul Cuzner
88346c790c doc/dev/dashboard: link designs to dev guide
Add a feature design section to the dashboard dev
guide, linking to the individual docs under dov/dev/dashboard

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-11-02 17:36:44 +13:00
Paul Cuzner
c0a49c8fd9 doc/dev/dashboard: Document key UI design principles
Document which defines the high level design principles
for the Ceph Dashboard UI

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-11-02 17:36:43 +13:00
Kefu Chai
ac33cea383
Merge pull request #37590 from pcuzner/prometheus-slow-ops
mgr/prometheus: Add SLOW_OPS healthcheck as a metric

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-02 11:32:06 +08:00
Paul Cuzner
fc1905b4a7 mgr: add doc to describe relationship to prometheus
The healthcheck for slow_ops is used by the mgr/prometheus
module so it's important the alert generated matches the
format expected in mgr/prometheus.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-11-02 15:33:46 +13:00
Paul Cuzner
2010432b50 mgr/prometheus: Add healthcheck metric for SLOW_OPS
SLOW_OPS is triggered by op tracker, and generates a health
alert but healthchecks do not create metrics for prometheus to
use as alert triggers. This change adds SLOW_OPS metric, and
provides a simple means to extend to other relevant health
checks in the future

If the extract of the value from the health check message fails
we log an error and remove the metric from the metric set. In
addition the metric description has changed to better reflect
the scenarios where SLOW_OPS can be triggered.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-11-02 15:30:49 +13:00
Jason Dillaman
6fef5198b3
Merge pull request #36626 from lixiaoy1/rbd_image_discard
librbd/rwl: discard cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-01 08:42:01 -05:00
Kefu Chai
8a58d7fdf5
Merge pull request #37870 from xxhdx1985126/wip-crimson-recovery-bug-fixes
crimson: recovery-related bug fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-01 21:23:59 +08:00
Kefu Chai
00b78a6ad5
Merge pull request #37910 from tchaikov/wip-crimson-osd-send-pg-temp
crimson/osd: merge pg_temp_wanted before sending them

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 21:21:42 +08:00
Yuval Lifshitz
2996d138cb
Merge pull request #37656 from yuvalif/allow_lua_to_set_metadata
rgw/lua: allow setting metadata via lua
2020-11-01 12:03:26 +02:00
Kefu Chai
4d17fda7e3 crimson/osd: merge pg_temp_wanted before sending them
there is chance that new pg_temp_wanted is added when we are sending
them in ShardServices::send_pg_temp(), but the pg temp are already
collected into the messages before seastar::parallel_for_each(). so,
we cannot move all elements from pg_temp_wanted to pg_temp_pending after
sending the messages, that'd also move the unsent pg temps to
pg_temp_pending as well. so we have to do this before do the async call,

this issue was root caused by Xuehan Xu <xxhdx1985126@gmail.com>.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-01 11:55:42 +08:00
Kefu Chai
dbbd2d32f3 crimson/osd: drop ShardServices::_sent_pg_temp()
there is no need to define a wrapper for moving pg_temp_wanted to
pg_temp_pending. and it hurts the readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-01 11:55:03 +08:00
Xuehan Xu
124aa74deb crimson/osd: report statfs data
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 11:37:21 +08:00
Xuehan Xu
471531e25d crimson/osd: rename heartbeat_timer to tick_timer
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 11:37:21 +08:00
Xuehan Xu
8b7d0ae035 crimson/common: make Gated handle gate_close_exception
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 11:37:21 +08:00
Kefu Chai
6656cae082 crimson/osd: do not check HAVE_STDLIB_MAP_SPLICING
seastar always uses GCC-9 and up, so there is no need to check for
the existence of map::merge() before using it anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-01 11:28:28 +08:00
Xuehan Xu
d205776796 crimson/osd: clean up pending_txn when actingset is changed
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 10:39:24 +08:00
Xuehan Xu
c7e6b6f021 crimson/osd: fix pg info statistics error during recovery
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 10:38:45 +08:00
Xuehan Xu
3a8f133923 crimson/osd: make I/O reqs wait for object recovery if it's degraded or backfilling
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-11-01 10:25:22 +08:00
Kefu Chai
038750c78a
Merge pull request #37327 from kamoltat/wip-mgr-progress-global-event
mgr/progress: Global Recovery Event in ceph -s

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-10-31 11:43:27 +08:00
Kefu Chai
a45fab9f81
Merge pull request #37598 from ronen-fr/scrubstore-fix-rf
osd: fix signatures of get_store_errors() and friends

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-10-31 11:42:35 +08:00
Kefu Chai
e96c45d9d2
Merge pull request #37751 from changchengx/nasm_avx512
common: use nasm to build isa-l and isa-l_crypto to prepare for AVX512

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-31 11:41:19 +08:00
Josh Durgin
8a2f2d82f4
Merge pull request #37773 from sunnyku/wip-f33-pyfix
do_cmake.sh: use python-3.9 with fedora version 33

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-10-30 08:15:59 -07:00
Jason Dillaman
0cd14ccff2
Merge pull request #37789 from trociny/wip-47827
mgr/rbd_support: create mirror snapshots asynchronously

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-30 09:40:10 -04:00
Yuval Lifshitz
e96331fdab rgw/lua: use lua exceptions instead of ceph_asserts
also use lua assert() in uni tests instead of print()
fix bug when accessing user id in an ACL grant

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-30 14:50:51 +02:00
Lenz Grimmer
21b24e0247
Merge pull request #37482 from rhcs-dashboard/datatable_click_prevent
mgr/dashboard: Prevent table items from getting selected while expanding

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-30 09:55:47 +01:00
Lenz Grimmer
587a84049b
Merge pull request #35769 from Codom/master
mgr/dashboard: Added Versioning to the REST API

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-30 09:50:05 +01:00
Yuval Lifshitz
eaf48d1a3a rgw/lua: allow setting metadata via lua
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-30 10:40:06 +02:00
Kefu Chai
d162c00c66
Merge pull request #37788 from tchaikov/wip-zbd
rpm,cmake: s/WITH_LIBZBD/WITH_ZBD/ and enable ZBD on demand

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-10-30 11:17:56 +08:00
Kefu Chai
92300bb747
Merge pull request #37888 from tchaikov/wip-crimson-gtest
crimson/gtest_seastar: do not keep a copy of argv

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2020-10-30 10:25:49 +08:00
Kefu Chai
2cdbbd1212
Merge pull request #37891 from tchaikov/wip-cmake-alienstore
cmake: build bluestore-tp before crimson-alienstore

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2020-10-30 10:25:06 +08:00
Kefu Chai
75c7a792e6
Merge pull request #37893 from tchaikov/wip-wunused-variable
osd/osd_types: mark unused variable [[maybe_unused]]

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-30 10:24:11 +08:00
Xiubo Li
f482b8ca79 rbd-nbd: reexpand the conf meta in child process
Fixed: https://tracker.ceph.com/issues/48046
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-29 22:05:16 -04:00
Jason Dillaman
190534ae08
Merge pull request #37864 from trociny/wip-48020
mgr/rbd_support: store global schedule without localized prefix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 20:58:44 -04:00
Jason Dillaman
54329691c0
Merge pull request #37880 from trociny/wip-rbd-finisher-cancel
librbd: relax requirements on finisher canceled callback

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-29 20:58:13 -04:00
Mykola Golub
08151a191f mgr/rbd_support: create mirror snapshots asynchronously
To scale up with number of images.

Fixes: https://tracker.ceph.com/issues/47827
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
13ce488d7a pybind/rbd: add async mirror image get mode and info methods
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
fd5e642cd7 librbd: add missing declaration of rbd_aio_mirror_image_get_mode
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00
Mykola Golub
b27db87c03 pybind/rbd: add image async open and close methods
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-29 19:12:01 +00:00