Commit Graph

121479 Commits

Author SHA1 Message Date
Samuel Just
cbcf08f318 crimson/os/seastore: introduce background gc framework
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-03-23 22:41:09 -07:00
Aashish Sharma
8f4574696c mgr/dashboard: Device health status is not getting listed under hosts section
Device health is shown as failed to retrieve data under Hosts > Device Health section. This PR intends to fix this issue.

Fixes: https://tracker.ceph.com/issues/49354
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-03-24 10:39:00 +05:30
Sage Weil
fe9454722a Merge PR #40314 into master
* refs/pull/40314/head:
	qa/tasks/cephadm: use 'orch apply mon' to deploy mons

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-03-23 22:58:14 -04:00
Sage Weil
f10c752966 Merge PR #40324 into master
* refs/pull/40324/head:
	mgr/cephadm/upgrade: do not crash if error races with user cancellation

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-03-23 22:58:05 -04:00
Patrick Donnelly
5b4a7668f1
Merge PR #40305 into master
* refs/pull/40305/head:
	doc/cephfs/nfs: Add note about cephadm NFS-Ganesha daemon port

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-03-23 18:45:48 -07:00
Patrick Donnelly
9107e1a347
cephsqlite: add julian day offset in milliseconds
This magic number was copied from another VFS but was not adjusted for
the xCurrentTimeInt64 interface.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-23 18:21:08 -07:00
Sage Weil
e4d7d89557 Merge PR #40320 into master
* refs/pull/40320/head:
	mgr/orchestrator: move PORTS column in 'orch ps' output

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-03-23 20:15:24 -04:00
Sage Weil
76ae7532c3 Merge PR #40322 into master
* refs/pull/40322/head:
	cephadm: only bootstrap using image that matches cephadm version

Reviewed-by: Adam King <adking@redhat.com>
2021-03-23 20:15:11 -04:00
Ernesto Puerta
c553763ec9
Merge pull request #40216 from rhcs-dashboard/fix-role-cloning
mgr/dashboard: Fix for broken User management role cloning

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2021-03-23 20:10:18 +01:00
Ernesto Puerta
f1557e8f62
Merge pull request #36402 from rhcs-dashboard/wip-45965-users-quota-usage
mgr/dashboard: Display users current quota usage

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-03-23 20:07:45 +01:00
Daniel Pivonka
b28fd9838e doc/cephadm: explicitly show host requirments in adding host section
Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
2021-03-23 14:56:33 -04:00
Zac Dover
49352a3150 doc/cephadm: rewrite osd.rst - list devices
This PR rewrites the "List Devices" section of
the OSD chapter of the Cephadm guide. This PR
is a simple grammar-and-elegance improvement.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-03-24 02:23:46 +10:00
Radoslaw Zarzynski
1b1c088dba doc/crimson: improve wording about the pipeline / wait states.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-03-23 16:49:55 +01:00
Jason Dillaman
8bb7779643
Merge pull request #40208 from CongMinYin/fix-flush-block-bug
librbd/cache/pwl: fix bug of flush request blocked by defered IO

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-03-23 09:54:35 -04:00
Dan van der Ster
780125d1ed test_ipaddr: check that we correctly skip loopback
We should skip devices named 'lo' or of the form 'lo:0' regardless
of their IP address.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
Related-to: https://tracker.ceph.com/issues/49938
2021-03-23 14:31:33 +01:00
Dan van der Ster
6147c09171 common/ipaddr: also skip just lo
Skip iface's with name like 'lo' or of the form 'lo:0', 'lo:1'. This
brings back the original behavior from b6d0fc9e0e

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
Fixes: https://tracker.ceph.com/issues/49938
2021-03-23 14:30:57 +01:00
Ernesto Puerta
bbe8803d6f
Merge pull request #40005 from rhcs-dashboard/49655-handle-no-rgw-daemons-running
mgr/dashboard: fix error shown when no rgw daemons are running.

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-03-23 12:51:47 +01:00
Alfonso Martínez
58253a0002 mgr/dashboard: fix error notification shown when no rgw daemons are running.
- Adapted code to changes introduced in: https://github.com/ceph/ceph/pull/40220
- Improved error handling.
- Increased test coverage.
- Some refactoring.
- Simplified documentation about setting default daemon host and port.

Fixes: https://tracker.ceph.com/issues/49655
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-03-23 11:14:11 +01:00
Igor Fedotov
35a3f7be8f os/bluestore: acquire proper lock in split_cache()
Fixes: https://tracker.ceph.com/issues/49900
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2021-03-23 10:37:05 +01:00
Kefu Chai
f3ad86069e
Merge pull request #40300 from tchaikov/test-promtool
ceph.spec,install-deps: use golang-github-prometheus for promtools

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-23 17:30:58 +08:00
Kefu Chai
4e35436cce pybind/mgr/telegraf: add type annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-23 16:58:33 +08:00
Kefu Chai
c190fee53d cmake: pass compile options by fio interface library
for better readability and maintainability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-23 16:25:47 +08:00
Nizamudeen A
2921b2e9a9 mgr/dashboard: Fix for alert notification message being undefined
Prometheus alert notification message in the dashboard always comes up
as undefined. Its because we were showing the alert.summary instead of
alert.description for displaying the message. I couldn't find the
summary field in the ceph_default_alerts.yml file. So removed all the
Summary fields from the dashboard code.

Fixes: https://tracker.ceph.com/issues/49342
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-03-23 12:40:46 +05:30
Samuel Just
4483262030 crimson/os/seastore/segment_cleaner: introduce ExtentCallbackInterface::submit_transaction_direct
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-03-23 00:02:26 -07:00
Samuel Just
1c8a495101 Revert "crimson/os/seastore: add releasing state for segments pending close"
This won't be necessary with the refactor in this series.

This reverts commit 3768ef692f.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-03-23 00:02:19 -07:00
Kefu Chai
a0d333c272
Merge pull request #40318 from batrick/libcephsqite-label
.github/labeler: add libcephsqlite label

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-23 12:03:01 +08:00
Kefu Chai
4e2762fed7 debian/libsqlite3-mod-ceph: add .symbols file
for tracking the public symbols

see also dh_makeshlibs(1) and dpkg-gensymbols(1)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-23 11:36:41 +08:00
Kefu Chai
21486ed953 cephsqlite: hide non-public symbols
mark public interfaces using `[[gnu::visibility("default")]]`, so
we can expose them when the default visibility is "hidden".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-23 11:36:41 +08:00
Kefu Chai
1ca93c9c96 cmake: hide non-public symbols in libcephsqlite
should not expose non-public symbols.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-23 11:36:41 +08:00
Yanhu Cao
463dda7251 client: rebuild bl to avoid too many vector(> IOV_MAX)
Fixes: https://tracker.ceph.com/issues/49936
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2021-03-23 11:29:33 +08:00
Patrick Donnelly
e05959de8d
Merge PR #40192 into master
* refs/pull/40192/head:
	test: reduce number of threads to 32 in LibCephFS.ShutdownRace

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 20:06:21 -07:00
Patrick Donnelly
7d412b86d0
Merge PR #40174 into master
* refs/pull/40174/head:
	qa/vstart_runner: fix the admin_socket args parsing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-22 20:05:29 -07:00
Patrick Donnelly
222ce06bfa
Merge PR #40158 into master
* refs/pull/40158/head:
	test: add test for removing non-existent xattr
	mds: fix removexattr logic when there aren't any

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-03-22 20:04:35 -07:00
Patrick Donnelly
49241859b5
Merge PR #40146 into master
* refs/pull/40146/head:
	test: pass peer uuid when adding cephfs mirror peers
	mon: check cephfs mirror peer based on remote cluster spec and file system name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 20:03:41 -07:00
Patrick Donnelly
5000b33180
Merge PR #40145 into master
* refs/pull/40145/head:
	doc: add note about disabling standby-replay during upgrades
	qa: add test for standby-replay disable
	mon: fail standby-replay daemons when flag is turned off

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2021-03-22 20:03:02 -07:00
Patrick Donnelly
42270a5338
Merge PR #38443 into master
* refs/pull/38443/head:
	qa: set "shell" to False for run_ceph_w()
	vstart_runner: make "shell" a default argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-22 20:00:46 -07:00
Kefu Chai
fbd079ae9f
Merge pull request #39777 from xxhdx1985126/wip-alienstore-thread-pin
crimson/os/alienstore: scatter alienstore threads onto specified cpu cores

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-23 10:04:03 +08:00
Sage Weil
94e152fb8d Merge PR #39435 into master
* refs/pull/39435/head:
	mgr/cephadm: redeploy daemons deployed using old image during upgrade
	mgr/cephadm: add container digests of mgr that deployed daemon to unit.meta

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-22 21:57:45 -04:00
Josh Durgin
5aab596d79
Merge pull request #40125 from ceph/wip-14218-notes
doc: 14.2.18 Release Notes

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 18:35:39 -07:00
Sage Weil
2580de1a5d mgr/cephadm/upgrade: do not crash if error races with user cancellation
If the user cancels the upgrade just before the upgrade thread runs into
a problem (and these things may be correlated!), ignore the failure
instead of crashing the module.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 18:40:25 -04:00
Adam Kupczyk
343b049a13 os/bluestore: Make Onode::put/get resiliant to split_cache
In
  OnodeCacheShard* ocs = c->get_onode_cache();
  std::lock_guard l(ocs->lock);
while waiting for lock, split_cache might have changed OnodeCacheShard.
This will result in adding Onode to improper OnodeCacheShard.
Such action is obviously bad, as we will operate in future (at least once) on
different OnodeCacheShard then we got lock for. Particulary sensitive to this
are _trim and split_cache functions, as they iterate over elements.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2021-03-22 23:19:54 +01:00
Sage Weil
1b5a068ddf cephadm: only bootstrap using image that matches cephadm version
Only allow bootstrap to deploy if the cephadm version matches the
ceph version in the container.  Allow the master branch version of cephadm
to deploy the latest stable version as well (at least for now).

Provide a flag to force bootstrap to continue despite the check.

Move the _pull_image call up into bootstrap so that it is easier to see
when it happens.

Fixes: https://tracker.ceph.com/issues/49884
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 18:05:16 -04:00
Sage Weil
a17593a177 qa/tasks/cephadm: use 'orch apply mon' to deploy mons
The 'orch daemon add ...' command is not idempotent and can cause
duplicate (and failing) attempts to add the same mon.

Maintain the ability to add mons the old way for the benefit of testing
upgrades from early octopus versions of cephadm.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 16:28:40 -05:00
Sage Weil
110c7a6e0f Merge PR #40203 into master
* refs/pull/40203/head:
	mgr/cephadm: retry after JSONDecodeError in wait_for_mgr_restart()

Reviewed-by: Sage Weil <sage@redhat.com>
2021-03-22 16:54:19 -04:00
Sage Weil
401e725506 mgr/cephadm: ha-rgw: use correct port
The DaemonDescription includes the port that RGW is bound to; use that
in the haproxy configuration.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 14:31:31 -05:00
Sage Weil
7ab7d08c5b mgr/orchestrator: move PORTS column in 'orch ps' output
Put it next to HOST.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 15:22:21 -04:00
Sage Weil
ccbf40317f Merge PR #40290 into master
* refs/pull/40290/head:
	qa/suites/rados/cephadm/upgrade: wait for rgw servicemap entries to refresh

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-22 13:26:06 -04:00
Sage Weil
3612fc2e56 Merge PR #40288 into master
* refs/pull/40288/head:
	mon/PGMap: change hard coded 0x10000 to macro CEPH_OSD_IN

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-22 13:25:29 -04:00
Patrick Donnelly
368e7e8020
.github/labeler: add libcephsqlite label
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 10:20:24 -07:00
Patrick Donnelly
6ad5901422
Merge PR #39191 into master
* refs/pull/39191/head:
	pybind/mgr/snap_schedule: use ceph VFS
	pybind/mgr/snap_schedule: idempotentize table creation
	mgr: add ceph sqlite VFS
	doc: add libcephsqlite
	ceph.spec,debian: package libcephsqlite
	test/libcephsqlite,qa: add tests for libcephsqlite
	libcephsqlite: rework architecture and backend
	SimpleRADOSStriper: wait for finished aios after write
	SimpleRADOSStriper: add new minimal async striper
	mon: define simple-rados-client-with-blocklist profile
	librados: define must renew lock flag
	common: add timeval conversion for durations
	Revert "libradosstriper: add function to read into char*"
	test_libcephsqlite: test random inserts
	cephsqlite: fix compiler errors
	cmake: improve build inst for cephsqlite
	libcephsqlite: sqlite interface to RADOS
	libradosstriper: add function to read into char*

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-22 10:06:11 -07:00