Commit Graph

132184 Commits

Author SHA1 Message Date
Ilya Dryomov
6813a78791 librbd: update progress for non-existent objects on deep-copy
As a side effect of commit e5a21e9041 ("librbd: deep-copy image copy
state machine skips clean objects"), handle_object_copy() stopped being
called for non-existent objects.  This broke progress_object_no logic,
which expects to "see" all object numbers so that update_progress()
callback invocations can be ordered.  Currently update_progress() based
progress reporting gets stuck after encountering a hole in the image.

To fix, arrange for handle_object_copy() to be called for all object
numbers, even if ObjectCopyRequest isn't created.  Defer the extra call
to the image work queue to avoid locking issues.

Fixes: https://tracker.ceph.com/issues/56181
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-27 21:38:47 +02:00
Laura Flores
d3f55c6047
Merge pull request #46673 from ljflores/wip-mempool-documentation
doc/dev: improve wording and grammar of mempool page
2022-06-27 14:01:58 -05:00
Yuri Weinstein
734736a8b9
Merge pull request #46756 from tobias-urdin/mgr-influx-pool-name-keyerror
mgr: influx: catch KeyError when looking up pool name

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-06-27 11:27:17 -07:00
Yuri Weinstein
a78bfedfa0
Merge pull request #46732 from rzarzynski/wip-55355
msg: fix deadlock when handling existing but closed v2 connection

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-06-27 11:26:34 -07:00
Yuri Weinstein
b99f145a69
Merge pull request #46628 from tchaikov/wip-msg-cleanup
msg, mount: cleanups

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2022-06-27 11:25:42 -07:00
Yuri Weinstein
1b2fb99a1a
Merge pull request #46571 from NitzanMordhai/wip-nitzan-add-pg-log-output
osd: add option to dump pg log to pg command

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-06-27 11:24:36 -07:00
Yin Congmin
a84a2e1091 cmake: rename a series of pmem libraries to pmdk
At first, libpmem was the only library. Later, pmem related libraries
such as libpmemobj and libpmem2 were gradually added. These libraries
were also integrated into one named pmdk. So rename to pmdk.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2022-06-28 01:16:33 +08:00
Laura Flores
6d475d3fa8 doc/dev: improve wording and grammar of mempool page
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-06-27 12:10:26 -05:00
Josh Soref
4bdecd3b91 doc/releases: Fix many spelling errors
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-06-27 12:57:27 -04:00
Ronen Friedman
52c58ee2e0
Merge pull request #46727 from cfsnyder/wip-54172-fix-scrub-abort
osd/scrubber/pg_scrubber.cc: fix bug where scrub machine gets stuck
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-06-27 19:25:30 +03:00
Kamoltat Sirivadhna
3c805c65ac
Merge pull request #46785 from kamoltat/wip-ksirivad-fix-56151
src/mgr/DaemonServer.cc: fix typo in output gap >= max_pg_num_change
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-06-27 12:11:51 -04:00
Kamoltat Sirivadhna
633397848f
Merge pull request #46761 from pdvian/wip-autoscaler-adjust
pybind/mgr/autoscaler: Donot show NEW PG_NUM value if autoscaler is not on
Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
2022-06-27 12:07:43 -04:00
Casey Bodley
311a7b6b0e
Merge pull request #46020 from pritha-srivastava/wip-rgw-gc-break-chain
rgw: splitting gc chains into smaller parts to prevent

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-27 09:26:30 -04:00
zdover23
b0b2347585
Merge pull request #46832 from zdover23/wip-doc-2022-06-24-sage-removal-1
doc: remove mention of Sage as current leader

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-06-27 23:05:03 +10:00
Matt Benjamin
85aed21839 rgw: return ENOENT for NO_SUCH_BUCKET in radosgw-admin bucket stats
This was a recent behavior change.

It might be tempting to normalize these, but I'm trying to avoid further
changes in result codes.

Fixes: https://tracker.ceph.com/issues/55975

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-06-27 07:54:08 -04:00
Kefu Chai
e56e85b891 cmake: use CMAKE_<LANG>_COMPILER_LAUNCHER for configuring ccache
ccache only works for c and c++, so instead of using the universal
`RULE_LAUNCH_COMPILE` use `CMAKE_<LANG>_COMPILER_LAUNCHER` instead,
so ccache is only configured for c and c++ compilation. this is a better
solution for integrating ccache into our building system.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-06-25 22:44:24 +08:00
Yin Congmin
693ad56503 install-deps: install pmdk libraries
Install libpmem and libpmemobj under focal ubuntu. the version of apt
list can meet the current requirements. libpmemobj require >=1.8.
Libpmem has no version requirements.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2022-06-25 20:44:02 +08:00
Yin Congmin
9da9c653c9 cmake: lower the required version of libpmem to 1.8
The upgrade of pmemobj in https://github.com/ceph/ceph/pull/40493
is to introduce new API. The minimum version requirement is 1.8.
Therefore, the requirements for find_package can be lowered.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2022-06-25 20:39:56 +08:00
David Galloway
04f00402d6
Merge pull request #46840 from ceph/fix-backport2
.github: Add labels while PR is open
2022-06-24 14:03:58 -04:00
David Galloway
605b457c98 .github: Add labels while PR is open
I think https://github.com/tibdex/backport will only create backport PRs if our doc/releases PRs are labelled *and then* closed.  This action currently labels after the PR is closed.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-24 12:27:43 -04:00
David Galloway
53b0e0b359
Merge pull request #46576 from ceph/wip-yuriw-release-17.2.1-main
doc: 17.2.1 Release Notes
2022-06-24 11:30:33 -04:00
David Galloway
8db6d89196
Merge pull request #46830 from ceph/backport-doc-pr
.github: Automatically backport doc/releases PRs
2022-06-24 11:06:22 -04:00
Zac Dover
83b77909e5 doc: remove mention of Sage as current leader
This commit removes mention of Sage as the leader of the
Ceph project in the following files:

dev/developer_guide/essentials.rst
dev/developer_guide/merging.rst
foundation.rst
governance.rst

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-06-24 17:07:09 +10:00
David Galloway
7f2eafc130 doc: 17.2.1 nit fixes
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-23 17:35:16 -04:00
David Galloway
f5f9459fb2 .github: Support for automatically creating backport PRs when labeled
e.g., add a 'backport quincy' label to a PR and this workflow will automatically create a backport PR

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-23 15:33:54 -04:00
David Galloway
24e3822435 .github: Label doc/releases PRs so tibdex/backport@v2 can backport
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-23 15:31:48 -04:00
Soumya Koduri
0620e58db1 rgw/dbstore: Fix crash in delete_stale_objs
Fix a race between RemoveBucket and delete_stale_objs operations
by using shared_ptr to add reference to DB Ops.

Fixes:https://tracker.ceph.com/issues/55828
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2022-06-23 23:53:53 +05:30
Ronen Friedman
2f71185ad6
Merge pull request #46643 from ronen-fr/wip-rf-blocked
scrub/osd: add clearer reminders that a scrub is blocked

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-06-23 18:29:27 +03:00
Tobias Urdin
59a5f8413f mgr: influx: catch KeyError when looking up pool name
It can lookup the pool name when a new pool is created
and the pool_info doesn't contain it causing a KeyError.

Signed-off-by: Tobias Urdin <tobias.urdin@binero.com>
2022-06-23 15:03:49 +00:00
Pritha Srivastava
e94873ad85 qa/rgw: 1. adding yaml files to integrate iam tests in teuthology.
2. Modifying s3tests.py for iam tests.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2022-06-23 09:15:24 +05:30
Liu-Chunmei
6ae30f61cd
Merge pull request #46435 from liu-chunmei/crimson-error-log
Crimson/osd:  add error log

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-22 15:28:48 -07:00
Liu-Chunmei
7906012ed9
Merge pull request #46613 from liu-chunmei/crimson-cmp-ext
crimson/osd: return error code to break next op in cmp_ext

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-22 15:26:53 -07:00
Neha Ojha
255b0204d2 doc: add more 17.2.1 notes
update release date

Signed-off-by: Neha Ojha <nojha@redhat.com>
2022-06-22 20:55:33 +00:00
Samuel Just
3fdbee5e70
Merge pull request #46795 from xxhdx1985126/wip-seastore-backref-trim-bug-fix
crimson/os/seastore/cache: trim backref cache before preparing record

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-22 11:32:44 -07:00
J. Eric Ivancich
61967a4d4a
Merge pull request #46788 from ivancich/wip-superfluous-struct
rgw: remove unnecessary "struct" from req_state declarations

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-06-22 12:56:52 -04:00
Casey Bodley
51100f91a8
Merge pull request #46707 from adamemerson/wip-timestamp-status
rgw: radosgw-admin includes current time in most status commands

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-22 12:51:28 -04:00
Samuel Just
5e223e8bf5
Merge pull request #46640 from xxhdx1985126/wip-seastore-count-tree-size
crimson/os/seastore: count tree sizes

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-06-22 09:20:43 -07:00
Casey Bodley
2d9c94d9fd
Merge pull request #46816 from cbodley/wip-54405-again
rgw: fix frontend's use of rgw_access log subsystem

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-22 11:27:38 -04:00
zdover23
945954681b
Merge pull request #46769 from zdover23/wip-doc-2022-06-21-dev-guide-config-local-env-add-context-note
doc/dev: add context note to dev guide config

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-06-23 00:03:14 +10:00
Adam King
3c7431f989
Merge pull request #46369 from rkachach/fix_issue_55357
doc/cephadm: document the new per-fsid cephadm conf location

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-06-22 09:46:25 -04:00
Casey Bodley
bd697e1769 rgw: fix frontend's use of rgw_access log subsystem
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-22 09:07:36 -04:00
Ilya Dryomov
d4d9594949
Merge pull request #46759 from idryomov/wip-rbd-mirror-remote-not-primary
rbd-mirror: generally skip replay/resync if remote image is not primary

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-06-22 13:51:20 +02:00
Ernesto Puerta
873dd327fe
Merge pull request #46765 from rhcs-dashboard/login-banner-cli-bug
mgr/dashboard: dashboard help command showing wrong syntax for login-banner

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-06-22 13:38:03 +02:00
Ernesto Puerta
3b9eaabc6c
Merge pull request #46733 from rhcs-dashboard/rbd-mirroring-snapshot-ui
mgr/dashboard: rbd mirroring promotion/demotion UI

Reviewed-by: Sarthak Gupta <sarthak.dev.0702@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-22 13:05:26 +02:00
chunmei-liu
a48a8fb81f crimson/osd: create and send error log when has error
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-06-21 23:43:04 -07:00
Redouane Kachach
443f93e95d
doc/cephadm: document the new per-fsid cephadm conf location
Fixes: https://tracker.ceph.com/issues/55357

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-06-22 08:25:23 +02:00
Ronen Friedman
996d9064c6 scrub/osd: disable blocked-scrub warnings during some tests
As some Teuthology tests seem to block objects for long minutes,
we must not issue the "scrub is blocked for too long" warning
(that warning causes the tests to fail).

A new configuration parameter now controls the grace period before
the warning is issued. Some tests were modified to set this
configuration parameter to a large value.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-06-22 05:24:37 +00:00
Liu-Chunmei
ec3c779b12
Merge pull request #46587 from liu-chunmei/crimson-check-truncate
crimson/osd: check truncate size in sparse_read

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-21 22:07:46 -07:00
Xuehan Xu
78d018958c crimson/os/seastore/cache: count tree size during OSD startup
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-22 11:51:50 +08:00
Xuehan Xu
e760ca204b crimson/os/seastore/cache: trim backref cache before preparing record
Otherwise, the transaction record would contain backrefs that has been
merged into the backref tree

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-22 09:49:48 +08:00