Commit Graph

132960 Commits

Author SHA1 Message Date
Kefu Chai
e460893b1f
Merge pull request #47309 from Thingee/update-foundation-mems-202207
doc: Updating Ceph Foundation members for July

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-08-06 07:06:45 +08:00
Kefu Chai
71049e913e
Merge pull request #47478 from tchaikov/wip-cmake-cython
cmake: remove spaces in macro used for compiling cython code

Reviewed-by: Tim Serong <tserong@suse.com>
2022-08-06 06:51:23 +08:00
Laura Flores
21df1d4586
Merge pull request #47481 from ljflores/wip-github-actions
.github/workflows: increase operations-per-run to 100 in stale bot
2022-08-05 14:14:17 -05:00
Laura Flores
0f31bf10f8 .github/workflows: increase operations-per-run to 100 in stale bot
The stale bot's `operations-per-run`
(https://github.com/actions/stale#operations-per-run) corresponds to the max
number of API calls it is allowed to make per hour. Currently,
`operations-per-run` is set to 30, which means that the stale bot
can make up to 30 API calls per hour.

With this limit in place, the stale bot is only able to process 400 PRs at a time.
Since there are 900+ PRs in the Ceph repository, we should increase the number of
operations to cover them all. This needs to be done with care though, since GitHub
has a rate limit
(https://docs.github.com/en/rest/overview/resources-in-the-rest-api#rate-limiting)
depending on business plan.

According to GitHub's documentation on GitHub action requests
(https://docs.github.com/en/rest/overview/resources-in-the-rest-api#requests-from-github-actions),
the rate limit is 1,000 requests per hour per repository when using `GITHUB_TOKEN` (which we are).
For enterprise accounts, GitHub Enterprise Cloud's rate limit applies, and the limit is 15,000
requests per hour per repository.

Based on this information, we should be fine to increase the max `operations-per-run`
to 100. This would cover a little over 1000 PRs, which should be enough
to process the 900-some-odd PRs in the Ceph repository.

Signed-off-by: Laura Flores <lflores@redhat.com>
2022-08-05 11:34:20 -05:00
David Galloway
4bc2f65712
Merge pull request #47459 from tchaikov/wip-cmake-debian-python
cmake: install pure python module to deb_system path
2022-08-05 08:51:27 -04:00
kalebskeithley
e6c7de61d6
Merge pull request #47397 from kalebskeithley/luamgr
rgw: lua, add support for lua packages to the lua manager
2022-08-05 08:27:13 -04:00
Kefu Chai
5824fed5b4 cmake: remove spaces in macro used for compiling cython code
we are facing following FTBFS on jammy + GCC-11.2 + Cython 0.29 +
CMake 3.22:

creating /home/jenkins-build/build/workspace/ceph-api/build/lib/cython_modules/temp.linux-x86_64-3.10/home/jenkins-build/build/workspace/ceph-api/build/src/pybind/cephfs
compile options: '-I/usr/include/python3.10 -I/usr/include/python3.10 -c'
extra options: '-Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -iquote/home/jenkins-build/build/workspace/ceph-api/src/include -w -Dvoid0=dead_function(void) -D__Pyx_check_single_interpreter(ARG)=ARG ## 0 -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2'
cc: /home/jenkins-build/build/workspace/ceph-api/build/src/pybind/cephfs/cephfs.c
cc: warning: ##: linker input file unused because linking not done
cc: error: ##: linker input file not found: No such file or directory
cc: warning: 0: linker input file unused because linking not done
cc: error: 0: linker input file not found: No such file or directory

it seems cython is not able to escape the space in the "extra options"
anymore, so the "##" and "0" are considered as object files passed to
compiler in addition to cephfs.c.

in this change the spaces are removed to help cython to make the right
decision.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 20:07:02 +08:00
Kefu Chai
8cb32e9c50
Merge pull request #47470 from tchaikov/wip-win32-silence-warning
dokan: cast variable to the expected type before comparison

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2022-08-05 15:59:34 +08:00
Yingxin
04567e7f51
Merge pull request #47471 from cyx1231st/wip-seastore-cleanup-paddr
crimson/os/seastore: cleanups and extentions to paddr_t related classes

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-05 14:41:10 +08:00
Venky Shankar
a023c0c4e5
Merge pull request #47214 from nmshelke/minor-fixes
docs: minor doc fixes of showing in progress clones for a snapshot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com
2022-08-05 12:01:13 +05:30
Kefu Chai
4eb0f0f038
Merge pull request #47472 from tchaikov/wip-do-cmake-with-newer-gcc
do_cmake:sh: use newer gcc if available

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 14:16:17 +08:00
Yingxin Cheng
4daf99778b crimson/os/seastore: introduce P_ADDR_ROOT
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 12:04:03 +08:00
Yingxin Cheng
8dd1d24e92 crimson/os/seastore: cleanup, call paddr_t's explicit function where possible
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 12:04:03 +08:00
Yingxin Cheng
1e3f441835 crimson/os/seastore: extend reserved device ids to 8 bits
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 12:04:03 +08:00
Yingxin Cheng
e122aed6d5 crimson/os/seastore: cleanup, introduce res_paddr_t with paddr_types_t::RESERVED
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 12:03:57 +08:00
Kefu Chai
3d3b94a9dc do_cmake:sh: use newer gcc if available
despite that we are using clang in `run-make-check.sh`, `do_cmake.sh`
is still used by some workflows like jenkins' ceph-pr-api job.
now that we've migrated to C++20, we need to use GCC-11 or up for
building the tree. GCC-11 is installed from PPA repo in
`install-deps.sh`, but to avoid interfere with the build of older
branches which do not use GCC-11, as their builds might break if
we use GCC-11 for building them. we don't use the alternative machinary
to point gcc to gcc-11, see 8f342a32ce.

so, in this change, we try to use the newest GCC in system when
running `do_cmake.sh`.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 11:53:12 +08:00
Yingxin Cheng
1446afa540 crimson/os/seastore: cleanup paddr_t classes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 10:23:53 +08:00
Yingxin Cheng
eaa1519217 crimson/os/seastore: cleanup segment_id_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 09:20:59 +08:00
Yingxin Cheng
487983477f crimson/os/seastore: cleanup DEVICE_ID_BITS
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-05 09:20:59 +08:00
Kefu Chai
04967404ed cmake,debian: install pure python module to deb_system path
in ubuntu 22.04 and debian unstable, the layout (scheme) for system
python module is named "deb_system", the default one is 'posix_local'.
and 'posix_local' installs python modules into paths like
usr/local/lib/python3.10/dist-packages/. hence dh_install fails
when it tries to find the files to be packaged under directory of
usr/lib/python3*/site-packages/.

in this change, the "deb_system" scheme is used if it is available,
and fall back to "posix_prefix" to be backward compatible with older
debian (derivative) distros.

also, update the source directories of pure python's installation
from `site-packages` to `*-packages`, to be compatible with ubuntu focal
and ubuntu jammy. as we are now using the specified scheme instead of
the default one.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 09:10:04 +08:00
Kefu Chai
f27e16ff94 dokan: cast variable to the expected type before comparison
to fix the FTBFS due to following warning:

```
/home/jenkins-build/build/workspace/ceph-windows-pull-requests/ceph/build.deps/src/dokany/dokan/dokan.h:723:22: error: narrowing conversion of '-1' from 'int' to 'long unsigned int' [-Wnarrowing]
  723 | #define DOKAN_ERROR -1
      |                      ^
```

also, clean up the following warning:

```
/home/jenkins-build/build/workspace/ceph-windows-pull-requests/ceph/src/dokan/dbg.cc:142:62: warning: NULL used in arithmetic [-Wpointer-arith]
  142 |   o << "\n\tIsDirectory: " << (DokanFileInfo->IsDirectory != NULL);
      |
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 08:31:27 +08:00
Kefu Chai
ba8a30c663
Merge pull request #47427 from tchaikov/wip-strong-ordering
include, common, osd: use std::strong_ordering machinery

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-05 08:29:35 +08:00
Kefu Chai
70d68f56b6
Merge pull request #47462 from ronen-fr/wip-rf-list-snapset
tests/osd: fix a test to follow an output formatting change

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 08:22:02 +08:00
Kefu Chai
2a87d0dada
Merge pull request #47461 from tchaikov/wip-wip32-deps
win32_deps_build.sh: bump curl to curl-7_84_0

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2022-08-05 07:51:35 +08:00
Casey Bodley
df35a7392d
Merge pull request #47468 from cbodley/wip-cmake-exporter-no-mgr
cmake: ceph-exporter fix for WITH_MGR=OFF

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2022-08-04 19:24:18 -04:00
Casey Bodley
be9b7cedb1 cmake: ceph-exporter fix for WITH_MGR=OFF
removing vstart-base's unconditional dependency on ceph-exporter. it's
added conditionally just below:

if (WITH_MGR)
  add_dependencies(vstart-base ceph-mgr)
  add_dependencies(vstart-base ceph-exporter)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-08-04 14:25:24 -04:00
Ronen Friedman
b04ef6ebfc tests/osd: fix a test to follow an output formatting change
PR#47255 modified the formatting of std::set-s. That broke
the osd-scrub-snaps.sh standalone test.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-04 15:46:11 +00:00
Kefu Chai
6b43df3c58 win32_deps_build.sh: bump curl to curl-7_84_0
to silence warnings like:

```
configure.ac:3671: warning: The macro `AC_HELP_STRING' is obsolete.
configure.ac:3671: You should run autoupdate.
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 23:08:12 +08:00
Nikhilkumar Shelke
c0c386b197 docs: minor doc fixes of showing in progress clones for a snapshot
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-04 19:16:39 +05:30
Kefu Chai
0420a7bb91 common,include: drop include/cmp.h
it is not used anymore. so just ditch it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
e9963ed7dc common: drop WRITE_{EQ,CMP}_OPERATORS_7()
the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
f02a2a7195 osd: implement three-way comparison operator for basic types
this is the prerequisite for implementing the three-way comparison
operator for types which aggregates these basic types

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
06c641b8c6 common: drop WRITE_{EQ,CMP}_OPERATORS_5()
the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
cba426698f common: drop WRITE_{EQ,CMP}_OPERATORS_4()
the default-generated comparison operators can fulfill our needs.

the order of member variables of `ghobject_t` is adjusted to match
the ordering of `ghobject_t`. the default-generated three-way
comparison operator uses the order in which the member variables
are declared to do the lexical comparison.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
fac4942b03 librados, os: drop WRITE_{EQ,CMP}_OPERATORS_3()
the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
e9a110aaa3 include: drop WRITE_{EQ,CMP}_OPERATORS_2()
the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
27e38181ab include: drop WRITE_{EQ,CMP}_OPERATORS_1()
the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
4bbc8cc2d3 osd/osd: do not init OSDOp::rval explicitly
errorcode32_t's ctor can take care of this. it sets the internal value
to 0.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 21:33:51 +08:00
Kefu Chai
c1062a0df2
Merge pull request #47449 from tchaikov/rpm-gts-11
ceph.spec.in: build with gcc-toolset-11

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-04 21:30:51 +08:00
Venky Shankar
bcfc2e2089
Merge pull request #46876 from neesingh-rh/feature_55821
mgr/volumes: add interface to check the presence of subvolumegroups/subvolumes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-04 18:40:10 +05:30
Kefu Chai
2a97033ba8 cmake: disable LTO when building pmdk
See-also: https://tracker.ceph.com/issues/54473
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 17:56:48 +08:00
Kefu Chai
9f00a70232 debian: use dpkg/default.mk to init popular make variables
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 16:35:20 +08:00
Nizamudeen A
4697911c07
Merge pull request #47263 from rhcs-dashboard/fix-host-service-instances
mgr/dashboard: host list tables doesn't show all services deployed

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-08-04 12:58:03 +05:30
Avan
ddce14e982
Merge pull request #46213 from ceph/feature-exporter
exporter: per node metric exporter

Reviewed-by: MrFreezeex <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-08-04 11:48:54 +05:30
Kefu Chai
3811e8835d ceph.spec.in: BuildRequires gcc-toolset-11-libatomic-devel for aarch64
to address following failure when generating the building system
using CMake:

```
-- Performing Test HAVE_LIBATOMIC
-- Performing Test HAVE_LIBATOMIC - Failed
CMake Error at cmake/modules/CheckCxxAtomic.cmake:66 (message):
  Host compiler /opt/rh/gcc-toolset-11/root/usr/bin/c++ requires libatomic,
but it is not found
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 12:15:03 +08:00
Kefu Chai
336fe86af8 ceph.spec.in: call %enable_devtoolset11 on centos8
before this change %enable_devtoolset11 is called only when building
with crimson on centos8.

after this change %enable_devtoolset11 is called when building on
centos8. because we've started using gcc-toolset-11 for building
rpm packages on centos8 after the C++20 migration. so, to build
with gcc-11, we need to enable it.

also, because gcc-toolset-11 is used, we have to disable
annotated_build.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-04 11:02:16 +08:00
Adam King
d32a19abe1
Merge pull request #47299 from hookak/loki-dependency
mgr/cephadm: Add loki dependency to grafana, promtail

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-03 15:52:07 -04:00
Yuri Weinstein
49937c3798
Merge pull request #47165 from NitzanMordhai/wip-nitzan-librados-ioctx-destroy-Segmentation-fault
librados: rados_ioctx_destroy check for initialized ioctx

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-08-03 08:04:58 -07:00
Yuri Weinstein
dc218e4b6b
Merge pull request #47138 from kamoltat/wip-ksirivad-fix-test-pool-min-size
qa/tasks/ceph_manager.py: increase test_pool_min_size timeout

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-08-03 08:03:52 -07:00
Yuri Weinstein
9b1e6011c8
Merge pull request #47065 from ifed01/wip-ifed-fix-blufs-unlink-fsync
os/bluestore: do not signal deleted dirty file to bluefs log

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-08-03 08:03:24 -07:00