Commit Graph

130352 Commits

Author SHA1 Message Date
Neeraj Pratap Singh
5aa304e128 qa: test chmod is allowed above 0777.
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-04-19 16:51:23 +05:30
Neeraj Pratap Singh
ddc85ece62 cephfs-shell: allowable mask changed to 07777.
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-04-13 13:29:01 +05:30
Kefu Chai
e1a7985ea6
Merge pull request #45743 from m-ildefons/docs-python3-librados
docs: update install steps for python librados

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-04-05 13:36:38 +08:00
zdover23
a2627850d8
Merge pull request #45764 from zdover23/wip-doc-2022-04-04-os-recommendations
doc/start: remove old OS tables

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-04-05 06:54:41 +10:00
Samuel Just
05d4912683
Merge pull request #45720 from xxhdx1985126/wip-55143
crimson/os/seastore: use different segment seq allocator from journal and ool segments

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-04-04 13:02:10 -07:00
Adam King
e884c54cff
Merge pull request #45735 from chrigl/fix-54620
mgr/cephadm: support non-root ssh-user w permissions

Reviewed-by: Adam King <adking@redhat.com>
2022-04-04 15:17:26 -04:00
Adam King
52c35c4a78
Merge pull request #45710 from rkachach/fix_issue_55132
mgr/cephadm: fixing public network conf parsing

Reviewed-by: Adam King <adking@redhat.com>
2022-04-04 15:15:33 -04:00
Neha Ojha
ba0f9606af
Merge pull request #45733 from benhanokh/simple_bitmap_fix
os/BlueStore: NCB fix for SimpleBitmap boundary check

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2022-04-04 11:33:16 -07:00
Adam King
f298cceff5
Merge pull request #45349 from guits/check-check-device-is-available
ceph-volume: various fixes in arg_validators

Reviewed-by: Adam King <adking@redhat.com>
2022-04-04 12:03:29 -04:00
Yuval Lifshitz
93638b2a02
Merge pull request #45687 from yuvalif/wip-yuval-multisite-test-rgws
multisite/test: running the multisite test script with multiple RGWs per zone
2022-04-04 18:23:22 +03:00
Casey Bodley
35058f6794
Merge pull request #45696 from cbodley/wip-cmake-system-utf8proc
cmake: WITH_SYSTEM_UTF8PROC defaults to OFF

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-04-04 10:16:13 -04:00
Ernesto Puerta
40befabbe6
Merge pull request #45763 from rhcs-dashboard/fix-55172-master
monitoring/grafana: fix version

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-04-04 15:21:39 +02:00
Venky Shankar
18c4af3faf
Merge pull request #45514 from tchaikov/wip-cxx20-fixes-cephfs
cephfs: C++20 related fixes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-04 18:48:52 +05:30
Zac Dover
91695b2506 doc/start: remove old OS tables
This PR removes tables that contained outdated
information about Ceph's supported operating
systems. Ernesto Puerta had the idea to consolidate
the information that was in those tables into a single
table, and we're doing that.

Part of that process involves removing the old tables.
That's what this PR does.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-04-04 23:18:27 +10:00
Redouane Kachach
3ef6341e8e
mgr/cephadm: fixing public network conf parsing
Fixes: https://tracker.ceph.com/issues/55132

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-04 14:31:18 +02:00
Ernesto Puerta
8721bd6c5d
monitoring/grafana: fix version
Fixes: https://tracker.ceph.com/issues/55172
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-04-04 13:52:43 +02:00
Ernesto Puerta
a98c2475c6
Merge pull request #45254 from travisn/prometheus-rules-typos
prometheus: Spell check the alert descriptions

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-04 13:46:00 +02:00
Ilya Dryomov
86523c537c
Merge pull request #45746 from idryomov/wip-crush-rule-sizes-cleanup
doc,test: clean up crush rule min/max_size leftovers

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-04-04 13:31:05 +02:00
zdover23
7601206945
Merge pull request #45385 from zdover23/wip-doc-2022-03-14-os-recommendations
doc/start: update os-recommendations.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-04-04 14:20:12 +10:00
Tim Serong
e92720665f
Merge pull request #45705 from SUSE/wip-really-fix-55079
ceph.spec.in: remove build directory in %clean, not %install

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-04-04 13:49:32 +10:00
Radoslaw Zarzynski
bd85f2c1c5
Merge pull request #44612 from rzarzynski/wip-bs-lazy4freebsd
bdev: fix FTBFS on FreeBSD, keep the huge paged read buffers.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-04-02 11:44:37 +02:00
Liu-Chunmei
3cd054d117
Merge pull request #45719 from liu-chunmei/crimson-setopflag
Crimson handle CEPH_OSD_OP_FLAG_FAILOK

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-04-01 21:01:29 -07:00
Xuehan Xu
feaf582481 crimson/os/seastore: use different segment seq allocator from journal and ool segments
Fixes: https://tracker.ceph.com/issues/55143
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-04-02 11:09:45 +08:00
Xuehan Xu
252118fc25 crimson/os/seastore: rename segment_header_t::journal_segment_seq to segment_seq
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-04-02 11:09:45 +08:00
Xuehan Xu
ded9bb01d1 crimson/os/seastore/cache: clean up in Cache::get_next_dirty_extents()
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-04-02 11:09:42 +08:00
David Galloway
7e2ad53343
Merge pull request #45658 from ceph/wip-debug-install
build: Add some debugging messages
2022-04-01 15:25:41 -04:00
David Galloway
57edb76ea4 build: Add some debugging messages
Having a unique string like "CI_DEBUG" will help me know where we are in the build process in Jenkins logs.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-04-01 13:33:36 -04:00
David Galloway
b4910a6627
Merge pull request #45739 from rhcs-dashboard/fix-55155-master
grafana/Makefile: don't push to docker
2022-04-01 13:30:05 -04:00
Zac Dover
9ba68fb1a0 doc/start: update os-recommendations.rst
This PR updates the extremely out-of-date
os-recommendations.rst file.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-04-02 01:50:45 +10:00
Ilya Dryomov
5bdf197431 src/crush: remove sample.txt
It is hopelessly outdated -- the weights were moved from crushmap to
osdmap in 2008, etc.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-01 14:00:13 +02:00
Ilya Dryomov
1ab943cabb doc,test: clean up crush rule min/max_size leftovers
These fields were removed in quincy in commit f95eb04411 ("crush:
eliminate min_size and max_size").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-01 14:00:13 +02:00
Ernesto Puerta
7e6309fac3
grafana/Makefile: don't push to docker
Fixes: https://tracker.ceph.com/issues/55155
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-04-01 11:44:43 +02:00
Ernesto Puerta
2d1c480f5a
Merge pull request #45583 from p-se/monitoring-alert-mtu-group-by-devices
mgr/dashboard: Compare values of MTU alert by device

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2022-04-01 11:11:30 +02:00
Moritz Röhrich
dad15f2dfd
docs: update install steps for python librados
- Put the correct package names for python librados in the install
  instructions.
- librados-devel does not actually pull in python3-librados as
  dependency anymore, remove mention of this.
- Add instructions for openSUSE/SLE

Signed-off-by: Moritz Röhrich <moritz.rohrich@suse.com>
2022-04-01 10:49:20 +02:00
Kefu Chai
553d2bfef8
Merge pull request #45742 from tchaikov/wip-python-debian
debian: install from site-packages to dist-packages

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2022-04-01 14:57:41 +08:00
Kefu Chai
e6eee05222 debian: install from site-packages to dist-packages
this change addresses the regression introduced by
637dd7b404

dist-packages is a debian specific directory for holding 3rd party
python modules. so install the pure python packages into it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-04-01 13:14:23 +08:00
Chunmei Liu
31b6340b87 crimson: set result = 0 when op.flags include CEPH_OSD_OP_FLAG_FAILOK
Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
2022-03-31 16:06:34 -07:00
chunmei-liu
9aa3defc1f crimson: handle osd_op.op.flags include CEPH_OSD_OP_FLAG_FAILOK
If the osd_op failed, still continue to next op when it include
CEPH_OSD_OP_FLAG_FAILOK.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-03-31 16:06:22 -07:00
Liu-Chunmei
4feeea0ebb
Merge pull request #45707 from rzarzynski/wip-crimson-errorator-2nd-arg-handle
crimson/common: let errorator's handlers to conditionally forward errors 

Reviewed-by: Sam Just <sjust@redhat.com>
                       liu-chunmei <chunmei.liu@intel.com>
2022-03-31 15:15:12 -07:00
Ernesto Puerta
87f494eda0
Merge pull request #45578 from rhcs-dashboard/fix-grafana-build
mgr/dashboard: remove transition-through-oci image workaround in grafana  build

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-03-31 19:58:29 +02:00
Gabriel BenHanokh
7dfa208630 os/BlueStore: NCB fix for SimpleBitmap boundary check
The boundary check in SimpleBitmap is off by one causing an assert to trigger
Also fixed a bug when asking for the next clear_extent on a unaligned map when the last bits in the map were set.
Adding unit-tests
Fixes: https://tracker.ceph.com/issues/55145
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
2022-03-31 17:51:07 +03:00
Christoph Glaubitz
452e52a7e3
mgr/cephadm: support non-root ssh-user w permissions
Restructured code, so that in case of non-root, the resulting file will
be created with permissions set to the ssh-user. This allows the
subsequent scp to be able to write the file. The remaining code kept the
same, so that file permissions are restored to the expected ones, but
just runs after the scp.

Fixes: https://tracker.ceph.com/issues/54620
Signed-off-by: Christoph Glaubitz <c.glaubitz@syseleven.de>
2022-03-31 15:06:15 +02:00
Radoslaw Zarzynski
d04ea43cfd bdev: fix FTBFS on FreeBSD, keep the huge paged read buffers.
Special thanks to Willem Jan Withagen!

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-03-31 13:27:43 +02:00
Ilya Dryomov
d191b08bb6
Merge pull request #45660 from CongMinYin/fix-pwl-status
librbd/cache/pwl: correct cache state

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-31 12:30:03 +02:00
Travis Nielsen
9cca95b16a
prometheus: spell check the alert descriptions
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-30 17:38:43 -06:00
Radosław Zarzyński
fc3d1b2f01 crimson/common: let errorator's handlers to conditionally forward errors
The use case is like the following one:

```diff
diff --git a/src/crimson/osd/replicated_recovery_backend.cc b/src/crimson/osd/replicated_recovery_backend.cc
index a96f1b8dd2b..055add2e407 100644
--- a/src/crimson/osd/replicated_recovery_backend.cc
+++ b/src/crimson/osd/replicated_recovery_backend.cc
@@ -516,10 +516,14 @@ ReplicatedRecoveryBackend::read_object_for_push_op(
       recovered_to = push_op->data_included.range_end();
     }
     return seastar::make_ready_future<uint64_t>(recovered_to);
-  }, PGBackend::read_errorator::all_same_way([](auto e) {
+  }, PGBackend::read_errorator::all_same_way([](auto e, auto&& e_raw) -> PGBackend::read_errorator::future<uint64_t> {
     logger().debug("build_push_op: read exception");
-    return seastar::make_exception_future<uint64_t>(e);
-  }));
+    if (42) {
+      return std::move(e_raw);
+    } else {
+      return seastar::make_exception_future<uint64_t>(e);
+    }
+  })).handle_error_interruptible(PGBackend::read_errorator::discard_all{});
 }

 RecoveryBackend::interruptible_future<>
```

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2022-03-31 01:17:16 +02:00
Adam King
6e4dd0e082
Merge pull request #45361 from adk3798/mds-upgrade-test
qa/suites/fs: stop looping in mds upgrade test if upgrade failed

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-30 18:56:45 -04:00
Guillaume Abrioux
a5fab15e44 ceph-volume/tests: reject loop devices in lvm.conf
The current task doesn't works (typo?).
Otherwise api/lvm.py can't work properly, functions such as
`get_single_lv()` and many other don't return the expected results.
Indeed, lvm is confused because of the nvme_loop setup.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-03-30 23:49:01 +02:00
Guillaume Abrioux
7f007e7fc7 ceph-volume: do not leave pv when zapping osds
when zapping a device and no vg/lv are left, the pv should be
removed too.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-03-30 23:49:01 +02:00
Guillaume Abrioux
8aa2f4745a orchestrator: support complex osd creation
This adds the support of complex OSD creation with command
`orch daemon add osd`.
Any argument supported by `DriveGroupSpec()` can be passed on the command line.

Usage:
```
ceph orch daemon add osd host:data_devices=device1,device2,db_devices=device3,osds_per_device=2,...
```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-03-30 23:49:01 +02:00