Commit Graph

123266 Commits

Author SHA1 Message Date
Kefu Chai
30d2910e30
Merge pull request #41287 from adk3798/daemon-for-service-warn
mgr/cephadm: warn users if they try to pass a daemon to 'orch rm'

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-05-20 14:19:15 +08:00
Kefu Chai
60c462ed37
Merge pull request #41356 from tchaikov/wip-options-mgr-mon
common/options: extract mgr and mon options out

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-20 14:18:43 +08:00
Kefu Chai
ee71091689
Merge pull request #41373 from myoungwon/wip-fix-50806
osd: fix wrong input when calling recover_object()

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-05-20 14:16:59 +08:00
Samuel Just
a3304290c5
Merge pull request #41423 from athanatos/sjust/wip-lba-merge-fix
crimson/.../lba_btree_node_impl: handle relative addr in merge

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-05-19 21:15:40 -07:00
Kefu Chai
326569dfc4
Merge pull request #41392 from tchaikov/wip-librados
include/rados/librados.h: use UINT64_C to define constants

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-05-20 09:04:33 +08:00
Josh Durgin
5ab2128633
Merge pull request #41409 from zdover23/wip-doc-security-2021-05-19-fifth-item
doc/security: updating fifth listitem

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-19 17:42:21 -07:00
Josh Durgin
1e40b15980
Merge pull request #41410 from zdover23/wip-doc-security-2021-05-19-seventh-item
doc/security: enrich seventh listitem

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-19 17:41:38 -07:00
Samuel Just
d2389cbb14
Merge pull request #41424 from athanatos/sjust/wip-interruptor-unittest-name
test/crimson/CMakeLists.txt: fix name of unittest-interruptible-future

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
2021-05-19 17:11:02 -07:00
Kefu Chai
3090dc9686
Merge pull request #41425 from athanatos/sjust/wip-seastore-build
crimson: fix misc build issues

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-20 08:10:11 +08:00
Samuel Just
4f256762c6 crimson/tools/store_nbd/tm_driver: remove perfcounter argument
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-05-19 21:41:40 +00:00
Samuel Just
f096f337ec crimson/os/seastore/logging: fix log() argument
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-05-19 21:41:40 +00:00
Samuel Just
624f9f8c82 test/crimson/CMakeLists.txt: fix name of unittest-interruptible-future
unittest-interruptible-future matches the other unit tests here.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-05-19 14:13:06 -07:00
Samuel Just
0bdadf3c27 crimson/.../lba_btree_node_impl: handle relative addr in merge
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-05-19 14:12:24 -07:00
Josh Durgin
d29f7d2f71
Merge pull request #40836 from kamoltat/wip-autoscaler-new-alg-turn-on-off
pybind/mgr/pg_autoscaler: Added autoscale-profile feature

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-19 13:15:37 -07:00
Kamoltat
0e49683b53 pybind/mgr/pg_autoscaler: Added autoscale-profile feature
The autoscaler by default will start out each pool with minimal
pgs and `scale-up` the pgs when there is more usage in each pool.

Users can now use the commands:

`osd pool set autoscale-profile scale-down` to make the pools
start out with a full complement of pgs and only `scale-down`
when usage ratio across the pools are not even.

`osd pool set autoscale-profile scale-up` (by default) to make the pools
start out with minimal pgs and `scale-up` the pgs when there
is more usage in each pool.

Edited KVMonitor.cc file to make the `autoscale_profile` variable
persistent.

Edited tests/test_cal_final_pg_target.py so that it takes into account
the new `profile` argument when calling cal_final_pg_target(). Also,
added some new test cases for when profile is `scale-up`

Renamed tests/test_autoscaler.py to a more appropriate name:
tests/test_cal_ratio.py

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-05-19 16:48:35 +00:00
Zac Dover
b4058169ed doc/security: enrich seventh listitem
This PR improves the language of the seventh listitem
in the Vulnerability Management Process in the security
documentation.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-05-20 00:44:00 +10:00
Josh Durgin
a3e0351bb2
Merge pull request #41406 from zdover23/wip-doc-security-2021-05-19-first-item
doc/security: removing pleonasm

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-19 07:40:59 -07:00
Zac Dover
6ccf27fcef doc/security: updating fifth listitem
This PR enriches the text in the fifth listitem
of the Vulnerability Management Process.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-05-20 00:37:52 +10:00
Kefu Chai
bd71c70f15
Merge pull request #41391 from tchaikov/wip-libcephfs
libcephfs: include <sys/time.h>

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-19 22:13:15 +08:00
Kefu Chai
e6b53c1dbe
Merge pull request #41359 from tchaikov/wip-cmake-cleanup
cmake: cleanups related to file(GLOB_RECURSE..) call

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-05-19 22:12:24 +08:00
Zac Dover
92c351c211 doc/security: removing pleonasm
s/three business days or less/three business days/

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-05-20 00:07:45 +10:00
Kefu Chai
f6b24ece91
Merge pull request #41355 from tchaikov/wip-doc-rgw-conf
doc/radosgw: use confval directive to define options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-05-19 21:19:11 +08:00
Kefu Chai
fa03786426
Merge pull request #41399 from idryomov/wip-mrun-if-posix
mrun: avoid == in [ command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-19 20:38:07 +08:00
Kefu Chai
05b561a1d1
Merge pull request #41393 from rosinL/fix-50835
common/crc32c_aarch64: fix crc32c unittest failed on aarch64

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-19 20:37:44 +08:00
Kefu Chai
9ece0292f3 doc/radosgw: use confval directive to define options
less repeating this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-19 20:35:25 +08:00
Sage Weil
4029981e45 Merge PR #41388 into master
* refs/pull/41388/head:
	cephadm: write config files as utf-8

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-05-19 07:57:20 -04:00
Sage Weil
b9d8dc483a Merge PR #41286 into master
* refs/pull/41286/head:
	qa/suites/orch/rook: disable centos for now
	qa/suites/orch/rook/smoke: initial smoke suite
	qa/tasks/rook: ROOK_HOSTPATH_REQUIRES_PRIVILEGED=true on centos
	qa/tasks/rook: simplify shutdown
	qa/tasks/rook: archive logs
	qa/tasks/rook: more orderly cluster teardown
	qa/tasks/rook: deploy ceph via rook on top of kubernetes
	qa/tasks/kubeadm: install kubernetes with kubeadm
	qa/suites: move rados/cephadm -> orch/cephadm; symlink
	qa/tasks/cephadm: add whitespace between functions
	qa/tasks/cephadm: clean up ctx.manager setup

Reviewed-by: Sébastien Han <seb@redhat.com>
2021-05-19 07:55:30 -04:00
Sage Weil
825481b4f3 Merge PR #41370 into master
* refs/pull/41370/head:
	mgr/cephadm: pin haproxy image to 2.3.z

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-05-19 07:52:17 -04:00
Ernesto Puerta
1eda1da113
Merge pull request #41345 from rhcs-dashboard/fix-CVE-2021-3509-master
mgr/dashboard: fix cookie injection issue (CVE-2021-3509)

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-05-19 13:43:42 +02:00
Ilya Dryomov
20584f09e9 mrun: avoid == in [ command
== operator is not supported in POSIX sh (e.g. dash):

  ./mrun: 24: [: unexpected operator

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-19 13:00:16 +02:00
Ernesto Puerta
67fb1b157c
Merge pull request #41104 from rhcs-dashboard/fix-ESOCKETTIMEDOUT-e2e-failure
mgr/dashboard: fix ESOCKETTIMEDOUT E2E failure

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-05-19 12:41:33 +02:00
Ernesto Puerta
8e1b94898b
Merge pull request #41273 from rhcs-dashboard/update-frontend-deps
mgr/dashboard: update frontend deps due to security vulnerabilities

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-05-19 12:40:02 +02:00
luo rixin
06ca2eba72 common/crc32c_aarch64: fix crc32c unittest failed on aarch64
On centos 8.2 for aarch64 with gcc 8.3, the complier will use
register v0 conflicting with the register v0 be usded in inline
asm code. Adding the related registers into clobber list to inform
complier avoiding the confict.

Fixes: https://tracker.ceph.com/issues/50835

Signed-off-by: luo rixin <luorixin@huawei.com>
2021-05-19 18:27:26 +08:00
Sage Weil
fa2cf2987c cephadm: write config files as utf-8
If we don't specify the encoding, python may use something like 'latin-1',
which cannot handle unicode characters.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 21:49:55 -04:00
Kefu Chai
5549747255 include/rados/librados.h: use UINT64_C to define constants
UINT64_C add the appropriate suffix to literals, this is more readable
than casting the literal to the expected type.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-19 09:33:25 +08:00
Kefu Chai
c52f359487 libcephfs: include <sys/time.h>
header files should be self-contained. we are using `timeval` in the header,
but failed to include the header defining it.

this change addresses the build failures on Darwin like:

int ceph_lutimes(struct ceph_mount_info *cmount, const char *path, struct timeval times[2]);
                                                                          ^
src/include/cephfs/libcephfs.h:1080:78: error: array has incomplete element type 'struct timeval'
int ceph_futimes(struct ceph_mount_info *cmount, int fd, struct timeval times[2]);
                                                                             ^
src/include/cephfs/libcephfs.h:1080:65: note: forward declaration of 'struct timeval'
int ceph_futimes(struct ceph_mount_info *cmount, int fd, struct timeval times[2]);
                                                                ^
3 errors generated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-19 09:21:19 +08:00
Kefu Chai
ee9ae39d80
Merge pull request #41390 from batrick/i50865
doc: use sphinx .dot include

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-19 08:47:34 +08:00
Patrick Donnelly
5d8d691da2
Merge PR #41357 into master
* refs/pull/41357/head:
	mds: do not assert when receiving a unknow metric type

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-05-18 13:43:28 -07:00
Patrick Donnelly
e1f1659b18
Merge PR #41347 into master
* refs/pull/41347/head:
	mon,doc: deprecate CephFS min_compat_client
	doc: add alternate_name cephfs feature to table

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-05-18 13:42:47 -07:00
Patrick Donnelly
d706e825ce
Merge PR #41332 into master
* refs/pull/41332/head:
	mds: place the journaler pointer under the mds_lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-18 13:42:09 -07:00
Patrick Donnelly
e9f7fafe52
Merge PR #41171 into master
* refs/pull/41171/head:
	test: disable mirroring module for certain tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-18 13:41:28 -07:00
Patrick Donnelly
4111780363
Merge PR #41097 into master
* refs/pull/41097/head:
	cephfs-mirror: allow connecting to local cluster using mon address

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
2021-05-18 13:40:45 -07:00
Patrick Donnelly
d59f2fbbcf
Merge PR #40885 into master
* refs/pull/40885/head:
	doc: document cephfs-mirror configuration options
	cephfs-mirror: use sensible mount timeout when mounting local/remote fs
	test: add tests for settting mount timeout
	pybind/cephfs: add interface to set mount timeout
	libcephfs: add interface to set mount timeout

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-18 13:36:05 -07:00
Patrick Donnelly
ba1aaae837
Merge PR #41371 into master
* refs/pull/41371/head:
	mds/Mutation: initialize MutationImpl object's initiated_at

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-18 13:20:20 -07:00
Sage Weil
ad8096e0a0 qa/suites/orch/rook: disable centos for now
We are hitting an selinux denial:

type=AVC msg=audit(1621353663.595:6016): avc: denied { write } for pid=28812 comm="cephcsi" name="pids.max" dev="cgroup" ino=2933 scontext=system_u:system_r:container_t:s0:c43,c177 tcontext=system_u:object_r:cgroup_t:s0 tclass=file permissive=1

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
ab33ca3655 qa/suites/orch/rook/smoke: initial smoke suite
- os: 18.04, 20.04, centos, centos+kubic
- nodes: 1 or 3
- rook: 1.6.2 or master
- k8s: 1.21 always (for now)
- net: calico always (flannel + centos is wonky)
- workload: none, rados bench

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
f765677b81 qa/tasks/rook: ROOK_HOSTPATH_REQUIRES_PRIVILEGED=true on centos
This fixes OSD creation on centos.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
929d6ad8ca qa/tasks/rook: simplify shutdown
For some reason deleting common.yaml sometimes fails.  Not really
sure why, but since we will tear down kubernetes anyway this
cleanup isn't really needed.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
e5148b3f59 qa/tasks/rook: archive logs
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
539cd362dd qa/tasks/rook: more orderly cluster teardown
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00