Commit Graph

122715 Commits

Author SHA1 Message Date
Sage Weil
41b3194bff doc/releases/pacific: note cepahdm ingress+rgw support
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-05 09:31:45 -05:00
David Galloway
20301d8599 doc: 16.2.2 Release Notes
Signed-off-by: David Galloway <dgallowa@redhat.com>
2021-05-04 19:39:39 -04:00
Casey Bodley
4854791236
Merge pull request #41152 from linuxbox2/wip-restore-rgw-lua
cmake: restore Lua scripting support for RGW

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-05-04 15:14:29 -04:00
Ernesto Puerta
b6e4d6fd25
Merge pull request #41024 from rhcs-dashboard/generate-manifest
mgr/dashboard: Generate NPM dependencies manifest

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-05-04 20:52:30 +02:00
Ernesto Puerta
9f5acc392d
Merge pull request #41062 from rhcs-dashboard/50519-fix-ssl-cmd
mgr/dashboard: fix set-ssl-certificate{,-key} commands

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-05-04 20:46:05 +02:00
Matt Benjamin
bbe461bb74 cmake: restore Lua scripting support for RGW
RGW linkage with Lua was broken by the following commit:

commit 7471fbfa4b
Author: Kefu Chai <kchai@redhat.com>
Date:   Mon Apr 26 22:44:16 2021 +0800

    cmake: require lua if WITH_CEPHFS is enabled

    in src/mds/Mantle.cc, the lua C binding APIs are used, so we should only
    require lua if WITH_CEPHFS is enabled.

    Signed-off-by: Kefu Chai <kchai@redhat.com>

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-05-04 12:09:45 -04:00
Patrick Donnelly
93bca2d0e9
Merge PR #41134 into master
* refs/pull/41134/head:
	doc/man: build and install cephfs-shell manpage
	doc/man/8/cephfs-shell: reformat options

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-04 07:32:51 -07:00
J. Eric Ivancich
7e70b15c43
Merge pull request #40926 from ivancich/wip-orphan-list-pools
rgw: allow rgw-orphan-list to process multiple data pools

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
2021-05-04 09:08:48 -04:00
Casey Bodley
b7718366c4
Merge pull request #40631 from cbodley/wip-49780
rgw/sts: read_obj_policy() consults iam_user_policies on ENOENT

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2021-05-04 08:08:51 -04:00
Kefu Chai
e870f7a428
Merge pull request #41033 from tchaikov/wip-osx-build
cmake,common: various cleanup for building on MacOS

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-05-04 19:11:52 +08:00
Sebastian Wagner
becbe5fc4a
Merge pull request #41045 from jmolmo/fix_cv_lvm_lock
mgr/cephadm: ceph-volume verbose only when fails

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-05-04 11:08:39 +02:00
Sebastian Wagner
2e195e977f
Merge pull request #40313 from jmolmo/purge_iscsi_config
mgr/cephadm: Remove gateway.conf from iscsi pool when service is removed

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-05-04 10:43:57 +02:00
Samuel Just
a47f9bf6b2
Merge pull request #40799 from myoungwon/wip-fix-null-promote-obc
osd: fix not set promote_obc when manifest object is rollbacked

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-05-04 00:55:33 -07:00
Kefu Chai
5191008aa4 doc/man: build and install cephfs-shell manpage
otherwise the manpage of cephfs-shell is not built and installed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-04 15:11:22 +08:00
Kefu Chai
0fa568b54a doc/man/8/cephfs-shell: reformat options
* format global options using option directive
* fix the header, so man/conf.py is able to parse
  the description
* define "Synopsis" section to be consistent with other manpages.
* drop reference to glossary using "term" as manapge does not have
  reference to glossary entries.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-04 15:11:22 +08:00
Patrick Donnelly
fc74911784
Merge PR #41066 into master
* refs/pull/41066/head:
	mds: session dumps num_completed_flushes
	mds: completed_requests -> num_completed_requests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:51:37 -07:00
Patrick Donnelly
5c1f350c8b
Merge PR #40963 into master
* refs/pull/40963/head:
	mds: do not trim the inodes from the lru list in standby_replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:46:16 -07:00
Patrick Donnelly
a52cc67249
Merge PR #40962 into master
* refs/pull/40962/head:
	test: add test to validate snap synchronization with parent directory snapshots
	cephfs-mirror: ignore parent directory snapshots when building snap map

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:43:47 -07:00
Patrick Donnelly
5fe5ec095c
Merge PR #40927 into master
* refs/pull/40927/head:
	mds: reset the return value for heap command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:39:41 -07:00
Patrick Donnelly
d65632289c
Merge PR #40903 into master
* refs/pull/40903/head:
	test: add test case for MDS privated inos accessing
	mds: make the lost+found dir accessible from clients
	mds: move the inos 1,2 and 3 macros to ceph_fs.h

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:37:34 -07:00
Patrick Donnelly
878d38bcfe
Merge PR #40882 into master
* refs/pull/40882/head:
	client: Fix executeable access check for the root user

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-05-03 17:35:24 -07:00
Patrick Donnelly
35dabfe69f
Merge PR #41120 into master
* refs/pull/41120/head:
	doc/_ext: ignore desc if it is unavailable
	doc/_ext: check "default" for None
	doc/_ext: print 0B if option value is 0
	doc/cephfs: render options using confval directive

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 14:51:55 -07:00
Casey Bodley
afaed75012
Merge pull request #41102 from soumyakoduri/set_acl_fix
rgw/acl: set_acl shouldn't overwrite bucket attrs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-05-03 14:27:58 -04:00
Alfonso Martínez
fb20990bca mgr/dashboard: fix set-ssl-certificate{,-key} commands
- Now create-self-signed-cert command relies on set-ssl-certificate{,-key} commands.
- Simplify the command testing and increase the test coverage.

Fixes: https://tracker.ceph.com/issues/50519
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-05-03 18:46:08 +02:00
Ilya Dryomov
5f12e85d91
Merge pull request #41093 from idryomov/wip-rbd-pwl-ssd-boundary
librbd/cache/pwl/ssd/WriteLog: don't crash on split log entries

Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2021-05-03 15:27:18 +02:00
Sage Weil
94acfd5ada Merge PR #41105 into master
* refs/pull/41105/head:
	qa/workunits/cephadm/test_cephadm: test zap-osds
	cephadm: add --zap-osds argument to rm_cluster
	cephadm: implement zap-osds --fsid ... command

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-05-03 08:28:15 -04:00
Ilya Dryomov
155ee28d98 librbd/cache/pwl/ssd/WriteLog: don't crash on split log entries
write_log_entries() will split a log entry at the end of the log, the
remainder is written to the beginning at DATA_RING_BUFFER_OFFSET.  On
the read side aio_read_data_block() doesn't handle this case and just
crashes.  Unless the workload in use is <= 4K, the image is rendered
unusable sooner or later.

Fixes: https://tracker.ceph.com/issues/50589
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-03 14:05:58 +02:00
Ilya Dryomov
7f17f21857
Merge pull request #41068 from idryomov/wip-rbd-pwl-ssd-capacity
librbd/cache/pwl/ssd/WriteLog: decrement m_bytes_allocated when retiring

Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2021-05-03 14:00:48 +02:00
myoungwon oh
127dd41fca osd: fix not set promote_obc when manifest object is rollbacked
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-05-03 19:14:59 +09:00
Ilya Dryomov
c804989a32
Merge pull request #41042 from tchaikov/wip-rbd-cls-sparse-size
librbd: 32-bit and libc++ portability fixups

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:31:06 +02:00
Soumya Koduri
f61227e472 rgw/acl: set_acl shouldn't overwrite bucket attrs
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-05-02 22:49:55 +05:30
Kefu Chai
659d01dcb5 doc/_ext: ignore desc if it is unavailable
there is chance that we don't have desc, desc_long or fmt_desc, in that
case, we should just skip desc before checking its length. so, just use
'if desc' which is able to check for None or empty string.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 19:57:29 +08:00
Kefu Chai
ab7cb630ae doc/_ext: check "default" for None
default could be None and we don't reference the default value using
`opt.default`, so this variable is always defined. to avoid printing
a None default value, check for a None value. see
https://jinja.palletsprojects.com/en/2.11.x/templates/#none

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 18:17:02 +08:00
Kefu Chai
d1aacf555e doc/_ext: print 0B if option value is 0
before this change, the rendered Default is "0Ei" if the default size is 0,
would be more readable if it is "0B" or "0".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 17:50:38 +08:00
Kefu Chai
79e8c4f9e8 doc/cephfs: render options using confval directive
less repeating, better maintainability this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 17:48:31 +08:00
Mykola Golub
f0bd648992
Merge pull request #41085 from idryomov/wip-rbd-nuke-source-spec-file
rbd: --source-spec-file should be --source-spec-path

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-05-02 12:11:10 +03:00
Kefu Chai
d0858dbfb4 librados/librados_c: check .symver support using cmake
the __asm__(".asmver ..") is a support provided by the compiler, so
would be better to detect it by either checking the compiler identifer
or just try it out.

in this change, instead of checking the building platform, we check this
feature using check_c_source_compiles().

in future, we could support versioned symbols using function attriubte
or symbol tables or version-script.

on platform where symbol versioning is not supported, we might need to
go with a different approach.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
7c0ed157d7 common/util: enable cgroup only on linux
cgroups, i.e. control groups, are a linux kernel feature. this is not
available on FreeBSD, Win32 or MacOS. furthermore, we are reading the
information of it by accessing files exposed using a tmpfs filesystem
mounted at /sys/fs/cgroup, which is not available on other systems.

in this change, instead of guarding it using `#ifndef _WIN32`, it is now
guraded using `defined(__linux__)`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
08034454e1 include/compat.h: declare cpu_set_t for MacOS
to appease the compiler as it needs to compile numa.cc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
d34aae8c86 common/Throttle: remove unused member variable
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
fab337c1d0 common/compat: detect memset_s() using check_function_exists()
more robust this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
a938108197 common/ceph_time: do not include non-existent header file
i have following error when building on MacOS

ceph/src/common/ceph_time.cc:29:10: fatal error: 'ostringstream' file not found
         ^~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
aeb1ef57f0 common/StackStringStream: make override method with "final"
this change also silences the warnings like:

src/common/StackStringStream.h:75:7: warning: 'overflow' overrides a member function but is not marked 'override' [-Winconsistent-missing-override]
  int overflow(int c)
      ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:12 +08:00
Kefu Chai
731ec94831 cmake: detect suseconds_t using CHECK_TYPE_SIZE
instead assuming it's a macro use CHECK_TYPE_SIZE to check it.

on Darwin, it's defined as `__darwin_suseconds_t`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:16:07 +08:00
Kefu Chai
78d4990ac4 cmake: do not build libblk if libblk_srcs is empty
if we don't or just not able to buld libblk, let's skip it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:15:15 +08:00
Kefu Chai
7471fbfa4b cmake: require lua if WITH_CEPHFS is enabled
in src/mds/Mantle.cc, the lua C binding APIs are used, so we should only
require lua if WITH_CEPHFS is enabled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:15:15 +08:00
Kefu Chai
d275875b0e cmake: check for empty string by its value
the behavior of cmake 3.17 is a little bit different as it consider

NOT _library STREQUAL ""

as true, if ${_library} is "".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 08:15:15 +08:00
Kefu Chai
5093c6f36e
Merge pull request #41116 from tchaikov/wip-in_addr_t
common/pick_address: define in_addr_t if it is not defined

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-02 08:09:03 +08:00
Kefu Chai
7e6a653dea
Merge pull request #41117 from tchaikov/wip-doc-cephfs-conf
doc/cephfs/mds-config-ref: remove duplicated confval

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-01 23:34:11 +08:00
Kefu Chai
a06f8edeca common/pick_address: define in_addr_t if it is not defined
neither mingw not not have in_addr_t defined, see
https://docs.microsoft.com/en-us/windows/win32/api/winsock2/ns-winsock2-in_addr,
so define it if it is not defined.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-01 23:30:53 +08:00