Commit Graph

107273 Commits

Author SHA1 Message Date
Abhishek L
72763b2deb
Merge pull request #31987 from linuxbox2/rgw-putacls-no-body
rgw: s3: don't require a body in S3 put-object-acl
2020-02-04 17:22:35 +01:00
Abhishek L
7c1a690560
Merge pull request #30684 from theanalyst/rgw/qa/rgw-admin-user-stats
qa: radosgw_admin: validate a simple user stats output

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-02-04 17:21:25 +01:00
Sage Weil
19928c13ec Merge PR #33048 into master
* refs/pull/33048/head:
	cephadm: fix error handling in `command_check_host()`
	cephadm: increase default retry_max value

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-04 07:08:22 -06:00
Sage Weil
b9a38a0371 Merge PR #32995 into master
* refs/pull/32995/head:
	cephadm: add group 'disk' to privileged container
	cephadm: adopt: disable ceph-volume unit on host
	cephadm: refactor privileged arg handling
	cephadm: chown block symlink targets
	cephadm-adoption-corpus: add stud-mon.tgz
	cephadm: adopt: rename leveldb *.ldb -> *.sst
	cephadm: adopt: by default, pull first
	cephadm: adopt: chown data content

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-04 07:07:01 -06:00
Sage Weil
3a3fd5679c Merge PR #33020 into master
* refs/pull/33020/head:
	osdc/Objecter: inline pool full check
	osdc/Objecter: remove duplicated pause check code
	osdc/Objecter: only pause if respects_full()
	osdc/Objecter: move respects_full() to op_target_t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-03 21:28:40 -06:00
Sage Weil
64ef3242bf Merge PR #32831 into master
* refs/pull/32831/head:
	common, include: drop the copy{_in} from bufferlist entirely.
	os/bluestore: switch copy_in() users to bufferlist::iterator.
	osdc: switch users of bufferlist::copy{_in} to iterators.
	osd: switch users of bufferlist::copy{_in} to iterators.
	rgw: switch copy{_in} users to bufferlist::iterator.
	ec: switch users of bufferlist::copy{_in} to iterators.
	cls/queue: switch users of bufferlist::copy{_in} to iterators.
	client: switch users of bufferlist::copy{_in} to iterators.
	*: switch trivial users of bufferlist::copy{_in} to iterators.
	test/bl: switch copy{_in} users to bufferlist::iterator.
	common, include: kill the bl::last_p member.
	common: encode for std::list<T> doesn't use bl::copy_in() anymore.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-03 21:28:19 -06:00
Josh Durgin
79040c2ea3
Merge pull request #32531 from zdover23/wip-doc-landing-page-update
doc: Added the crisp getting started guide to index.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-02-03 15:50:25 -08:00
Sage Weil
b5e5c753f4 cephadm: add group 'disk' to privileged container
This lets the osd read block devs that are group rw disk even after they
drop root privs.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-03 16:49:20 -06:00
Sage Weil
e17ffa6c11 Merge PR #32977 into master
* refs/pull/32977/head:
	qa/workunits/cephadm/test_cephadm.sh: add missing monitoring tests
	cephadm: simplify Monitoring.components structure
	cephadm: add proper tox type for monitoring components

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-02-03 16:28:04 -06:00
Sage Weil
0f61bbcdcb Merge PR #33012 into master
* refs/pull/33012/head:
	mgr/cephadm: prefix daemon ids with hostname
	cephadm: bootstrap: name mgr with $hostname.$random

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-03 16:27:51 -06:00
Sage Weil
1a529bf230 cephadm: adopt: disable ceph-volume unit on host
This might be a simple or lvm unit.  Disable it so that the host doesn't
try to start this OSD after a reboot.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-03 16:24:34 -06:00
Sage Weil
2884223817 cephadm: refactor privileged arg handling
Pass a bool if we want a privileged container instead of explicitly
passing --privileged.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-03 16:24:34 -06:00
Guillaume Abrioux
f67610c73c cephadm: fix error handling in command_check_host()
`find_program()` raises `ValueError` when the executable hasn't been
found. It means we need to catch `ValueError` exception in
`command_check_host()` and raise `Error` instead of `RuntimeError` since
only `Error` is caught at the end.

Typical failure:

```
INFO:cephadm:/usr/bin/ceph:stderr Error ENOENT: New host mon1 failed check: ['INFO:cephadm:podman|docker (/bin/podman) is present', 'INFO:cephadm:systemctl is present', 'Traceback (most recent call last):', '  File "<stdin>", line 2820, in <module>', '  File "<stdin>", line 2434, in command_check_host', '  File "<stdin>", line 796, in find_program', 'ValueError: lvcreate not found']
```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-02-03 18:43:39 +01:00
Guillaume Abrioux
fed96416dc cephadm: increase default retry_max value
When playing with cephadm, at multiple times, I've reached the max
number of attempt in `is_available()`

Increasing the `retry_max` helps to avoid failure like following:

```
INFO:cephadm:mgr not available, waiting (1/5)...
INFO:cephadm:mgr not available, waiting (2/5)...
INFO:cephadm:mgr not available, waiting (3/5)...
INFO:cephadm:mgr not available, waiting (4/5)...
INFO:cephadm:mgr not available, waiting (5/5)...
ERROR: mgr not available after 5 tries

```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-02-03 17:25:06 +01:00
Yuval Lifshitz
c5af4b3505
Merge pull request #32155 from yuvalif/wip-yuval-multidelete-notifications
rgw/pubsub: send notifications from multi-delete op
2020-02-03 18:02:06 +02:00
Sage Weil
1ad536ba40 mgr/cephadm: prefix daemon ids with hostname
This is friendlier to a human operator since they can immediately see
where an instance is located, as with the legacy scheme, while still
keeping the unique random suffix.  Use a . to separate so that we can
set per-host options.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-03 08:23:37 -06:00
Sebastian Wagner
97fffb13fe
Merge pull request #32859 from liewegas/wip-cephadm-services
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-03 14:27:38 +01:00
Abhishek L
b6aa44cad5
Merge pull request #33030 from smithfarm/wip-luminous-12.2.13-release-notes
doc: release notes for Luminous v12.2.13

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-02-03 13:32:50 +01:00
Abhishek L
f2f868c107
Merge pull request #33031 from smithfarm/wip-nautilus-14.2.7-release-notes
doc: release notes for Nautilus 14.2.7

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-02-03 13:32:05 +01:00
Kefu Chai
80487f4a60
Merge pull request #33038 from tchaikov/wip-librados-reinterpret-cast
librados: prefer reinterpret_cast over c-style cast

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-02-03 19:58:13 +08:00
Kefu Chai
0ac42dc7fd
Merge pull request #32933 from DimStar77/obs-mini
ceph.spec.in: Use pkgconfig() style BuildRequires for udev/libudev-devel

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-03 19:45:07 +08:00
Lenz Grimmer
4c9c4229ed
Merge pull request #32553 from tspmelo/wip-ts-strict
mgr/dashboard: Enable compiler options used by Angular --strict flag

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-02-03 11:33:33 +00:00
Kefu Chai
5fcf0641cd librados: prefer reinterpret_cast over c-style cast
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-03 18:16:09 +08:00
Kefu Chai
7c1f7807d7
Merge pull request #33016 from tchaikov/wip-do-cmake
do_cmake.sh: bail out if something goes wrong

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-02-03 17:15:16 +08:00
Michael Fritch
4535216267
qa/workunits/cephadm/test_cephadm.sh: add missing monitoring tests
add tests for node-exporter, prometheus, and grafana

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-02-02 21:08:02 -07:00
Michael Fritch
c37504e81c
cephadm: simplify Monitoring.components structure
by removing the nested image/metadata dict

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-02-02 21:08:02 -07:00
Zac Dover
97df0b5274 More commits to the landing page project.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-02-03 11:21:34 +10:00
Sage Weil
128095c219 cephadm: bootstrap: name mgr with $hostname.$random
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-02 09:43:13 -06:00
Patrick Donnelly
29d850fb7e
Merge PR #32570 into master
* refs/pull/32570/head:
	cephfs-shell: Add tests for setxattr, getxattr and listxattr
	cephfs-shell: Add listxattr command
	cephfs-shell: Add getxattr command
	cephfs-shell: Add setxattr command
	doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:56:50 -08:00
Patrick Donnelly
3a6f107331
Merge PR #31633 into master
* refs/pull/31633/head:
	cephfs-shell: Instead of assert use stat for tests in rmdir
	cephfs-shell: Add function for common rmdir test code
	cephfs-shell: Add rmdir test for non empty directory
	cephfs-shell: Add rmdir -p test for non empty directory
	cephfs-shell: Add rmdir -p test for non existing dir
	cephfs-shell: Add rmdir -p test to delete all dirs in given path
	cephfs-shell: Add rmdir -p test for root directory with empty directories
	cephfs-shell: Add rmdir test for valid file
	cephfs-shell: Add rmdir test for invalid directory
	cephfs-shell: Add rmdir test for valid directory
	cephfs-shell: Fix rmdir '-p' issues

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:52:23 -08:00
Sage Weil
b66f5df514 Merge PR #32986 into master
* refs/pull/32986/head:
	qa/tasks/ceph_manager: fix movement of cot exports with cephadm

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-01 10:47:56 -06:00
Nathan Cutler
08615ccba2 doc: release notes for Nautilus 14.2.7
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-01 12:45:03 +01:00
Nathan Cutler
b18a1ca4e1 doc: release notes for Luminous v12.2.13
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-01 12:28:20 +01:00
Ramana Raja
b7768eca2a
Merge pull request #32030 from vshankar/wip-mgr-volumes-clone
mgr/volumes: clone from snapshot
2020-02-01 13:17:51 +05:30
Sage Weil
4813b4132b Merge PR #33014 into master
* refs/pull/33014/head:
	mgr/dashboard: pass a list of drive_group to create_osds

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-31 23:28:44 -06:00
Sage Weil
25e7d92026 Merge PR #32973 into master
* refs/pull/32973/head:
	mgr/insights: make 'insights prune-health-history 0' zap current state

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-31 21:26:46 -06:00
Sage Weil
d8a7c73a48 Merge PR #32987 into master
* refs/pull/32987/head:
	qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-31 17:40:23 -06:00
Sage Weil
a5d848d206 Merge PR #32989 into master
* refs/pull/32989/head:
	qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-31 17:40:13 -06:00
Sage Weil
b02c3ff18b Merge PR #32830 into master
* refs/pull/32830/head:
	global: ensure CEPH_ARGS is decoded before early arg processing

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-31 17:31:44 -06:00
Sage Weil
798213b512 Merge PR #32806 into master
* refs/pull/32806/head:
	common/bl: fix accessibility of bptr's _off and _len fields.
	common/bl: drop get_raw() from the public buffer::ptr interface.
	common: drop sharing of buffer::raw outside bufferlist.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-31 17:31:31 -06:00
Sage Weil
42768600d4 qa/tasks/ceph_manager: fix movement of cot exports with cephadm
I think this will finally work...

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 17:26:10 -06:00
Sage Weil
da9d40f0cc cephadm: chown block symlink targets
Again, these need to match the container's uid/gid, not the host's.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 13:56:36 -06:00
Sage Weil
3792e423c5 cephadm-adoption-corpus: add stud-mon.tgz
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 13:56:36 -06:00
Sage Weil
5504b3e8c5 cephadm: adopt: rename leveldb *.ldb -> *.sst
We may be adopting from ubuntu, which means we need to rename these files.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 13:56:36 -06:00
Sage Weil
fc9c231e80 cephadm: adopt: by default, pull first
This just bit me: I had a months-old container revision locally and ended
up accidentally starting up ancient monitor code.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 13:56:36 -06:00
Sage Weil
4ac58eb1e1 cephadm: adopt: chown data content
The ceph uid/gid vary between distros.  Chown everything to match the
target distro.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 13:56:36 -06:00
Sage Weil
74b2cd6d9d osdc/Objecter: inline pool full check
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 12:01:19 -06:00
Sage Weil
c0482d7afa osdc/Objecter: remove duplicated pause check code
_calc_target() already pauses and unpauses based on the
target_should_be_paused() helper, and we just called _calc_target at the
top of this method.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 11:59:26 -06:00
Sage Weil
130596f321 osdc/Objecter: only pause if respects_full()
If the FULL_TRY or _FORCE flag is set on an op, then we should not pause
it due to a full flag.

Fixes: https://tracker.ceph.com/issues/43813
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 11:55:03 -06:00
Sage Weil
3ef8c4210f osdc/Objecter: move respects_full() to op_target_t
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 11:51:23 -06:00