Commit Graph

92123 Commits

Author SHA1 Message Date
Yehuda Sadeh
7c241f2c1d rgw: sys_obj service, move zone init to svc_zone
still wip

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
f46a94f8fc rgw: svc: more zone work, add zone_utils, quota services
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
ca8a636d08 rgw: more refactoring work, initial work on svc_rados
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:18:09 -08:00
Yehuda Sadeh
e44a5fe22e rgw: svc: initial work on zone_svc
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:18:09 -08:00
Yehuda Sadeh
add60c82ea rgw: basic rgw services registry
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:18:09 -08:00
Lenz Grimmer
d9c9cf65f0
Merge pull request #24719 from Devp00l/wip-issue-26861
mgr/dashboard: Remove _filterValue from CdFormGroup

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-08 18:09:38 +01:00
Sage Weil
dc80d27843 Merge PR #24333 into master
* refs/pull/24333/head:
	test: update librados tests for CLI arg syntax
	librados: update for CLI arg format change
	pybind: update python callers of force flags
	mon: convert remaining confirmation flags to CephBool
	ceph_argparse: introduce CephBool arguments
	test: remove quirky argparse case
	mgr,mon: use CephChoices for confirmation flags
	test: add cases for CLI's --key=val style
	mon: remove dead "cluster_snap" command
	pybind: enable --keyword=arguments in ceph_argparse
	ceph.in: some cleanups
	ceph.in: misc cleanups
	common: remove unused 'avail' field from commands
	mon: fix help string for `osd crush rule create-replicated`

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-08 10:52:16 -06:00
Lenz Grimmer
b0ae24b1d7
Merge pull request #24930 from tspmelo/wip-multiple-actions
mgr/dashboard: Fix duplicate tasks

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-08 17:14:46 +01:00
Lenz Grimmer
31cf0e86ee
Merge pull request #24974 from rhcs-dashboard/36712-cluser-hosts-fix
mgr/dashboard: fix for 'Cluster >> Hosts' page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-11-08 17:04:37 +01:00
Volker Theile
258223cabc mgr/dashboard: Improve CRUSH map viewer
Display the OSD state using a label.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-11-08 16:30:03 +01:00
Ricardo Marques
04f4d5053e mgr/dashboard: SAML 2.0 support
Fixes: https://tracker.ceph.com/issues/24268

Signed-off-by: Ricardo Dias <rdias@suse.com>
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-11-08 15:27:37 +00:00
Kefu Chai
cac0f5802a rpm,deb: libradospp1-dev should depend on librados-dev
because librados.hpp `#include`s librados.h

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-08 07:00:24 -08:00
Kefu Chai
38f99bc7af examples/librados: link c++ samples against libradospp
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-08 06:52:44 -08:00
Casey Bodley
c22e2c951d
Merge pull request #24530 from alimaredia/wip-rgw-dpp-gc-lc
rgw: refactor logging in gc and lc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 09:51:14 -05:00
Casey Bodley
57950584be
Merge pull request #24510 from pritha-srivastava/wip-sts-buffer-overflow
rgw: Fix for buffer overflow in STS op_post().

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-11-08 09:50:05 -05:00
Casey Bodley
e824900fb3
Merge pull request #24594 from theanalyst/wip-reshard-enoent
rgw: reshard add: fail correctly on a non existant bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2018-11-08 09:48:59 -05:00
Casey Bodley
750ffeff90
Merge pull request #24638 from linuxbox2/wip-reshard-st
radosgw-admin: translate reshard status codes (trivial)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:48:00 -05:00
Casey Bodley
b97e471022
Merge pull request #24816 from linuxbox2/wip-rgw-keystone-secret
rgw: move keystone secrets from ceph.conf to files

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:47:37 -05:00
Casey Bodley
38aab9f653
Merge pull request #24869 from joke-lee/wip-op-mask-radosgw-admin-rest
rgw: admin rest api support op-mask

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 09:46:44 -05:00
Casey Bodley
f40b6dba9b
Merge pull request #24887 from cbodley/wip-36662
rgw: beast frontend parses ipv6 addrs

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 09:45:59 -05:00
Alfredo Deza
9526587403 ceph-volume simple.trigger replace systemd with from_trigger keyword argument
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2018-11-08 09:14:24 -05:00
Alfredo Deza
4d9ad0d3d4 ceph-volume simple.activate allow a --no-systemd flag to skip systemctl actions
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2018-11-08 09:13:31 -05:00
Matt Benjamin
2b748220f8
Merge pull request #23906 from dongbula/nf-add-latency-after-finish-processing
rgw: add latency info in the log of req done
2018-11-08 09:04:22 -05:00
Lenz Grimmer
9a0a06592a
Merge pull request #24947 from votdev/bug_36708
mgr/dashboard: tasks.mgr.dashboard.test_osd.OsdTest failures

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-11-08 14:41:38 +01:00
Ilya Dryomov
fa65651f90
Merge pull request #24966 from daixiang0/correct-rbytes-description
doc: correct rbytes description

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2018-11-08 14:12:44 +01:00
alfonsomthd
a5a2da7dad mgr/dashboard: fix for 'Cluster >> Hosts' page
- Added permission mapping for 'tcmu-runner' service type.
- Avoid error caused by unmapped services' types:
  The hosts list should be visible even with not mapped services' types,
  as this mapping only decides whether the service being displayed has a link or not.

Fixes: https://tracker.ceph.com/issues/36712

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2018-11-08 12:34:14 +01:00
Xiang Dai
0c2c3e0316 doc: correct rbytes description
The default was changed from on to off in 4.6 because the way rbytes behaves can be surprising and sometimes confuses tools like rsync.

Signed-off-by: Xiang Dai <764524258@qq.com>
2018-11-08 17:56:47 +08:00
Kefu Chai
da0401af29
Merge pull request #24817 from tone-zhang/wip-64-assert
bluestore/NVMEDevice.cc: fix ceph_assert() when enable SPDK with 64KB kernel page size

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-07 21:24:09 -08:00
Kefu Chai
05c150bfb2
Merge pull request #24964 from Songweibin/wip-doc-rados
doc/rados: correct osd path in troubleshooting-mon.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-07 21:22:33 -08:00
Matt Benjamin
92a19f022b
Merge pull request #23940 from robbat2/wip-12713-chunked-encoding
rgw: use chunked encoding to get partial results out faster
2018-11-07 22:01:05 -05:00
lvshuhua
2e98edfe49 rgw: add latency info in the log of req done
Signed-off-by: lvshuhua <lvshuhua@cmss.chinamobile.com>
2018-11-08 10:46:20 +08:00
David Zafman
4ff0ecc510 osd: Improve SnapMapper handling of inconsistencies
My using nop() instead of setattr() we avoid crashing
a replica that is missing the object for some reason.
Although this is a corruption, it would be getting "fix"
by removal of the snapshot.

In the other cases we accept completely missing keys (ENOENT)
that happens when an object is removed somehow or missed
by recovery/backfill.

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-07 14:23:29 -08:00
Kefu Chai
0e1ec8dc20 qa: install libradospp-dev for librados_hello_world.yaml
libradospp-{dev,devel} is necessary for compiling sources in
examples/librados/hello_world.cc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:13:48 -08:00
David Zafman
02964703de
Merge pull request #24749 from dzafman/wip-36474
Add support for osd_delete_sleep configuration value

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-07 14:05:55 -08:00
Kefu Chai
70a26ed476 debian: libradospp-dev should depend on libradospp1 not libradospp
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
0e5bdd9d56 librados: remove rados_tmap_*
we have switched from tmap to omap long ago.

but keep the server side implementation around, in case ancient
client is still using these tmap APIs.

also, tmap_update() is kept, because librbd is using it for v1 image
backward compatibility.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
0a03a4e5c1 librados: add new setxattr overload back
this change reverts b8ff781ddc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
28f18c4e31 librados: remove redundant IoCtx::nobjects_begin() variants
this change partially reverts 6eca7d0889

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
6abc092dcc librados: deprecate ObjectWriteOperation::copy_from()
this change partially reverts 6eca7d0889

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
4fe2c2018a common: remove redundant implementations
this change reverts cac1d6f936

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Kefu Chai
d5aa8c61fd debian: loosen the Depends of python bindings packages
- python-* packages are using the C APIs which are not changed across
librados2 and librados3.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Mykola Golub
f5bb54eccd mgr: support performance counter descriptors compatibility
when a new type is added and still running an older osd.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-07 21:25:26 +02:00
Mykola Golub
f495b8cce9 osd: collect client perf stats when query is enabled
Fixes: https://tracker.ceph.com/issues/36091
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-07 21:25:25 +02:00
Julien Collet
30b47ee51c mgr: add OSDPerfMetricReport struct to MMgrReport
Signed-off-by: Julien Collet <julien.collet@cern.ch>
2018-11-07 21:15:38 +02:00
Andrew Schoen
bd350433f8
Merge pull request #24977 from alfredodeza/wip-bz1644265
ceph-volume util.encryption robust blkid+lsblk detection of lockbox

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-11-07 13:11:50 -06:00
Alfredo Deza
fc3e6ea3d9 ceph-volume util.encryption robust blkid+lsblk detection of lockbox
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-11-07 11:47:10 -05:00
Volker Theile
e6f130d470 mgr/dashboard: backend api tests: tasks.mgr.dashboard.test_osd.OsdTest failures
- Fix bug in Dashboard QA unit test framework. Don't set the application type header manually, this is done by the requests library if required.
- Enhance QA unit test helper: Print the response of the API request if it fails. This should help to identify the problem more easily.
- Fix bug in the OSD controller. A parameter needs to be converted to integer.
- Take care that the params of the request object are not modified.

The issue was introduced by PR https://github.com/ceph/ceph/pull/24475. The CherryPy json_in plugin disclosed the errorneous unit test helper implementation.

Fixes: https://tracker.ceph.com/issues/36708

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-11-07 17:36:53 +01:00
Matt Benjamin
59db1dc303
Merge pull request #24847 from pritha-srivastava/wip-rgw-assume-role-doc
rgw: Improvements to STS Lite documentation.
2018-11-07 10:39:12 -05:00
hsiang41
28707a4cd0 Avoid import _strptime failed
Failed to import _strptime because the import lockis held by another thread

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-07 22:07:40 +08:00
Boris Ranto
0f9816f131
Merge pull request #24841 from b-ranto/wip-deep-scrub
mgr/restful: Fix deep-scrub typo

Reviewed-by: John Spray <john.spray@redhat.com>
2018-11-07 14:48:54 +01:00