Commit Graph

92450 Commits

Author SHA1 Message Date
Casey Bodley
2217c0f018 qa/rgw: radosgw_admin_rest.py uses /admin/user?list for user listing
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-30 12:22:23 -05:00
Casey Bodley
abfefe5f27 qa/rgw: fix invalid syntax error in radosgw_admin_rest.py
Fixes: http://tracker.ceph.com/issues/37440

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-28 10:53:23 -05:00
Lenz Grimmer
4db915d06d
Merge pull request #25290 from noahdesu/dashboard-tox-workdir
mgr/dashboard: use dedicated tox working dir

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-11-28 12:17:39 +01:00
Lenz Grimmer
ebd9a1632a
Merge pull request #25179 from tspmelo/wip-check-i18n
mgr/dashboard: Add i18n validation script

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-11-28 11:19:06 +01:00
Lenz Grimmer
720e0d4bfd
Merge pull request #24900 from zmc/wip-minimal-health
mgr/dashboard: Replace dashboard service

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-11-28 10:56:40 +01:00
Kefu Chai
57160722b4
Merge pull request #25280 from tchaikov/wip-ceph-py3
ceph.in: write bytes to stdout in raw_write()

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-28 13:14:19 +08:00
Kefu Chai
3fb560a422
Merge pull request #25261 from sebastian-philipp/mgr-handle-command-result
mgr: Add `HandleCommandResult` namedtuple
2018-11-28 13:12:05 +08:00
Kefu Chai
73e92ab7fa
Merge pull request #25255 from tchaikov/wip-ceph-dencoder-without-cephfs
tools/ceph-dencoder: conditionally link against mds
2018-11-28 13:10:05 +08:00
Kefu Chai
1c97ce4aad
Merge pull request #25244 from trociny/wip-crash-procname
mgr/crash: add process name to crash metadata

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-28 13:08:53 +08:00
Kefu Chai
56142dfb23
Merge pull request #24990 from dragonylffly/wip-fix-bench
tools/rados: always call rados.shutdown() before exit()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-28 13:07:59 +08:00
Kefu Chai
2a6d98127d
Merge pull request #24939 from marcosps/simplify_examples
examples/librados: Remove not needed else clauses

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-28 13:04:07 +08:00
Sage Weil
cdcc5b4521 Merge PR #24502 into master
* refs/pull/24502/head:
	crushtool: implement --rebuild-class-roots command
	crushtool: make --reweight re-sum choose_args weight-sets too
	crushtool: --reweight should only reweight nonshadow roots
	crush/CrushWrapper: reclassify: use default parent for created buckets
	crush/CrushWrapper: reclassify: handle to-be-created buckets that we need twice
	test/cli/crushtool/reclassify: add second gabe test case
	crushtool: add --set-subtree-class; do not set class via --reclassify-root
	test/cli/crushtool/reclassify: add reclassify test cases
	doc/rados/operations/crush*: document reclassify
	doc/rados/operations/crush: remove instructions for separate crush trees for ssd
	crushtool: add --compare command
	crushtool: implement --reclassify
	crush/CrushCompiler: fix id scan to include class ids

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-27 21:32:04 -06:00
Sage Weil
6fe1ea0dd5 crushtool: implement --rebuild-class-roots command
This simply rebuilds the class roots.  Normally this should create no
change in the map since whatever was making changes to the map before
should have rebuild the shadow roots at that point.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
0f6a36e1e4 crushtool: make --reweight re-sum choose_args weight-sets too
This ensures that the weights add us for each weight-set (and each
position).  Note that since we don't have anything that actually
creates positional weight-sets, the behavior here might not be what we
want in the end, but for the compat weight-sets (no position), we *do*
keep the weights as a properly summing tree.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
c9921dc7e9 crushtool: --reweight should only reweight nonshadow roots
The shadow roots will be then be rebuilt accordingly.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
dec38c69cb crush/CrushWrapper: reclassify: use default parent for created buckets
Note that these last 2 fixes also fix the 'h' test case.  \o/

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
c2211e851d crush/CrushWrapper: reclassify: handle to-be-created buckets that we need twice
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
1028bf832a test/cli/crushtool/reclassify: add second gabe test case
New adjusted test map from Dan.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
7a80f993f4 crushtool: add --set-subtree-class; do not set class via --reclassify-root
Sometimes we don't want the --reclassify-root to set the class of every
device because a small number of them are (correctly) a different class.
Allow both behaviors by adding a new, separate command to set the class
of all devices beneath a point in the hierarchy and do not implicitly do
that relabeling as part of --reclassify-root.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
cb327b8f42 test/cli/crushtool/reclassify: add reclassify test cases
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
505050befd doc/rados/operations/crush*: document reclassify
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Zack Cerza
50b7d42fe5 mgr/dashboard: Replace dashboard service
This splits out the collection of health and log data from the
/api/dashboard/health controller into /api/health/{full,minimal} and
/api/logs/all.

/health/full contains all the data (minus logs) that /dashboard/health
did, whereas /health/minimal contains only what is needed for the health
component to function. /logs/all contains exactly what the logs portion
of /dashboard/health did.

By using /health/minimal, on a vstart cluster we pull ~1.4KB of data
every 5s, where we used to pull ~6KB; those numbers would get larger
with larger clusters. Once we split out log data, that will drop to
~0.4KB.

Fixes: http://tracker.ceph.com/issues/36675

Signed-off-by: Zack Cerza <zack@redhat.com>
2018-11-27 16:08:53 -07:00
Patrick Donnelly
54640f7cd8
Merge PR #24923 into master
* refs/pull/24923/head:
	mds: properly update freeze_tree_state when fragmenting dirfrags

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-27 14:47:03 -08:00
Noah Watkins
9b125b087a mgr/dashboard: use dedicated tox working dir
Avoids conflicting with other test environments.

Fixes: https://tracker.ceph.com/issues/37405

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-11-27 14:28:47 -08:00
Patrick Donnelly
3358e3a2d6
Merge PR #24849 into master
* refs/pull/24849/head:
	client: remove redundant abort logic during dentry invalidation test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-11-27 14:23:20 -08:00
Patrick Donnelly
b76f14569d
Merge PR #24886 into master
* refs/pull/24886/head:
	qa: fix delay type config name

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-11-27 13:58:26 -08:00
Patrick Donnelly
302e4f4af2
Merge PR #24839 into master
* refs/pull/24839/head:
	ceph-volume-client: allow setting mode of CephFS volumes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-27 13:53:50 -08:00
Zack Cerza
a90b5ac7c7 Allow specifying a schema for unknown JObj keys
Signed-off-by: Zack Cerza <zack@redhat.com>
2018-11-27 12:47:26 -07:00
Patrick Donnelly
c7607f6371
Merge PR #25020 into master
* refs/pull/25020/head:
	script/ceph-backport.sh: adjust to change in github API

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-27 10:36:03 -08:00
Lenz Grimmer
55e2ee34f0
Merge pull request #25235 from sebastian-philipp/dashboard-fix-type-annotation-error
qa/mgr/dashboard: Fix type annotation error.

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-11-27 18:19:27 +01:00
Sebastian Wagner
4eadada5c6 mgr: Add HandleCommandResult namedtuple
Mostly a documentation improvement to make it obvious
what `handle_command` is supposed to return .

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-27 17:36:04 +01:00
Kefu Chai
9c0141caae
Merge pull request #25268 from smithfarm/wip-37392
qa/workunits/rados/test_librados_build.sh: grab files from explicit git branch

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-27 23:22:51 +08:00
Kefu Chai
ffd8795805
Merge pull request #25129 from rzarzynski/wip-common-annotate
common: avoid the overhead of ANNOTATE_HAPPENS_* in NDEBUG builds.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-27 23:18:48 +08:00
Alfredo Deza
b284bcc626
Merge pull request #25224 from sebastian-philipp/ceph-volume-fix-json
ceph-volume: fix JSON output in `inventory`

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-27 10:05:31 -05:00
Kefu Chai
44a4422d2e
Merge pull request #25256 from tchaikov/wip-kv-bench-cleanup
ceph_kvstorebench: include <errno.h> not asm-generic/errno.h

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-11-27 22:32:53 +08:00
Casey Bodley
b54b1db0f4
Merge pull request #25073 from oshynsong/master
rgw: add list user admin OP API

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-27 09:08:01 -05:00
Abhishek L
eda51771f2
Merge pull request #25034 from smithfarm/wip-luminous-notes-12.2.10
doc: Luminous v12.2.10 release notes

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Yuri Weinstein <yweinstein@redhat.com>
2018-11-27 13:46:58 +01:00
Kefu Chai
319c8507ea ceph.in: write bytes to stdout in raw_write()
in python3, sys.stdout.buffer is an io.BufferedWriter, while in python2
`sys.__stdout__` is a plain file. the former only accepts "bytes". so if
we send it a "str", it complains:

TypeError: a bytes-like object is required, not 'str'

it happens when quitting from the interactive mode of ceph CLI. in that
case, `new_style_command()` returns a tuple of `0, '\n', ''`, where the
second element is a str.

in this change, we always send `bytes` to raw_stdout.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-27 19:26:08 +08:00
Lenz Grimmer
0d10254b48
Merge pull request #25107 from familyuu/pool
mgr/dashboard: Allow renaming an existing Pool

Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-27 12:03:43 +01:00
Sebastian Wagner
4fe1344696 qa/mgr/dashboard: Fix type annotation error.
Also removed unused import

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-27 11:45:22 +01:00
guodan1
2f1f55c08a mgr/dashboard: Allow renaming an existing Pool
fixes: http://tracker.ceph.com/issues/36560
Signed-off-by: guodan1 <guodan1@lenovo.com>
2018-11-27 16:19:19 +08:00
Mykola Golub
58a0fae815 mgr/crash: group by process name in 'ceph crash json_report'
It is almost the same for daemons like osd or mon, but much better
for 'client' daemons like rgw or rbd-mirror.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-27 09:27:30 +02:00
Mykola Golub
d8b094c81c mgr/crash: add process name to 'ceph crash ls' output
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-27 09:27:30 +02:00
Mykola Golub
31e6d10e54 global: add process_name to crash meta
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-27 09:27:30 +02:00
Kefu Chai
232a89069b
Merge pull request #25251 from tchaikov/wip-bionic-dockerfile
tests: add ubuntu 18.04 dockerfile

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-11-27 14:30:45 +08:00
Kefu Chai
ab4459b487
Merge pull request #25245 from wjwithagen/wjw-fix-install-flake8
install-deps.sh: Update python requirements for FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-27 14:07:42 +08:00
Kefu Chai
06264dd1ee
Merge pull request #25146 from noahdesu/separate-tox-workdir
mgr/insights: use dedicated tox working dir

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-27 14:01:12 +08:00
Kefu Chai
2357526a50
Merge pull request #25177 from iotcg/master
make-debs.sh: clean dir to allow building deb packages multiple times

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-27 13:09:22 +08:00
Li Wang
2c14926288 tools/rados: always call rados.shutdown() before exit()
When connected to ceph cluster, if call exit(1) directly, will cause the finisher
thread segmentation fault as follows,

Caught signal (Segmentation fault) **in thread 7f45377fe700 thread_name:fn_anonymous

run 'rados mapext' without other arguments could easily get it. This patch fixes it
by calling rados.shutdown() before exit()

Fixes: http://tracker.ceph.com/issues/36732

Signed-off-by: Li Wang <laurence.liwang@gmail.com>
2018-11-27 03:35:53 +00:00
Li Wang
3804f52b10 tools/rados: use unique_ptr for better memory management
Signed-off-by: Li Wang <laurence.liwang@gmail.com>
2018-11-27 03:15:26 +00:00