J. Eric Ivancich
9d5e9c3031
doc/rgw: add docs for rgw-orphan-list
and ceph-diff-sorted
...
Add man pages and documentation for both tools.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:33:56 -04:00
J. Eric Ivancich
e396064d9a
rgw: add rgw-orphan-list
tool & radosgw-admin bucket radoslist ...
...
Adds a `radosgw-admin` subcommand and walks the associated bucket
indices and manifests to generate the list of rados objects that
represent the rgw objects in the bucket(s).
Also adds a tool named `rgw-orphan-list`, which uses the radoslist
subcommand, that produces a list in a local file of what appear to be
rgw orphans.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
J. Eric Ivancich
eaa8f66ec0
rgw: add const-correctness to rgw_obj_manifest and svc_tier_rados
...
Mark functions as "const" or function parameters as "const" in order
to make those functions more widely callable.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:20:08 -04:00
Casey Bodley
a8762af4af
Merge pull request #34172 from cbodley/wip-44751
...
radosgw-admin: fix infinite loops in 'datalog list'
2020-05-04 12:30:18 -04:00
Casey Bodley
67415ea07b
Merge pull request #34286 from cbodley/wip-qa-rgw-cls-2pc-queue
...
qa/rgw: run ceph_test_cls_2pc_queue in verify suite
Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-05-04 12:29:14 -04:00
Casey Bodley
a3f1f21462
Merge pull request #29062 from zhangsw/rgw-reshard-stats
...
rgw: add check for index entry's existing when adding bucket stats during bucket reshard.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 12:28:21 -04:00
J. Eric Ivancich
16ca63002e
Merge pull request #34892 from ivancich/wip-fix-tests_ps
...
qa/rgw: fix issue error in tests_ps.py
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-04 12:10:18 -04:00
J. Eric Ivancich
9218065109
qa/rgw: fix issue error in tests_ps.py
...
The Python interpreter on teuthology complains about the lack of
parens in a print statement.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 11:35:25 -04:00
Patrick Donnelly
ec2fcf3035
Merge PR #34088 into master
...
* refs/pull/34088/head:
doc: mailmap: changes for octopus release
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-04 06:44:39 -07:00
Jan Fajerski
39a5fc1af3
Merge pull request #34436 from jschmid1/dg_affinity
...
ceph-volume: add ceph.osdspec_affinity tag
2020-05-04 14:15:15 +02:00
Lenz Grimmer
3af27bfb71
Merge pull request #34867 from tspmelo/wip-fix-table-filter
...
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-05-04 12:18:19 +02:00
Sebastian Wagner
e1360f1653
Merge pull request #34779 from mgfritch/cephadm-workunit-node-exporter-avail
...
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
2020-05-04 11:11:32 +02:00
Sebastian Wagner
d6872343ad
Merge pull request #34728 from ricardoasmarques/infer-config
...
cephadm: Infer config on "cephadm shell"
2020-05-04 11:11:01 +02:00
Sebastian Wagner
e150f0250c
Merge pull request #34723 from matthewoliver/cephadm_iscsi_remove_fqdn_enabled
...
cephadm: remove fqdn_enabled from ceph-iscsi
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-05-04 11:09:05 +02:00
Lenz Grimmer
b7b46a9691
Merge pull request #34448 from Devp00l/wip-44621
...
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-05-04 10:51:18 +02:00
Lenz Grimmer
9334471340
Merge pull request #33991 from SchoolGuy/monitoring/rbd-image-details
...
mgr/dashboard/grafana: Add rbd-image details dashboard
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-05-04 09:59:53 +02:00
Kefu Chai
516785822e
Merge pull request #34874 from tchaikov/wip-crimson-thread-pool-test
...
test/crimson: minimize the lexical scope of thread pool
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-05-02 11:52:41 +08:00
Josh Durgin
beaa4b04bc
Merge pull request #34880 from neha-ojha/wip-balancer-cleanup
...
qa/suites/rados/thrash*: remove upmap.yaml and off.yaml
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-05-01 13:15:58 -07:00
Gregory Farnum
294a662a86
Merge pull request #34536 from varshar16/wip-cephfs-shell-flake8-py3
...
cephfs-shell: Change tox testenv name to py3
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 12:30:00 -07:00
Neha Ojha
d46ea00320
qa/suites/rados/thrash*: add on.yaml
...
To test with balancer in upmap mode, which is the default.
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-01 18:49:36 +00:00
Neha Ojha
cb5611e0d5
qa/suites/rados/thrash*: remove upmap.yaml and off.yaml
...
The balancer is always on, so we don't need upmap.yaml.
off.yaml doesn't make sense anymore.
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-01 18:31:01 +00:00
Jason Dillaman
5b1e05fc25
Merge pull request #34765 from changchengx/doc
...
doc/rbd: explicit reminder for libvirt directory access permissions
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 12:33:00 -04:00
Casey Bodley
83cea4f3b7
Merge pull request #34877 from vumrao/wip-vumrao-45355
...
rgw/rgw_bucket: clear tenant string for non tenanted buckets in rgw_bucket_parse_bucket_key function.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-01 12:31:49 -04:00
Vikhyat Umrao
6c4594a6aa
rgw/rgw_bucket: clear tenant string for non tenanted buckets
...
in rgw_bucket_parse_bucket_key function.
Fixes: https://tracker.ceph.com/issues/45355
Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-05-01 08:28:55 -07:00
Jason Dillaman
efb6b656a1
Merge pull request #34787 from trociny/wip-45305
...
qa/workunits/rbd: fix list-mapped filter in unmap_device
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 11:23:02 -04:00
Changcheng Liu
f90b4997b8
doc/rbd: explicit remind the directory access right
...
It needs to create admin socket to use perf counter for
debug purpose. Remind the access right to directory.
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-05-01 22:51:18 +08:00
Jason Dillaman
384c3db1ed
Merge pull request #34756 from yison/rwl-image-writeback-cache-seq7
...
rbd/cache: Replicated Write Log core codes - aio_discard
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 10:41:28 -04:00
Yuri Weinstein
9bc92c3aac
Merge pull request #34575 from hillpd/suicide_grace_fix
...
rados: prevent ShardedOpWQ suicide_grace drop when waiting for work.
2020-05-01 07:33:10 -07:00
Yuri Weinstein
e10f02cbde
Merge pull request #34569 from ifed01/wip-ifed-more-bluefs-stats
...
os/bluestore: improve bluefs stats reporting
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-05-01 07:31:52 -07:00
Casey Bodley
e68c60ac73
Merge pull request #34376 from yuvalif/fix_amqp_routable_option
...
rgw/amqp: fix the "routable" delivery mode
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-01 09:00:01 -04:00
Kefu Chai
4c81db2abf
test/crimson: minimize the lexical scope of thread pool
...
to show the typical use case of thread pool in a better manner: thread
pool can be initialized *in* a seastar application.
also move `handle_exception()` out to catch all exceptions throwns in
the seastar app.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-05-01 15:05:22 +08:00
Kefu Chai
fcf222a589
Merge pull request #34657 from lxbsz/py3_com
...
qa/tasks/vstart_runner.py: to be python3 compatible
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 13:35:46 +08:00
Kefu Chai
d80e566c9e
Merge pull request #34824 from sebastian-philipp/python-common-fix-device-selection-type-annotation
...
python-common: Fix wrong type annotation
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-05-01 13:11:01 +08:00
Kefu Chai
f701ed8b26
Merge pull request #34846 from tchaikov/wip-45147
...
mgr: do not load disabled modules
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-05-01 13:08:29 +08:00
Kefu Chai
e44d861f27
Merge pull request #34786 from aclamk/wip-common-pretty-binary
...
common: Add pretty_binary_string conversions
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 13:06:59 +08:00
Kefu Chai
193a5b274b
Merge pull request #34772 from aclamk/wip-bs-faster-fsck-no-cache
...
kv/KeyValueDB, os/bluestore: Made fsck faster by not caching results
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-05-01 13:06:09 +08:00
Kefu Chai
c21200b614
Merge pull request #34754 from ifed01/wip-ifed-fix-45195
...
os/bluestore: fix improper blob usage while handling deferred big write.
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-01 13:04:30 +08:00
Kefu Chai
151557b850
Merge pull request #34738 from sebastian-philipp/insights-rm-tox
...
pybind/mgr: Remove insights/tox.ini
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 13:03:18 +08:00
Kefu Chai
a08ff8194c
Merge pull request #34690 from sebastian-philipp/cephadm-crush-keyring-erro
...
mgr/cephadm: raise, if crash keyring fails
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-05-01 13:02:18 +08:00
Kefu Chai
d14afb8fa9
Merge pull request #34632 from kotreshhr/bash-completion
...
bash_completion: Do not auto complete obsolete and hidden cmds
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-01 13:01:28 +08:00
Kefu Chai
befb2ab5a4
Merge pull request #34503 from ifed01/wip-ifed-fix-huge-bluefs-reads
...
os/bluestore: fix huge (>4GB) bluefs reads
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-05-01 13:00:05 +08:00
Kefu Chai
60b7772e40
Merge pull request #34363 from majianpeng/osd-thread-per-shard-ssd
...
osd: wakeup all threads of shard rather than one thread.
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2020-05-01 12:58:51 +08:00
Tiago Melo
873028a359
mgr/dashboard: Fix error when filtering table without data
...
Fixes: https://tracker.ceph.com/issues/45351
Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-04-30 17:18:20 +00:00
Casey Bodley
eba76abdf8
Merge pull request #34641 from yuvalif/fix_zer_size_in_notifications
...
rgw/notifications: fix zero size in notifications
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-30 10:21:34 -04:00
Casey Bodley
6c1f3cbb24
Merge pull request #34352 from smanjara/wip-dynamic-resharding
...
rgw: more multisite dynamic resharding pieces.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-30 10:02:12 -04:00
David Galloway
fee0cda092
Merge pull request #34743 from sebastian-philipp/doc-fix-getting-started
...
doc: fix "getting started" link
2020-04-30 08:57:47 -04:00
Kefu Chai
067adbf9a0
mgr: do not load disabled modules
...
an option named "mgr_disabled_modules" is added in this change to
prevent mgr from loading modules listed in this option. because mgr
loads *all* modules found in the configured path, and per
https://tracker.ceph.com/issues/45147 , python subinterpreter could hang
when loading numpy, so this behavior practically creates a deadlock
in mgr.
this issue is found when mgr uses python3.8 runtime. in development
environment, it'd be inconvenient to disable the offending mgr module
without changing the source code, even if we can choose to not install
them, for instance, the enduser can workaround this issue by
uninstalling `ceph-mgr-diskprediction-local`.
an option would be useful in this case, so we can add the module to the
list before mgr tries to load it.
as this issue is found with python3.8 + diskprediction_local (numpy), so
this mgr module is disabled by default if mgr is compiled with python3.8
runtime.
Fixes: https://tracker.ceph.com/issues/45147
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-30 19:11:22 +08:00
Kefu Chai
40d06ce623
mgr/PyModuleRegistry: probe modules using std::filesystem
...
for better readability
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-30 19:10:02 +08:00
Joshua Schmid
815f8e6470
ceph-volume: add osdspec_affinity flag to ceph-osd
...
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-04-30 12:07:36 +02:00
Joshua Schmid
b7bc6f7607
ceph-volume: add ceph.osdspec_affinity tag
...
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-04-30 12:07:35 +02:00