Commit Graph

110922 Commits

Author SHA1 Message Date
Kefu Chai
ea5c668fea
Merge pull request #34594 from tchaikov/wip-more-tolerant-perf-test
test/crimson/cbt: increase stddev variance to 2

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2020-04-30 17:42:47 +08:00
Kefu Chai
39b561fe03
Merge pull request #34603 from liu-chunmei/crimson_msgr_local_conf
crimson/net: remove hardcoded msgr configuration

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-30 17:39:26 +08:00
Sebastian Wagner
ef8a2cde4f
Merge pull request #34707 from jschmid1/fix_orch_docs
doc/orchestrator: adapt to new syntax, add more examples

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-30 10:36:54 +02:00
Shilpa Jagannath
71b657b9d2 minor fix: run tests in python venv
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-30 12:39:50 +05:30
Yuri Weinstein
84fbf1c5cd
Merge pull request #34616 from ifed01/wip-ifed-fix-upgrade-super
os/bluestore: invoke _prepare_ondisk_format_super as the last op

Reviewed-by: Greg Farnum <gfarnum@redhat
2020-04-29 09:24:02 -07:00
Ricardo Marques
eb732dcbc5 cephadm: Infer config on "cephadm shell"
Fixes: https://tracker.ceph.com/issues/44792

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-04-29 16:31:29 +01:00
Lenz Grimmer
dc9973a7fb
Merge pull request #33462 from s0nea/wip-dashboard-telemetry-report
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-29 17:22:50 +02:00
Tatjana Dehler
18875ef337 mgr/dashboard: add telemetry report component
Add a telemetry component in order to give the user the
possibility to configure the telemetry module in a more
guided fashion. The component offers broader explanations,
shows a preview of the generated report and asks the user
to accept the license before enabling the module.

Fixes: https://tracker.ceph.com/issues/43956
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-04-29 16:34:00 +02:00
Tatjana Dehler
d2f76c91af mgr/dashboard: handle textarea and add tooltip
Enhance `Copy2ClipboardButtonDirective` in order to
handle `textarea`s and copy a formatted input.
Add a tooltip to the button, too.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-04-29 16:33:50 +02:00
Ilya Dryomov
c033094bfb
Merge pull request #34818 from idryomov/wip-krbd-tempfile-fixes
qa/tasks/rbd{,_fio}: update NamedTemporaryFile usage for python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 15:38:48 +02:00
Tatjana Dehler
8d91443c8b mgr/telemetry: refactor/enhance CLI commands
1. Move the implementations of the `on` and `off`
command into dedicated methods so that they can
be accessed by other mgr modules via `mgr.remote`.

2. Add a `show-all` command to return the report
and device report at once. Also add a method
`get_report` to make the reports accessible for
other mgr modules as mentioned above.

3. Add two  minor changes and a note where the
gathered data can be found to the Telemetry docu
file.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-04-29 15:08:35 +02:00
Lenz Grimmer
e2c8d49906
Merge pull request #34580 from bk201/wip-45106
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 14:42:47 +02:00
Lenz Grimmer
c7d602929a
Merge pull request #34587 from rhcs-dashboard/async_user_name
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-29 14:00:11 +02:00
Sebastian Wagner
ea085d6839 python-common: Fix wrong type annotation
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 13:22:22 +02:00
Sebastian Wagner
1cafad1244
Merge pull request #34733 from sebastian-philipp/cepahdm-15.2.2-release-notes
PendingReleaseNotes: Add Cephadm for >15.2.1

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-29 13:07:56 +02:00
Sebastian Wagner
1f889815ff pybind/mgr: Remove insights/tox.ini
All we need is part of mgr/tox.ini nowadays.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 13:02:37 +02:00
Adam Kupczyk
f2db105438 kv/KeyValueDB, os/bluestore: Made fsck faster by not caching results
Added ability to pass extra options when creating iterators to KV.
Used that ability to perform fsck operations without caching results.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-29 12:32:20 +02:00
Lenz Grimmer
2c38355f66
Merge pull request #34682 from rhcs-dashboard/fix-45183-master
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 12:27:32 +02:00
Adam Kupczyk
6b254a7872 common: Add pretty_binary_string conversions
Moved all incarnations of pretty binary printing into one common place.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-29 12:03:12 +02:00
Kefu Chai
4eb64d38a6
Merge pull request #34251 from JackSlateur/doc-os-recommendations
doc/start/os-recommendations.rst: add Octopus' platform

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 17:43:39 +08:00
Alexandre Bruyelles
443c12070c
doc/start/os-recommendations.rst: add opensuse, comment centos7
Signed-off-by: Alexandre Bruyelles <jack@jack.fr.eu.org>
2020-04-29 11:12:20 +02:00
Sebastian Wagner
a057467ede PendingReleaseNotes: Add Cephadm for >15.2.1
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 11:04:59 +02:00
Sebastian Wagner
0230a614ee
Merge pull request #34590 from zdover23/wip-doc-cidr-network-troubleshooting2
ceph/doc: Add guidance for cidr network troubleshooting

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 10:45:51 +02:00
Lenz Grimmer
4b536f04bd
Merge pull request #34729 from votdev/issue_43081_show_prom_alerts_in_navbar
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 10:31:47 +02:00
Sebastian Wagner
d26b699a44
Merge pull request #34747 from varshar16/wip-doc-remove-duplicate-ps
doc/mgr/orchestrator: Remove duplicate ps from support table

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 09:53:36 +02:00
Joshua Schmid
cc5bf59413 doc/orchestrator: update docs to new syntax and updated examples
Signed-off-by: Joshua Schmid <jschmid@suse.de>
Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
2020-04-29 09:47:51 +02:00
Yuan Lu
7df57322c7 librbd: add aio_discard test case
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:32 +08:00
Yuan Lu
2a0514c7ab librbd: add aio_discard
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:25 +08:00
Yuan Lu
cd896c3bfc librbd: add DiscardRequest
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:18 +08:00
Yuan Lu
72263d5877 librbd: add DiscardLogOperation
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:08 +08:00
Yuan Lu
0532ae8e39 librbd: add DiscardLogEntry
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:01 +08:00
Kefu Chai
8cd7e3b1df test/crimson/cbt: increase stddev variance to 2.0
as per Mark requests. we've being observing

```
03:55:21 - WARNING  - cbt      - prefill/incerta04.front.sepia.ceph.com/1: iops_stddev: (or (less) (near 0.50)):: 434.037/69.2122  => rejected
...
04:37:52 - WARNING  - cbt      - rand/incerta04.front.sepia.ceph.com/0: iops_stddev: (or (less) (near 0.50)):: 3830.51/2473.17  => rejected
...
04:37:52 - WARNING  - cbt      - rand/incerta04.front.sepia.ceph.com/1: iops_avg: (or (greater) (near 0.05)):: 53916.0/57375.0  => rejected
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-29 12:39:00 +08:00
Kefu Chai
54a4eb0318
Merge pull request #34704 from jap/big-endian-day-operator
osd: Make the _day operator"" internals big-endian.

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-29 11:16:46 +08:00
Kefu Chai
9d3c85ac8e
Merge pull request #34812 from rzarzynski/wip-osd-drop-statechart-from-pgh
osd: drop unneeded inclusion of boost::statechart in PG.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 11:15:56 +08:00
Kefu Chai
d0fe246f7d
Merge pull request #34813 from rzarzynski/wip-osd-fix-typo-pglog
crimson/osd, osd: fix typos in PG Log-related comments

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 08:24:14 +08:00
Kefu Chai
34268fa536
Merge pull request #34791 from rzarzynski/wip-crimson-backfill-pgtemp-ref
crimson/osd: fix missed ref in ShardServices::send_pg_temp().

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 08:19:53 +08:00
Radoslaw Zarzynski
7816776e9d osd: s/log.bottom/log.tail/ in osd_types.h.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 23:48:58 +02:00
Radoslaw Zarzynski
9fb937c4d4 osd: fix typo in PGLog.cc.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 23:47:51 +02:00
Ilya Dryomov
4e3160a019 qa/tasks/rbd_fio: update NamedTemporaryFile usage for python3
Open the file in text mode to avoid 'bytes' objects.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-04-28 23:38:05 +02:00
Ilya Dryomov
aba9910388 qa/tasks/rbd: update NamedTemporaryFile usage for python3
- open the file in text mode to avoid 'bytes' objects

- 'bufsize' is now spelled 'buffering' and switching buffering off
  with 'buffering=0' is only allowed in binary mode.  As we need the
  file to be either in the page cache or on disk before we copy it
  to the remote, call flush().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-04-28 23:22:17 +02:00
Jason Dillaman
fe5ca0c4fb
Merge pull request #34753 from trociny/wip-44938-fixup
qa/workunits/rbd: retry the addition of a mirror pool peer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 16:43:19 -04:00
Radoslaw Zarzynski
06a2ea6168 osd: drop unneeded inclusion of boost::statechart in PG.h.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 22:19:51 +02:00
Jason Dillaman
97939567c5
Merge pull request #34699 from yison/rwl-image-writeback-cache-seq5
rbd/cache: Replicated Write Log core codes - aio_read

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 14:12:42 -04:00
Igor Fedotov
fe558c4dd1 os/bluestore: fix huge (>4GB) bluefs reads
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-28 20:09:16 +03:00
Radoslaw Zarzynski
eee9eed2bc crimson/osd: fix missed ref in ShardServices::send_pg_temp().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 18:28:51 +02:00
Mykola Golub
1ad816ae0c qa/workunits/rbd: fix peer_add helper
We need to temporary disable "exit on error" mode so it does not
abort when `rbd mirror pool peer add` returns "already exists"
error code.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-28 17:04:43 +01:00
Stephan Müller
5da7c02597 mgr/dashboard: ECP modal enhanced validation
New validations with meaningful error messages:
* For all plugins
  * k + m <= OSDs that are available
  * k > 1
* For LRC
  * Display calculation factor for k (always)
  * Show error calculation for k is not met (also shows calculation)
  * Display number of groups for l (always)
  * Show error if calculation for l is not met (also shows calculation)
* For SHEC
  * m <= k
  * c <= m

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
94a32d1a12 mgr/dashboard: Use of crush node class in ECP modal
Now the crush node class preselects root, failure domain and device
class in the erasure code profile modal.

Like for crush rule, now also if you try to delete an used ECP you can't
and the info box will show you, what pool is using the profile.

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
9adb251668 mgr/dashboard: Use of crush node class in crush rule modal
Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
59673eb4ee mgr/dashboard: Crush node selection class
This class helps the erasure code profile modal and the crush rule modal
to determine which inputs can be made to create a decent rule or
profile.

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00