Commit Graph

110907 Commits

Author SHA1 Message Date
Tatjana Dehler
8d91443c8b mgr/telemetry: refactor/enhance CLI commands
1. Move the implementations of the `on` and `off`
command into dedicated methods so that they can
be accessed by other mgr modules via `mgr.remote`.

2. Add a `show-all` command to return the report
and device report at once. Also add a method
`get_report` to make the reports accessible for
other mgr modules as mentioned above.

3. Add two  minor changes and a note where the
gathered data can be found to the Telemetry docu
file.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-04-29 15:08:35 +02:00
Lenz Grimmer
e2c8d49906
Merge pull request #34580 from bk201/wip-45106
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 14:42:47 +02:00
Lenz Grimmer
c7d602929a
Merge pull request #34587 from rhcs-dashboard/async_user_name
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-29 14:00:11 +02:00
Sebastian Wagner
ea085d6839 python-common: Fix wrong type annotation
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 13:22:22 +02:00
Sebastian Wagner
1cafad1244
Merge pull request #34733 from sebastian-philipp/cepahdm-15.2.2-release-notes
PendingReleaseNotes: Add Cephadm for >15.2.1

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-04-29 13:07:56 +02:00
Sebastian Wagner
1f889815ff pybind/mgr: Remove insights/tox.ini
All we need is part of mgr/tox.ini nowadays.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 13:02:37 +02:00
Adam Kupczyk
f2db105438 kv/KeyValueDB, os/bluestore: Made fsck faster by not caching results
Added ability to pass extra options when creating iterators to KV.
Used that ability to perform fsck operations without caching results.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-29 12:32:20 +02:00
Lenz Grimmer
2c38355f66
Merge pull request #34682 from rhcs-dashboard/fix-45183-master
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 12:27:32 +02:00
Adam Kupczyk
6b254a7872 common: Add pretty_binary_string conversions
Moved all incarnations of pretty binary printing into one common place.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-04-29 12:03:12 +02:00
Kefu Chai
4eb64d38a6
Merge pull request #34251 from JackSlateur/doc-os-recommendations
doc/start/os-recommendations.rst: add Octopus' platform

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 17:43:39 +08:00
Alexandre Bruyelles
443c12070c
doc/start/os-recommendations.rst: add opensuse, comment centos7
Signed-off-by: Alexandre Bruyelles <jack@jack.fr.eu.org>
2020-04-29 11:12:20 +02:00
Sebastian Wagner
a057467ede PendingReleaseNotes: Add Cephadm for >15.2.1
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 11:04:59 +02:00
Sebastian Wagner
0230a614ee
Merge pull request #34590 from zdover23/wip-doc-cidr-network-troubleshooting2
ceph/doc: Add guidance for cidr network troubleshooting

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 10:45:51 +02:00
Lenz Grimmer
4b536f04bd
Merge pull request #34729 from votdev/issue_43081_show_prom_alerts_in_navbar
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-29 10:31:47 +02:00
Sebastian Wagner
d26b699a44
Merge pull request #34747 from varshar16/wip-doc-remove-duplicate-ps
doc/mgr/orchestrator: Remove duplicate ps from support table

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 09:53:36 +02:00
Joshua Schmid
cc5bf59413 doc/orchestrator: update docs to new syntax and updated examples
Signed-off-by: Joshua Schmid <jschmid@suse.de>
Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
2020-04-29 09:47:51 +02:00
Yuan Lu
7df57322c7 librbd: add aio_discard test case
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:32 +08:00
Yuan Lu
2a0514c7ab librbd: add aio_discard
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:25 +08:00
Yuan Lu
cd896c3bfc librbd: add DiscardRequest
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:18 +08:00
Yuan Lu
72263d5877 librbd: add DiscardLogOperation
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:08 +08:00
Yuan Lu
0532ae8e39 librbd: add DiscardLogEntry
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-29 14:44:01 +08:00
Kefu Chai
8cd7e3b1df test/crimson/cbt: increase stddev variance to 2.0
as per Mark requests. we've being observing

```
03:55:21 - WARNING  - cbt      - prefill/incerta04.front.sepia.ceph.com/1: iops_stddev: (or (less) (near 0.50)):: 434.037/69.2122  => rejected
...
04:37:52 - WARNING  - cbt      - rand/incerta04.front.sepia.ceph.com/0: iops_stddev: (or (less) (near 0.50)):: 3830.51/2473.17  => rejected
...
04:37:52 - WARNING  - cbt      - rand/incerta04.front.sepia.ceph.com/1: iops_avg: (or (greater) (near 0.05)):: 53916.0/57375.0  => rejected
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-29 12:39:00 +08:00
Kefu Chai
54a4eb0318
Merge pull request #34704 from jap/big-endian-day-operator
osd: Make the _day operator"" internals big-endian.

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-29 11:16:46 +08:00
Kefu Chai
9d3c85ac8e
Merge pull request #34812 from rzarzynski/wip-osd-drop-statechart-from-pgh
osd: drop unneeded inclusion of boost::statechart in PG.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 11:15:56 +08:00
Kefu Chai
d0fe246f7d
Merge pull request #34813 from rzarzynski/wip-osd-fix-typo-pglog
crimson/osd, osd: fix typos in PG Log-related comments

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 08:24:14 +08:00
Kefu Chai
34268fa536
Merge pull request #34791 from rzarzynski/wip-crimson-backfill-pgtemp-ref
crimson/osd: fix missed ref in ShardServices::send_pg_temp().

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-29 08:19:53 +08:00
Radoslaw Zarzynski
7816776e9d osd: s/log.bottom/log.tail/ in osd_types.h.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 23:48:58 +02:00
Radoslaw Zarzynski
9fb937c4d4 osd: fix typo in PGLog.cc.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 23:47:51 +02:00
Ilya Dryomov
4e3160a019 qa/tasks/rbd_fio: update NamedTemporaryFile usage for python3
Open the file in text mode to avoid 'bytes' objects.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-04-28 23:38:05 +02:00
Ilya Dryomov
aba9910388 qa/tasks/rbd: update NamedTemporaryFile usage for python3
- open the file in text mode to avoid 'bytes' objects

- 'bufsize' is now spelled 'buffering' and switching buffering off
  with 'buffering=0' is only allowed in binary mode.  As we need the
  file to be either in the page cache or on disk before we copy it
  to the remote, call flush().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-04-28 23:22:17 +02:00
Jason Dillaman
fe5ca0c4fb
Merge pull request #34753 from trociny/wip-44938-fixup
qa/workunits/rbd: retry the addition of a mirror pool peer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 16:43:19 -04:00
Radoslaw Zarzynski
06a2ea6168 osd: drop unneeded inclusion of boost::statechart in PG.h.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 22:19:51 +02:00
Jason Dillaman
97939567c5
Merge pull request #34699 from yison/rwl-image-writeback-cache-seq5
rbd/cache: Replicated Write Log core codes - aio_read

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 14:12:42 -04:00
Igor Fedotov
fe558c4dd1 os/bluestore: fix huge (>4GB) bluefs reads
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-28 20:09:16 +03:00
Radoslaw Zarzynski
eee9eed2bc crimson/osd: fix missed ref in ShardServices::send_pg_temp().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-04-28 18:28:51 +02:00
Mykola Golub
1ad816ae0c qa/workunits/rbd: fix peer_add helper
We need to temporary disable "exit on error" mode so it does not
abort when `rbd mirror pool peer add` returns "already exists"
error code.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-28 17:04:43 +01:00
Stephan Müller
5da7c02597 mgr/dashboard: ECP modal enhanced validation
New validations with meaningful error messages:
* For all plugins
  * k + m <= OSDs that are available
  * k > 1
* For LRC
  * Display calculation factor for k (always)
  * Show error calculation for k is not met (also shows calculation)
  * Display number of groups for l (always)
  * Show error if calculation for l is not met (also shows calculation)
* For SHEC
  * m <= k
  * c <= m

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
94a32d1a12 mgr/dashboard: Use of crush node class in ECP modal
Now the crush node class preselects root, failure domain and device
class in the erasure code profile modal.

Like for crush rule, now also if you try to delete an used ECP you can't
and the info box will show you, what pool is using the profile.

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
9adb251668 mgr/dashboard: Use of crush node class in crush rule modal
Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Stephan Müller
59673eb4ee mgr/dashboard: Crush node selection class
This class helps the erasure code profile modal and the crush rule modal
to determine which inputs can be made to create a decent rule or
profile.

Fixes: https://tracker.ceph.com/issues/44621
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-04-28 17:45:28 +02:00
Jason Dillaman
8d4ce1f5e8
Merge pull request #34700 from lixiaoy1/early_finish
librbd: Return read request early

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 11:22:41 -04:00
Lenz Grimmer
55c5ec5a70
Merge pull request #34285 from tspmelo/wip-cypress
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-04-28 16:13:28 +02:00
Casey Bodley
d266fe82a0
Merge pull request #30024 from vumrao/wip-vumrao-41061
radosgw-admin: add support for --bucket-id in bucket stats command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-28 08:29:19 -04:00
Enno Gotthold
dfb1e0020e
mgr/dashboard: Remove additional unneeded steps for the metrics calculation
Signed-off-by: Enno Gotthold <egotthold@suse.de>
2020-04-28 13:34:16 +02:00
Mykola Golub
d667e385a1 qa/workunits/rbd: fix list-mapped filter in unmap_device
In recent versions `rbd list-mapped` does not print the white space
at the end of the line.

Fixes: https://tracker.ceph.com/issues/45305
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-28 11:45:33 +01:00
Tiago Melo
ec45e2faa0 mgr/dashboard: E2E: Add navigateEdit method
This method should be use to navigate to the edit page.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-04-28 09:43:50 +00:00
Tiago Melo
4af6c855c0 mgr/dashboard: Replace Protractor with Cypress
Fixes: https://tracker.ceph.com/issues/44812

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-04-28 09:43:50 +00:00
Kefu Chai
9486206f5a
Merge pull request #34429 from xxhdx1985126/wip-crimson-recovery-pr
crimson: pglog based recovery ---- part 1

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-28 17:22:06 +08:00
Lenz Grimmer
56a2a9ab9f
Merge pull request #34656 from rhcs-dashboard/44935-custom-cherryPy-header
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen <nia@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-28 10:52:53 +02:00
Xiubo Li
028e214c97 qa/tasks/vstart_runner: fix TypeError of string argument expected, got 'bytes'
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-28 01:30:25 -04:00