Commit Graph

94602 Commits

Author SHA1 Message Date
Casey Bodley
82cd04b9d7
Merge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch
rgw: Fix for SignatureMismatchError in s3 commands.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-30 12:39:39 -05:00
David Zafman
553d83dd24
Merge pull request #25403 from liyichao/rdigest
tools: Add clear-data-digest command to objectstore tool.

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-01-30 09:30:23 -08:00
David Zafman
894bdf080e
Merge pull request #26158 from dzafman/wip-38053
Add hashinfo testing for dump command of ceph-objectstore-tool

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-30 09:29:01 -08:00
Casey Bodley
0aebb55af5 qa/mon: fix cluster support for monmap bootstrap
-filter out mons from other clusters
-fix parsing of mon name from role

Fixes: http://tracker.ceph.com/issues/38115

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-01-30 12:24:36 -05:00
Mykola Golub
f22347db55 mgr: load modules in finisher to avoid potential lock cycles
Fixes: https://tracker.ceph.com/issues/37997
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-30 15:47:51 +00:00
Stephan Müller
a768571566 mgr/dashboard: Updated messages.xlf
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Stephan Müller
454f1caecf mgr/dashboard: Application icons in notifications
Now notifications and alerts show an application icon, that gives a hint
about their origin.

Fixes: https://tracker.ceph.com/issues/37950
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Stephan Müller
b5e0f997eb mgr/dashboard: Provide values with different style in KV-table
Now it's possible to style values inside the KV-table based on the
values.

Fixes: https://tracker.ceph.com/issues/37951
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Stephan Müller
8451e8c595 mgr/dashboard: Add the Prometheus alerts
The backend is now capable of receiving alert notifications from
the Prometheus alertmanager and it can get all alerts with all kinds of
parameters from the API of the same.

In the frontend Prometheus alerts can be found in "Cluster > Alerts". Incoming
notifications can be seen as usual in the notifications popover.

To clarify:
Prometheus alerts are received from the alertmanager API.
Prometheus alert notification are send from the alertmanager to the
backend receiver. An alert notification can have multiple alerts, but
these alerts differ from the prometheus alerts.

To clarify that, I've added some models and services.

If one of the methods to get alerts contains changes the user will be
notified.

The documentation explains how to configure the alertmanager to use the
dashboard receiver and how to connect the use of the alertmanager API.
Further it explains where to find the alerts and what happens if they
are configured and something is happening.

Fixes: https://tracker.ceph.com/issues/36721
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Pritha Srivastava
df47d26f6e rgw: Fix for SignatureMismatchError in s3 commands.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2019-01-30 21:09:34 +05:30
Lenz Grimmer
d239c2a8b4
Merge pull request #25638 from ricardoasmarques/iscsi-management-w
mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-01-30 15:56:48 +01:00
Lenz Grimmer
fda70511a8
Merge pull request #26172 from rhcs-dashboard/fix-skipped-api-tests
mgr/dashboard: fix skipped backend API tests

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-01-30 15:49:06 +01:00
Jan Fajerski
026d5b80fd ceph-volume: don't crash on unusable data devices
Also add test case for a MixedStrategy with unusable data devices.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-01-30 15:48:12 +01:00
Jan Fajerski
833c6a3ecf ceph-volume: add a wal device specific unit test and size validator
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-01-30 15:48:12 +01:00
Jan Fajerski
73978ca0c7 ceph-volume: add osd_ids argument
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-01-30 15:48:05 +01:00
alfonsomthd
e03d37f52a mgr/dashboard: Updated colors in PG Status chart
* For consistency:
  Set 'Clean' status color to 'HEALTH_OK' color
  (Cluster Status card).

  Set 'Warning' status color to 'HEALTH_WARN' color.

  'Working' (blue) & 'Unknown' (red) are kept due to
  previous consensus about these complementary colors
  in doughnut/pie charts.

* Renamed Health Pie colors for the sake of clarity.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-01-30 15:27:47 +01:00
Kefu Chai
8d5ddb5817
Merge pull request #26091 from tchaikov/wip-36737
cmake: use $CMAKE_BINARY_DIR for default $CEPH_BUILD_VIRTUALENV

Tested-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-30 21:35:52 +08:00
Sage Weil
1a9734c970 Merge PR #26142 into master
* refs/pull/26142/head:
	doc/dev/cephx: document current implementation of cephx

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-01-30 07:06:42 -06:00
Jason Dillaman
d07cc3b627
Merge pull request #26097 from trociny/wip-rbd-mirror-perf-lock
rbd-mirror: guard access to image replayer perf counters

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-30 07:52:41 -05:00
Jason Dillaman
347eac67ba
Merge pull request #26168 from shyukri/qa-rbd-replace-bench-write
qa: rbd/workunits : Replace "rbd bench-write" with "rbd bench --io-type write"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-01-30 07:51:55 -05:00
Juan Miguel Olmo Martínez
ec8b8cc59b
mgr/ansible: Replace Inventory Ansible playbook
A new Ansible playbook allows now to retrieve the storage devices information produced by ceph-volume.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-01-30 13:23:49 +01:00
alfonsomthd
c094e2d702 mgr/dashboard: fix skipped backend API tests
* When the creation of the cluster is delegated to vstart_runner.py
(--create or --create-target-only) the amount of MGRs required
is calculated by the script so there is no more skipped tests
due to insufficient amount of MGRs.

* Additionally, this issue is not reproducible anymore:
Fixes: https://tracker.ceph.com/issues/37964

* Fixed typo: TEUTHOLOFY_PY_REQS

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-01-30 13:05:02 +01:00
Lenz Grimmer
9ea48b7fba
Merge pull request #26162 from familyuu/crush
mgr/dashboard: CRUSH map viewer RFE

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-30 11:43:59 +01:00
Lenz Grimmer
8086a88329
Merge pull request #26182 from p-na/wip-pna-fix-pool-reload
mgr/dashboard: Fix reloading of pool listing

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-01-30 11:26:28 +01:00
Ricardo Marques
7ebc04d696
Merge pull request #26143 from LenzGr/master-documentation
doc: Updated feature list and overview in dashboard.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-30 09:49:35 +00:00
Tatjana Dehler
5307b55353 mgr/dashboard: Group buttons together into one button menu
Group the two buttons 'Set Cluster-wide Flags' and 'Set Cluster-wide
Recovery Priority' together into one button menu.

Fixes: http://tracker.ceph.com/issues/37380
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-01-30 10:32:47 +01:00
Sebastian Wagner
c5dcd0cea9
Merge pull request #25893 from sebastian-philipp/orchestrator-current-status
doc/orchestrator: Aligned Documentation with specification

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-01-30 09:48:11 +01:00
Lei Liu
b3bac28d08
pybind/mgr: PEP 8 code clean and fix typo
Signed-off-by: Lei Liu <liul.stone@gmail.com>
2019-01-30 15:30:07 +08:00
guodan1
411c423410 mgr/dashboard: CRUSH map viewer RFE
Fixes: http://tracker.ceph.com/issues/37794

Signed-off-by: familyuu <guodan1@lenovo.com>
2019-01-30 11:04:14 +08:00
Neha Ojha
ead6c226eb
Merge pull request #26175 from neha-ojha/wip-37919
osd/PG.cc: account for missing set irrespective of last_complete

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2019-01-29 16:19:34 -08:00
Neha Ojha
023b5f6a21
Merge pull request #25737 from arthurhsliu/patch-1
doc: fix typo in erasure coding example

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 16:11:26 -08:00
Yehuda Sadeh
8a5f3174fe rgw: es: query sent to elasticsearch needs content-type
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-29 15:33:01 -08:00
Yehuda Sadeh
6988ef0ae8 rgw: es: don't error out on index initialization
if index already exists. Assuming index was created externally.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-29 15:33:01 -08:00
Yehuda Sadeh
0bb0f234a4 rgw: rest cr: can return json decoded errors
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-29 15:33:00 -08:00
Yehuda Sadeh
1c3583c5ad rgw: es: fix v5+ index map settings
and rework the way it's being done

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-29 15:33:00 -08:00
Patrick Donnelly
3bc093fd9e
mds: add extra details for cache drop output
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:31 -08:00
Patrick Donnelly
30aaa884bf
qa: test mds_max_caps_per_client conf
That the MDS will not let a client sit above mds_max_caps_per_client caps.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:31 -08:00
Patrick Donnelly
48ca097a9f
mds: limit maximum number of caps held by session
This is to prevent unsustainable situations where a client has so many
outstanding caps that a linear traversal/operation on the session's caps takes
unacceptable amounts of time.

Fixes: http://tracker.ceph.com/issues/38022
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:31 -08:00
Patrick Donnelly
7244cae4b8
mds: adapt drop cache for incremental recall
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:31 -08:00
Patrick Donnelly
ef46216d8d
mds: recall caps incrementally
As with trimming, use DecayCounters to throttle the number of caps we recall,
both globally and per-session.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:30 -08:00
Patrick Donnelly
b750b3bb25
mds: adapt drop cache for incremental trim
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:30 -08:00
Patrick Donnelly
7bf2f31abf
mds: add throttle for trimming MDCache
This is necessary when the MDS cache size decreases by a significant amount.
For example, when stopping a large MDS or when the operator makes a large cache
size reduction.

Fixes: http://tracker.ceph.com/issues/37723

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:30 -08:00
Patrick Donnelly
69efdaf646
mds: cleanup SessionMap init
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:30 -08:00
Patrick Donnelly
ce153b8112
mds: cleanup Session init
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 15:16:30 -08:00
Sage Weil
9f7713a905 osd: refuse to start if release > recorded min_osd_release + 2
If we try to start up the objectstore, we may make writeable changes to
(say) rocksdb that are not backwards compatible.  This happens, for
example, if you start a mimic osd.  Even if the compatset checks fail,
rocksdb may have written something that is not backwards compatible.

Fixes: http://tracker.ceph.com/issues/38076
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-29 16:36:03 -06:00
Sage Weil
141c305c12 doc/dev/cephx: document current implementation of cephx
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-29 12:28:36 -06:00
Casey Bodley
f25e85696c rgw: only update last_trim marker on ENODATA
if cls_log_trim() returns 0, it may have stopped after 1000 entries
before trimming all the way to to_marker. only update last_trim on
ENODATA, so we continue trimming until done

Fixes: http://tracker.ceph.com/issues/38075

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-01-29 12:26:23 -05:00
Casey Bodley
0a506c8ff4
Merge pull request #26157 from cbodley/wip-rgw-olh-repair
rgw: repair olh attributes that were broken by sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-29 12:04:39 -05:00
Matt Benjamin
e3b6c8356e
Merge pull request #26002 from pritha-srivastava/wip-sts-assumerole-webidentity
rgw: Initial commit for AssumeRoleWithWebIdentity.
2019-01-29 11:58:50 -05:00
Kefu Chai
c6edb27b3a
Merge pull request #26110 from yaozongyou/fix-statistics-bug
mon: fix pg_sum_old not copied correctly

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-30 00:19:01 +08:00