Commit Graph

91122 Commits

Author SHA1 Message Date
James McClune
43540c3eb3
doc: updated cluster map reference link
Updated cluster map reference link in rados/troubleshooting/troubleshooting-mon.rst
Fixes: https://tracker.ceph.com/issues/36336

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-10-07 21:48:31 -04:00
Sage Weil
2e66381c95 PendingReleaseNotes: add note about increased mon memory footprint
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-07 17:18:05 -05:00
Sage Weil
6af6127748 doc/start/hardware-recommendations: refresh recommendations for RAM
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-07 17:18:05 -05:00
Sage Weil
cbfc3ee192 rocksdb: increase default cache size to 512 MB
For filestore OSDs, this is probably a good idea anyway, and is generally
not going to be hugely impactful on the memory footprint (where users
have been told to provide 1 GB RAM per 1 TB storage for a long time now).

For bluestore OSDs, this value is meaningless as we're autotuning this
anyway.

For mons, this is a more reasonable default.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-07 17:18:05 -05:00
Sage Weil
1ce6429251 mon: mon_osd_cache_size = 500 (from 10)
10 maps is too small to enable all mon sessions to keep abreast of the
latest maps, especially if OSDs are down for any period of time during an
upgrade.

Note that this is quite a bit larger, but the memory usage of the mon will
scale proportionally to the size of the cluster: 500 small osdmaps is not
a significant amount of RAM, while conversely having a large cache is
most important on a large cluster and those mons will generally have
plenty of RAM available.

Someday we should control this with a memory envelope like we do with the
OSDs, but that remains future work.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-07 17:18:05 -05:00
Mykola Golub
f2d72d46d4 qa/workunits/rbd: fix cli generic namespace test
expect_fail incorrectly unset '-e' option and if a consequent test
failed it did not abort the execution. And two typos in the namespace
tests were not detected due to this.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-07 15:09:25 +03:00
Patrick Donnelly
d4766462fe
Merge PR #24437 into master
* refs/pull/24437/head:
	PendingReleaseNotes: add note for mds drop cache

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2018-10-05 10:16:11 -07:00
Matt Benjamin
544019a848
Merge pull request #24444 from theanalyst/wip-reshard-stats
rgw: copy actual stats from the source shards during reshard
2018-10-05 11:59:56 -04:00
Jeff Layton
0bbca1c665 mgr/orchestrator: clarify error message about kubernetes python module
When I saw this message, it took a bit of digging for me to understand
that it meant the _python_ module and not some missing ceph-mgr module.
Let's make that clear.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-10-05 11:16:46 -04:00
Jeff Layton
9bca82d00e tests/libcephfs: add simple reclaim test
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-10-05 10:18:28 -04:00
Matt Benjamin
f873c5957f
Merge pull request #23504 from pritha-srivastava/wip-sts-authentication
rgw: Code for STS Authentication.
2018-10-05 09:56:11 -04:00
Jason Dillaman
b4e2ad943d librbd: remove non-performance sensitive cached config values
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-05 09:54:54 -04:00
Jason Dillaman
dd14d79487 librbd: simplify filtering of config key overrides
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-05 09:54:53 -04:00
Jason Dillaman
f01aa56e7d librbd: use ConfigProxy within ImageCtx to store overrides
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-05 09:54:53 -04:00
Jason Dillaman
47049e6417 common/config: expose full config schema via the proxy
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-05 09:54:53 -04:00
Volker Theile
34525ba3af Relocate cluster_log(). Only active modules can use it.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-05 14:46:58 +02:00
Abhishek Lekshmanan
beb90638ae rgw: copy actual stats from the source shards during reshard
Currently we don't copy the actual_stats field during reshard, which makes
resharded buckets show a size_utilized as 0, which further has the problem that
a subsequent object removal would subtract the object size from the 0 size
utilized showing up large uint64_t values. Copy the size_actual from the source
object in both cls and in reshard_process. This will fix the new buckets,
existing buckets will still have to go through a bucket check --fix for their
stats to be corrected.

Fixes: http://tracker.ceph.com/issues/36290
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-10-05 11:24:26 +02:00
Mykola Golub
6745c288b1
Merge pull request #24433 from dillaman/wip-rbd-mirror-doc
doc/rbd: explicitly state that mirroring requires connectivity to clusters

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-05 11:21:36 +03:00
Josh Durgin
864594f473
Merge pull request #24144 from tchaikov/wip-spdk
bluestore/NVMe: use PCIe selector as the path name

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-04 16:12:18 -07:00
Josh Durgin
8f826e146c
Merge pull request #24168 from tchaikov/wip-17516
cmake: detect armv8 crc and crypto feature using CHECK_C_COMPILER_FLAG

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-04 16:10:18 -07:00
Ricardo Marques
d033f100e4
Merge pull request #24322 from votdev/improve_error_interceptor
mgr/dashboard: Improve error message handling

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-04 23:26:50 +01:00
Patrick Donnelly
adb1d3e31d
PendingReleaseNotes: add note for mds drop cache
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-04 15:06:18 -07:00
Jason Dillaman
7ff5ea9f56 common/options: ensure all RBD-related integer options are unsigned
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-04 16:39:32 -04:00
Jason Dillaman
c6651ff309 doc/rbd: explicitly state that mirroring requires connectivity to cluster
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-04 12:21:35 -04:00
Kanika Murarka
15f9e45291 mgr/dashboard: Reverse proxy changes
Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-10-04 21:35:16 +05:30
Kanika Murarka
336c92b334 mgr/dashboard: Updates documentation
Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-10-04 21:34:14 +05:30
Kanika Murarka
81ffe2bf5b mgr/dashboard: Adding Grafana componenets to views
Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-10-04 21:23:22 +05:30
Kanika Murarka
fc571f37b6 mgr/dashboard: Adding grafana component and backend changes
Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-10-04 20:59:14 +05:30
Ricardo Marques
3e92f772d6
Merge pull request #24370 from tspmelo/fix-rbd-trash-purge
mgr/dashboard: Add permission validation to the  "Purge Trash" button

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-04 15:16:41 +01:00
Casey Bodley
1ecddba2d2
Merge pull request #24271 from croit/fix-36041
rgw/beast: drop privileges after binding ports

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-04 09:57:38 -04:00
Volker Theile
7d41a4a402 mgr/dashboard: Improve error message handling
The current implementation of the HTTP interceptor does not use the error description in all cases.

Fixes: https://tracker.ceph.com/issues/36190

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-04 15:53:50 +02:00
Boris Ranto
ea6d7d2c98 rpm: Use hardened LDFLAGS
Currently, we do pass the hardened CFLAGS and CPPFLAGS when building the
code. However, we do not pass the hardened flags to the linker. This
means that the binaries are linked without the options like -Wl,-z,now.
As a result, we do not fully harden the binaries that we build.

This commit fixes this by passing the RPM_LD_FLAGS to the linker so the
builds are linked with the properly hardened flags.

Fixes: http://tracker.ceph.com/issues/36316

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-10-04 14:52:08 +02:00
alfonsomthd
6df0dd1a92 mgr/dashboard: New Landing Page: Milestone 2
Reduced space between info group title and cards (PR review suggestion).

Fixes: https://tracker.ceph.com/issues/27050

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2018-10-04 14:47:47 +02:00
Maxime
68b044a75e [grafana] Fix OSD Capacity Utlization graph
Signed-off-by: Maxime <maxime@root314.com>
2018-10-04 13:44:12 +02:00
Volker Theile
95746ecce9 mgr: Add ability to trigger a cluster/audit log message from Python
Fixes: https://tracker.ceph.com/issues/36194

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-04 13:33:18 +02:00
Ricardo Dias
43a72f0e49
Merge pull request #24350 from ricardoasmarques/wip-json-decode
mgr/dashboard: Check content-type before decode json response

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-10-04 10:08:37 +01:00
Ricardo Marques
25ee67701d
Merge pull request #24213 from familyuu/mgr
mgr/dashboard: Display logged in user

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-04 09:50:24 +01:00
Kefu Chai
21dd24f17d
Merge pull request #20645 from rishabh-d-dave/fix-doc-add-subcommand-application-manpages
ceph: describe application subcommand in ceph man page

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-04 14:25:45 +08:00
Jason Dillaman
ba68d1fd64
Merge pull request #24117 from trociny/wip-35915
mgr: create shell OSD performance query class

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-03 19:20:42 -04:00
Noah Watkins
c475484f43 doc: install build-doc deps without git clone
With `-e` the repository is cloned, leading to `git clean` skipping
the cloned dependencies due to the `.git` directory, and forcing manual
removal.

[nwatkins@daq ceph]$ git clean -dxf
Skipping repository build-doc/virtualenv/src/breathe
Skipping repository build-doc/virtualenv/src/sphinx-ditaa

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-10-03 15:49:27 -07:00
Alfredo Deza
02ea6dc066 ceph-volume tests.lvm verify get_cluster_fsid can read from args or ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-10-03 16:22:27 -04:00
Alfredo Deza
a92883e60f ceph-volume lvm.prepare consume the value from --cluster-fsid if available
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-10-03 16:22:26 -04:00
Alfredo Deza
15546ae699 ceph-volume lvm.common add the --cluster-fsid flag
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-10-03 13:31:43 -04:00
Mykola Golub
264ad39ff6 mgr: module to test osd_perf_query methods
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-03 19:29:43 +03:00
Mykola Golub
b18ddf4d37 mgr: add osd_perf_query methods to ActivePyModules
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-03 19:29:43 +03:00
Mykola Golub
a6c3390834 mgr: create shell OSD performance query class
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-10-03 19:29:43 +03:00
Casey Bodley
1d44ba0451 librgw: initialize curl and http client for multisite
Fixes: http://tracker.ceph.com/issues/36302

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-10-03 11:41:33 -04:00
Yuri Weinstein
61dbeed256
Merge pull request #24380 from smithfarm/wip-opensuse-15
qa/distros: add openSUSE Leap 42.3 and 15.0

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-10-03 08:10:13 -07:00
Andrew Schoen
4b8f717b88
Merge pull request #24399 from alfredodeza/wip-rm36246
ceph-volume util.encryption don't push stderr to terminal

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-10-03 10:04:58 -05:00
Andrew Schoen
d6cd2f90c2
Merge pull request #24394 from alfredodeza/wip-rm24795
ceph-volume lvm.prepare update help to indicate partitions are needed, not devices

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-10-03 09:59:01 -05:00