Commit Graph

104532 Commits

Author SHA1 Message Date
Sebastian Krah
5efe0a3ab2 mgr/dashboard: Don't use any xlf file when building the default language
The build-i18n script no longer uses a xlf file when building the default
language. This means that we don't need to keep the messages.en-US.xlf in the repository anymore.

Fixes: https://tracker.ceph.com/issues/42693
Signed-off-by: Sebastian Krah <skrah@suse.com>
2019-11-20 14:17:19 +01:00
Jan Fajerski
2da7330e7e
Merge pull request #31410 from jan--f/c-v-create-vgs-on-demand
ceph-volume: allow raw block devices everywhere
2019-11-20 13:45:41 +01:00
Lenz Grimmer
3b8f661389
mgr/dashboard: Fixes removal of custom tags during pool edit (#31373)
mgr/dashboard: Fixes removal of custom tags during pool edit

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-11-20 12:34:43 +00:00
Volker Theile
234171b882 python-common: Fix typo in device type
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-11-20 13:14:00 +01:00
Kefu Chai
17a2cd69a9
Merge pull request #31751 from tchaikov/wip-run-tox.sh-python3
script/run_tox.sh: do not use python2 if we have python3

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-11-20 19:47:22 +08:00
Lenz Grimmer
0e1f0e6b81
Merge pull request #31607 from tspmelo/wip-pool-pattern
mgr/dashboard: Add invalid pattern message for Pool name

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-11-20 11:22:11 +00:00
Lenz Grimmer
e45645e61e
mgr/dashboard: show "Rename" in header & button when renaming… (#31551)
mgr/dashboard: show "Rename" in header & button when renaming RBD snapshot

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-11-20 11:18:21 +00:00
Lenz Grimmer
ce704eec58
mgr/dashboard: CephFS snapshot management UI (#30996)
mgr/dashboard: CephFS snapshot management UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-11-20 11:16:50 +00:00
Lenz Grimmer
e8218d8bf4
Merge pull request #31563 from tspmelo/wip-default-i18n
mgr/dashboard: Use default language when running "npm run build"

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-11-20 11:14:27 +00:00
Jan Fajerski
f2018d76eb doc: update ceph-volume lvm prepare
Add option to pass raw physical devices everywhere, restructure a little
(bluestore section before filestore) and reword a few things.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-11-20 11:54:07 +01:00
Jan Fajerski
01a603f6e9 ceph-volume: make lvm report fields into constants
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-11-20 11:54:07 +01:00
Jan Fajerski
bb4de1a3fc ceph-volume: api/lvm create or reuse a vg
This changes create_lv so one can pass the desired device and either a
VG with a name starting with ceph is re-used or a new one is created.
This commit also adds two new lvm primitives, making use of lvm's select
feature. The goal is to eventually avoid keeping a full list of lv's (or
vg's) around and query the lvm system as needed.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-11-20 11:53:59 +01:00
Kefu Chai
b2b3b76dbd
Merge pull request #31755 from tchaikov/wip-mgr-orch
mgr/orch: pass unicode string to ipaddress.ip_network()

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
2019-11-20 18:09:19 +08:00
Kefu Chai
d3fb8fb0d8 mgr/orch: pass unicode string to ipaddress.ip_network()
otherwise it complains like

>               raise e
E               AddressValueError: '10.1.1.10' does not appear to be an
IPv4 or IPv6 address. Did you pass in a bytes (str in Python 2) instead
of a unicode object?

orchestrator.py:94: AddressValueError

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-11-20 16:41:09 +08:00
Kefu Chai
71b38f5c8b pybind/mgr: add ipaddress to requirements.txt
ipaddress dependency was introduced in 16f281d2. because the tox testenv
is isolated from the host python env, the test env has no access to the
ipaddress python module installed by install-deps.sh. we have to install
ipaddress for python<3.3 for testing which uses `orchestrator.py`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-11-20 16:41:09 +08:00
Tatjana Dehler
650be211a4 mgr/dashboard: Update dev documentation URL
Update the developer documentation URL because the
old one is only returning "403 Forbidden".

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-11-20 09:30:55 +01:00
Alfonso Martínez
b5344d7dcf mgr/dashboard: sort monitors by open sessions correctly.
Fixes: https://tracker.ceph.com/issues/42893
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-11-20 08:56:21 +01:00
Kefu Chai
ef5a8d069a script/run_tox.sh: do not use python2 if we have python3
always use python3 for bootstrapping tox environment unless the tox-env
contains "py2" but not "py3"

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-11-20 15:47:38 +08:00
Jan Fajerski
246539dc3d
Merge pull request #31574 from jan--f/c-v-refactor-get_devices
ceph-volume: make get_devices fs location independent
2019-11-20 08:41:47 +01:00
Kiefer Chang
0a9bb59d1d
mgr/dashboard: open files with UTF-8 encoding in Grafana checking script
Fixes: https://tracker.ceph.com/issues/42892
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-11-20 12:48:43 +08:00
Michael Fritch
4312ca8252 ceph-daemon: infer fsid for shell, enter, ceph-volume, unit, logs
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-11-19 20:32:29 -07:00
Sage Weil
82c2320fbb qa/suites/rados/singleton-nomsgr/all/balancer: whitelist PG_AVAILABILITY
Balancer triggers peering, which may make PGs briefly go inactive--when
they possibly haven't been active yet.  E.g.,

    "PG_AVAILABILITY": {
        "severity": "HEALTH_WARN",
        "summary": {
            "message": "Reduced data availability: 3 pgs inactive, 3 pgs peering",
            "count": 6
        },
        "detail": [
            {
                "message": "pg 2.6 is stuck peering since forever, current state peering, last acting [2,0]"
            },
            {
                "message": "pg 2.1c is stuck peering since forever, current state peering, last acting [2,1]"
            },
            {
                "message": "pg 2.7a is stuck peering since forever, current state peering, last acting [2,0]"
            }
        ]
    }

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-19 20:38:08 -06:00
Sage Weil
64bd0e2ab4 Merge PR #30698 into master
* refs/pull/30698/head:
	common/options: Set bluestore min_alloc size to 4K

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-11-19 20:25:43 -06:00
Sage Weil
f03f15cc4d Merge PR #31638 into master
* refs/pull/31638/head:
	mgr/pg_autoscaler: only generate target_* health warnings if targets set

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-11-19 20:24:54 -06:00
Sage Weil
b136be294d Merge PR #31572 into master
* refs/pull/31572/head:
	mgr/diskprediction_local: some debug output during predict (and self-test)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-19 20:24:33 -06:00
Sage Weil
31b7816e94 qa/suites/rados/thrash-old-clients: skip TestClsRbd.mirror
Older versions have this test and fail it.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-19 20:11:55 -06:00
Sage Weil
bc62adc4f5 Merge PR #31721 into master
* refs/pull/31721/head:
	mgr/ssh: set UserKnownHostsFile

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-11-19 16:05:16 -06:00
Ali Maredia
c1b142ef71
Merge pull request #31660 from ivancich/wip-add-some-const
rgw: add const correctness to some rest functions
2019-11-19 14:23:33 -05:00
Casey Bodley
669453138d
Merge pull request #16715 from adamemerson/wip-I-Object!
osdc/Objecter: Boost.Asio (I object!)

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-11-19 12:48:26 -05:00
Sage Weil
36f5fcbb97 Merge PR #31672 into master
* refs/pull/31672/head:
	mgr/orch: adapt update_mgr/mon funcs to new parsing
	mgr/orch: improve commandline parsing

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-11-19 10:37:49 -06:00
Sage Weil
9ae8a737dd Merge PR #31679 into master
* refs/pull/31679/head:
	ceph-daemon: add osd create test(s)

Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-19 10:37:33 -06:00
Ricardo Marques
3e2922148a mgr/dashboard: unable to set bool values to false when default is true
Fixes: https://tracker.ceph.com/issues/41776

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-11-19 16:18:53 +00:00
Sage Weil
9b61479da4
Merge pull request #31731 from varshar16/wip-doc-update-orchestrator_cli-url
mgr/orchestrator_cli: Update doc link in README
2019-11-19 09:09:43 -06:00
Sage Weil
977657a4a5 mgr/ssh: set UserKnownHostsFile
Set this to /dev/null, since we have StrictHostKeyChecking
off anyway.  This gets rid of messages to stderr every time we connect
to a new host.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-19 09:08:15 -06:00
Jan Fajerski
4749f4c59d ceph-volume: refactor tests for refactored get_devices
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-11-19 15:24:21 +01:00
Jan Fajerski
b35e8c485f ceph-volume: refactor get_devices, don't use os.path.realpath
Fixes: https://tracker.ceph.com/issues/42777

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-11-19 15:24:14 +01:00
Jason Dillaman
2773e68f43 journal: properly handle immediate overflow upon advancing object set
While the old set is being closed, additional IO can be queued up within
the old, closed objects while the in-flight IO settles. It's therefore
possible that the queued IO that is transferred from the old set to the
new set causes an immediate overflow of the new set.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:45:46 -05:00
Jason Dillaman
e536b5c8e1 journal: fix flush by age and in-flight byte tracking
The flush by age was always causing an immediate flush due to a
backwards comparison. Additionally, the in-flight byte tracker was
never decremented which caused premature closure of the journal
object.

Finally, there was a potential race condition between closing the
object and in-flight notification callbacks executing. Now we keep
the lock held for both closed and overflow callbacks to prevent
the small chance of a race.

Fixes: https://tracker.ceph.com/issues/42598
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:45:46 -05:00
Jason Dillaman
5a5b5c5801 journal: simplify object recorder locker aggregation
Use move semantics and RAII to control the locking of the
per-object recorder lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:45:46 -05:00
Matt Benjamin
b35926ea8a
Merge pull request #29399 from ofriedma/master
rgw: Fix expiration header does not return the earliest rule
2019-11-19 08:42:19 -05:00
Matt Benjamin
6068e3ace1
Merge pull request #29937 from ofriedma/wip-ofriedma-days0
Add days0 to rgw lc
2019-11-19 08:41:10 -05:00
Jason Dillaman
eb3fb7479a
Merge pull request #31642 from trociny/wip-rbd-mirror-service-daemon-ns-support
rbd-mirror: add namespace support to service daemon

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:16:44 -05:00
Jason Dillaman
8617416990
Merge pull request #31627 from trociny/wip-pybind-rbd-snap_remove
pybind/rbd: provide snap remove flags

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:16:29 -05:00
Jason Dillaman
2dc02761cb
Merge pull request #31608 from trociny/wip-mock-warnings
test/rbd_mirror: fix mock warnings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:15:26 -05:00
Jason Dillaman
f0f62cc5dd
Merge pull request #31606 from trociny/wip-test_rbd.py-tabs
test/pybind: inconsistent use of tabs and spaces in indentation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-11-19 08:14:44 -05:00
Nathan Cutler
fb60d2ffce ceph-backport.sh: restore "set -x" when in debug mode
Recently, "set -x"/"set +x" code was added to show the user which git commands
the script is running. This code was inadvertently deactivating "set -x" when
running in debug mode.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-19 13:53:21 +01:00
Nathan Cutler
0cb63573d8 ceph-backport.sh: mention --force in usage message
The --force option was missing in "usage()".

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-19 13:47:34 +01:00
Nathan Cutler
3697e0fc00 ceph-backport.sh: allow user to specify --fork explicitly
Some users prefer to use a Ceph fork on GitHub other than their personal one.

Support this by implementing a "--fork EXPLICIT_FORK" option. Users without
a personal fork of ceph/ceph.git would need to provide this option always --
even when setting up the script.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-19 13:47:31 +01:00
Stephan Müller
bde9aa61ec mgr/dashboard: CephFS snapshot management UI
CephFS snapshots can now be created on a directory basis. Multiple
snapshots can be deleted at once.

Fixes: https://tracker.ceph.com/issues/41791

Signed-off-by: Volker Theile <vtheile@suse.com>
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-11-19 12:27:39 +01:00
Varsha Rao
f7f5d1b723 mgr/orchestrator_cli: Update doc link in README
Update the orchestrator cli doc link to fix page not found error. Also remove
some unnecessary blank lines.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-11-19 16:50:41 +05:30