Commit Graph

76459 Commits

Author SHA1 Message Date
Alfredo Deza
4fce55b381 ceph-volume: terminal: easier terminal reporting utils
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
970e3978f3 ceph-volume: decorators: catch exceptions, disable on debug
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
f291b321c7 ceph-volume: log: be more robust, report back to config
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
3c576f91a7 ceph-volume: log: create a utility for setting up logging
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
1f9807b024 ceph-volume: config: default to 'info' verbosity, set the config dict
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
0a71da843c ceph-volume: rename: initial take on renaming to ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Dan Mick
de06f8e504 cmake/Distutils.cmake: make pkg files optional, add bin
Skip nonexistent 'expected' Python packaging files, and add bin/ as
a possible file for symlinking during build (for Python projects with
slightly different forms, currently ceph-volume)

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
7e0ee3d6b5 build: include the ceph-volume-systemd command in the spec file
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
171bee9ce1 build: add ceph-volume to CMakeLists in src
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
b20fdb8e84 systemd: include the ceph-volume service
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
49af65951e build: create a CMakeLists file for ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
d6954111dc systemd: create a service file for ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
31524efd1d build: add deb install rule for ceph-volume executable
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
7ca7b04521 build: add deb rules for ceph-volume systemd service file
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
004e907e6b build/ops: add ceph-volume scripts/files to spec file
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
59052b3a04 ceph-volume: create the executables
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
1fff4ffa9a ceph-volume: packaging: create a setup.py
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
dee11ceb72 ceph-volume: tests: create a tox.ini file
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
abd21c82fa ceph-volume: add a manifest.in file
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Alfredo Deza
e25b93ffd4 ceph-volume: create a .gitignore specific to ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-04 10:25:57 -04:00
Sage Weil
6dfae21eda Merge pull request #16805 from liewegas/wip-crush-classes
crush: misc changes/fixes for device classes

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-04 08:48:53 -05:00
Sage Weil
c8af364699 Merge pull request #16739 from liewegas/wip-multi-backfill-reject
qa/suites/rados/singleton-nomsgr/all/multi-backfill-reject: sleep longer
2017-08-04 08:41:06 -05:00
Sage Weil
f681d6e794 Merge pull request #16794 from liewegas/wip-rbd-app
qa/tasks/ceph: enable rbd on rbd pool
2017-08-04 08:40:45 -05:00
Alfredo Deza
0d70d36e2f Merge pull request #16776 from dachary/wip-20893-ceph-fsid
ceph-disk: dmcrypt cluster must default to ceph

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-04 09:40:37 -04:00
Sage Weil
7ed9d1e8aa qa/tasks/ceph: enable rbd on rbd pool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-04 09:40:26 -04:00
Sage Weil
b87cb025ba Merge pull request #16798 from jdurgin/wip-complete-to-loop
osd/PGLog: avoid infinite loop if missing version is corrupted

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-04 08:38:31 -05:00
Pan Liu
9964cf177b Merge pull request #16804 from xiexingguo/wip-some-cleanup
os/bluestore: space between func and contents
2017-08-04 13:12:17 +08:00
Sage Weil
47480d8a06 qa/suites/rados/thrash-erasure-code-big: add k=4 m=2
Get better coverage for larger codes.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-03 22:50:16 -04:00
xie xingguo
af0d3661db os/bluestore: space between func and contents
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-04 10:47:25 +08:00
Sage Weil
c121501ad3 crush: remove cleanup_classes()
I can't for the life of me figure out what this is supposed to do.

- why remove (some) classes right after we populated them?
- why remove them after we decode the crush map?

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-03 22:39:05 -04:00
Sage Weil
226d210ab6 crush/CrushWrapper: rebuild_roots_with_classes on bucket removal
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-03 22:32:47 -04:00
Sage Weil
cb807b0006 crush: fix preservation of shadow bucket ids
1- a decompiled and recompiled was parsing the class bucket ids but it
wasn't actually using them.
2- rebuild_roots_with_classes() was throwing out the old ids and assigning
new ids when the tree was rebuilt.

Fix by passing in a (potentially partial) class_bucket map into
populate_classes().  Take care to allocate new bucket ids that don't
collide with previously used ids.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-03 22:32:47 -04:00
Patrick Donnelly
d89af4a3e8
Merge PR #16802 into master
* refs/remotes/upstream/pull/16802/head:
	qa: update wait_for_health for new health json syntax

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 16:20:20 -07:00
John Spray
0613d411aa qa: update wait_for_health for new health json syntax
Fixes: http://tracker.ceph.com/issues/20890
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-03 23:46:41 +01:00
Patrick Donnelly
051dd86898
Merge PR #16766 into master
* refs/remotes/upstream/pull/16766/head:
	cephfs: Clarify health warning
	cephfs: Always print filesystem name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 15:05:53 -07:00
Douglas Fuller
e697636ebb cephfs: Clarify health warning
Add text to MDS_INSUFFICIENT STANDBY to clarify it refers
to MDS daemons.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-03 17:45:48 -04:00
Douglas Fuller
53bf6df4c9 cephfs: Always print filesystem name
Previously, the FSMap summary omitted the filesystem
name in clusters with only one filesystem. Print the
file system name no matter what.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-03 17:44:44 -04:00
Kefu Chai
007095b7ae qa/workunits/mon/crush_ops.sh: remove existing dev class before setting it
we cannot overwrite existing dev class, and "osd_class_update_on_start"
is true by default (see 0c885d6). so we should remove all device classes before
setting them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-03 17:26:26 -04:00
xie xingguo
d4390486a0 mon/OSDMonitor: kill unused variable 'ts'
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-03 17:26:26 -04:00
xie xingguo
734b5f2c60 test/osd-fast-mark-down: enable 'osd-class-update-on-start' by default
116cf759c8
will now hide all shadow trees(roots), so this is not applicable anymore
(actually it is misleading).

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-03 17:26:26 -04:00
xie xingguo
f134a14eff crush: make 'remove_root' idempotent
We might use 'crush link' to link same host into
different roots, which as a result can cause different
shadow trees reference same hosts too.

This means we may need to destory the same buckets(hosts, racks, etc.)
multiple times during rebuilding all shadow trees and hence 'remove_root'
shall be idempotent.

Fixes: http://tracker.ceph.com/issues/20845
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-03 17:26:26 -04:00
Sage Weil
b17287ef14 Merge pull request #16740 from liewegas/wip-crush-tree
mon: show class in 'osd crush tree' output; sort output

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-03 16:16:17 -05:00
Patrick Donnelly
b8a474d9a0
Merge PR #16772 into master
* refs/remotes/upstream/pull/16772/head:
	qa: add health whitelist for all fs sub-suites

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 14:07:58 -07:00
Patrick Donnelly
9d348ad8c9
qa: add health whitelist for all fs sub-suites
Fixes: http://tracker.ceph.com/issues/20892

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 14:01:28 -07:00
Patrick Donnelly
60fa9714d4
Merge PR #16768 into master
* refs/remotes/upstream/pull/16768/head:
	qa: fix log whitelist string

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-03 13:55:42 -07:00
Patrick Donnelly
f2a1a10da5
Merge PR #16743 into master
* refs/remotes/upstream/pull/16743/head:
	mds: add inter-mds operations to PerfCounter
2017-08-03 13:55:39 -07:00
Patrick Donnelly
fda4188772
Merge PR #16654 into master
* refs/remotes/upstream/pull/16654/head:
	mds: fix race in "open inode by inode number"
	mds: cleanup {do_open,_do_find}_ino_peer()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 13:55:36 -07:00
Patrick Donnelly
3755649a4f
Merge PR #16631 into master
* refs/remotes/upstream/pull/16631/head:
	cephfs: Resend discover when joining from starting state
	cephfs: Wait for MDCache to be ready before starting log segment

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 13:55:33 -07:00
Patrick Donnelly
8fa8c241bd
Merge PR #16363 into master
* refs/remotes/upstream/pull/16363/head:
	mds: fix health checks for multiple filesystems
	mon: fix log message on mds rank stop
	mon: uniform way of referring to MDS daemons
	mds: revise health checks for _FAILED/_DEGRADED
	mon/MDSMonitor: log messages on MDS rank changes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 13:55:29 -07:00
Patrick Donnelly
66756c4f65
Merge PR #16292 into master
* refs/remotes/upstream/pull/16292/head:
	qa: use new hex rep of inode
	qa: fix whitelist error message
	mds: refine "Scrub error" cluster log message
	mds: polish clog messages
	doc: developer logging guidance

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-03 13:55:21 -07:00