Commit Graph

101064 Commits

Author SHA1 Message Date
Jason Dillaman
6f16f44b56
Merge pull request #29655 from trociny/wip-40923
qa/workunits/rbd: stress test `rbd mirror pool status --verbose`

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-20 11:04:04 -04:00
Jason Dillaman
3f64a3e0fe
Merge pull request #29376 from Songweibin/wip-rbd-display-id
rbd/action: display image id in rbd du/list output

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-20 10:23:36 -04:00
Nathan Cutler
303e276ac7
Merge pull request #29743 from smithfarm/wip-ceph-backport-https
script/ceph-backport.sh: carry https through to logical conclusion

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2019-08-20 16:23:06 +02:00
Jason Dillaman
9fab5b7e02
Merge pull request #29653 from lixiaoy1/AsyncOpTracker_dup
librbd: Remove duplicated AsyncOpTracker in librbd/Utils.h

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-20 10:22:38 -04:00
Casey Bodley
0849b0e8df
Merge pull request #29094 from cbodley/wip-40806
radosgw-admin: bucket sync status not 'caught up' during full sync

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2019-08-20 10:19:07 -04:00
Nathan Cutler
793e9179e5 scripts/ceph-backport.sh: always use https://tracker.ceph.com
Completing the wave of fixes to this script in the wake of
https://tracker.ceph.com/issues/38764, this commit replaces
"http" with "https" in the comments and puts the Redmine endpoint
into a variable, along with some other cleanups.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-08-20 15:32:08 +02:00
Alfredo Deza
6b0ef5dc3c
Merge pull request #29762 from alfredodeza/bz-1738379
ceph-volume: use the OSD identifier when reporting success

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2019-08-20 09:32:05 -04:00
Lenz Grimmer
16adf47ab8
mgr/dashboard: login screen language dropdown enhancement (#29636)
mgr/dashboard: login screen language dropdown enhancement

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-20 12:48:49 +00:00
Lenz Grimmer
9707152afc
Merge pull request #29737 from tspmelo/wip-label-alignment
mgr/dashboard: Vertically align the "Refresh" label

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-20 12:20:05 +00:00
Lenz Grimmer
0830e3e80c
mgr/dashboard: Exclude some folders in the frontend project (#29708)
mgr/dashboard: Exclude some folders in the frontend project

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-20 12:18:53 +00:00
Alfredo Deza
d0d5750c1b ceph-volume devices.lvm zap use the identifier to report success
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-08-20 08:04:56 -04:00
Alfredo Deza
88c7429a60 ceph-volume tests check success message when zapping
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-08-20 08:04:26 -04:00
Lenz Grimmer
aca9cf2499
mgr/dashboard: Hosts Page Service Links Test (#29516)
mgr/dashboard: Hosts Page Service Links Test

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-20 10:43:53 +00:00
Kefu Chai
71361306a9
Merge pull request #29728 from tchaikov/wip-41330
cmake,run-make-check.sh: disable SPDK by default

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-08-20 18:31:18 +08:00
Kefu Chai
3234fb3982 cmake,run-make-check.sh,deb,rpm: disable SPDK by default
but we still enable it in `run-make-check.sh`

* cmake: disable SPDK by default
* run-make-check.sh: enable WITH_SPDK so at least we can ensure it
  builds
* deb,rpm: add uuid-dev / libuuid-devel as a "make check" dependency

Fixes: https://tracker.ceph.com/issues/41330
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 15:38:33 +08:00
Kefu Chai
6fb738abb9 cmake: make WITH_SPDK a dependent option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 15:38:33 +08:00
Kefu Chai
122c17f55f
Merge pull request #29753 from tchaikov/wip-sudo-sysctl
run-make-check.sh: run sudo with absolute path

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-08-20 11:57:03 +08:00
Xie Xingguo
28e7feb3e7
Merge pull request #29726 from xiexingguo/wip-inc-recovery-1
osd/PrimaryLogPG: fix dirty range of write_full

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-20 11:22:39 +08:00
Xie Xingguo
3062bd6b15
Merge pull request #29729 from xiexingguo/wip-inc-recovery-2
osd/PrimaryLogPG: finish_copyfrom - dirty omap if necessary

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-20 11:22:08 +08:00
Kefu Chai
11f9aae4ca run-make-check.sh: run sudo with absolute path
there is chance that `/sbin` is not listed in `secure_path`, see
sudoers(5) for more details

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 10:51:36 +08:00
Patrick Donnelly
0dd2d0fd7e
Merge PR #29518 into master
* refs/pull/29518/head:
	mount.ceph: properly handle -o strictatime

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-19 09:36:37 -07:00
Patrick Donnelly
b2eb9e435a
Merge PR #29411 into master
* refs/pull/29411/head:
	mds: fix InoTable::force_consume_to()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-19 09:34:42 -07:00
Patrick Donnelly
0935ab2c4f
Merge PR #29543 into master
* refs/pull/29543/head:
	mds: move some MDCache member init to header

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-08-19 09:33:26 -07:00
Jason Dillaman
d9d4eb550b
Merge pull request #29429 from dillaman/wip-40834
doc/rbd: initial kubernetes / ceph-csi integration documentation

Reviewed-by: ShyamsundarR <srangana@redhat.com>
Reviewed-by: Humble Chirammal <hchiramm@redhat.com>
Reviewed-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-19 11:57:01 -04:00
Sage Weil
329463b386 Merge PR #29719 into master
* refs/pull/29719/head:
	osd/PrimaryLogPG: kill obsolete ondisk_{read,write}_lock comments

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-19 09:09:06 -05:00
Lenz Grimmer
a9e6eb5dc2
mgr/dashboard: E2E Test for RBD Mirroring and Images (#29381)
mgr/dashboard: E2E Test for RBD Mirroring and Images

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-19 13:10:59 +00:00
Tiago Melo
79a31a433f mgr/dashboard: Vertically align the "Refresh" label
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-08-19 10:59:53 +00:00
Tiago Melo
14b2d26946 mgr/dashboard: Exclude some folders in the frontend project
This will remove an warning in VS Code [1] and, more important, will reduce the
number of files that TS will watch when compiling or linting.

[1] To enable project-wide JavaScript/TypeScript language features,
exclude large folders with source files that you do not work on.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-08-19 10:43:50 +00:00
Nathan Cutler
06e34dae12
Merge pull request #29685 from smithfarm/wip-41296
rpm: always build ceph-test package

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
2019-08-19 12:17:46 +02:00
Lenz Grimmer
f09fd7373b
Merge pull request #29556 from Devp00l/wip-41165
mgr/dashboard: CephFS client tab switch

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-19 09:08:43 +00:00
Lenz Grimmer
148312c6af
mgr/dashboard: Verify fields on ISCSI page (#29608)
mgr/dashboard: Verify fields on ISCSI page

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-19 09:03:57 +00:00
Lenz Grimmer
eee4518422
mgr/dashboard: clean-up python unit tests (#28696)
mgr/dashboard: clean-up python unit tests

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-19 08:52:53 +00:00
xie xingguo
42e968e7fb osd/PrimaryLogPG: finish_copyfrom - dirty omap if necessary
otherwise we'll at risk of losing track of omap entries.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-19 13:29:36 +08:00
xie xingguo
e2f278675d osd/PrimaryLogPG: fix dirty range of write_full
A write_full operation may implicitly truncate the object down,
hence we need to mark the truncated part as dirty as well since
follow-up randomized writes may still be able to (re)extend the
object size and leave some holes against the truncated part,
which as a result might cause problems during incremental-mode
recovery.

Note that write_update_size_and_usage would reset oi.size
and that's why we move the mark_data_region_dirty call before that.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-19 08:39:07 +08:00
Kefu Chai
bf6c13f299
Merge pull request #29584 from tchaikov/wip-qa-test_envlibrados_for_rocksdb-cmake3
qa/workunits/rados/test_envlibrados_for_rocksdb: install newer cmake

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-18 12:03:56 +08:00
Kefu Chai
52277bfa52 qa/workunits/rados/test_envlibrados_for_rocksdb: install newer cmake
rocksdb needs CMake 3.5.1 since
https://github.com/facebook/rocksdb/pull/5662

Fixes: https://tracker.ceph.com/issues/41253
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-18 01:32:25 +08:00
xie xingguo
c31c8e26d4 osd/PrimaryLogPG: kill obsolete ondisk_{read,write}_lock comments
The ondisk_{read,write}_lock infrastructure was long gone with
https://github.com/ceph/ceph/pull/20177 merged - c244300ef3,
to be specific. Hence the related comments must die since they
could be super-misleading.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-17 15:19:46 +08:00
Mykola Golub
879326aca8
Merge pull request #29433 from dillaman/wip-41029
pybind/mgr/rbd_support: ignore missing support for RBD namespaces

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-08-17 09:27:02 +03:00
Patrick Donnelly
b365ffef34
mds: move some MDCache member init to header
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-16 17:24:04 -07:00
Neha Ojha
b906a6f1e3
Merge pull request #29712 from neha-ojha/wip-basic-workflow
doc/dev/developer_guide/index.rst: add youtube reference for Getting Started

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-16 14:22:06 -07:00
Neha Ojha
f93b48a786 doc/dev/developer_guide/index.rst: add youtube ref for Getting Started
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-08-16 12:52:12 -07:00
Casey Bodley
a282cfaafa
Merge pull request #29448 from cbodley/wip-41045
rgw: datalog/mdlog trim commands loop until done

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-08-16 15:52:11 -04:00
Ernesto Puerta
1e07237d92
mgr/dashboard: clean-up tox and unit tests
Refactor CMake add_tox_test to automatically add py27 and/or py3 to
provided toxenvs.

Refactor tox.ini:
- Remove requirements-{py27,py3}.txt, as python release dependant
packages can be handled with PEP 508 syntax.
- Remove develepment dependencies from requirements.
- Move pycodestyle settings to separate section.
- Add flake8 check and other checkers (rst, naming, etc). Some of them
are commented out for future clean-ups (Ceph trackers have been opened)
- Pycodestyle removed, as flake8 is a wrapper for pycodestyle.
- Add instafail plugin to report failures immediately
- Add timeout plugin to limit max run time (sometimes test_tasks hangs)
- Remove unused dependencies (lru_cache, pluggy)

Test and code linting fixes:
- Unused imports
- Fixes to HACKING.rst

Doc:
- Update HACKING.rst

Add conftest.py to mock imported modules (rados, rbd, cephfs), and mock
also rados Error and OSError Exceptions.

Fixes: https://tracker.ceph.com/issues/40487
Fixes: https://tracker.ceph.com/issues/41152
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-16 19:17:27 +02:00
Sage Weil
3d295cb407 Merge PR #29548 into master
* refs/pull/29548/head:
	osd: add device_id to list_devices to help get smart info easily

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-16 11:39:13 -05:00
Kefu Chai
b4989dc434
Merge pull request #29709 from rzarzynski/wip-osd-no-mds-pglsparent
osd: remove orphan include after PGLSParentFilter.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-16 23:29:07 +08:00
Casey Bodley
91eef6712a radosgw-admin: 'mdlog trim' loops until done
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 11:28:22 -04:00
Casey Bodley
b9af497b2a radosgw-admin: 'datalog trim' takes shard-id and loops until done
Fixes: https://tracker.ceph.com/issues/41045

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 11:28:22 -04:00
Casey Bodley
fd618763c5
Merge pull request #29695 from cbodley/wip-41300
rgw: RGWSI_User_Module filters '.buckets' objects out of user listing

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-08-16 11:21:12 -04:00
Casey Bodley
f0575a7144
Merge pull request #26787 from soumyakoduri/bucket_name_validation
[rgw]:Validate bucket names as per revised s3 spec

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:53:54 -04:00
Casey Bodley
4b0eec368c
Merge pull request #29515 from ivancich/wip-clean-up-reset-stats
rgw: housekeeping of reset stats operation in radosgw-admin and cls back-end

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-08-16 10:21:02 -04:00