Commit Graph

101047 Commits

Author SHA1 Message Date
Lenz Grimmer
0830e3e80c
mgr/dashboard: Exclude some folders in the frontend project (#29708)
mgr/dashboard: Exclude some folders in the frontend project

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-20 12:18:53 +00:00
Lenz Grimmer
aca9cf2499
mgr/dashboard: Hosts Page Service Links Test (#29516)
mgr/dashboard: Hosts Page Service Links Test

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-20 10:43:53 +00:00
Kefu Chai
71361306a9
Merge pull request #29728 from tchaikov/wip-41330
cmake,run-make-check.sh: disable SPDK by default

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-08-20 18:31:18 +08:00
Kefu Chai
3234fb3982 cmake,run-make-check.sh,deb,rpm: disable SPDK by default
but we still enable it in `run-make-check.sh`

* cmake: disable SPDK by default
* run-make-check.sh: enable WITH_SPDK so at least we can ensure it
  builds
* deb,rpm: add uuid-dev / libuuid-devel as a "make check" dependency

Fixes: https://tracker.ceph.com/issues/41330
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 15:38:33 +08:00
Kefu Chai
6fb738abb9 cmake: make WITH_SPDK a dependent option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 15:38:33 +08:00
Kefu Chai
122c17f55f
Merge pull request #29753 from tchaikov/wip-sudo-sysctl
run-make-check.sh: run sudo with absolute path

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-08-20 11:57:03 +08:00
Xie Xingguo
28e7feb3e7
Merge pull request #29726 from xiexingguo/wip-inc-recovery-1
osd/PrimaryLogPG: fix dirty range of write_full

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-20 11:22:39 +08:00
Xie Xingguo
3062bd6b15
Merge pull request #29729 from xiexingguo/wip-inc-recovery-2
osd/PrimaryLogPG: finish_copyfrom - dirty omap if necessary

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-20 11:22:08 +08:00
Kefu Chai
11f9aae4ca run-make-check.sh: run sudo with absolute path
there is chance that `/sbin` is not listed in `secure_path`, see
sudoers(5) for more details

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-20 10:51:36 +08:00
Patrick Donnelly
0dd2d0fd7e
Merge PR #29518 into master
* refs/pull/29518/head:
	mount.ceph: properly handle -o strictatime

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-19 09:36:37 -07:00
Patrick Donnelly
b2eb9e435a
Merge PR #29411 into master
* refs/pull/29411/head:
	mds: fix InoTable::force_consume_to()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-19 09:34:42 -07:00
Patrick Donnelly
0935ab2c4f
Merge PR #29543 into master
* refs/pull/29543/head:
	mds: move some MDCache member init to header

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-08-19 09:33:26 -07:00
Jason Dillaman
d9d4eb550b
Merge pull request #29429 from dillaman/wip-40834
doc/rbd: initial kubernetes / ceph-csi integration documentation

Reviewed-by: ShyamsundarR <srangana@redhat.com>
Reviewed-by: Humble Chirammal <hchiramm@redhat.com>
Reviewed-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-19 11:57:01 -04:00
Sage Weil
329463b386 Merge PR #29719 into master
* refs/pull/29719/head:
	osd/PrimaryLogPG: kill obsolete ondisk_{read,write}_lock comments

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-19 09:09:06 -05:00
Lenz Grimmer
a9e6eb5dc2
mgr/dashboard: E2E Test for RBD Mirroring and Images (#29381)
mgr/dashboard: E2E Test for RBD Mirroring and Images

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-19 13:10:59 +00:00
Tiago Melo
14b2d26946 mgr/dashboard: Exclude some folders in the frontend project
This will remove an warning in VS Code [1] and, more important, will reduce the
number of files that TS will watch when compiling or linting.

[1] To enable project-wide JavaScript/TypeScript language features,
exclude large folders with source files that you do not work on.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-08-19 10:43:50 +00:00
Nathan Cutler
06e34dae12
Merge pull request #29685 from smithfarm/wip-41296
rpm: always build ceph-test package

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
2019-08-19 12:17:46 +02:00
Lenz Grimmer
f09fd7373b
Merge pull request #29556 from Devp00l/wip-41165
mgr/dashboard: CephFS client tab switch

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-19 09:08:43 +00:00
Lenz Grimmer
148312c6af
mgr/dashboard: Verify fields on ISCSI page (#29608)
mgr/dashboard: Verify fields on ISCSI page

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-19 09:03:57 +00:00
Lenz Grimmer
eee4518422
mgr/dashboard: clean-up python unit tests (#28696)
mgr/dashboard: clean-up python unit tests

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-19 08:52:53 +00:00
xie xingguo
42e968e7fb osd/PrimaryLogPG: finish_copyfrom - dirty omap if necessary
otherwise we'll at risk of losing track of omap entries.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-19 13:29:36 +08:00
xie xingguo
e2f278675d osd/PrimaryLogPG: fix dirty range of write_full
A write_full operation may implicitly truncate the object down,
hence we need to mark the truncated part as dirty as well since
follow-up randomized writes may still be able to (re)extend the
object size and leave some holes against the truncated part,
which as a result might cause problems during incremental-mode
recovery.

Note that write_update_size_and_usage would reset oi.size
and that's why we move the mark_data_region_dirty call before that.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-19 08:39:07 +08:00
Kefu Chai
bf6c13f299
Merge pull request #29584 from tchaikov/wip-qa-test_envlibrados_for_rocksdb-cmake3
qa/workunits/rados/test_envlibrados_for_rocksdb: install newer cmake

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-18 12:03:56 +08:00
Kefu Chai
52277bfa52 qa/workunits/rados/test_envlibrados_for_rocksdb: install newer cmake
rocksdb needs CMake 3.5.1 since
https://github.com/facebook/rocksdb/pull/5662

Fixes: https://tracker.ceph.com/issues/41253
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-18 01:32:25 +08:00
xie xingguo
c31c8e26d4 osd/PrimaryLogPG: kill obsolete ondisk_{read,write}_lock comments
The ondisk_{read,write}_lock infrastructure was long gone with
https://github.com/ceph/ceph/pull/20177 merged - c244300ef3,
to be specific. Hence the related comments must die since they
could be super-misleading.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-08-17 15:19:46 +08:00
Mykola Golub
879326aca8
Merge pull request #29433 from dillaman/wip-41029
pybind/mgr/rbd_support: ignore missing support for RBD namespaces

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-08-17 09:27:02 +03:00
Patrick Donnelly
b365ffef34
mds: move some MDCache member init to header
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-16 17:24:04 -07:00
Neha Ojha
b906a6f1e3
Merge pull request #29712 from neha-ojha/wip-basic-workflow
doc/dev/developer_guide/index.rst: add youtube reference for Getting Started

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-16 14:22:06 -07:00
Neha Ojha
f93b48a786 doc/dev/developer_guide/index.rst: add youtube ref for Getting Started
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-08-16 12:52:12 -07:00
Casey Bodley
a282cfaafa
Merge pull request #29448 from cbodley/wip-41045
rgw: datalog/mdlog trim commands loop until done

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-08-16 15:52:11 -04:00
Ernesto Puerta
1e07237d92
mgr/dashboard: clean-up tox and unit tests
Refactor CMake add_tox_test to automatically add py27 and/or py3 to
provided toxenvs.

Refactor tox.ini:
- Remove requirements-{py27,py3}.txt, as python release dependant
packages can be handled with PEP 508 syntax.
- Remove develepment dependencies from requirements.
- Move pycodestyle settings to separate section.
- Add flake8 check and other checkers (rst, naming, etc). Some of them
are commented out for future clean-ups (Ceph trackers have been opened)
- Pycodestyle removed, as flake8 is a wrapper for pycodestyle.
- Add instafail plugin to report failures immediately
- Add timeout plugin to limit max run time (sometimes test_tasks hangs)
- Remove unused dependencies (lru_cache, pluggy)

Test and code linting fixes:
- Unused imports
- Fixes to HACKING.rst

Doc:
- Update HACKING.rst

Add conftest.py to mock imported modules (rados, rbd, cephfs), and mock
also rados Error and OSError Exceptions.

Fixes: https://tracker.ceph.com/issues/40487
Fixes: https://tracker.ceph.com/issues/41152
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-16 19:17:27 +02:00
Sage Weil
3d295cb407 Merge PR #29548 into master
* refs/pull/29548/head:
	osd: add device_id to list_devices to help get smart info easily

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-16 11:39:13 -05:00
Kefu Chai
b4989dc434
Merge pull request #29709 from rzarzynski/wip-osd-no-mds-pglsparent
osd: remove orphan include after PGLSParentFilter.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-16 23:29:07 +08:00
Casey Bodley
91eef6712a radosgw-admin: 'mdlog trim' loops until done
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 11:28:22 -04:00
Casey Bodley
b9af497b2a radosgw-admin: 'datalog trim' takes shard-id and loops until done
Fixes: https://tracker.ceph.com/issues/41045

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 11:28:22 -04:00
Casey Bodley
fd618763c5
Merge pull request #29695 from cbodley/wip-41300
rgw: RGWSI_User_Module filters '.buckets' objects out of user listing

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-08-16 11:21:12 -04:00
Casey Bodley
f0575a7144
Merge pull request #26787 from soumyakoduri/bucket_name_validation
[rgw]:Validate bucket names as per revised s3 spec

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:53:54 -04:00
Casey Bodley
4b0eec368c
Merge pull request #29515 from ivancich/wip-clean-up-reset-stats
rgw: housekeeping of reset stats operation in radosgw-admin and cls back-end

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-08-16 10:21:02 -04:00
Casey Bodley
fa38718e6f
Merge pull request #28904 from ZVampirEM77/wip-s3website-fix
rgw: fix the bug of rgw not doing necessary checking to website configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:20:24 -04:00
Casey Bodley
5b0ef90265
Merge pull request #29215 from tianshan/fix_list_with_delimiter
rgw: fix list bucket with delimiter wrongly skip some special keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-08-16 10:19:50 -04:00
Casey Bodley
cb725cb679
Merge pull request #29369 from tianshan/fix_realm_watch
rgw: fix potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:18:27 -04:00
Casey Bodley
44a6203f99
Merge pull request #29380 from theanalyst/rgw-dns-name-fixes
rgw: make dns hostnames matching case insensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:18:08 -04:00
Casey Bodley
44ce9e5d7f
Merge pull request #28558 from cbodley/wip-rgw-bucket-max-aio
[RFC] rgw: raise default rgw_bucket_index_max_aio to 128

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-08-16 10:17:33 -04:00
Radoslaw Zarzynski
96502dfc00 osd: remove orphan include after PGLSParentFilter.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-08-16 16:15:34 +02:00
Casey Bodley
38be6f81c6
Merge pull request #28824 from dang/zipper
rgw: Project Zipper part 1

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 09:49:28 -04:00
Ernesto Puerta
f4cbe8965f
mgr/dashboard: clean-up python unit tests
Fix pylint issues.

Refactor JwtManager check to avoid code duplication (found by pylint
when --jobs=1).

Fix issue with DashboardException.code property, using abs() on
potentially None attribute.

Disables Doctests in services/rbd.py that are actually integration tests
(they check the value of rbd.RBD_FEATURES_NAME_MAPPING). Ideally, these
kind of tests should be explicitly executed in an integration testing
stage, rather that unit-testing. Disabled tests have been prepended with
@DISABLEDOCTEST token.

Fixes: https://tracker.ceph.com/issues/40487
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-16 15:24:31 +02:00
Kefu Chai
3bdf181ffe
Merge pull request #29621 from xiexingguo/wip-build-push-segv
osd/ReplicatedBackend: check against empty data_included before enabling crc

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-16 20:25:55 +08:00
Kefu Chai
fc55a51a87
Merge pull request #29579 from liewegas/wip-big-vs-bluestore
osd: scrub error on big objects; make bluestore refuse to start on big objects

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-16 20:24:43 +08:00
Kefu Chai
7be0708b5c
Merge pull request #29663 from cxytt/bugfix
osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-16 20:22:32 +08:00
Kefu Chai
a041cffd6c
Merge pull request #29646 from zy751713126/get_pool_name_and_id
pybind/rados: add Ioctx.get_pool_id() and Ioctx.get_pool_name()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-16 20:21:34 +08:00