Commit Graph

98992 Commits

Author SHA1 Message Date
Kefu Chai
585d3fe31f
Merge pull request #28564 from ceph/store_statfs-log
log: fix store_statfs log line

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 17:26:30 +08:00
Kefu Chai
1f5e3e8da6
Merge pull request #28621 from Aran85/fix-ec-rf
osd: accident of rollforward may need to mark pglog dirty

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2019-06-20 17:21:38 +08:00
Kefu Chai
e10116657a
Merge pull request #28656 from dvanders/zstd-upgrade
zstd: upgrade to v1.4.0

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-20 17:19:09 +08:00
Xie Xingguo
dba845bac6
Merge pull request #28570 from xiexingguo/wip-objecter-direct-spgid
osdc/Objecter: _calc_target - inline spgid

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-20 11:15:44 +08:00
Xie Xingguo
14cee82049
Merge pull request #28568 from xiexingguo/wip-off-by-one-max-osd
mon/OSDMonitor: fix off-by-one when updating new_last_in_change

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-20 10:41:21 +08:00
Xie Xingguo
b294dc6749
Merge pull request #28629 from xiexingguo/wip-osd-df-by-pool-name
mgr, osd: 'osd df' by pool

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-20 10:40:40 +08:00
Jason Dillaman
9497655da5
Merge pull request #28553 from trociny/wip-40071
librbd: mirror image enable/disable should enable/disable journaling

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-19 20:21:37 -04:00
Jason Dillaman
57c4669ff4
Merge pull request #28627 from trociny/wip-40409
journal: properly advance read offset after skipping invalid range

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-19 16:58:44 -04:00
Kefu Chai
b2f75ba2aa
Merge pull request #28460 from tchaikov/wip-cmake-detect-libnl
cmake: rewrite Findgenl to support components argument

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-20 00:36:53 +08:00
Dan van der Ster
fa9cd3faad zstd: compat with v1.4.0
In zstd d8e215cbee03b038fffe74aebad63b625c42f23c
ZSTD_compress_generic() is renamed to ZSTD_compressStream2().

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2019-06-19 16:57:13 +02:00
Dan van der Ster
2c2797a71f zstd: upgrade to v1.4.0
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2019-06-19 15:58:13 +02:00
Casey Bodley
8d44d03d4d
Merge pull request #28631 from cbodley/wip-17882
qa/rgw: extra s3tests tasks use rgw endpoint configuration

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-19 09:32:18 -04:00
Kefu Chai
86b62af5de debian/control: remove "libnl-3-dev" from build dependencies
what we need is "libnl-genl-3-dev", libnl-3-dev should be a dependency
of "libnl-genl-3-dev". the only reason we would have added it, is if
the package maintainer of "libnl-genl-3-dev" fails to do so. and
the packages of "libnl-genl-3-dev" on both debian and ubuntu just look
correct in this perspective.

so let's remove this.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-19 21:21:00 +08:00
Kefu Chai
c028de2f93 cmake: rewrite Findgenl to support components argument
* rename genl to nl:
  "genl" is not very specific without more context. and libnl is actually
  a library suite. so it would be better if we can rename the library to
  be found to "libnl", and by following the naming convention of CMake,
  in this change, Findgenl.cmake is renamed to Findnl.cmake
* Findnl.cmake: support the component argument, in our specific case,
  what we want is "libnl-genl" library, which is one of the libraries
  offered by libnl. so let's just make it a component.
* Findnl.cmake: should pass the names of the required variables instead of
  their values to `find_package_handle_standard_args()`. before this
  change, we pass `GENL_LIBRARIES` to this function. it was correct at the
  first glance. but it is not able to handle the case where case where
  libnl-genl is not installed. so the fix is to pass all the names of
  required library paths to this function. in this change, their name
  are concatenated to a single variable -- `nl_LIBRARIES`, and the
  value of this variable is passed to
  `find_package_handle_standard_args()`. and the error message would
  be more specific this way if libnl-genl is not found:
    Could NOT find nl (missing: nl_genl_LIBRARY)
* Findnl.cmake: add nl::<component> as imported library, it helps the
  consumer of these libraries to import them -- no need to
  specify the `target_include_directories()` separately anymore.
* move the find_package() code to where it is used. it helps to improve
  the readability.
* remove `HAVE_GENL` variable: it's not used anywhere.
* drop the messages of "Not using foobar", they do not help.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-19 21:21:00 +08:00
Lenz Grimmer
127f23091d
mgr/dashboard: Ensure E2E tests can be run independently (#28592)
mgr/dashboard: Ensure E2E tests can be run independently

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nathan Weinberg <nweinber@redhat.com>
Reviewed-by: Rafael Quintero <rquinter@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-06-19 15:07:39 +02:00
Sage Weil
ef1f331b8f Merge PR #28453 into master
* refs/pull/28453/head:
	qa/valgrind.supp: be slightly less specific on suppression
	msg/async, v2: make the reset_recv_state() unconditional.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-19 07:59:45 -05:00
Kefu Chai
9ac2e7fde5
Merge pull request #28566 from liewegas/wip-40377
osd: copy (don't move) pg list when sending beacon

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-19 20:15:18 +08:00
Casey Bodley
1643879218 qa/rgw: update default port in perl workunits
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-19 07:50:35 -04:00
Casey Bodley
09e992ff01 qa/rgw: extra s3tests tasks use rgw endpoint configuration
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-19 07:50:35 -04:00
Mykola Golub
7b8fd11fc6 journal: properly advance read offset after skipping invalid range
Fixes: https://tracker.ceph.com/issues/40409
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-19 09:44:14 +01:00
Patrick Donnelly
f2384bd58e
Merge PR #28212 into master
* refs/pull/28212/head:
	mds: trim cache during standby replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-06-18 18:31:29 -07:00
Patrick Donnelly
6d304cf753
Merge PR #28551 into master
* refs/pull/28551/head:
	mds: don't mark cap NEEDSNAPFLUSH if client has no pending capsnap

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-18 18:30:25 -07:00
Patrick Donnelly
9dc3cbd53d
Merge PR #28545 into master
* refs/pull/28545/head:
	client: set snapdir's link count to 1

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-06-18 18:28:51 -07:00
Kefu Chai
c036b9265f
Merge pull request #28496 from ifed01/wip-ifed-fix-40080
os/bluestore: fix duplicate allocations in bmap allocator

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-18 23:31:40 +08:00
Kefu Chai
4999d56897
Merge pull request #28509 from tchaikov/wip-mon_clean_pg_upmaps_per_chunk
common/options: make mon_clean_pg_upmaps_per_chunk unsigned

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-18 23:31:13 +08:00
Kefu Chai
ce26c99bed
Merge pull request #28418 from xiexingguo/wip-kick-recovery-priority
osd: give recovery ops initialized by client op a higher priority

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-18 23:29:42 +08:00
Kefu Chai
b97d0e7ba3
Merge pull request #25395 from rzarzynski/wip-build-compiletest_cxx11_client
tests: introduce compiletest_cxx11_client for C++11 conformity.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-18 23:12:35 +08:00
Sage Weil
d4719f508a Merge PR #28229 into master
* refs/pull/28229/head:
	os/bluestore: do garbage collection if blob count is too high.
	common/perf_conters: make dump_formatted_xxx funcs as const.
	os/bluestore: store extents for GC within WriteContext.
	os/bluestore: GC class, make some members local.
	os/bluestore: vector -> interval set in GC to track extents to collect.
	tests/store_test: many-many spanning blobs test case

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-18 10:02:40 -05:00
Sage Weil
3d15ed0047 Merge PR #28630 into master
* refs/pull/28630/head:
	os/bluestore: fix duplicative and misleading debug in KernelDevice::open().

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-06-18 09:58:22 -05:00
Patrick Nawracay
0c64f40607 mgr/dashboard: Ensure E2E tests can be run independently
Introduces the PageHelper.

- Reads class attributes from Helpers to reduce boilerplace code for
  navigation.
- The PageHelper is supposed to be the new class for code that's reused
  across all Helpers for page related code.
- The Helper class is by now meant to be used for non-page specific
  helper code, like used in the `checkConsole` method.
- The Helper class will act as central registry to enable all other
  tests to use helper functions of all derived PageHelper tests.

  Example:

  `Helper.pools.create('foobar', ...);`

Fixes: http://tracker.ceph.com/issues/40397

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2019-06-18 16:05:56 +02:00
Radoslaw Zarzynski
caef9058e4 os/bluestore: fix duplicative and misleading debug in KernelDevice::open().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-18 14:37:06 +02:00
xie xingguo
ec27a162de mgr, osd: 'ceph osd df' by pool
Our test admin has been asking for this for the past few years:-)
Besides, this is also useful for operating on large Ceph clusters with
mutliple storage pools possibly spanning over all osds.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-18 20:29:40 +08:00
Lenz Grimmer
c634bd6f0c
mgr/dashboard: Update translations (#28059)
mgr/dashboard: Update translations

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-06-18 13:20:20 +02:00
Mykola Golub
c99e26eff9 qa/workunits/rbd: tweak mirror tests
(after "image mirror disable" started to disable journaling)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-18 12:08:58 +01:00
Mykola Golub
d0058e4706 librbd: mirror image enable/disable should enable/disable journaling
Fixes: https://tracker.ceph.com/issues/40071
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-18 12:08:58 +01:00
Lenz Grimmer
92a650ad19
Merge pull request #28377 from p-na/wip-pna-message-xlf-opt
mgr/dashboard: Improve hints shown when message.xlf is invalid

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-06-18 12:16:23 +02:00
Lenz Grimmer
363c81a858
mgr/dashboard: Log's time from UTC to local (#27777)
mgr/dashboard: Log's time from UTC to local

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-06-18 12:14:09 +02:00
xie xingguo
4c90cee204 osd/OSDMap: pass filter directly to the OSDUtilizationDumper
This makes the code easy to maintain and especially to extend,
e.g., adding per pool filters.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-18 16:27:11 +08:00
Sebastian Wagner
ee12c0c887
Merge pull request #28264 from rhcs-dashboard/mypy-config-to-file
src/script: extract mypy config to mypy.ini

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-06-18 09:09:06 +02:00
Zengran Zhang
35cb184bec osd: accident of rollforward may need to mark pglog dirty
refers: https://github.com/ceph/ceph/pull/27015/files#r294114392

Fixes: http://tracker.ceph.com/issues/40403

Signed-off-by: Zengran Zhang <zhangzengran@sangfor.com.cn>
2019-06-18 11:32:33 +08:00
Yuri Weinstein
10dfa31e23
Merge pull request #28605 from cbodley/wip-40304
qa/rgw: fix import error in tasks/swift.py

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-17 13:22:49 -07:00
Casey Bodley
2dd5574cf9 qa/rgw: fix import error in tasks/swift.py
> ImportError: No module named packaging

replaces packaging.version.Version with distutils.version.LooseVersion

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-17 15:07:40 -04:00
Lenz Grimmer
692b78891f
Merge pull request #28095 from Devp00l/wip-39702
mgr/dashboard: OSD custom action button removal

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-06-17 15:28:48 +02:00
Jason Dillaman
41334de1ee
Merge pull request #27670 from trociny/wip-rbd-mirror-fetch-autotune
rbd-mirror: adjust journal fetch properties based on memory target

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-17 09:02:58 -04:00
Jason Dillaman
6dd39a1764
Merge pull request #28524 from trociny/wip-qa-rbd-mirror-compare
qa/workunits/rbd: fix compare_images and compare_image_snapshots

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-17 09:02:40 -04:00
Jason Dillaman
34f2ba4e8f
Merge pull request #28529 from trociny/wip-journal-in_flight_advance_sets
journal: wait for in flight advance sets on stopping recorder

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-17 09:01:04 -04:00
Lenz Grimmer
61c7632a3d
mgr/dashboard: Add QA tests for RBD configuration (#27774)
mgr/dashboard: Add QA tests for RBD configuration

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-06-17 13:29:00 +02:00
Patrick Nawracay
754e080177 mgr/dashboard: Cleanup HACKING.rst
Rephrase explanations on how to write E2E tests with Protractor.

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2019-06-17 13:07:01 +02:00
Kefu Chai
fbbe078a1e
Merge pull request #28586 from aclamk/fix-vstart-extra-conf
vstart.sh: Fix problem that all extra_conf got merged into single line.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-17 17:57:16 +08:00
Adam Kupczyk
45f070bc12 vstart.sh: Fix problem that all extra_conf got merged into single line.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-06-17 09:43:44 +02:00