Commit Graph

103283 Commits

Author SHA1 Message Date
Milind Changire
49e20da0ef doc: hide page contents for Ceph Internals
Fixes: https://tracker.ceph.com/issues/42414

Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-10-22 14:16:42 +05:30
Patrick Donnelly
c7e3b4281f
Merge PR #30505 into master
* refs/pull/30505/head:
	test/libcephfs: introduce (uint64_t)ceph_pthread_self()
	test/libcephfs: Only use sys/xattr.h on Linux
	cephfs: Create a separate dirent{} for FreeBSD
	test/fs: Only use features.h on Linux

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 21:23:41 -07:00
Patrick Donnelly
3c4328c0a4
Merge PR #30813 into master
* refs/pull/30813/head:
	qa: get rid of iteritems for python3 compatibility

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 21:22:00 -07:00
Patrick Donnelly
46b32b6eb6
Merge PR #30886 into master
* refs/pull/30886/head:
	mgr/volumes: cleanup leftovers from earlier purge job implementation

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-21 21:21:15 -07:00
Patrick Donnelly
581be7595b
Merge PR #30971 into master
* refs/pull/30971/head:
	qa: whitelist "Error recovering journal" for cephfs-data-scan

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-21 21:18:36 -07:00
Patrick Donnelly
16ad4e78e9
Merge PR #30986 into master
* refs/pull/30986/head:
	qa: allow client mount to reset fully

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-21 21:14:07 -07:00
Xie Xingguo
ad9b7fea90
Merge pull request #30897 from tchaikov/wip-bluestore/avl-allocator
os/bluestore: AVL-tree & extent - based space allocator

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-10-22 08:33:54 +08:00
Kefu Chai
1e1a19bfc0
Merge pull request #30957 from tchaikov/wip/crimson/mon/client
crimson/{osd,mon}: lower log level when sending a replicated op

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-21 23:03:19 +08:00
Kefu Chai
1309976cc0 crimson/mon: skip CEPHX_V2 challenge if client doesn't support it
port 321548010578d6ff7bbf2e5ce8a550008b131423 from src/mon/MonClient

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-21 22:59:59 +08:00
Kefu Chai
ddb4cb3b3e crimson/osd: lower log level when sending a replicated op
it's but normal i/o, no need to print it using "info"

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-21 22:59:59 +08:00
Kefu Chai
2f6ce4c7b1
Merge pull request #30925 from cyx1231st/wip-seastar-msgr-policies
test/crimson: verify msgr v2 behavior with different policies

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 22:18:54 +08:00
Venky Shankar
dcbdc726a6 qa: allow client mount to reset fully
... without this there is a sutle race where it takes a
bit of time after a hard reset of a client mount causing
further checks to fail as the (still up) client is still
connected to the MDS.

Fixes: http://tracker.ceph.com/issues/42213
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-10-21 08:38:37 -04:00
Tim Serong
ff7b16f60c
Merge pull request #31008 from SUSE/wip-doc-telemetry-default-interval
doc/mgr/telemetry: update default interval
2019-10-21 20:10:19 +11:00
Ilya Dryomov
a80185d02c
Merge pull request #30965 from idryomov/wip-krbd-udev-socket-overrun
krbd: avoid udev netlink socket overrun

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-10-21 11:00:46 +02:00
Tim Serong
3c8793c4bd doc/mgr/telemetry: update default interval
Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
2019-10-21 18:18:05 +11:00
Kefu Chai
a5b5134cb8
Merge pull request #30973 from tchaikov/wip/qa/tasks/ceph_manager
qa/tasks/ceph_manager: do not panic if "pg_num_target" is missing

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-10-21 12:20:01 +08:00
Kefu Chai
09863ef3d9 qa/tasks/ceph: tolerate 'T' or ' ' as date and time separator
str.replace() does not change the string in-place, so we need to assign
its return value to `t`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-21 12:18:58 +08:00
Kefu Chai
548098668e qa/tasks/ceph_manager: do not panic of "pg_num_target" is missing
we don't have "pg_num_target" in "osd dump" back in mimic, so we don't
need to check it if it is missing when performing upgrade test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-21 12:18:58 +08:00
Kefu Chai
4c2f207501
Merge pull request #30947 from dillaman/wip-42332
common/ceph_context: avoid unnecessary wait during service thread shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 12:14:46 +08:00
Kefu Chai
3ae93a77c6
Merge pull request #30840 from majianpeng/async-messenger-narrow-lock
msg/async: narrow scope of AsyncMessenger::lock in fun connect_to.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-10-21 12:13:47 +08:00
Kefu Chai
69d40bb059
Merge pull request #30883 from majianpeng/msg-remove-submit-message
msg/async: move submit_message() into send_to()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 12:12:29 +08:00
Kefu Chai
f8c4766840
Merge pull request #30695 from dsavineau/ceph_cli_cephconf_rc
ceph.in: check ceph-conf returncode

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 00:50:26 +08:00
Kefu Chai
18ccae63fa
Merge pull request #30758 from kshtsk/wip-python3-print
tests: use python3 compatible print

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 00:34:18 +08:00
Kefu Chai
9443335620
Merge pull request #30987 from trociny/wip-42370
mgr/balancer: python3 compatibility issue

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-21 00:32:22 +08:00
Nathan Cutler
63f984a100
Merge pull request #30705 from smithfarm/wip-sp-backporting-2
doc: split up SubmittingPatches.rst

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2019-10-19 10:20:47 +02:00
Dan Mick
c5a53ba82d
Merge pull request #30989 from tchaikov/wip/ceph-crash/logger-name
ceph-crash: use "ceph-crash" as logger name
2019-10-18 16:11:37 -07:00
Ilya Dryomov
898c113f93 qa: add script to test udev event reaping
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-10-18 21:56:30 +02:00
Ilya Dryomov
1c6cac1aca krbd: increase udev netlink socket receive buffer to 2M
Even though with the previous commit we no longer block between binding
the socket and starting handling events, we still want a larger receive
buffer to accommodate for scheduling delays.  Since the filtering is
done in the listener, an estimate focused on just rbd is not accurate,
but anyway: a pair of "rbd" and "block" events for "rbd map" take 2048
bytes in the receive buffer.  This allows for roughly a thousand of
them ("rbd map" and "rbd unmap" require root and libudev makes use of
SO_RCVBUFFORCE so rmem_max limit is ignored).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-10-18 21:55:56 +02:00
Kefu Chai
7552cd790f ceph-crash: use "ceph-crash" as logger name
"ceph-crash" is a better name than "__main__", we don't use ceph-crash
as a module, so its `__name__` is always `__main__`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-18 17:47:14 +08:00
Mykola Golub
97720eddd9 mgr/balancer: python3 compatibility issue
Fixes: https://tracker.ceph.com/issues/42370
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-10-18 12:19:30 +03:00
Kefu Chai
512560ec75
Merge pull request #30701 from pdvian/wip-fix-target-size-bytes
mon/OSDMonitor: Fix pool set target_size_bytes (etc) with unit suffix

Reviewed-by: Sage Weil <sage@redhat.com>
2019-10-18 17:15:45 +08:00
Kefu Chai
977bf94eb7
Merge pull request #30870 from rosinL/wip-addlog-setnumaaffinity
osd/osd: add an err log to set_numa_affinty

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-18 17:15:07 +08:00
Kefu Chai
fc11221b93
Merge pull request #30549 from aclamk/fix-garbled-wal
os/bluestore/BlueFS: clear newly allocated space for WAL logs

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-10-18 17:14:00 +08:00
Ilya Dryomov
340d6f61b3
Merge pull request #30978 from idryomov/wip-krbd-modprobe
krbd: modprobe before calling build_map_buf()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-10-18 11:11:07 +02:00
Jan Fajerski
d565888832
Merge pull request #30790 from kshtsk/wip-python3-print-ceph-volume
ceph-volume: use python3 compatible print
2019-10-18 10:07:06 +02:00
Kefu Chai
0a8448e0c7
Merge pull request #30829 from kshtsk/wip-misc-drop-legacy-code-in-skeleton_config
tasks/ceph: drop testdir replacement in skeleton_config

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-18 16:06:23 +08:00
Kefu Chai
b6201ed4c8
Merge pull request #30852 from dzafman/wip-42115
osd: Turn off repair pg state when leaving recovery

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-18 16:02:32 +08:00
Kefu Chai
df8bb8b8f6
Merge pull request #30646 from shyukri/wip-qa-mgr-balancer
qa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-10-18 15:43:33 +08:00
Nathan Cutler
ec6af09384 doc: split up SubmittingPatches.rst
Split the existing SubmittingPatches.rst into three files:

* SubmittingPatches.rst (general guidelines, for GitHub/master branch)
* SubmittingPatches-kernel.rst (for kernel patches)
* SubmittingPatches-backports.rst (for backports)

Fixes: http://tracker.ceph.com/issues/20953
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-17 19:32:03 +02:00
Kefu Chai
c5282b04db
Merge pull request #30293 from rosinL/wip-fix-kvstorebench
kv_store_bench: fix teuthology_tests() return value

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-10-17 23:31:24 +08:00
Kefu Chai
2502df3084
Merge pull request #30833 from majianpeng/async-batch-counter
msg/async: remove unsued code.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-17 23:28:29 +08:00
Lenz Grimmer
c44131b582
Merge pull request #30288 from ricardoasmarques/display-uuid-lunid
mgr/dashboard: Display WWN and LUN number in iSCSI target details

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-10-17 15:21:16 +00:00
Ilya Dryomov
286bdbfe24 krbd: modprobe before calling build_map_buf()
Otherwise add_key() in set_kernel_secret() fails as if running against
an ancient kernel and we fall back to secret= in options for the first
image being mapped on the machine.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-10-17 16:52:43 +02:00
J. Eric Ivancich
ca7318c3a1
Merge pull request #30940 from cbodley/wip-qa-rgw-crypt
qa/rgw: refactor the kms backend configuration

Reviewed-by:  J. Eric Ivancich <ivancich@redhat.com>
2019-10-17 09:27:40 -04:00
Yan, Zheng
c4c7df8bf0 qa: whitelist "Error recovering journal" for cephfs-data-scan
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/41836
2019-10-17 21:19:54 +08:00
Adam Kupczyk
53aac52474 objectstore/test/aging: Added avl, added more test cases, added reporting free score.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-10-17 20:54:57 +08:00
xie xingguo
29512a70d4 qa: add AvlAllocator test script
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-10-17 20:54:57 +08:00
xie xingguo
97dfbc9c48 src/test/objectstore/Allocator_{test,bench}.cc: test AvlAllocator too
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-10-17 20:54:57 +08:00
xie xingguo
adbc79a8ac os/bluestore: implement avl-extent-based allocator
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-17 20:54:57 +08:00
Ricardo Dias
7bc60cacf0
Merge pull request #30937 from rjfd/wip-dashboard-fix-home-py2
mgr/dashboard: fix python2 failure in home controller 

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-10-17 09:51:26 +01:00