Commit Graph

97224 Commits

Author SHA1 Message Date
Rishabh Dave
d90c0a0e81 qa: add stdin parameter to run_shell
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-17 23:58:22 +05:30
Rishabh Dave
5462ba5d9d qa: command to be ran as a different user should be a single string
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-17 23:58:19 +05:30
Rishabh Dave
bbca211225 qa: looks for quotes in Python shell and get rid of them
Since quotes are not a token for Python's shell simulation (unlike
Bash), raise a RuntimeError for them and add an exception for Python
command since it quotes to define a program on commandline.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-12 15:00:58 +05:30
Rishabh Dave
512f4721a5 qa: move checks on command arguments to a different method
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-12 15:00:58 +05:30
Rishabh Dave
ee940faaff qa: accept args as strings
Till now the run() method in vstart_runner.py accepts commands only as
a (Python) list. It is very inconvenient to write commands as
['setfacl', '-m', 'user:someuser:rwx', 'somedir/somefile'] when they
can be simply be written as
'setfacl -m user:someuser:rwx somedir/somefile'. Also, converting the
latter form to former one is exceedingly simple. So writing commands as
strings should be allowed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-12 15:00:58 +05:30
Rishabh Dave
cb262323bc qa: add a method to run given command as root user
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-12 15:00:58 +05:30
Rishabh Dave
8ca094ff99 qa: add a method to run a command as a different user
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-12 15:00:57 +05:30
Rishabh Dave
3e0a1361f7 qa: allow keeping sudo in command arguments
sudo cannot be omitted from the given command's arguments, when running
passwd, chown and, specially, when sudo is used for running the given
command as different user.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-09 21:03:31 +05:30
Rishabh Dave
5df2b82c4f qa: make execution abortion optional for command ran through run_shell()
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-04-09 21:03:31 +05:30
Kefu Chai
2662ae8f3c
Merge pull request #27455 from wjwithagen/wjw-fix-test_weighted_shuffle.cc
test: Add `#include <array>`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-09 22:29:55 +08:00
Sebastian Wagner
559b2e7402
Merge pull request #27431 from sebastian-philipp/rook-doc-update-mon
doc/mgr/orchestrator_cli: Rook orch supports mon update

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-04-09 16:19:53 +02:00
Casey Bodley
f2bb87b7ec
Merge pull request #25985 from l-vo/update_php_doc
doc/radosgw: update documentation examples with the current S3 PHP client

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-04-09 09:40:42 -04:00
Patrick Donnelly
11bf2d36ad
Merge PR #27051 into master
* refs/pull/27051/head:
	mds: open import bounding dirfrags in batch
	mds: remove superfluous error in StrayManager::advance_delayed()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-09 06:18:26 -07:00
Patrick Donnelly
c5e8c22ab6
Merge PR #27412 into master
* refs/pull/27412/head:
	doc: add doc for blacklisting older CephFS clients

Reviewed-by: Barbora Ančincová <bara@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-04-09 06:17:43 -07:00
Jason Dillaman
42ac6ac442
Merge pull request #27194 from trociny/wip-38661
librbd: do not allow to deep copy migrating image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-09 08:58:50 -04:00
Jason Dillaman
f42d3ffb31
Merge pull request #27268 from trociny/wip-38364
librbd: support EC data pool images sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-09 08:57:53 -04:00
Kefu Chai
2bde981fa9
Merge pull request #27452 from tchaikov/wip-crimson-auth-server
crimson: move dummy impl of AuthServer to DummyAuth

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-09 19:16:50 +08:00
Willem Jan Withagen
3b5c7be852 test: Add includefile for arrays
Otherwise Clang will complain on FreeBSD:
```
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:9:23: error: implicit instantiation of undefined template 'std::__1::array<char, 5>'
  std::array<char, 5> choices{'a', 'b', 'c', 'd', 'e'};
                      ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
                                                               ^
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:10:22: error: implicit instantiation of undefined template 'std::__1::array<int, 5>'
  std::array<int, 5> weights{100, 50, 25, 10, 1};
                     ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-04-09 11:24:49 +02:00
Kefu Chai
4f9e1e2499 crimson/mon: implement AuthServer methods
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 14:36:45 +08:00
Kefu Chai
abb374aec4 crimson/auth: move dummy impl of AuthServer to DummyAuth
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 14:35:24 +08:00
Kefu Chai
7cbbe9acea
Merge pull request #27416 from tchaikov/wip-crimson-auth
crimson: update osd when peer gets authenticated

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-04-09 11:39:28 +08:00
Kefu Chai
e2f2a7f606 crimson: update osd when peer gets authenticated
* common/auth_handler.h: add an abstract class of AuthHandler, the one who is interested in
  an authenticated peer should implement this class
* mon/MonClient: let mon::Client implement AuthServer, as it has access the keyring. it
  will update the registered AuthHandler if the client (peer) is
  authenticated.
* osd: implement AuthHandler class. we will keep track of the connected
  sessions along their caps in a follow-up change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 11:38:04 +08:00
Kefu Chai
a866d16095
Merge pull request #27426 from tchaikov/wip-crimson-setup-msgr
crimson/osd: consolidate the code to initialize msgrs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-09 11:31:19 +08:00
Kefu Chai
6ca92572da
Merge pull request #27286 from tchaikov/wip-strncpy-with-nul
osdc/Objecter: always add `\0' after strncpy()

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-04-09 11:30:05 +08:00
Kefu Chai
539b8b40e1
Merge pull request #27429 from cyx1231st/wip-seastar-msgr-perf2
test/crimson: include writes in perf_crimson/async_server

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-09 11:27:52 +08:00
Yingxin Cheng
e289ec8521 test/crimson: wrap perf parameters as structured data
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-04-09 16:37:40 +08:00
Yingxin Cheng
478e9e8395 test/crimson: perf_crimson/async_server write test support
Allow server to have write/send workload with specified block size.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-04-09 16:06:39 +08:00
Xie Xingguo
a0e1519f31
Merge pull request #27422 from iotcg/doc_pg
doc: fix parameter to set pg autoscale mode

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-09 08:58:41 +08:00
Patrick Donnelly
56c52e6894
Merge PR #27427 into master
* refs/pull/27427/head:
	cephfs-shell: Use colorama module instead of colorize

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 17:09:45 -07:00
Patrick Donnelly
07a557411d
Merge PR #27369 into master
* refs/pull/27369/head:
	docs: Add note to execute cephfs-shell

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 16:16:06 -07:00
Patrick Donnelly
40c06914de
Merge PR #27256 into master
* refs/pull/27256/head:
	mds: drop reconnect message from non-existent session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-04-08 16:13:00 -07:00
Patrick Donnelly
7808995aee
Merge PR #27214 into master
* refs/pull/27214/head:
	mds/server: check directory split after rename.

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-04-08 16:11:51 -07:00
Patrick Donnelly
9ce4c2df01
Merge PR #27415 into master
* refs/pull/27415/head:
	qa: decouple session map test from simple msgr
	msg/async: move connection ref
	msg/async: dec active connections when marked down

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-08 15:41:48 -07:00
Patrick Donnelly
19fb785490
Merge PR #27414 into master
* refs/pull/27414/head:
	msg/async: resolve gcc warning

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-04-08 15:21:42 -07:00
Patrick Donnelly
95714b5c7c
qa: decouple session map test from simple msgr
Instead of looking at the number of threads (used by the simple messenger) to
judge the coming and going of connections, use the (async) messenger perf
counters.

Plus some other minor improvements.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 11:50:17 -07:00
Patrick Donnelly
5134a7ddbb
msg/async: move connection ref
Trivial optimization.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 11:42:12 -07:00
Patrick Donnelly
d2d38ac858
msg/async: dec active connections when marked down
Otherwise, tests can't tell when a connection is stopped until it's eventually
"lazily" deleted. This should be safe since the perf counter is manipulating an
atomic value.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 11:42:12 -07:00
Patrick Donnelly
19372b8492
doc: add doc for blacklisting older CephFS clients
Fixes: http://tracker.ceph.com/issues/39130
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 10:56:38 -07:00
Patrick Donnelly
7b03130e2a
Merge PR #27281 into master
* refs/pull/27281/head:
	script/ceph-release-notes: alternate merge commit format

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2019-04-08 09:35:43 -07:00
Kefu Chai
8c553e3522
Merge pull request #26782 from iotcg/master
vstart.sh: fix CEPH_PORT check and cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-09 00:32:46 +08:00
Patrick Donnelly
b90d566d34
Merge PR #27437 into master
* refs/pull/27437/head:
	vstart: add an alias for cephfs-shell to vstart_environment.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 09:26:01 -07:00
Sage Weil
1aabb186b7 Merge PR #27419 into master
* refs/pull/27419/head:
	common: add --log-early command line option

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-08 10:17:50 -05:00
Yuval Lifshitz
9641f27eff
Merge pull request #27091 from yuvalif/s2_pubsub_api_new
S3 compatible pubsub API
2019-04-08 17:31:40 +03:00
Sage Weil
441a3160b6 Merge PR #27374 into master
* refs/pull/27374/head:
	mgr/volume: set cephfs metadata bias at 4x
	mgr/volume: default to 16 PGs (min) for metadata pool

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 09:25:14 -05:00
Sage Weil
5e6f43ed03 Merge PR #27349 into master
* refs/pull/27349/head:
	qa/distros/supported/ubuntu_latest: 16.04 -> 18.04
	qa/distros/supported/centos_latest: 7.5 -> 7.6
	qa/distros: add centos 7.6

Reviewed-by: David Galloway <dgallowa@redhat.com>
2019-04-08 09:24:26 -05:00
Sage Weil
8420e3f32b Merge PR #27386 into master
* refs/pull/27386/head:
	os/filestore/FileJournal: note EIO events
	os/filestore: make note of EIO errors when we see them
	os/filestore: note devname for later use
	global/signal_handler: avoid core dump on EIO
	os/bluestore/KernelDevice: note EIO metadata on aio EIO
	global: add hook to annotate crash report with EIO information

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-04-08 09:24:09 -05:00
Sage Weil
1695764436 Merge PR #27337 into master
* refs/pull/27337/head:
	msg/async: add timeout for connections which are not yet ready
	msg: rename ms_tcp_read_timeout to ms_connection_idle_timeout

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-04-08 09:13:37 -05:00
Jeff Layton
91d3d96691 vstart: add an alias for cephfs-shell to vstart_environment.sh
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-04-08 10:00:03 -04:00
Kefu Chai
fbc71dcf27
Merge pull request #27341 from liewegas/wip-learn-addr-from-peer
msg/async/ProtocolV[12]: add ms_learn_addr_from_peer

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-04-08 19:53:09 +08:00
Kefu Chai
2cecb87855
Merge pull request #27340 from tchaikov/wip-cmt-more-chatty
ceph-monstore-tool: print out caps when rebuilding monstore

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-08 19:50:01 +08:00