Commit Graph

110057 Commits

Author SHA1 Message Date
Sebastian Wagner
bc162005a9 doc/mgr/orchestrator: use yaml syntax highlighting
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
0c6759750a doc/mgr/orchestrator: Add "Service Specification"
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Guillaume Abrioux
5bf7cc87ec ceph-volume: update functional testing deploy.yml playbook
This commit adds a call to `ceph-facts` role in the first play of this
playbook. This is needed so `ceph-validate` won't fail because of
following error:

```
fatal: [osd0]: FAILED! => {}

MSG:

'osd_pool_default_size' is undefined
```

`osd_pool_default_size` is set in ceph-facts.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-04-01 11:32:40 +02:00
zhangdaolong
a183aac978 pybind/rbd: fix no lockers are obtained, ImageNotFound exception will be output
No lockers are obtained, ImageNotFound exception will be output,
but tht image is always exist.when lockers number is zero,
Should not output any exceptions。

Fixes: https://tracker.ceph.com/issues/44613

Signed-off-by: zhangdaolong <zhangdaolong@fiberhome.com>
2020-04-01 16:48:51 +08:00
Laura Paduano
4d5fa9317d
Merge pull request #34232 from bk201/wip-44743
qa/tasks/mgr/dashboard/test_rbd: wait longer when purging

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-04-01 10:15:41 +02:00
Changcheng Liu
827aae2603 mailmap: update mail org relationship
The owner of "changcheng.liu@aliyun.com" is an employee of Intel.
Update info for comming statistic.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-04-01 14:02:39 +08:00
Shilpa Jagannath
d6b1e6b768 modified get_target_shard_id() to take bucket_index_normal_layout directly
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-01 11:18:09 +05:30
Yingxin Cheng
2c9a617081 crimson/net: fix is_connected() to identify if handshake has completed
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:49:08 +08:00
Yingxin Cheng
f8259a5e90 crimson/net: notify if the connection is to be replaced during reset
is_replace=true means the reset connection is going to be replaced by
another accepting connection with the same peer_addr, which currently
only happens under lossy policy when both sides wish to connect to each
other.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:43:00 +08:00
Yingxin Cheng
2c77d580c5 crimson/net: remove too-verbose info logs in connect()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:41:29 +08:00
Yingxin Cheng
0c9aec9cd3 crimson/net: audit peer_name(type, id) during handshake
Allow connect to specific peer with entity_name_t, with required
internal validation during handshake in v2.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:41:18 +08:00
Xiubo Li
fbff4ee153 Client: make sure the Finisher's mutex lock not held during it being distructed
The objecter_finisher is already started in Client::Client(), but
in the failure path when initializing and starting the Client object,
we may not get a chance to call the Client::shutdown() to stop the
Finisher thread, which maybe still holding the mutex lock in it. Then
when destrucing the Finisher object the pthread_mutex_destroy() will
fail.

This fix will delay the objecter_finisher thread to start in ::init()
until we're ready to call Client::shutdown on any errors instead.

Fixes: https://tracker.ceph.com/issues/44389
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-03-31 20:43:10 -04:00
Michael Fritch
246a80af7a
cephadm: add extra_args to nfs daemon
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-31 17:39:03 -06:00
Sage Weil
b225bd4a9e cephadm: fix typo
This has been bugging me

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-31 18:06:46 -05:00
Casey Bodley
768c9f3839 rgw: pubsub sync module ignores ERR_USER_EXIST
otherwise, this error gets returned by RGWPSDataSyncModule::start_sync()
and data sync fails to start

Fixes: https://tracker.ceph.com/issues/44857

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-03-31 16:49:43 -04:00
Yuri Weinstein
fb99112ba3
Merge pull request #34291 from dillaman/wip-44814
librbd: fix client backwards compatibility issues
2020-03-31 07:44:31 -07:00
dehao shang
5bcb27c975 qa: fix nfs setup and teardown bug in qemu task
For example, when there are two RBD client in the same teuthology node,
no matter what the result of test case is, always lead to the below error :

"Error : test -f /home/ubuntu/cephtest/archive/qemu/client.1/success"

The main reason is that _setup_nfs_mount and _teardown_nfs_mount just
support single mount point.

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2020-03-31 21:43:15 +08:00
Joshua Schmid
04f0d3395c python-common: add pyyaml to requirements file
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:28:30 +02:00
Joshua Schmid
494728c5dc python-common: python-common: fix /hosts/ parsing in servicespecs
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:28:05 +02:00
Sebastian Wagner
7ff5d89dcb
Merge pull request #34295 from sebastian-philipp/raise-for-invalid-dg
python-common: raise on empty drive selections

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:25:25 +02:00
Sage Weil
eae20a7073 cephadm: ceph-volume: disallow concurrent execution
Fixes: https://tracker.ceph.com/issues/44820
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-31 08:16:25 -05:00
Lenz Grimmer
d72de4b7df
Merge pull request #34026 from votdev/issue_44539_shorten_container_id
mgr/dashboard: shorten `Container ID` and `Container image ID` in Services page

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-03-31 15:01:37 +02:00
zhengyin
e03a749b8f doc: add a note that states the behavior change for the clone operation
in the PendingReleaseNotes.

     Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2020-03-31 20:57:44 +08:00
Kiefer Chang
1c3d6539d9
qa/tasks/mgr/dashboard/test_rbd: wait longer when purging
Fixes: https://tracker.ceph.com/issues/44743
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
Co-authored-by: Kefu Chai <kefu@redhat.com>
Co-authored-by: Volker Theile <vtheile@suse.com>
2020-03-31 19:48:58 +08:00
Shilpa Jagannath
197a141d05 Removed redundant encoding of layout.* and adjusted the corresponding decoding
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-03-31 16:48:19 +05:30
Shilpa Jagannath
c7157a655f Moved ostream operator overloading to BucketIndexType() to rgw_bucket_layout header file
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-03-31 16:43:12 +05:30
Tiago Melo
d7e7d2b09e mgr/dashboard: Fix ServiceDetails and PoolDetails unit tests
While testing the upgrade to Angular 9,
these 2 unit tests were consistently failling.

Fixes: https://tracker.ceph.com/issues/42929

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-31 09:59:36 +00:00
Volker Theile
ed51f8039a mgr/dashboard: shorten Container ID and Container image ID in Services page
Fixes: https://tracker.ceph.com/issues/44539

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-03-31 11:13:41 +02:00
Kefu Chai
558853be66
Merge pull request #34259 from rzarzynski/wip-crimson-fix-bad-methods
crimson/osd: fix method's flag handling on CEPH_OSD_OP_CALL.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-31 17:04:49 +08:00
Kefu Chai
481248edb4
Merge pull request #34305 from tchaikov/wip-crimson-stddev
test/crimson: increase variance of stdev to 0.20

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-03-31 15:49:57 +08:00
Brad Hubbard
f7c49a4063 qa/suites/rados/rest: Test against all supported distros
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-31 17:43:10 +10:00
Brad Hubbard
e20e6fc329 qa/suites/rados/rest: Don't pass empty dict as data arg
Passing an empty 'args' dict as a data argument when calling
requests.get somehow confuses the transaction, causing it to fail. Pass
'None' instead.

Fixes: https://tracker.ceph.com/issues/43720

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-31 17:43:10 +10:00
Gregory Farnum
2d62a20112
Merge pull request #34167 from javacruft/32bit-fixes-march
mds: resolve type mismatches on 32 bit archs

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-03-30 23:54:30 -07:00
Venky Shankar
3c531197a6 qa: whitelist cluster warning message for removed MDS
Fixes: http://tracker.ceph.com/issues/44677
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-31 02:41:00 -04:00
Venky Shankar
bccbf1fa03 mgr: force purge normal ceph entities from service map
Normal ceph services can send task status updates to manager.
Task status is tracked in service map implying that normal
ceph services have entries in service map and daemon tracking
index (daemon state). But the manager prunes entries from daemon
state when it receives an updated map (fs, mon, etc...). This
causes periodic pruning of service map entries to fail for normal
ceph services (those which send task status updates) since it
expects a corresponding entry in daemon state.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-31 02:41:00 -04:00
Kefu Chai
f2d162d54b test/crimson: increase variance of stdev to 0.20
per Mark Nelson,

> yeah, 5% variation is way too low
> Sometimes we can stay within 5%, but especially if we are pushing the
> system hard we can see closer to 10-20% sometimes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-31 12:24:06 +08:00
Yan, Zheng
7aa22fac60 ceph-fuse: don't get mount options from /etc/fstab when doing remount
If there happen to be an kcephfs entry in /etc/fstab for ceph-fuse's
mount point. 'mount -o remount' may get options from that entry. fuse
may not understand some options (E.g name option).

Fixes: https://tracker.ceph.com/issues/44771
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-31 11:47:51 +08:00
Yuan Lu
b98a869d2c librbd: add flush test case
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:07:10 +08:00
Yuan Lu
d860e909fb librbd: add internal flush
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:51 +08:00
Yuan Lu
555e101110 librbd: flush dirty entries to osd
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:42 +08:00
Yuan Lu
a1c3fdf77b librbd: flush sync point into cache device
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:33 +08:00
Yuan Lu
07fb05a658 librbd: add FlushRequest to handle flush
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:24 +08:00
Jason Dillaman
42e60584d4
Merge pull request #34112 from trociny/wip-44610
pybind/rbd: ensure image is open before permitting operations

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-03-30 20:50:44 -04:00
Jason Dillaman
d45de978d1
Merge pull request #34019 from changchengx/blockguard
librbd: refine BlockGuard debug output

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-03-30 20:49:48 -04:00
Sage Weil
5a516db38f Merge PR #34150 into master
* refs/pull/34150/head:
	cephadm: rm-cluster clean up /etc/ceph

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-30 15:22:32 -05:00
Daniel-Pivonka
bb4554a3a6 mgr/cephadm: add useful error if python3 is not on remote host
show 'Error ENOENT: New host example (example) failed check: ["Can't communicate with
remote host, possibly because python3 is not installed there"]' instead of traceback
with OSError: cannot send(already closed?) when adding host if python3 is not on host

Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
2020-03-30 14:51:53 -04:00
Sebastian Wagner
874ba5049a python-common: raise on emtpy drive groups
adds a test for https://tracker.ceph.com/issues/44758

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-30 19:51:31 +02:00
Sebastian Wagner
8194d4972f cephadm: check hostnames case insensitive
Salt converts minion names to lowercase.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-30 18:16:57 +02:00
Jason Dillaman
d1a67c3bda librbd: re-add support for nautilus clients talking to jewel clusters
We want to support N - 3 client backward compatibility (special case
to support Jewel since it was a LTS release). The "get_snapshot_timestamp"
cls method does not exist in Jewel clusters so librbd should fallback
to excluding the op if it fails.

Note that this N - 3 also needs to apply for downstream releases as well,
which implies we still need Jewel for the time being.

Fixes: http://tracker.ceph.com/issues/39450
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit c644121820)

Conflicts:
	src/test/librbd/image/test_mock_RefreshRequest.cc: tweaked to support pool configs
2020-03-30 11:37:12 -04:00
Jason Dillaman
ab720d4c00 librbd: ignore -EOPNOTSUPP errors when retrieving image group membership
The Luminous release did not support adding images to a group (it only
included the bare-minimum support for creating groups). Commit f76df32666
incorrectly dropped support for ignoring this possible failure. This
prevents Nautilus-release clients from opening images contained within
a Luminous-release cluster.

Fixes: http://tracker.ceph.com/issues/38834
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 6f29dc69a0)
2020-03-30 11:20:21 -04:00