Commit Graph

110121 Commits

Author SHA1 Message Date
Kefu Chai
36448b5628 crimson/osd: do not use "warn()" when handling non-error
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-01 20:01:16 +08:00
Kefu Chai
a84be33461 crimson/mon: do not print error log at seeing unknown connection
it happens if a client or an peer osd drops the connection, so it's not
an error and hence we should not print this error message using
"error()".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-01 20:01:15 +08:00
Jan Fajerski
748d3d444f
Merge pull request #34341 from guits/update_cv_deploy
ceph-volume: update functional testing deploy.yml playbook
2020-04-01 13:26:59 +02:00
Kefu Chai
b144ef3d1f
Merge pull request #34331 from zealoussnow/wip-fix-clone-error
test/common/unittest_blkdev: delete unused test file

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-01 19:23:54 +08:00
Leo Zhang
f2de1dc442 unittest_blkdev: delete unused test file
Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2020-04-01 18:57:52 +08:00
Sebastian Wagner
b740ae12e5 doc/mgr/orchestrator: Update Placement by pattern matching
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
8d4487527e doc/cephadm/drivegroup: Don't introduce DriveGroups
We already have a name for it: a Service Specification of
type `osd`. We don't need to introduce a new name for it.

Well, they are "DriveGroups", but users don't need to know it.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
f5e3e60e0e doc/cephadm/drivegroups: Update to new yaml
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
bc162005a9 doc/mgr/orchestrator: use yaml syntax highlighting
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
0c6759750a doc/mgr/orchestrator: Add "Service Specification"
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Guillaume Abrioux
5bf7cc87ec ceph-volume: update functional testing deploy.yml playbook
This commit adds a call to `ceph-facts` role in the first play of this
playbook. This is needed so `ceph-validate` won't fail because of
following error:

```
fatal: [osd0]: FAILED! => {}

MSG:

'osd_pool_default_size' is undefined
```

`osd_pool_default_size` is set in ceph-facts.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-04-01 11:32:40 +02:00
zhangdaolong
a183aac978 pybind/rbd: fix no lockers are obtained, ImageNotFound exception will be output
No lockers are obtained, ImageNotFound exception will be output,
but tht image is always exist.when lockers number is zero,
Should not output any exceptions。

Fixes: https://tracker.ceph.com/issues/44613

Signed-off-by: zhangdaolong <zhangdaolong@fiberhome.com>
2020-04-01 16:48:51 +08:00
Laura Paduano
4d5fa9317d
Merge pull request #34232 from bk201/wip-44743
qa/tasks/mgr/dashboard/test_rbd: wait longer when purging

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-04-01 10:15:41 +02:00
Jianpeng Ma
bdde3a8bb5 common/Throttle: Don't lock for atomic type update.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2020-04-01 15:47:46 +08:00
Changcheng Liu
827aae2603 mailmap: update mail org relationship
The owner of "changcheng.liu@aliyun.com" is an employee of Intel.
Update info for comming statistic.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-04-01 14:02:39 +08:00
Shilpa Jagannath
d6b1e6b768 modified get_target_shard_id() to take bucket_index_normal_layout directly
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-01 11:18:09 +05:30
Yingxin Cheng
2c9a617081 crimson/net: fix is_connected() to identify if handshake has completed
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:49:08 +08:00
Yingxin Cheng
f8259a5e90 crimson/net: notify if the connection is to be replaced during reset
is_replace=true means the reset connection is going to be replaced by
another accepting connection with the same peer_addr, which currently
only happens under lossy policy when both sides wish to connect to each
other.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:43:00 +08:00
Yingxin Cheng
2c77d580c5 crimson/net: remove too-verbose info logs in connect()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:41:29 +08:00
Yingxin Cheng
0c9aec9cd3 crimson/net: audit peer_name(type, id) during handshake
Allow connect to specific peer with entity_name_t, with required
internal validation during handshake in v2.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-04-01 11:41:18 +08:00
Xiubo Li
fbff4ee153 Client: make sure the Finisher's mutex lock not held during it being distructed
The objecter_finisher is already started in Client::Client(), but
in the failure path when initializing and starting the Client object,
we may not get a chance to call the Client::shutdown() to stop the
Finisher thread, which maybe still holding the mutex lock in it. Then
when destrucing the Finisher object the pthread_mutex_destroy() will
fail.

This fix will delay the objecter_finisher thread to start in ::init()
until we're ready to call Client::shutdown on any errors instead.

Fixes: https://tracker.ceph.com/issues/44389
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-03-31 20:43:10 -04:00
Michael Fritch
246a80af7a
cephadm: add extra_args to nfs daemon
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-31 17:39:03 -06:00
Sage Weil
b225bd4a9e cephadm: fix typo
This has been bugging me

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-31 18:06:46 -05:00
Casey Bodley
768c9f3839 rgw: pubsub sync module ignores ERR_USER_EXIST
otherwise, this error gets returned by RGWPSDataSyncModule::start_sync()
and data sync fails to start

Fixes: https://tracker.ceph.com/issues/44857

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-03-31 16:49:43 -04:00
Yuri Weinstein
fb99112ba3
Merge pull request #34291 from dillaman/wip-44814
librbd: fix client backwards compatibility issues
2020-03-31 07:44:31 -07:00
dehao shang
5bcb27c975 qa: fix nfs setup and teardown bug in qemu task
For example, when there are two RBD client in the same teuthology node,
no matter what the result of test case is, always lead to the below error :

"Error : test -f /home/ubuntu/cephtest/archive/qemu/client.1/success"

The main reason is that _setup_nfs_mount and _teardown_nfs_mount just
support single mount point.

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2020-03-31 21:43:15 +08:00
Joshua Schmid
04f0d3395c python-common: add pyyaml to requirements file
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:28:30 +02:00
Joshua Schmid
494728c5dc python-common: python-common: fix /hosts/ parsing in servicespecs
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:28:05 +02:00
Sebastian Wagner
7ff5d89dcb
Merge pull request #34295 from sebastian-philipp/raise-for-invalid-dg
python-common: raise on empty drive selections

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-03-31 15:25:25 +02:00
Sage Weil
eae20a7073 cephadm: ceph-volume: disallow concurrent execution
Fixes: https://tracker.ceph.com/issues/44820
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-31 08:16:25 -05:00
Lenz Grimmer
d72de4b7df
Merge pull request #34026 from votdev/issue_44539_shorten_container_id
mgr/dashboard: shorten `Container ID` and `Container image ID` in Services page

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-03-31 15:01:37 +02:00
zhengyin
e03a749b8f doc: add a note that states the behavior change for the clone operation
in the PendingReleaseNotes.

     Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2020-03-31 20:57:44 +08:00
Kiefer Chang
1c3d6539d9
qa/tasks/mgr/dashboard/test_rbd: wait longer when purging
Fixes: https://tracker.ceph.com/issues/44743
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
Co-authored-by: Kefu Chai <kefu@redhat.com>
Co-authored-by: Volker Theile <vtheile@suse.com>
2020-03-31 19:48:58 +08:00
Shilpa Jagannath
197a141d05 Removed redundant encoding of layout.* and adjusted the corresponding decoding
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-03-31 16:48:19 +05:30
Shilpa Jagannath
c7157a655f Moved ostream operator overloading to BucketIndexType() to rgw_bucket_layout header file
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-03-31 16:43:12 +05:30
Tiago Melo
d7e7d2b09e mgr/dashboard: Fix ServiceDetails and PoolDetails unit tests
While testing the upgrade to Angular 9,
these 2 unit tests were consistently failling.

Fixes: https://tracker.ceph.com/issues/42929

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-31 09:59:36 +00:00
Volker Theile
ed51f8039a mgr/dashboard: shorten Container ID and Container image ID in Services page
Fixes: https://tracker.ceph.com/issues/44539

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-03-31 11:13:41 +02:00
Kefu Chai
558853be66
Merge pull request #34259 from rzarzynski/wip-crimson-fix-bad-methods
crimson/osd: fix method's flag handling on CEPH_OSD_OP_CALL.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-31 17:04:49 +08:00
Kefu Chai
481248edb4
Merge pull request #34305 from tchaikov/wip-crimson-stddev
test/crimson: increase variance of stdev to 0.20

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-03-31 15:49:57 +08:00
Brad Hubbard
f7c49a4063 qa/suites/rados/rest: Test against all supported distros
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-31 17:43:10 +10:00
Brad Hubbard
e20e6fc329 qa/suites/rados/rest: Don't pass empty dict as data arg
Passing an empty 'args' dict as a data argument when calling
requests.get somehow confuses the transaction, causing it to fail. Pass
'None' instead.

Fixes: https://tracker.ceph.com/issues/43720

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-31 17:43:10 +10:00
Gregory Farnum
2d62a20112
Merge pull request #34167 from javacruft/32bit-fixes-march
mds: resolve type mismatches on 32 bit archs

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-03-30 23:54:30 -07:00
Venky Shankar
3c531197a6 qa: whitelist cluster warning message for removed MDS
Fixes: http://tracker.ceph.com/issues/44677
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-31 02:41:00 -04:00
Venky Shankar
bccbf1fa03 mgr: force purge normal ceph entities from service map
Normal ceph services can send task status updates to manager.
Task status is tracked in service map implying that normal
ceph services have entries in service map and daemon tracking
index (daemon state). But the manager prunes entries from daemon
state when it receives an updated map (fs, mon, etc...). This
causes periodic pruning of service map entries to fail for normal
ceph services (those which send task status updates) since it
expects a corresponding entry in daemon state.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-31 02:41:00 -04:00
Kefu Chai
f2d162d54b test/crimson: increase variance of stdev to 0.20
per Mark Nelson,

> yeah, 5% variation is way too low
> Sometimes we can stay within 5%, but especially if we are pushing the
> system hard we can see closer to 10-20% sometimes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-31 12:24:06 +08:00
Yan, Zheng
7aa22fac60 ceph-fuse: don't get mount options from /etc/fstab when doing remount
If there happen to be an kcephfs entry in /etc/fstab for ceph-fuse's
mount point. 'mount -o remount' may get options from that entry. fuse
may not understand some options (E.g name option).

Fixes: https://tracker.ceph.com/issues/44771
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-31 11:47:51 +08:00
Yuan Lu
b98a869d2c librbd: add flush test case
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:07:10 +08:00
Yuan Lu
d860e909fb librbd: add internal flush
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:51 +08:00
Yuan Lu
555e101110 librbd: flush dirty entries to osd
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:42 +08:00
Yuan Lu
a1c3fdf77b librbd: flush sync point into cache device
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-03-31 11:06:33 +08:00