Commit Graph

99078 Commits

Author SHA1 Message Date
zhang Shaowen
b61b2f65f5 rgw: add missing operation to iam_policy
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-06-12 11:19:04 +08:00
zhang Shaowen
07f70d780c rgw: fix some bugs in object lock feature
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-06-12 11:19:04 +08:00
zhang Shaowen
5789109290 rgw: fix some errors in params
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-06-12 11:19:04 +08:00
zhang Shaowen
18949105ae rgw: add object lock doc.
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-06-12 11:19:04 +08:00
zhang Shaowen
0c24ce5581 rgw: add object lock feature.
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-06-12 11:19:04 +08:00
Kefu Chai
ddeda902b9 mgr/dashboard: s/portal_ip_address/portal_ip_addresses/
and take portal_ip_addresses as a list

it's a follow-up fix of #28084

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-12 10:44:49 +08:00
Kefu Chai
304c791db2
Merge pull request #28290 from b-ranto/wip-selinux-rhel8
selinux: Update the policy for RHEL8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-12 10:17:16 +08:00
Neha Ojha
469abff18c qa/suites/perf-basic/workloads: add client_endpoint_rbd_4K_rand_write.yaml
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-12 00:16:59 +00:00
Igor Fedotov
a90d57ca05 os/bluestore: BitmapAllocator::allocate: log new extents only
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-06-12 02:13:57 +03:00
Igor Fedotov
84c2d41485 os/bluestore: distinguis request and results in bitmap alloc log
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-06-12 02:13:21 +03:00
Kamoltat (Junior) Sirivadhna
dd2c3f66a1 mgr/progress: Add event when OSD marked in
Basically keeps track of affected PGs
similar to how funciton _osd_out works
but instead of tracking up+acting set
we only care about acting. Also made
a minor change on the function pg_update:
we consider pg to be complete when it
is active and clean and nothing else.
Removed the variable "unmoved" since
If the pg wasn't moved, we shouldn't
have an event for it in the first place.

Signed-off-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2019-06-11 15:14:15 -04:00
Igor Fedotov
d9a4b1638c test/objectstore: change check order in Allocator_test.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-06-11 20:17:54 +03:00
Casey Bodley
13da9add19
Merge pull request #27507 from pritha-srivastava/wip-rgw-cross-tenant-doc
rgw: Improving doc for Cross Project(Tenant) access with Openstack Ke…

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-11 13:16:28 -04:00
Igor Fedotov
95dcee1f75 tests/objectstore: trivial tool to replay allocator logs
This is rather a template to build custom troubleshooters
for bitmap allocator using existing logs. Tool replays OSD
log to build allocator state that caused an issue.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-06-11 20:13:33 +03:00
Igor Fedotov
eac81bc859 os/bluestore: fix duplicate allocations in bmap allocator
Fixes: http://tracker.ceph.com/issues/40080

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-06-11 20:05:09 +03:00
Ricardo Marques
247af2831b doc: Update 'python-rtslib' and 'tcmu-runner' min versions
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-06-11 16:59:37 +01:00
Mark Kogan
8565ec0db6 rgw: update the "radosgw-admin reshard status"
command documentation with expected output examples

Fixes: http://tracker.ceph.com/issues/37615

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2019-06-11 10:07:40 -04:00
xie xingguo
a160dc416a mon/OSDMonitor: report pg[pgp]_num_target instead of pg[pgp]_num
As by calling "ceph osd pool set <pool-name> pg_num", we set the
pg_num_target instead. Hence we should report pg_num_target as well
when invoked by the "ceph osd pool get <pool-name> pg_num" call.

I doubt an ideal fix would be exposing both the pg_num(*actual*) and
pg_num_target concepts to user, but for now I think we can stop here
and get some more feedback first.

Fixes: http://tracker.ceph.com/issues/40193
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-11 20:39:05 +08:00
Kefu Chai
59dcc74f12
Merge pull request #28084 from ricardoasmarques/improve-portal-ips-calculation
mgr/dashboard: Optimize portal IPs calculation

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-06-11 20:17:32 +08:00
Kefu Chai
df0e98313c
Merge pull request #28454 from tchaikov/wip-gcc-9-on-bionic
install-deps.sh: use GCC-9 on bionic

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-11 20:14:51 +08:00
Kefu Chai
748c294508
Merge pull request #28246 from kungf/mgr_default_addr
mgr: use ipv4 default when ipv6 was disabled

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-11 19:48:00 +08:00
Kefu Chai
e0fce726af
Merge pull request #28481 from iotcg/common
include: buffer_raw.h: Copyright time fix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-11 19:35:19 +08:00
Kefu Chai
7da903db83 buffer,crypto,osd,tools: extract digest methods out of bufferlist
they were consumers of ceph::list::buffers(), and there is no need to
make them member functions of ceph::list, so move them into ceph::crypto
namespace. and update the unit test and ceph_dedup_tool.cc accordingly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-11 18:30:19 +08:00
Lianne
7c7c7870d3 qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs
Fixes: http://tracker.ceph.com/issues/40184

Signed-off-by: Lianne <liyan.wang@xtaotech.com>
2019-06-11 18:27:06 +08:00
Kefu Chai
b233e471ad common/ceph_crypto: add digest_size to digest classes
prepare for extracting the digest methods from ceph::buffer::list, so we
can use them in a templated implementation.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-11 16:58:43 +08:00
Jianpeng Ma
9400c850ac os/objectstore: add new op OP_CREATE for create a new object.
For OP_CREATE in bluestore mean node didn't exist, so skip search form kvdb.

This function merged  in 22f73ba. But because compatible problem,
it revert in 491c254.
This commit fix the compatible problem

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-11 16:41:44 +08:00
Jianpeng Ma
c7979833ca test/fio/fio_ceph_messenger: make exec multi client on the same host.
When create Messenger, for client we should give different nonce to
make multi clients on the same host can work. Otherwise, server only
accept one connection.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-11 16:15:19 +08:00
xie xingguo
c0f87e0f91 osd: give recovery ops initialized by client op a higher priority
to use strict priority ordering.

The new "mclock_opclass/mclock_client" queue basically prioritizes
operations based on the class they belong to. The priority property
of an operation, if lower than a specific value (64, by default),
will get ignored and hence all operations from the same class will
be treated fairly in a FIFO fashion (but still limited by the total
IOPS or bandwidth available for the corresponding class).

To reduce the impact of performance, a more general strategy would be
enforcing some limitations on the IOPS or bandwidth for the background
recovery (or backfill) operation class. However, this way we'll end up
blocking client operations too if they are currently blocked by some
degraded objects which need to be recovered first.

We hereby grant recovery operations of this kind a higher priority
to force them to use strict priority ordering, which should still
be of significance once we switch to the new "mclock_opclass/mclock_client"
queue.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-11 15:46:57 +08:00
Mykola Golub
1ef12ea0d2 rbd-mirror: remove rbd_mirror_journal_max_fetch_bytes option
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 08:00:28 +01:00
Mykola Golub
37c3ac0563 rbd-mirror: auto-tune journal fetch params based on memory target
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 08:00:27 +01:00
Mykola Golub
232203522c rbd-mirror: fix potential context leak on replay interrupted
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 07:59:04 +01:00
Mykola Golub
e836e2e6cf journal: auto-tune journal fetch params based on memory target
(if a cache manager is specified)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 07:59:04 +01:00
Mykola Golub
03085f7e46 common: make pri cache perf counters optional
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 07:59:04 +01:00
Mykola Golub
41b32d7db1 common: make extra memory allocation for pri cache optional
Not all caches may want this.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-06-11 07:59:04 +01:00
Kefu Chai
9296d783d0
Merge pull request #28443 from dzafman/wip-40198
osd: Don't randomize deep scrubs when noscrub set

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-11 14:03:23 +08:00
Kefu Chai
2ad1733809
Merge pull request #28431 from cbodley/wip-40188
common: OutputDataSocket retakes mutex on error path

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-11 14:02:28 +08:00
Kefu Chai
a12d94fa79
Merge pull request #28427 from tchaikov/wip-40174
mgr/influx: try to call close()

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-06-11 13:59:38 +08:00
Kefu Chai
fd45fd9237
Merge pull request #28254 from myoungwon/wip-hashfuncs-dedup
common,osd: add hash algorithms for dedup fingerprint

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-11 13:57:36 +08:00
Kefu Chai
18f978f151
Merge pull request #28176 from p-na/wip-pna-fix-fixmod
mgr/dashboard: Fix `npm run fixmod` command

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-06-11 13:56:28 +08:00
Kefu Chai
194b915e88
Merge pull request #26909 from vitalif/wal-sync-fix
os/bluestore: Actually wait until completion in write_sync

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-11 13:53:59 +08:00
Kefu Chai
b2bcee3a7e
Merge pull request #28167 from dillaman/wip-39972
librados: move buffer free functions to inline namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-11 13:47:49 +08:00
Chang Liu
7993fd36c7 osd: uses new policy in Octopus only
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-11 11:21:07 +08:00
Kefu Chai
e03666b3bf
Merge pull request #28463 from tchaikov/wip-yaml.safe_load
admin,doc/_ext/ceph_releases.py: use yaml.safe_load()

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-06-11 09:52:37 +08:00
Kefu Chai
054576468c
Merge pull request #28074 from falcon78921/wip-doc-39712
doc: fixed broken links in nautilus release page

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-06-11 09:16:11 +08:00
Changcheng Liu
f464ed5d53 include: buffer_raw.h: Copyright time fix
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2019-06-11 09:08:36 +08:00
Yuri Weinstein
2622958e0d
Merge pull request #28479 from yuriw/wip-yuriw-crontab-master
qa.tests: added "smoke" suite to the schedule on "mimic","nautilus"
2019-06-10 14:26:12 -07:00
Yuri Weinstein
a986bd0ae2 qa.tests: added "smoke" suite to the schedule on "mimic","nautilus"
Note: frequency can/will reduce later

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-10 12:40:30 -07:00
Matt Benjamin
a4bab5b967
Merge pull request #28451 from linuxbox2/wip-rgwfile-dirinv
rgw_file: all directories are virtual with respect to contents
2019-06-10 13:41:37 -04:00
Mykola Golub
8a1ad814f4
Merge pull request #28434 from dillaman/wip-40110
rbd-mirror: link against the specified alloc library

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-06-10 20:09:32 +03:00
Kefu Chai
40ad5783ff
Merge pull request #28414 from smithfarm/wip-40175
build/ops: make "patch" build dependency explicit

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-11 00:11:14 +08:00