Commit Graph

79806 Commits

Author SHA1 Message Date
Alfredo Deza
5696fed09b ceph-volume lvm.activate add bluestore support for activation
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Alfredo Deza
f61007cc65 ceph-volume util.system create mappings of mounts
This makes it easier for consumers to detect a path, or a device that
might be mounted or might have more than one mount, including tmpfs and
devtmpfs support, which was just not possible before.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Jason Dillaman
4f227e108d doc/rbd: tweaks for the LIO iSCSI gateway
Fixes: http://tracker.ceph.com/issues/21763
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-19 09:40:22 -04:00
amitkuma
17df8c979b rgw: Initialization of epoch,len
Fixes the coverity issues:

** 1402628 Uninitialized scalar field
CID 1402628 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member epoch is not initialized
in this constructor nor in any functions that it calls.

** 1409841 Uninitialized scalar field
CID 1409841 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member len is not initialized
in this constructor nor in any functions that it calls.

** 1416594 Uninitialized scalar field
CID 1416594 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member field fh.fh_hk is not
initialized in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-10-19 19:09:27 +05:30
kungf
1ea6fab5ed osd: make scrub no deadline when max interval is zero
some times, we only want scrub at out permitted time, avoid
scrub mainly deep scrub affecting business io. this patch
make no scrub deadline when osd_scrub_max_interval == 0, then
we can make sure scrub can only do in expect time.

Signed-off-by: kungf <yang.wang@easystack.cn>
2017-10-19 20:15:39 +08:00
Xie Xingguo
3e38616297 Merge pull request #18389 from yaozongyou/fix-type-in-bluestore-migration
doc: fix typo in bluestore-migration.rst

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-19 18:36:25 +08:00
Jos Collin
33d99b91c1 Merge pull request #18395 from gaosibei/mailmap
mailmap: Add Sibei, XueYu Affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-19 10:21:40 +00:00
gaosibei
d6c3e8676b mailmap, organizationmap: add Sibei, XueYu
Signed-off-by: Sibei Gao <gaosb@inspur.com>
2017-10-19 17:02:52 +08:00
Kefu Chai
22aff9e87e osd: update mClock.*Queue to incorporate the changes on dmclock
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-19 15:39:46 +08:00
Yao Zongyou
ae660d902b doc: fix typo in bluestore-migration.rst
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-10-19 14:38:40 +08:00
Kefu Chai
a79af0c256 Merge pull request #18232 from jdurgin/wip-filestore-rocksdb
common/options: enable multiple rocksdb compaction threads for filestore

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:55:14 +08:00
Kefu Chai
297efaa81f Merge pull request #18311 from shinobu-x/sk-osd_20171015
osd: Don't initialze pointers by NULL or 0

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-19 13:54:31 +08:00
Kefu Chai
0d32658ecf Merge pull request #14213 from xiaoxichen/fix_wbthrottle_assert
os/Filestore: fix wbthrottle assert.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:53:15 +08:00
Kefu Chai
21cf1eb4fd Merge pull request #18256 from liewegas/wip-bluestore-superblock
os/bluestore: allow reconstruction of osd data dir from bluestore bdev label

Reviewed-By: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:51:18 +08:00
Kefu Chai
54dab66341 Merge pull request #18346 from tchaikov/wip-log-if-do_read_entry-fails
os/filestore: print out the error if do_read_entry() fails

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-19 13:41:18 +08:00
Kefu Chai
5e370e1299 dmclock: pickup latest dmclock subtree
to include the change of https://github.com/ceph/dmclock/pull/41
Merge commit '060a7777cb6fe3f052259e1324490cdbf7b49980'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:20:29 +08:00
Kefu Chai
060a7777cb Squashed 'src/dmclock/' changes from 93f760c57c..1bbd42b8fe
1bbd42b8fe Merge pull request #41 from tchaikov/wip-client-info-ptr
cb7901e99a ClientRec: instead of a copy of ClientInfo, keep a pointer of it

git-subtree-dir: src/dmclock
git-subtree-split: 1bbd42b8fe212dbff68c2b470813e936859705d6
2017-10-19 13:19:16 +08:00
Leo Zhang
bd018bf48b ceph-bluestore-tool: create out_dir before create full path of kvdb
Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2017-10-19 11:58:46 +08:00
Yan, Zheng
dee3711bd7 mds: make mksnap/setlayout wait for unsafe requests on other mds
This guarantees replayed unsafe requests (on other mds) and mksnap/setlayout
get processed in proper order.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Yan, Zheng
0afbc0338e mds: don't rdlock locks in replica object while auth mds is recovering
Auth mds may take xlock on the lock and change the object when replaying
unsafe requests. To guarantee new requests and replayed unsafe requests
(on auth mds) get processed in proper order, we shouldn't rdlock locks in
replica object while auth mds of the object is recovering

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Yan, Zheng
da6e50890d mds: move ScatterLock::state_flags into SimpleLock
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Josh Durgin
a5e917fb9b Merge pull request #18145 from dzafman/wip-18162
osd: object added to missing set for backfill, but is not in recovering, error!

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-18 17:33:12 -07:00
Sage Weil
a8a514b957 osd/osd_types: pg_pool_t: remove crash_replay_interval member
We removed the dual ack before luminous, so this option is completely
obsolete now.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-18 16:05:19 -05:00
Matt Benjamin
3d88b2cd12 Merge pull request #18377 from joscollin/wip-cleanup-rgw-function-names
rgw: Fix getter function names in RGWEnv
2017-10-18 16:52:37 -04:00
Casey Bodley
8a7d97af42 Revert "radosgw: fix awsv4 header line sort order."
This reverts commit c11485e1b3a58631628644152816d9b22a17d8bd.

The original sort order was compliant with amazon. Failures observed
in s3tests turned out to be a bug in boto2 - boto3 and other s3 clients
produce the correct sort order.

Fixes: http://tracker.ceph.com/issues/21832

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-18 16:38:22 -04:00
Matt Benjamin
5e0bea71b5 rgw_file: disable FLAG_EXACT_MATCH enforcement
a. upstream motivating behavior no longer reproduces
b. incorrect stat behavior observed, traced to exact match enforcement

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-10-18 16:29:19 -04:00
Matt Benjamin
a2c34c5973 rgw_file: implement variant offset readdir processing
Introduce new rgw_readdir2(...), which in which continues
from an arbitrary dirent name, which presumably has been
seen in a prior partial enumeration.

Add single-file unit test for READDIR cases, librgw_file_marker.cc.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-10-18 16:23:51 -04:00
vasukulkarni
3172a63c64 Merge pull request #18380 from zmc/wip-master-init
Changes required for teuthology's systemd support
2017-10-18 13:00:07 -07:00
Matt Benjamin
cea38c72d2 Merge pull request #18365 from linuxbox2/wip-rgw-v3open-write
rgw_file: explicit NFSv3 open() emulation
2017-10-18 15:31:13 -04:00
Zack Cerza
f9acdc774d qa/tasks/ceph: Set owner on mds mount point
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
e606386626 qa/tasks/cephfs/filesystem: Check for mds failure
... inside Filesystem.are_daemons_healthy()

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
4516ebb6c0 qa/tasks/ceph: Remove /var/lib/ceph copypasta
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
a653720f50 qa/tasks/ceph: Set owner on osd mount point
This is needed when running with systemd

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
16dcceae5c qa/tasks/ceph: Set owner on mon mount point
This is needed when running with systemd

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Casey Bodley
8c68b30905 Merge pull request #15554 from cbodley/wip-rgw-parse-cr-dump
tools/rgw: add script to inspect admin socket "cr dump"

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-10-18 14:32:22 -04:00
David Zafman
568819f20c osd: Re-organize _update_calc_stats() to make the code clearer
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:22:06 -07:00
David Zafman
69b5fc54fe test: Cleanup test-erasure-eio.sh code
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:12:14 -07:00
David Zafman
c2572bee3c test: Add replicated recovery/backfill test
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:12:14 -07:00
David Zafman
689bff354a osd: Better recovery/backfill restart for mark_unfound_lost delete/revert
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:12:07 -07:00
David Zafman
7f8b0ce9e6 osd, mon: Add new pg states recovery_unfound and backfill_unfound
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:02:10 -07:00
David Zafman
bb2bcb95f5 osd: Add new UnfoundBackfill and UnfoundRecovery pg transitions
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:01:39 -07:00
David Zafman
b9de5eec26 test: Test case that reproduces tracker 18162
recover_replicas: object added to missing set for backfill, but is not in recovering, error!

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 10:58:23 -07:00
Yuri Weinstein
aa1d93fdb5 Merge pull request #18378 from ceph/wip-yuriw-21822-master
tests - ceph-ansible vars additions

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2017-10-18 10:19:35 -07:00
Alfredo Deza
85cdc78300 ceph-volume util.prepare separate filestore vs. bluestore prepare utils
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
bbcca70d96 ceph-volume process allow obfuscating a key or index when logging commands
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
555b664882 ceph-volume util.prepare add other ln helpers for bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
211c38f591 ceph-volume util.arg_validators allow to pass a group as --data for lvm
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
6b23fc7224 ceph-volume util.disk add utilities for is_device and is_partition
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
ac0d1555d3 ceph-volume api.lvm udpate create_lv for bluestore
Require full size notation for LVM (e.g. 50G or 100M) and do not
"translate" tags by pre-fixing them with 'ceph'. That is already how the
rest of the API works, no need to make that translation in one place

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:29 -04:00
Alfredo Deza
1e8a79b8f4 ceph-volume lvm.prepare update filestore workflow to use new helpers
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-18 12:46:28 -04:00