Commit Graph

79820 Commits

Author SHA1 Message Date
Sage Weil
481277b8c9 buffer: allow mempool to be passed into raw* ctors and create methods
This is more convenient, and also faster than initializing it in
buffer_anon and the immediately moving it elsewhere.

Drop the optionality of the alignment argument.

No users yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-19 16:30:11 -05:00
Adam C. Emerson
14c3f3c214 zstd: Upgrade to v1.3.2
This buys us fixes for a few memory errors and asserts and also
improves the CMake build script so it doesn't mostly ignore the
CXXFLAGS we pass in.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 16:08:07 -04:00
Josh Durgin
34951266fe Merge pull request #18374 from tchaikov/wip-ceph-C-d
ceph.in: do not panic at control+d in interactive mode

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-10-19 11:52:13 -07:00
Adam C. Emerson
bda3c2673b OSD: Silence unused variable warnings
Even though extending the lifetime of this temporary delays execution
of its destructor, the compiler does not consider the reference to
have a side-effecting constructor.

The compiler is wrong, but we can silence its complaints.

This will cease to be an issue once we adopt C++17, since mandatory
RVO will solve the inability to bind a variable to a returned
move-only object and the need to extend a temporary.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 14:43:57 -04:00
Adam C. Emerson
87b4d1646e kvstore_tool: Create default constructor
Clang4 does not recognize a constructor with all arguments defaulted
as a default constructor in some circumstances.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 13:59:50 -04:00
Adam C. Emerson
c40953f696 test/cls_journal: Fix reversed std::string constructor arguments
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-19 13:15:32 -04:00
Ali Maredia
73f75c5365 cmake: add cython_rbd as a dependency to vstart target
Without cython_rbd, there are import errors
in the mgr log and the ceph-mgr dashboard cannot be
viewed by building just the vstart target.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2017-10-19 13:04:46 -04:00
Jens Rosenboom
bd0576652d Update docs for manual deployment
Fixes: http://tracker.ceph.com/issues/20309
Signed-off-by: Jens Rosenboom <j.rosenboom@x-ion.de>
2017-10-19 17:03:16 +00:00
Kefu Chai
cc09e30d42 Merge pull request #17462 from majianpeng/pmem-work
cmake: compile nvml as an external project

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 23:38:10 +08:00
Jianpeng Ma
b4cc9a9aa8 cmake: Build libpmem from source code.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-10-20 00:44:09 +08:00
Alfredo Deza
f3bb616bcf ceph-volume lvm.activate ceph-bluestore-tool should populate the osd dir
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Alfredo Deza
472aa0b199 ceph-volume lvm.activate auto detect objectstore type
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Alfredo Deza
f579ef0702 ceph-volume lvm.trigger enable objectstore auto detection for activate
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Alfredo Deza
5696fed09b ceph-volume lvm.activate add bluestore support for activation
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Alfredo Deza
f61007cc65 ceph-volume util.system create mappings of mounts
This makes it easier for consumers to detect a path, or a device that
might be mounted or might have more than one mount, including tmpfs and
devtmpfs support, which was just not possible before.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-10-19 11:31:38 -04:00
Jason Dillaman
4f227e108d doc/rbd: tweaks for the LIO iSCSI gateway
Fixes: http://tracker.ceph.com/issues/21763
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-19 09:40:22 -04:00
amitkuma
17df8c979b rgw: Initialization of epoch,len
Fixes the coverity issues:

** 1402628 Uninitialized scalar field
CID 1402628 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member epoch is not initialized
in this constructor nor in any functions that it calls.

** 1409841 Uninitialized scalar field
CID 1409841 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member len is not initialized
in this constructor nor in any functions that it calls.

** 1416594 Uninitialized scalar field
CID 1416594 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member field fh.fh_hk is not
initialized in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-10-19 19:09:27 +05:30
kungf
1ea6fab5ed osd: make scrub no deadline when max interval is zero
some times, we only want scrub at out permitted time, avoid
scrub mainly deep scrub affecting business io. this patch
make no scrub deadline when osd_scrub_max_interval == 0, then
we can make sure scrub can only do in expect time.

Signed-off-by: kungf <yang.wang@easystack.cn>
2017-10-19 20:15:39 +08:00
Xie Xingguo
3e38616297 Merge pull request #18389 from yaozongyou/fix-type-in-bluestore-migration
doc: fix typo in bluestore-migration.rst

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-19 18:36:25 +08:00
Jos Collin
33d99b91c1 Merge pull request #18395 from gaosibei/mailmap
mailmap: Add Sibei, XueYu Affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-19 10:21:40 +00:00
gaosibei
d6c3e8676b mailmap, organizationmap: add Sibei, XueYu
Signed-off-by: Sibei Gao <gaosb@inspur.com>
2017-10-19 17:02:52 +08:00
Kefu Chai
22aff9e87e osd: update mClock.*Queue to incorporate the changes on dmclock
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-19 15:39:46 +08:00
Yao Zongyou
ae660d902b doc: fix typo in bluestore-migration.rst
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-10-19 14:38:40 +08:00
Kefu Chai
a79af0c256 Merge pull request #18232 from jdurgin/wip-filestore-rocksdb
common/options: enable multiple rocksdb compaction threads for filestore

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:55:14 +08:00
Kefu Chai
297efaa81f Merge pull request #18311 from shinobu-x/sk-osd_20171015
osd: Don't initialze pointers by NULL or 0

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-19 13:54:31 +08:00
Kefu Chai
0d32658ecf Merge pull request #14213 from xiaoxichen/fix_wbthrottle_assert
os/Filestore: fix wbthrottle assert.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:53:15 +08:00
Kefu Chai
21cf1eb4fd Merge pull request #18256 from liewegas/wip-bluestore-superblock
os/bluestore: allow reconstruction of osd data dir from bluestore bdev label

Reviewed-By: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:51:18 +08:00
Kefu Chai
54dab66341 Merge pull request #18346 from tchaikov/wip-log-if-do_read_entry-fails
os/filestore: print out the error if do_read_entry() fails

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-19 13:41:18 +08:00
Kefu Chai
5e370e1299 dmclock: pickup latest dmclock subtree
to include the change of https://github.com/ceph/dmclock/pull/41
Merge commit '060a7777cb6fe3f052259e1324490cdbf7b49980'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-19 13:20:29 +08:00
Kefu Chai
060a7777cb Squashed 'src/dmclock/' changes from 93f760c57c..1bbd42b8fe
1bbd42b8fe Merge pull request #41 from tchaikov/wip-client-info-ptr
cb7901e99a ClientRec: instead of a copy of ClientInfo, keep a pointer of it

git-subtree-dir: src/dmclock
git-subtree-split: 1bbd42b8fe212dbff68c2b470813e936859705d6
2017-10-19 13:19:16 +08:00
Leo Zhang
bd018bf48b ceph-bluestore-tool: create out_dir before create full path of kvdb
Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2017-10-19 11:58:46 +08:00
Yan, Zheng
dee3711bd7 mds: make mksnap/setlayout wait for unsafe requests on other mds
This guarantees replayed unsafe requests (on other mds) and mksnap/setlayout
get processed in proper order.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Yan, Zheng
0afbc0338e mds: don't rdlock locks in replica object while auth mds is recovering
Auth mds may take xlock on the lock and change the object when replaying
unsafe requests. To guarantee new requests and replayed unsafe requests
(on auth mds) get processed in proper order, we shouldn't rdlock locks in
replica object while auth mds of the object is recovering

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Yan, Zheng
da6e50890d mds: move ScatterLock::state_flags into SimpleLock
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-19 09:32:48 +08:00
Josh Durgin
a5e917fb9b Merge pull request #18145 from dzafman/wip-18162
osd: object added to missing set for backfill, but is not in recovering, error!

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-18 17:33:12 -07:00
Sage Weil
a8a514b957 osd/osd_types: pg_pool_t: remove crash_replay_interval member
We removed the dual ack before luminous, so this option is completely
obsolete now.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-18 16:05:19 -05:00
Matt Benjamin
3d88b2cd12 Merge pull request #18377 from joscollin/wip-cleanup-rgw-function-names
rgw: Fix getter function names in RGWEnv
2017-10-18 16:52:37 -04:00
Casey Bodley
8a7d97af42 Revert "radosgw: fix awsv4 header line sort order."
This reverts commit c11485e1b3.

The original sort order was compliant with amazon. Failures observed
in s3tests turned out to be a bug in boto2 - boto3 and other s3 clients
produce the correct sort order.

Fixes: http://tracker.ceph.com/issues/21832

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-18 16:38:22 -04:00
Matt Benjamin
5e0bea71b5 rgw_file: disable FLAG_EXACT_MATCH enforcement
a. upstream motivating behavior no longer reproduces
b. incorrect stat behavior observed, traced to exact match enforcement

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-10-18 16:29:19 -04:00
Matt Benjamin
a2c34c5973 rgw_file: implement variant offset readdir processing
Introduce new rgw_readdir2(...), which in which continues
from an arbitrary dirent name, which presumably has been
seen in a prior partial enumeration.

Add single-file unit test for READDIR cases, librgw_file_marker.cc.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-10-18 16:23:51 -04:00
vasukulkarni
3172a63c64 Merge pull request #18380 from zmc/wip-master-init
Changes required for teuthology's systemd support
2017-10-18 13:00:07 -07:00
Matt Benjamin
cea38c72d2 Merge pull request #18365 from linuxbox2/wip-rgw-v3open-write
rgw_file: explicit NFSv3 open() emulation
2017-10-18 15:31:13 -04:00
Zack Cerza
f9acdc774d qa/tasks/ceph: Set owner on mds mount point
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
e606386626 qa/tasks/cephfs/filesystem: Check for mds failure
... inside Filesystem.are_daemons_healthy()

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
4516ebb6c0 qa/tasks/ceph: Remove /var/lib/ceph copypasta
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
a653720f50 qa/tasks/ceph: Set owner on osd mount point
This is needed when running with systemd

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Zack Cerza
16dcceae5c qa/tasks/ceph: Set owner on mon mount point
This is needed when running with systemd

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-10-18 12:59:09 -06:00
Casey Bodley
8c68b30905 Merge pull request #15554 from cbodley/wip-rgw-parse-cr-dump
tools/rgw: add script to inspect admin socket "cr dump"

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-10-18 14:32:22 -04:00
David Zafman
568819f20c osd: Re-organize _update_calc_stats() to make the code clearer
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:22:06 -07:00
David Zafman
69b5fc54fe test: Cleanup test-erasure-eio.sh code
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-10-18 11:12:14 -07:00