Commit Graph

78598 Commits

Author SHA1 Message Date
Kefu Chai
c999abd7a8 cmake: requires rockdb version 5.8
we've updated the rockdb wrapper on ceph side to be compatible with
the latest version of rocksdb upstream. so ceph is not compatible with
older version of rocksdb.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
987c1b3ec2 cmake: detect rocksdb's version
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
58179f098b cmake: detect gperf-tools' version
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
aa603621bd cmake: extract BuildRocksDB into BuildRocksDB.cmake
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Kefu Chai
da8ce07a21 cmake: enable find_package(perftools) to check non-default dir
so it checks $ENV{GPERF_ROOT} first.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-19 13:46:50 +08:00
Neha Ojha
2635e7a591 qa/suites/rados/perf: add optimized settings
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-09-18 15:53:28 -07:00
David Zafman
0364ae104a test: Fix ceph-objectstore-tool usage check
Caused by: c7b7a1f04f

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-09-18 15:29:22 -07:00
John Spray
15ad33f99b vstart: create MDSs before filesystems
This avoids spurious complaints about not
enough MDS daemons in the logs.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 17:30:54 -04:00
John Spray
511439b515 mon/MDSMonitor: fix clog msgs on MDS rank add/rm
Because these were generated before the actual
change, the get_num_in values did not make sense.

Fixes: http://tracker.ceph.com/issues/21421
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 17:30:28 -04:00
Matt Benjamin
4639b96cae Merge pull request #15273 from rzarzynski/wip-rgw-18977
rgw: list_objects() honors end_marker regardless of namespace.
2017-09-18 16:10:08 -04:00
Matt Benjamin
6994e1dc5f Merge pull request #17320 from rzarzynski/wip-rgw-21148
rgw: add support for Swift's reversed account listings
2017-09-18 15:51:43 -04:00
Patrick Donnelly
bc3dd60e99
client: move Fh init to ctor
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-18 12:48:12 -07:00
Yuri Weinstein
f1f960e443 Merge pull request #17777 from cbodley/wip-qa-hadoop
qa/rgw: hadoop-s3a suite targets centos_latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 12:32:14 -07:00
Casey Bodley
a97d5bea42 qa/rgw: hadoop suite targets centos_latest
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:29:40 -04:00
Casey Bodley
4a953a16d7 qa/rgw: use overrides for hadoop version
instead of having two separate tasks, add v27.yaml and v28.yaml with
overrides for hadoop_version

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:28:24 -04:00
Yuri Weinstein
e876ffff99 Merge pull request #17776 from smithfarm/wip-rh-74
tests: CentOS 7.4 is now the latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 10:17:15 -07:00
Nathan Cutler
2311b64025 tests: CentOS 7.4 is now the latest
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-09-18 18:01:17 +02:00
Adam Kupczyk
483101008a Now giving unsupported allocator gives an error.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2017-09-18 16:37:52 +02:00
John Spray
ec09a7abc5 mgr: remove old-style config opt usage
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 07:21:10 -04:00
John Spray
6af4120d63 mon: remove old-style mgr config opt usage
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 07:21:09 -04:00
John Spray
eba4c3f276 common: populate manager config option metadata
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:49:21 -04:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
John Spray
37e0e34007 Merge pull request #17318 from jcsp/wip-20899
mgr/prometheus: Fix for MDS metrics

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-18 11:35:59 +01:00
John Spray
5f9bfc5b0e Merge pull request #16762 from jcsp/wip-dashboard-trim
mgr: remove unused static files from dashboard module

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-18 11:34:18 +01:00
John Spray
85a87da7aa mgr/dashboard: re-arrange static files
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
199d7ff269 mgr/dashboard: don't include remote js/css
This will help anyone running away from the internet.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
888f0f934e mgr/dashboard: remove un-minified datatables source
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
5ce51ebbf0 mgr/dashboard: remove non-minified bootstrap
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
38df5150ee mgr/dashboard: remove unneeded bits of AdminLTE
AdminLTE is delivered in a handy all-in format,
but we don't need all this stuff at runtime.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:39 -04:00
John Spray
d20915741d mgr: make pgmap_ready atomic to avoid taking lock
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 05:44:41 -04:00
John Spray
64af9d3da0 mgr/DaemonServer: handle MMgrReports in parallel
The DaemonStateIndex locking is sufficient to make all
the report processing safe: holding DaemonServer::lock
through all ms_dispatch was unnecessarily serializing
dispatch.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 05:44:40 -04:00
John Spray
806f10847c mgr: clean up DaemonStateIndex locking
Various things here were dangerously operating
outside locks.

Additionally switch to a RWLock because this lock
will be relatively read-hot when it's taken every time
a MMgrReport is handled, to look up the DaemonState
for the sender.

Fixes: http://tracker.ceph.com/issues/21158
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 05:44:40 -04:00
Adam Kupczyk
0eb5359273 bluestore/fio: Fixed problem with all objects having the same hash
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2017-09-18 08:06:40 +02:00
Kefu Chai
eff4961f46 common/util: do not print error if VERSION_ID is missing
per os-release(5), VERSION_ID is optional.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-18 13:01:33 +08:00
Kefu Chai
28c8e8953c Merge pull request #17737 from ivancich/wip-pull-updated-dmclock
osd: update dmclock library w git subtree pull

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-17 19:42:52 +08:00
Yan, Zheng
46962b2535 ceph: do link/rename semantic checks after srcdn is readable
For hard link, source inode must not be directory. For rename,
types of source/destination inodes must match. If srcdn is replica
and we do these checks while it's not readble, it's possible that
wrong source inode is used in these checks.

Fixes: http://tracker.ceph.com/issues/21383
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-17 16:59:08 +08:00
amitkuma
95571ad394 rados: Initialization of alignment
Fixes the coverity issues:

** 1409700 Uninitialized scalar field
CID 1409700 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member alignment is not initialized
in this constructor nor in any functions that it calls.

** 1409702 Uninitialized scalar field
CID 1409702 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member alignment is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-09-17 04:18:28 +05:30
Kefu Chai
cd6a312a4f Merge pull request #17762 from yaozongyou/fix-typo-in-php-rst
doc: fix typo in php.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-17 02:00:50 +08:00
Sage Weil
05653863aa Merge pull request #17763 from xiexingguo/wip-21409
qa: fix pool-quota related tests

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-16 12:59:12 -05:00
Jeff Layton
8252f3168a client: test shutdown race
Spawn threads that bring up a bunch of ceph_mounts with individual
CephContext objects, and then tear them down in parallel.

Tracker: http://tracker.ceph.com/issues/20988
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 08:59:29 -04:00
Jeff Layton
0cd0bd778a lockdep: fix Mutex tests to disable lockdep properly
...and make g_lockdep a bool.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 08:59:29 -04:00
Jeff Layton
75f41a9578 lockdep: fix races with concurrent lockdep teardown
If the cct is unregistered while other threads are flogging mutexes,
then we can hit all sorts of bugs. Ensure that we handle that
situation sanely, by checking that g_lockdep is still set after
we take the lockdep_mutex.

Also, remove an assertion from lockdep_unregister, and just turn it into
an immediate return. It's possible to have a call to
lockdep_unregister_ceph_context, and then a call to
lockdep_register_ceph_context while a mutex is being held by another
task.

In that case, it's possible the lock does not exist in the map
when we go to unregister it. That's not a bug though, just a natural
consequence of that series of actions.

Tracker: http://tracker.ceph.com/issues/20988
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Jeff Layton
01863bb6fb lockdep: don't take lockdep_mutex twice for new lock registrations
We can do it under the same mutex, which should be more efficient.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Jeff Layton
e057b6770b client: fix signed/unsigned comparison compiler warning
The build says:

src/client/Client.cc: In member function ‘void Client::trim_caps(MetaSession*, int)’:
src/client/Client.cc:4121:22: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   if (s->caps.size() > max)
       ~~~~~~~~~~~~~~~^~~~~

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Yao Zongyou
8e3380f20a doc: fix typo in php.rst
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-09-16 13:54:03 +08:00
xie xingguo
5dd3458eec qa: fix pool-quota related tests
https://github.com/ceph/ceph/pull/17371 introduces support of
per-pool space-full flag, which turns out to set both
full and full_no_quota flags now if a pool is currently running out
of quota.

Actually this test is fragile as long as we keep appending new flags
at pool granularity, but let's not bother with that complexity now.

Fixes: http://tracker.ceph.com/issues/21409
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-16 13:50:18 +08:00
Kefu Chai
9d07597ccc Merge pull request #17615 from tchaikov/wip-osx
cmake,common: changes to port part of ceph to osx

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-09-16 13:30:26 +08:00
Kefu Chai
8f1318e15b client: use st_mtimespec instea of st_mtime on osx
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 12:02:36 +08:00
Kefu Chai
9099ca599d msg/msg_types: fix the dencoder of entity_addr_t
improve the interoperability between freebsd/osx and GNU/Linux, because
the their layouts of sockaddr_storage are different, and we use the
one of linux as the wire format. so need to convert it on freebsd/osx
side.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 12:02:36 +08:00
Sage Weil
cdd9a0bfe1 Merge pull request #17698 from liewegas/wip-bluestore-big-allocations
os/bluestore: allocate entire write in one go

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-15 21:48:27 -05:00