Commit Graph

78448 Commits

Author SHA1 Message Date
John Spray
511439b515 mon/MDSMonitor: fix clog msgs on MDS rank add/rm
Because these were generated before the actual
change, the get_num_in values did not make sense.

Fixes: http://tracker.ceph.com/issues/21421
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 17:30:28 -04:00
Matt Benjamin
4639b96cae Merge pull request #15273 from rzarzynski/wip-rgw-18977
rgw: list_objects() honors end_marker regardless of namespace.
2017-09-18 16:10:08 -04:00
Matt Benjamin
6994e1dc5f Merge pull request #17320 from rzarzynski/wip-rgw-21148
rgw: add support for Swift's reversed account listings
2017-09-18 15:51:43 -04:00
Patrick Donnelly
bc3dd60e99
client: move Fh init to ctor
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-18 12:48:12 -07:00
Yuri Weinstein
f1f960e443 Merge pull request #17777 from cbodley/wip-qa-hadoop
qa/rgw: hadoop-s3a suite targets centos_latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 12:32:14 -07:00
Casey Bodley
a97d5bea42 qa/rgw: hadoop suite targets centos_latest
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:29:40 -04:00
Casey Bodley
4a953a16d7 qa/rgw: use overrides for hadoop version
instead of having two separate tasks, add v27.yaml and v28.yaml with
overrides for hadoop_version

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:28:24 -04:00
Yuri Weinstein
e876ffff99 Merge pull request #17776 from smithfarm/wip-rh-74
tests: CentOS 7.4 is now the latest

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-18 10:17:15 -07:00
Nathan Cutler
2311b64025 tests: CentOS 7.4 is now the latest
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-09-18 18:01:17 +02:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
John Spray
37e0e34007 Merge pull request #17318 from jcsp/wip-20899
mgr/prometheus: Fix for MDS metrics

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-18 11:35:59 +01:00
John Spray
5f9bfc5b0e Merge pull request #16762 from jcsp/wip-dashboard-trim
mgr: remove unused static files from dashboard module

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-18 11:34:18 +01:00
John Spray
85a87da7aa mgr/dashboard: re-arrange static files
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
199d7ff269 mgr/dashboard: don't include remote js/css
This will help anyone running away from the internet.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:33:09 -04:00
John Spray
888f0f934e mgr/dashboard: remove un-minified datatables source
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
5ce51ebbf0 mgr/dashboard: remove non-minified bootstrap
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:40 -04:00
John Spray
38df5150ee mgr/dashboard: remove unneeded bits of AdminLTE
AdminLTE is delivered in a handy all-in format,
but we don't need all this stuff at runtime.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-18 06:32:39 -04:00
Kefu Chai
eff4961f46 common/util: do not print error if VERSION_ID is missing
per os-release(5), VERSION_ID is optional.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-18 13:01:33 +08:00
Kefu Chai
28c8e8953c Merge pull request #17737 from ivancich/wip-pull-updated-dmclock
osd: update dmclock library w git subtree pull

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-17 19:42:52 +08:00
Yan, Zheng
46962b2535 ceph: do link/rename semantic checks after srcdn is readable
For hard link, source inode must not be directory. For rename,
types of source/destination inodes must match. If srcdn is replica
and we do these checks while it's not readble, it's possible that
wrong source inode is used in these checks.

Fixes: http://tracker.ceph.com/issues/21383
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-17 16:59:08 +08:00
amitkuma
95571ad394 rados: Initialization of alignment
Fixes the coverity issues:

** 1409700 Uninitialized scalar field
CID 1409700 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member alignment is not initialized
in this constructor nor in any functions that it calls.

** 1409702 Uninitialized scalar field
CID 1409702 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member alignment is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-09-17 04:18:28 +05:30
Kefu Chai
cd6a312a4f Merge pull request #17762 from yaozongyou/fix-typo-in-php-rst
doc: fix typo in php.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-17 02:00:50 +08:00
Sage Weil
05653863aa Merge pull request #17763 from xiexingguo/wip-21409
qa: fix pool-quota related tests

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-16 12:59:12 -05:00
Jeff Layton
8252f3168a client: test shutdown race
Spawn threads that bring up a bunch of ceph_mounts with individual
CephContext objects, and then tear them down in parallel.

Tracker: http://tracker.ceph.com/issues/20988
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 08:59:29 -04:00
Jeff Layton
0cd0bd778a lockdep: fix Mutex tests to disable lockdep properly
...and make g_lockdep a bool.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 08:59:29 -04:00
Jeff Layton
75f41a9578 lockdep: fix races with concurrent lockdep teardown
If the cct is unregistered while other threads are flogging mutexes,
then we can hit all sorts of bugs. Ensure that we handle that
situation sanely, by checking that g_lockdep is still set after
we take the lockdep_mutex.

Also, remove an assertion from lockdep_unregister, and just turn it into
an immediate return. It's possible to have a call to
lockdep_unregister_ceph_context, and then a call to
lockdep_register_ceph_context while a mutex is being held by another
task.

In that case, it's possible the lock does not exist in the map
when we go to unregister it. That's not a bug though, just a natural
consequence of that series of actions.

Tracker: http://tracker.ceph.com/issues/20988
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Jeff Layton
01863bb6fb lockdep: don't take lockdep_mutex twice for new lock registrations
We can do it under the same mutex, which should be more efficient.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Jeff Layton
e057b6770b client: fix signed/unsigned comparison compiler warning
The build says:

src/client/Client.cc: In member function ‘void Client::trim_caps(MetaSession*, int)’:
src/client/Client.cc:4121:22: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   if (s->caps.size() > max)
       ~~~~~~~~~~~~~~~^~~~~

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-09-16 07:57:04 -04:00
Yao Zongyou
8e3380f20a doc: fix typo in php.rst
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-09-16 13:54:03 +08:00
xie xingguo
5dd3458eec qa: fix pool-quota related tests
https://github.com/ceph/ceph/pull/17371 introduces support of
per-pool space-full flag, which turns out to set both
full and full_no_quota flags now if a pool is currently running out
of quota.

Actually this test is fragile as long as we keep appending new flags
at pool granularity, but let's not bother with that complexity now.

Fixes: http://tracker.ceph.com/issues/21409
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-16 13:50:18 +08:00
Kefu Chai
9d07597ccc Merge pull request #17615 from tchaikov/wip-osx
cmake,common: changes to port part of ceph to osx

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-09-16 13:30:26 +08:00
Kefu Chai
8f1318e15b client: use st_mtimespec instea of st_mtime on osx
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 12:02:36 +08:00
Kefu Chai
9099ca599d msg/msg_types: fix the dencoder of entity_addr_t
improve the interoperability between freebsd/osx and GNU/Linux, because
the their layouts of sockaddr_storage are different, and we use the
one of linux as the wire format. so need to convert it on freebsd/osx
side.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 12:02:36 +08:00
Sage Weil
cdd9a0bfe1 Merge pull request #17698 from liewegas/wip-bluestore-big-allocations
os/bluestore: allocate entire write in one go

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-15 21:48:27 -05:00
Kefu Chai
cea9f1e3da crc32c: pass integer param by uint64_t
the assembly is expecting 64bits input, so make this explicit.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:47:02 +08:00
Kefu Chai
de1cc425be crc32c: mach-o 64 follows the same calling convention as elf64 does
so reuse the register-parameter/variable mappings

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:47:02 +08:00
Kefu Chai
767df416da test/encoding/readable.sh: use sysctl -n hw.ncpu instead of nproc on osx also
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
5980a60ab3 cmake: check for fdatasync() on non osx
on osx, fdatasync() is a syscall without userspace wrapper.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
6f6e3af01f mds: use the best-effort if procfs is not available
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
0a35e18b14 cmake: allows undefined symbol in plugin on osx
clang on osx erros out when linking a dynamic library if any symbols is
missing by default. so disable this behavior.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
629ad1986d cmake: disable plugins using isa-l on osx
clang on osx emits functions with leading underscore, but the isa-l
assembly's functions have no leading underscore. we could label the
function declaration like `int foo asm("foo")` to remove the leading
underscore, but isa-l is a git submodule, let do this later. and in the
meanwhile, disable this plugin on osx.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
02067e7451 crc32: label assembler functions without leading underscore
clang onder osx adds leading undescore to the function names to be
ABI compatible. but the assembly code does not do so. so we need to
control the name using gcc/clang extension. see
https://gcc.gnu.org/onlinedocs/gcc-4.4.0/gcc/Asm-Labels.html#Asm-Labels

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
56a897449b compat: consolidate definitions of osx and freebsd
on osx, ENODATA = 96, so we need to fix it. also define
CLOCK_MONOTONIC_COARSE and CLOCK_REALTIME_COARSE for osx, ceph_time.h
defines this also, but i don't want to include compat.h in ceph_time.h
at this moment.

and silence the warning of
 #warning ENODATA already defined to a value different from 87 (ENOATRR), refining to fix
because it is fired everywhere on osx when "compat.h" is included.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
3eff8a65c7 msg/msg_types: fix the denc of sockaddr_storage on freebsd/osx
the layout of sockaddr_in and sockaddr_in6 are different on
GNU/Linux and FreeBSD/OSX:
 - on GNU/Linux, sockaddr does not have sa_len,
 - on GNU/Linux, sockaddr* use a 16 bit integer for sa_family, but
   on FreeBSD, a 32bit integer is used.
so we need to be more care when memcpy() between sockaddr_storage()
and ceph_sockaddr_storage().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
cf778097d6 msg/msg_types: consolidate sockaddr_storage dencoders
utilize ceph_sockaddr_storage on FreeBSD and osx to perform the
dencoding, to improve the readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
a921f0663c cmake: do not pass --exclude-libs on osx
it is not supported by osx linker

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
5b0ad9a8a8 crc32c: only add qualifiers for elf64 format
they are not understood by non-elf formats

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
b7fbe46d55 cmake: compile Mach-O format instead of ELF on OSX
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
d709772240 cmake: link against libresolv on OSX
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00
Kefu Chai
8857a3019a time: use mach_absolute_time() for monotonic time
* use mach_absolute_time() for monotonic time
  mach_absolute_time() is faster and monotonic, see
  https://developer.apple.com/library/content/qa/qa1398/_index.html

  for its implementation, see
  https://opensource.apple.com/source/xnu/xnu-3248.60.10/libsyscall/wrappers/mach_absolute_time.s

  it's using rdtsc.
* and remove unnecessary headers from ceph_time.h

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-16 10:43:32 +08:00