Commit Graph

83372 Commits

Author SHA1 Message Date
Yuri Weinstein
7e6edc0c46
Merge pull request #19606 from cfanz/wip-rgw-fix-collect-return
rgw: fix collect()'s return in coroutine

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-15 09:25:05 -08:00
Yuri Weinstein
fdeb12f6a7
Merge pull request #19815 from qrGitHub/wip-rgw-memory-optimize2
rgw: drop unused vector elements

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:24:35 -08:00
Yuri Weinstein
0762dbe9cc
Merge pull request #19921 from fangyuxiangGL/lc-ret
rgw: lifecycle omap entry was removed in abnormal situation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2018-02-15 09:07:57 -08:00
Yuri Weinstein
04d17acc99
Merge pull request #20006 from jcsp/wip-rgw-perfcounters
rgw: set priority on perf counters

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-02-15 09:07:00 -08:00
Yuri Weinstein
350eef5c61
Merge pull request #20021 from tianshan/fix_bilog_list
cls/rgw: fix bi_log_iterate_entries return wrong truncated

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:05:10 -08:00
Yuri Weinstein
f4080c4a61
Merge pull request #20023 from badone/wip-rgw-better-ERANGE-error
rgw: Better ERANGE error message

Reviewed-by: <mkogan@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-02-15 09:04:48 -08:00
Yuri Weinstein
0eab7516ba
Merge pull request #20024 from luomuyao/dev
rgw: fix a typo in rgw_perms[]

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:04:19 -08:00
David Zafman
33e747724a osd: Add new snapset_inconsistency error check
Includes new test case

Caused by: 5f58301a13
This changed attr consistency checking to exclude system keys,
which required snapset to be handled just like object info.

Fixes: http://tracker.ceph.com/issues/22996

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-02-15 09:03:49 -08:00
Yuri Weinstein
327d3bd337
Merge pull request #20191 from yehudasa/wip-22833
rgw: sync tracing fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: <mkogan@redhat.com>
2018-02-15 09:02:19 -08:00
Yuri Weinstein
3563d21664
Merge pull request #20063 from cethikdata/rgw_quota
rgw: upldate the max-buckets when the quota is uploaded

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:59:00 -08:00
Yuri Weinstein
d881a416e4
Merge pull request #20095 from tianshan/fix_reload
rgw: fix RGWCompletionManager get_next stuck after going down

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:58:39 -08:00
Alfredo Deza
287c952bc8 ceph-volume util.prepare extend flags when found
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
457a5173d2 ceph-volume util.constants update mount flags to include rw, normalize on list
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
b80e3bf117 ceph-volume configuration normalize underscore vs. whitespace named options
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
676c93fcf3 ceph-volume tests check for mount/format usage from ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
a8eecc6471 ceph-volume tests add ceph.conf stub for custom conf files
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:28 -05:00
Mykola Golub
cd3ae9b81f
Merge pull request #20423 from dillaman/wip-22945
librbd: new tag should use on-disk committed position

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-15 14:13:45 +02:00
John Wilkins
9d21c2983f
Merge pull request #20442 from JordanHus/master
doc: Fixes a spelling error and a broken hyperlink.

Reviewed-by: John Wilkins
2018-02-14 15:15:27 -08:00
Radoslaw Zarzynski
cbdd7c9b4c common: make ceph_clock_now() inlineable.
The `ceph_clock_now()` is a widely spread but thin routine.
All it does is wrap `clock_gettime` or `gettimeofday` with
accompanying conversion to `utime_t`.

Unfortunately, as it is defined outside of header, compilers
are enforced to generate a full-blown function. The overhead
is related not only the well visible stack smashing protection
but also to enforcing callers to go through PLT each time.

Taking into account the time getters are usually *user-space
syscalls* (leveraging e.g. the VDSO mechanism), eradicating
even small boilerplate might be beneficial.

```
0000000000000000 <ceph_clock_now()>:
   0:   48 83 ec 28             sub    $0x28,%rsp
   4:   31 ff                   xor    %edi,%edi
   6:   48 89 e6                mov    %rsp,%rsi
   9:   64 48 8b 04 25 28 00    mov    %fs:0x28,%rax
  10:   00 00
  12:   48 89 44 24 18          mov    %rax,0x18(%rsp)
  17:   31 c0                   xor    %eax,%eax
  19:   e8 00 00 00 00          callq  1e <ceph_clock_now()+0x1e>
  1e:   8b 44 24 08             mov    0x8(%rsp),%eax
  22:   48 c1 e0 20             shl    $0x20,%rax
  26:   48 89 c2                mov    %rax,%rdx
  29:   8b 04 24                mov    (%rsp),%eax
  2c:   48 09 d0                or     %rdx,%rax
  2f:   48 8b 4c 24 18          mov    0x18(%rsp),%rcx
  34:   64 48 33 0c 25 28 00    xor    %fs:0x28,%rcx
  3b:   00 00
  3d:   75 05                   jne    44 <ceph_clock_now()+0x44>
  3f:   48 83 c4 28             add    $0x28,%rsp
  43:   c3                      retq
  44:   e8 00 00 00 00          callq  49 <SubProcess::spawn()::__PRETTY_FUNCTION__+0x9>
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-02-14 21:43:50 +01:00
Jordan Hus
d68e84dadf doc: Fixes a spelling error and a broken hyperlink.
Signed-off-by: Jordan Hus <jordan.hus@dicecorp.com>
2018-02-14 14:23:59 -05:00
Jason Dillaman
24df022e0b journal: flush commit positions should wait for refresh
Fixes: http://tracker.ceph.com/issues/22945
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:02 -05:00
Jason Dillaman
c5a5b20e08 journal: support concurrent refresh requests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:01 -05:00
Kefu Chai
1b8ddee81b
Merge pull request #19859 from yaozongyou/rgw-remove-register-warning
rgw: silence not allow register storage class specifier warning

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-15 00:13:37 +08:00
John Spray
c15cf4d83f mon: dump percent_used PGMap field as float
Formatting this as a string was awkward for anyone
consuming it from other code.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-02-14 15:19:54 +00:00
John Spray
e69afea925
Merge pull request #20187 from wido/influxdb-connection-error
mgr/influx: Various fixes and improvements

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-14 15:18:31 +00:00
Alfredo Deza
f21200627d
Merge pull request #20265 from ceph/wip-rm22876
ceph-volume: lvm zap will unmount osd paths used by zapped devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-02-14 07:07:16 -05:00
Tianshan Qu
690482d611 rgw: fix index cancel op miss update header
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2018-02-14 16:43:27 +08:00
Mykola Golub
ad765021bc
Merge pull request #20406 from dillaman/wip-22979
librbd: fix issues discovered in clone v2 during upgrade tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-14 09:36:02 +02:00
Kefu Chai
d43c8da833 os/bluestore: fix the demotion in StupidAllocator::init_rm_free
* we should update the _size field when demotion kicks in, otherwise the
  interval_set::m and interval_set::_size won't be consistent.
* also rename post_process to claim, as it "steals" the leftover(s) of
chopped segment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-14 12:22:56 +08:00
Andrew Schoen
3f2e7074ee ceph-volume: use terminal.MultiLogger in lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
c8a6da4e1b ceph-volume: use api helper methods for pvs and lvs in lvm zap
This is just a cleaner way of doing this instead of using PVolumes
and Volumes directly.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
5552cefc4c ceph-volume: fix documentation typos for lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
d4639ac116 ceph-volume: when zapping unmount osd directories
If you zap an lv, device or partition and it's currently mounted as a
ceph osd directory then it will be unmounted so the zap can complete.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
6909baef54 ceph-volume: adds a util.system.unmount function
This function will unmount the given path

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:04 -06:00
Andrew Schoen
5f7c250d29
Merge pull request #20427 from ceph/wip-rm22988
ceph-volume use realpath when checking mounts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 23:57:04 +01:00
Patrick Donnelly
2e44b87141
Merge PR #19263 into master
* refs/pull/19263/head:
	qa: ignore bad backtrace cluster wrn
	qa/cephfs: Add tests to validate scrub functionality
	cephfs: Add option to load invalid metadata from disk
	cephfs: Reset scrub data when inodes move

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:43:32 -08:00
Patrick Donnelly
5224d94f4b
qa: ignore bad backtrace cluster wrn
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:12:53 -08:00
Alfredo Deza
16eabbc3ab ceph-volume tests verify realpath usage in mounts
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Alfredo Deza
53e691e1d5 ceph-volume util.system optionally use realpath on devices
To check a mounted device it is needed to verify on a combination of
realpath and plain devices against realpath and plain paths. In LVM, two
different paths might refer to the same devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Patrick Donnelly
3ed7cc2cbc
Merge PR #19957 into master
* refs/pull/19957/head:
	client: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-02-13 11:36:18 -08:00
Patrick Donnelly
e9468619f9
Merge PR #20336 into master
* refs/pull/20336/head:
	client: re-use free snap tag

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:36:11 -08:00
Patrick Donnelly
304efb05c6
Merge PR #20373 into master
* refs/pull/20373/head:
	client: clamp I/O sizes to INT_MAX when we can't return larger values
	test: new testcase for ceph_ll_readv and ceph_ll_writev
	client: hook up ceph_ll_readv and ceph_ll_writev
	client: type safety cleanup for _read and _write codepaths

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 11:36:04 -08:00
Patrick Donnelly
4d2106bfe7
Merge PR #20386 into master
* refs/pull/20386/head:
	mds: optimize getattr file size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:35:57 -08:00
Patrick Donnelly
608e002195
qa: ignore MON_DOWN while thrashing mons
Fixes: https://tracker.ceph.com/issues/22993

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:24:39 -08:00
Douglas Fuller
07339e2d1d qa/cephfs: Add tests to validate scrub functionality
Add tests to ensure the scrub operation is not adversly affected
by certain metadata pathologies.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-02-13 14:07:28 -05:00
Patrick Donnelly
0d0dd943cd
MgrStatMonitor: fix formatting of pending_digest
Fixes: http://tracker.ceph.com/issues/22991

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 10:22:01 -08:00
Yehuda Sadeh
c598e53c95 rgw: parse old rgw_obj with namespace correctly
Fixes: http://tracker.ceph.com/issues/22982

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-13 10:18:08 -08:00
Patrick Donnelly
7bf6eb0198
qa: ignore io pause warnings in mds-full test
Fixes: http://tracker.ceph.com/issues/22990

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 09:54:12 -08:00
Gregory Farnum
240b688177
Merge pull request #20147 from smithfarm/wip-15904
tools: rados: make -f be --format for consistency with ceph tool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 09:07:24 -08:00
Kefu Chai
9a0d1517a8
Merge pull request #20422 from cbodley/wip-check-cls-rgw
cmake: 'make check' builds radosgw and its cls dependencies

Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-14 00:35:14 +08:00