Commit Graph

83333 Commits

Author SHA1 Message Date
Kefu Chai
d4c7b932a7
Merge pull request #20409 from badone/wip-better-error-reporting-ceph_test_admin_socket_output
test/admin_socket_output: better error reporting

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-16 11:26:21 +08:00
Kefu Chai
5d8391c6ad
Merge pull request #20370 from ovh/bp-no-normalizing-of-normalized
common/ConfUtils: check key before actually normalizing

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-16 11:25:43 +08:00
Kefu Chai
a6c97c3ffc
Merge pull request #20437 from tchaikov/wip-admin-socket
common/admin_socket: validate command json before feeding it to hook

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-02-16 11:01:46 +08:00
Andrew Schoen
9bc0b8b985
Merge pull request #20408 from ceph/wip-rm22785
ceph-volume consume mount/format options from ceph.conf

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-15 21:08:38 +01:00
Kefu Chai
21fdfc25a2 common/admin_socket: consolidate dump_cmd_to_json() and validate_cmd()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-16 03:51:12 +08:00
Kefu Chai
90ea4b91e4 common/admin_socket: validate command json before feeding it to hook
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-16 03:51:12 +08:00
Orit Wasserman
82ea1b5c6b
Merge pull request #20158 from liaoxin01/fix-list-multi-upload
rgw: fix the max-uploads parameter not work
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-02-15 21:28:32 +02:00
Kefu Chai
097e2de5f7
Merge pull request #20362 from tchaikov/wip-mgr-py3
mgr: fix py3 support

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-02-16 02:32:04 +08:00
Kefu Chai
57d1b785ff
Merge pull request #20430 from tchaikov/wip-bluefs-demotion
os/bluestore: fix the demotion in StupidAllocator::init_rm_free

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-02-16 02:26:09 +08:00
David Zafman
00d4c3eef0
Merge pull request #20410 from dzafman/wip-21218
osd: Fix assert when checking missing version

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-15 10:25:44 -08:00
Yuri Weinstein
bd26668ad1
Merge pull request #19322 from theanalyst/usage-trim-2
rgw: add an option to clear all usage entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:26:06 -08:00
Yuri Weinstein
bb4b98bf07
Merge pull request #19573 from Leeshine/wip-rgw-sync-status
rgw: improve sync status

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:25:36 -08:00
Yuri Weinstein
7e6edc0c46
Merge pull request #19606 from cfanz/wip-rgw-fix-collect-return
rgw: fix collect()'s return in coroutine

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-15 09:25:05 -08:00
Yuri Weinstein
fdeb12f6a7
Merge pull request #19815 from qrGitHub/wip-rgw-memory-optimize2
rgw: drop unused vector elements

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:24:35 -08:00
Yuri Weinstein
0762dbe9cc
Merge pull request #19921 from fangyuxiangGL/lc-ret
rgw: lifecycle omap entry was removed in abnormal situation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2018-02-15 09:07:57 -08:00
Yuri Weinstein
04d17acc99
Merge pull request #20006 from jcsp/wip-rgw-perfcounters
rgw: set priority on perf counters

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-02-15 09:07:00 -08:00
Yuri Weinstein
350eef5c61
Merge pull request #20021 from tianshan/fix_bilog_list
cls/rgw: fix bi_log_iterate_entries return wrong truncated

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:05:10 -08:00
Yuri Weinstein
f4080c4a61
Merge pull request #20023 from badone/wip-rgw-better-ERANGE-error
rgw: Better ERANGE error message

Reviewed-by: <mkogan@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-02-15 09:04:48 -08:00
Yuri Weinstein
0eab7516ba
Merge pull request #20024 from luomuyao/dev
rgw: fix a typo in rgw_perms[]

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:04:19 -08:00
David Zafman
33e747724a osd: Add new snapset_inconsistency error check
Includes new test case

Caused by: 5f58301a13
This changed attr consistency checking to exclude system keys,
which required snapset to be handled just like object info.

Fixes: http://tracker.ceph.com/issues/22996

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-02-15 09:03:49 -08:00
Yuri Weinstein
327d3bd337
Merge pull request #20191 from yehudasa/wip-22833
rgw: sync tracing fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: <mkogan@redhat.com>
2018-02-15 09:02:19 -08:00
Yuri Weinstein
3563d21664
Merge pull request #20063 from cethikdata/rgw_quota
rgw: upldate the max-buckets when the quota is uploaded

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:59:00 -08:00
Yuri Weinstein
d881a416e4
Merge pull request #20095 from tianshan/fix_reload
rgw: fix RGWCompletionManager get_next stuck after going down

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:58:39 -08:00
Alfredo Deza
287c952bc8 ceph-volume util.prepare extend flags when found
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
457a5173d2 ceph-volume util.constants update mount flags to include rw, normalize on list
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
b80e3bf117 ceph-volume configuration normalize underscore vs. whitespace named options
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
676c93fcf3 ceph-volume tests check for mount/format usage from ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
a8eecc6471 ceph-volume tests add ceph.conf stub for custom conf files
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:28 -05:00
Mykola Golub
cd3ae9b81f
Merge pull request #20423 from dillaman/wip-22945
librbd: new tag should use on-disk committed position

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-15 14:13:45 +02:00
John Wilkins
9d21c2983f
Merge pull request #20442 from JordanHus/master
doc: Fixes a spelling error and a broken hyperlink.

Reviewed-by: John Wilkins
2018-02-14 15:15:27 -08:00
Radoslaw Zarzynski
cbdd7c9b4c common: make ceph_clock_now() inlineable.
The `ceph_clock_now()` is a widely spread but thin routine.
All it does is wrap `clock_gettime` or `gettimeofday` with
accompanying conversion to `utime_t`.

Unfortunately, as it is defined outside of header, compilers
are enforced to generate a full-blown function. The overhead
is related not only the well visible stack smashing protection
but also to enforcing callers to go through PLT each time.

Taking into account the time getters are usually *user-space
syscalls* (leveraging e.g. the VDSO mechanism), eradicating
even small boilerplate might be beneficial.

```
0000000000000000 <ceph_clock_now()>:
   0:   48 83 ec 28             sub    $0x28,%rsp
   4:   31 ff                   xor    %edi,%edi
   6:   48 89 e6                mov    %rsp,%rsi
   9:   64 48 8b 04 25 28 00    mov    %fs:0x28,%rax
  10:   00 00
  12:   48 89 44 24 18          mov    %rax,0x18(%rsp)
  17:   31 c0                   xor    %eax,%eax
  19:   e8 00 00 00 00          callq  1e <ceph_clock_now()+0x1e>
  1e:   8b 44 24 08             mov    0x8(%rsp),%eax
  22:   48 c1 e0 20             shl    $0x20,%rax
  26:   48 89 c2                mov    %rax,%rdx
  29:   8b 04 24                mov    (%rsp),%eax
  2c:   48 09 d0                or     %rdx,%rax
  2f:   48 8b 4c 24 18          mov    0x18(%rsp),%rcx
  34:   64 48 33 0c 25 28 00    xor    %fs:0x28,%rcx
  3b:   00 00
  3d:   75 05                   jne    44 <ceph_clock_now()+0x44>
  3f:   48 83 c4 28             add    $0x28,%rsp
  43:   c3                      retq
  44:   e8 00 00 00 00          callq  49 <SubProcess::spawn()::__PRETTY_FUNCTION__+0x9>
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-02-14 21:43:50 +01:00
Jordan Hus
d68e84dadf doc: Fixes a spelling error and a broken hyperlink.
Signed-off-by: Jordan Hus <jordan.hus@dicecorp.com>
2018-02-14 14:23:59 -05:00
Jason Dillaman
24df022e0b journal: flush commit positions should wait for refresh
Fixes: http://tracker.ceph.com/issues/22945
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:02 -05:00
Jason Dillaman
c5a5b20e08 journal: support concurrent refresh requests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:01 -05:00
Kefu Chai
1b8ddee81b
Merge pull request #19859 from yaozongyou/rgw-remove-register-warning
rgw: silence not allow register storage class specifier warning

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-15 00:13:37 +08:00
John Spray
c15cf4d83f mon: dump percent_used PGMap field as float
Formatting this as a string was awkward for anyone
consuming it from other code.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-02-14 15:19:54 +00:00
John Spray
e69afea925
Merge pull request #20187 from wido/influxdb-connection-error
mgr/influx: Various fixes and improvements

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-14 15:18:31 +00:00
Alfredo Deza
f21200627d
Merge pull request #20265 from ceph/wip-rm22876
ceph-volume: lvm zap will unmount osd paths used by zapped devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-02-14 07:07:16 -05:00
Tianshan Qu
690482d611 rgw: fix index cancel op miss update header
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2018-02-14 16:43:27 +08:00
Mykola Golub
ad765021bc
Merge pull request #20406 from dillaman/wip-22979
librbd: fix issues discovered in clone v2 during upgrade tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-14 09:36:02 +02:00
Kefu Chai
d43c8da833 os/bluestore: fix the demotion in StupidAllocator::init_rm_free
* we should update the _size field when demotion kicks in, otherwise the
  interval_set::m and interval_set::_size won't be consistent.
* also rename post_process to claim, as it "steals" the leftover(s) of
chopped segment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-14 12:22:56 +08:00
Andrew Schoen
3f2e7074ee ceph-volume: use terminal.MultiLogger in lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
c8a6da4e1b ceph-volume: use api helper methods for pvs and lvs in lvm zap
This is just a cleaner way of doing this instead of using PVolumes
and Volumes directly.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
5552cefc4c ceph-volume: fix documentation typos for lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
d4639ac116 ceph-volume: when zapping unmount osd directories
If you zap an lv, device or partition and it's currently mounted as a
ceph osd directory then it will be unmounted so the zap can complete.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
6909baef54 ceph-volume: adds a util.system.unmount function
This function will unmount the given path

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:04 -06:00
Andrew Schoen
5f7c250d29
Merge pull request #20427 from ceph/wip-rm22988
ceph-volume use realpath when checking mounts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 23:57:04 +01:00
Patrick Donnelly
2e44b87141
Merge PR #19263 into master
* refs/pull/19263/head:
	qa: ignore bad backtrace cluster wrn
	qa/cephfs: Add tests to validate scrub functionality
	cephfs: Add option to load invalid metadata from disk
	cephfs: Reset scrub data when inodes move

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:43:32 -08:00
Patrick Donnelly
5224d94f4b
qa: ignore bad backtrace cluster wrn
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:12:53 -08:00
Alfredo Deza
16eabbc3ab ceph-volume tests verify realpath usage in mounts
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00