Commit Graph

83300 Commits

Author SHA1 Message Date
Jason Dillaman
c5a5b20e08 journal: support concurrent refresh requests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:01 -05:00
Kefu Chai
1b8ddee81b
Merge pull request #19859 from yaozongyou/rgw-remove-register-warning
rgw: silence not allow register storage class specifier warning

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-15 00:13:37 +08:00
John Spray
c15cf4d83f mon: dump percent_used PGMap field as float
Formatting this as a string was awkward for anyone
consuming it from other code.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-02-14 15:19:54 +00:00
John Spray
e69afea925
Merge pull request #20187 from wido/influxdb-connection-error
mgr/influx: Various fixes and improvements

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-14 15:18:31 +00:00
Alfredo Deza
f21200627d
Merge pull request #20265 from ceph/wip-rm22876
ceph-volume: lvm zap will unmount osd paths used by zapped devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-02-14 07:07:16 -05:00
Tianshan Qu
690482d611 rgw: fix index cancel op miss update header
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2018-02-14 16:43:27 +08:00
Mykola Golub
ad765021bc
Merge pull request #20406 from dillaman/wip-22979
librbd: fix issues discovered in clone v2 during upgrade tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-14 09:36:02 +02:00
Kefu Chai
d43c8da833 os/bluestore: fix the demotion in StupidAllocator::init_rm_free
* we should update the _size field when demotion kicks in, otherwise the
  interval_set::m and interval_set::_size won't be consistent.
* also rename post_process to claim, as it "steals" the leftover(s) of
chopped segment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-14 12:22:56 +08:00
Andrew Schoen
3f2e7074ee ceph-volume: use terminal.MultiLogger in lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
c8a6da4e1b ceph-volume: use api helper methods for pvs and lvs in lvm zap
This is just a cleaner way of doing this instead of using PVolumes
and Volumes directly.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
5552cefc4c ceph-volume: fix documentation typos for lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
d4639ac116 ceph-volume: when zapping unmount osd directories
If you zap an lv, device or partition and it's currently mounted as a
ceph osd directory then it will be unmounted so the zap can complete.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
6909baef54 ceph-volume: adds a util.system.unmount function
This function will unmount the given path

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:04 -06:00
Andrew Schoen
5f7c250d29
Merge pull request #20427 from ceph/wip-rm22988
ceph-volume use realpath when checking mounts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 23:57:04 +01:00
Patrick Donnelly
2e44b87141
Merge PR #19263 into master
* refs/pull/19263/head:
	qa: ignore bad backtrace cluster wrn
	qa/cephfs: Add tests to validate scrub functionality
	cephfs: Add option to load invalid metadata from disk
	cephfs: Reset scrub data when inodes move

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:43:32 -08:00
Patrick Donnelly
5224d94f4b
qa: ignore bad backtrace cluster wrn
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:12:53 -08:00
Alfredo Deza
16eabbc3ab ceph-volume tests verify realpath usage in mounts
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Alfredo Deza
53e691e1d5 ceph-volume util.system optionally use realpath on devices
To check a mounted device it is needed to verify on a combination of
realpath and plain devices against realpath and plain paths. In LVM, two
different paths might refer to the same devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Patrick Donnelly
3ed7cc2cbc
Merge PR #19957 into master
* refs/pull/19957/head:
	client: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-02-13 11:36:18 -08:00
Patrick Donnelly
e9468619f9
Merge PR #20336 into master
* refs/pull/20336/head:
	client: re-use free snap tag

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:36:11 -08:00
Patrick Donnelly
304efb05c6
Merge PR #20373 into master
* refs/pull/20373/head:
	client: clamp I/O sizes to INT_MAX when we can't return larger values
	test: new testcase for ceph_ll_readv and ceph_ll_writev
	client: hook up ceph_ll_readv and ceph_ll_writev
	client: type safety cleanup for _read and _write codepaths

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 11:36:04 -08:00
Patrick Donnelly
4d2106bfe7
Merge PR #20386 into master
* refs/pull/20386/head:
	mds: optimize getattr file size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:35:57 -08:00
Patrick Donnelly
608e002195
qa: ignore MON_DOWN while thrashing mons
Fixes: https://tracker.ceph.com/issues/22993

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:24:39 -08:00
Douglas Fuller
07339e2d1d qa/cephfs: Add tests to validate scrub functionality
Add tests to ensure the scrub operation is not adversly affected
by certain metadata pathologies.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-02-13 14:07:28 -05:00
Patrick Donnelly
0d0dd943cd
MgrStatMonitor: fix formatting of pending_digest
Fixes: http://tracker.ceph.com/issues/22991

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 10:22:01 -08:00
Yehuda Sadeh
c598e53c95 rgw: parse old rgw_obj with namespace correctly
Fixes: http://tracker.ceph.com/issues/22982

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-13 10:18:08 -08:00
Patrick Donnelly
7bf6eb0198
qa: ignore io pause warnings in mds-full test
Fixes: http://tracker.ceph.com/issues/22990

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 09:54:12 -08:00
Gregory Farnum
240b688177
Merge pull request #20147 from smithfarm/wip-15904
tools: rados: make -f be --format for consistency with ceph tool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 09:07:24 -08:00
Kefu Chai
9a0d1517a8
Merge pull request #20422 from cbodley/wip-check-cls-rgw
cmake: 'make check' builds radosgw and its cls dependencies

Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-14 00:35:14 +08:00
Casey Bodley
a029d20b86 cmake: 'make check' builds radosgw and its cls dependencies
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-02-13 10:32:11 -05:00
Jason Dillaman
bcfcbcfe0b librbd: flush journal commit position after stopping replay
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-13 10:05:29 -05:00
Jason Dillaman
487963cbf0 test/librbd: disable clone v2 for negative test cases
Fixes: http://tracker.ceph.com/issues/22979
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-13 09:14:18 -05:00
Jason Dillaman
e57a735bfe cls/rbd: don't clear CLONE_CHILD op feature if still a child
After removing the last snapshot linked to a parent image,
don't clear the CLONE_CHILD op feature bit if the image HEAD
is still linked to the parent.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-13 09:14:16 -05:00
Mykola Golub
f5c02adfdb librbd: potential race in RewatchRequest when resetting watch_handle
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-02-13 14:20:09 +02:00
Jos Collin
884b936f40 Handle dir->dentries.empty()
Handle dir->dentries.empty() (during stale file handle error) situation appropriately.

Fixes: http://tracker.ceph.com/issues/21995
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-02-13 09:12:53 +05:30
David Zafman
ba5a53ceeb osd: Fix assert when checking missing version
Fixes: http://tracker.ceph.com/issues/21218

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-02-12 16:57:02 -08:00
Brad Hubbard
96125fe2b2 test/admin_socket_output: better error reporting
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-02-13 10:22:53 +10:00
Sage Weil
e48d236053 osd/PG: keep PG alive until the final onreadable context under old ch is done
The onreadable completions go through a finisher; add a final event
in that stream that keeps the PG alive while prior events flush.

flush() isn't quite sufficient since it doesn't wait for the finisher
events to flush too--only for the actual apply to have happened.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
98b4e900df os/filestore: wait_for_apply on get_omap_iterator
Note that we don't need to worry about the internal get_omap_iterator
callrs (e.g., omap_rmkeyrange) because the apply thread does these
ops sequentially and in order.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
766092e333 osd/PG: flush ch before pg delete
Make sure SnapMapper's ContainerContexts don't outlive the mapper
itself.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
0c71bbab4e ceph-objectstore-tool: fix SnapMapper vs import
- keep mapper around for duration of import
- flush in-flight requests before tearing it down.  This is necessary
because the mapper still uses onreadable.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
c1c495f097 osd/PG: remove last_updated_applied, op_applied()
No longer used or needed, yay!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
01b68f969c osd/PGBackend: drop on_applied callback for submit_transaction
This removes a ton of tracking for ReplicatedBackend.  ECBackend needs
to keep most of it so that it can track in-flight applies on legacy
peer OSDs.  We can remove this post-nautilus.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:28 -06:00
Sage Weil
ac055b224a osd/PGBackend: remove on_applied() from interface
PrimaryLogPG calls it synchronously, on its own, after
submit_transaction.  That means the backends no longer need to
track it or call back to it.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
c489112a1d osd/PG: drop scrub machinery to wait for last_updated_applied
This is no longer needed--queued writes are immediately readable.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
f3d1b2574e osd/PrimaryLogPG: clean out applied members of RepGather
on_applied
rep_done (same as all_committed)
applies_with_commit (no longer relevant)

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
b21dbb3601 osd/PrimaryLogPG: drop repop_all_applied()
We don't need to eval_repop() since we know nothing has committed yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
17dd5eea5a osd/PG: remove obsolete comment in _delete_some()
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
ee314b9351 osd/ECBackend: unify commit+applied msg; drop applied callback
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00
Sage Weil
60776b6e18 osd/ReplicatedBackend: do applied work synchronously
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-12 14:35:27 -06:00