Commit Graph

97589 Commits

Author SHA1 Message Date
Ilya Dryomov
b56e933373
Merge pull request #27271 from idryomov/wip-krbd-wac-on-dm
qa: add device mapper and lvm test cases for stable pages

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-14 21:31:00 +02:00
Jeff Layton
adfe6ccc60 vstart: add new option to pass list of block devices to bluestore
I was doing a bit of testing against a vstart cluster, and ended up
hitting ENOSPC errors. This patch adds a new --bluestore-devs option
that will set up bluestore OSDs to use a set of block devices as the
backing store instead of creating files for them.

They are assigned in order and if there are more OSDs than
bluestore-devs, then we'll create files for the remaining ones.
Also skip doing bluestore fsck on mount in this case to improve
startup times.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-04-14 07:47:46 -04:00
Mykola Golub
c307d34d49
Merge pull request #27533 from dillaman/wip-39257
rbd-mirror: periodically flush IO and commit positions

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-14 10:09:25 +03:00
Mykola Golub
dbe22a392a
Merge pull request #27229 from dillaman/wip-librbd-writearound
librbd: introduce new default write-around cache policy

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-14 10:08:37 +03:00
Jason Dillaman
af6dfdbea3
Merge pull request #27446 from trociny/wip-rbd-io-simple-scheduler-improvements
librbd: dispatch delayed requests only if read intersects

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-13 13:21:09 -04:00
Jason Dillaman
debb52f473
Merge pull request #27513 from ddiss/librados_silence_unused_vars
librbd: silence -Wunused-variable warnings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-13 13:20:53 -04:00
Casey Bodley
59b9dad1a3 rgw: silence a -Wunused-function warning in pubsub
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-13 13:06:23 -04:00
Casey Bodley
f97be8cb6e rgw: RGWPeriodPusher uses zone system key for inter-zonegroup messages
RGWPeriodPusher was using an empty RGWAccessKey for inter-zonegroup
messages, which were rejected as an anonymous user with 403 Forbidden.
this prevented multi-zonegroup configurations from converging on the
same period configuration

Fixes: http://tracker.ceph.com/issues/39287

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-13 11:34:25 -04:00
Milind Changire
2a783569be cephfs-shell: support non-octal mode
Fixes: http://tracker.ceph.com/issues/38740

Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:27:40 +05:30
Milind Changire
3840d51452 cephfs-shell: fix rm command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:21:38 +05:30
Milind Changire
a8205b503f cephfs-shell: fix lls command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:21:38 +05:30
Milind Changire
2d36d7b4c8 cephfs-shell: fix lcd command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:18:38 +05:30
Milind Changire
b307999ab6 cephfs-shell: fix umask command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:18:38 +05:30
Milind Changire
b92ff840cc cephfs-shell: fix cat command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:15:47 +05:30
Milind Changire
39f11515a9 cephfs-shell: fix chmod command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:28 +05:30
Milind Changire
2dad1b96a0 cephfs-shell: fix chdir command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:27 +05:30
Milind Changire
bca5d60a09 cephfs-shell: fix mv command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:26 +05:30
Milind Changire
0340b9e098 cephfs-shell: fix rmdir command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:25 +05:30
Milind Changire
d2ad783b0c cephfs-shell: fix ls command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:24 +05:30
Milind Changire
8e1199f721 cephfs-shell: fix get command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:23 +05:30
Milind Changire
d9621257cf cephfs-shell: fix put command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:22 +05:30
Milind Changire
082333bfab cephfs-shell: fix mkdir command
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:21 +05:30
Milind Changire
54c7bba041 cephfs-shell: helper functions and infra changes
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-04-13 12:06:19 +05:30
Changcheng Liu
d5018973e3 denc: fix build error by calling global snprintf
The snprintf in local namespace only need 3 parameters which
doesn't match the call function protertype here.
Fix the build error by calling global snprintf.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-04-13 14:06:52 +08:00
Sage Weil
9b979a5c5d doc/release/nautilus: proscribe minimum hammer tunables and straw2 on upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 17:26:56 -05:00
Sage Weil
aa4238f025 common/options: update mon_crush_min_required_version=hammer
Hammer is a good point to set the minimum at:

 - it includes straw2 and vary_r, which are the worst offenders among the
   old tunables
 - it does not include chooseleaf_stable, which improves placement
   considerably but *also* shuffles basically all data in the cluster.

Getting everyone up to straw2 support means we can also proscribe the
'ceph osd crush set-all-straw-buckets-to-straw2' command.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 16:35:18 -05:00
Casey Bodley
3d52f30e6e rgw: multisite log trimming only checks peers that sync from us
if there are peer zones in our zonegroup that do not sync from us, they
won't have any sync status that corresponds to our logs. fetching their
status will give us empty markers, so we'll never make progress with log
trimming

the get_zone_data_notify_to_map() contains only the zones that are
configured to sync from us, so use that instead of get_zone_conn_map()

Fixes: http://tracker.ceph.com/issues/39283

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-12 16:36:14 -04:00
David Zafman
96861a8116 ceph-objectstore-tool: Rename dump-import to dump-export
If user specifies dump-import it will still work, but isn't
in the usage that way.

Fixes: http://tracker.ceph.com/issues/39284

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-04-12 13:17:45 -07:00
David Zafman
a35f1a9ce1 osd: Fix fast path to use version bumped value
Fix the code so that the version is in one place
for both the slow and fast path.

Caused by: d2ca3d2feb

Fixes: http://tracker.ceph.com/issues/39281

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-04-12 13:16:31 -07:00
Casey Bodley
ded548953c rgw: use std::optional in bilog trim
clean up an ugly workaround for a bug in boost::optional

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-12 15:56:04 -04:00
Ernesto Puerta
a55b17f5f3
mgr/dashboard: Add frontend code documentation
Adds compodoc as auto-documentation tool for Angular frontend code.

Fixes: http://tracker.ceph.com/issues/36243

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-04-12 19:09:48 +02:00
Mohamad Gebai
90d296b302 ceph-volume: add test for create_lv using a PV
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
4a1198deff ceph-volume: update volume's tags structure when setting tags
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
c88a6a8ad3 ceph-volume: add tests for tags
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
1f07776615 ceph-volume: add tests for reduce_vg()
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
6e3b530614 ceph-volume: add tests for size_from_human_readable()
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
5042806217 ceph-volume: add function to convert from a readable string to Size
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
776d485af8 ceph-volume: add clear_tag function for LVs
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
38b2d7a66c ceph-volume: add option to specify a pv for lvcreate
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:08 -04:00
Mohamad Gebai
ce0184b5d7 ceph-volume: add reduce_vg function
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:07 -04:00
Mohamad Gebai
463091e46b ceph-volume: look for hidden partitions when populating lvs
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-12 12:54:07 -04:00
Sage Weil
79f0043208 mon/OSDMonitor: respect crush node flags for can_mark_*()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 11:50:22 -05:00
Sage Weil
6578ce0539 osd/OSDMap: add get_crush_node_flags(int osd)
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 11:49:13 -05:00
Casey Bodley
be4d819013
Merge pull request #27470 from cbodley/wip-39160
rgw: don't recalculate etags for slo/dlo

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-04-12 12:25:34 -04:00
Sage Weil
a510b738ca mon/OSDMonitor: make 'osd {add,rm}-{noin,noout,...}' support crush nodes
Set noin, noout, etc. flags on crush nodes.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 11:12:00 -05:00
Ali Maredia
e1c1837ffa
Merge pull request #27528 from cbodley/wip-qa-rgw-no-debuginfo
qa/rgw: disable debuginfo packages
2019-04-12 12:11:17 -04:00
Sage Weil
9aa9893b8f osd/OSDMap: raise OSD_FLAGS health alert for crush node flags, too
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 11:10:35 -05:00
Sebastian Wagner
748e680541 mgr/rook: Remove support for Rook older than v0.9
http://tracker.ceph.com/issues/39278

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-04-12 18:02:00 +02:00
Sage Weil
2be95af821 osd/OSDMap: add flags for crush nodes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-12 10:54:20 -05:00
Jason Dillaman
c4dc8835de librbd: write-around cache should honor FUA op flag
If force unit access is specified, the cache should be bypassed just
like other non-optimized IO through the cache.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-04-12 11:07:31 -04:00