Commit Graph

82531 Commits

Author SHA1 Message Date
Yuan Zhou
dcf70f5f64 doc: fix librbdpy example
need to connect cluster before opening ioctx

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2018-01-19 10:41:03 +08:00
Matt Benjamin
9688fcc941 rgw: URL-decode S3 and Swift object-copy URLs
Fixes: http://tracker.ceph.com/issues/22121

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2018-01-18 17:51:09 -05:00
Andrew Schoen
57471fe7e7 ceph-volume: clean up docstrings for lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 14:54:55 -06:00
Andrew Schoen
d2529ee5dd ceph-volume: print a message to terminal if --destroy is skipped
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 14:41:53 -06:00
Andrew Schoen
129182645c ceph-volume: no need to set PVolume.vg_name explicitly
This will be set automatically in __init__ by looping
through kw.items and creating properties on PVolume
with them.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 14:34:22 -06:00
Andrew Schoen
5a1be9a739 ceph-volume: switch remove_vg and remove_pv to process.run
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 14:31:20 -06:00
Andrew Schoen
7204851042 ceph-volume: allow passing a fail_msg param to process.run
This will allow the user to provide a more detailed error message
on why the command failed.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 14:25:46 -06:00
Patrick Donnelly
dc914ba480
Merge PR #20011 into master
* refs/pull/20011/head:
	mds: fix some typo

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-18 11:59:53 -08:00
Sage Weil
c2d28e2750
Merge pull request #18971 from liewegas/wip-pg-scrub-preempt
osd/PG: allow scrub preemption

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-01-18 12:37:48 -06:00
Andrew Schoen
fafa183d8f ceph-volume: tests for lvm zap --destroy
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 12:08:58 -06:00
Yuri Weinstein
c329791978
Merge pull request #19476 from qrGitHub/wip-rgw-lack-timeSkewCheck
rgw: add time skew check in function parse_v4_auth_header

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-18 10:01:17 -08:00
Yuri Weinstein
7c575c88c9
Merge pull request #19826 from joke-lee/rgw_fix_s3website_redirect_location_string_length
rgw: fix s3website redirect location string length

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-18 09:59:42 -08:00
Yuri Weinstein
47713dc51e
Merge pull request #19918 from fangyuxiangGL/lc-omap
rgw: abort multipart if upload meta object doesn't exist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-18 09:59:17 -08:00
Sage Weil
f942ec70a3
Merge pull request #20003 from wjwithagen/fix-PG-protected
common: change routines to public access

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-18 11:47:13 -06:00
Sage Weil
0580f0125b mon/OSDMonitor: squelch 'id' arg errors
Several commands use 'id' but for other types (e.g., vector<int64_t>).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-18 11:46:14 -06:00
Sage Weil
918361e925 use stringsream::str(), not rdbuf()
Fixes: http://tracker.ceph.com/issues/22715
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-18 11:46:14 -06:00
Andrew Schoen
cb748ccb22 ceph-volume: also remove pvs with lvm zap --destroy
Leaving the pv around doesn't keep us from redeploying on
that device because we also wipefs, but explicitly destroying
it makes the output read better.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:31 -06:00
Andrew Schoen
0811c02b11 ceph-volume: adds an api.lvm.remove_pv method
Used to remove physical volumes

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:31 -06:00
Andrew Schoen
10a349742c ceph-volume: remove the -a flag from api.lvm.get_pvs
When we run `pvs -a` it returns all pvs, even ones that
have been recently deleted. Because of this pvs that have just
been zapped with `lvm zap` show up and can cause issues if a device
is zapped more than once.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:31 -06:00
Andrew Schoen
708cb43c50 ceph-volume: docs for the --destroy flag of lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:31 -06:00
Andrew Schoen
aea326b772 ceph-volume: adds the --destroy flag to ceph-volume lvm zap
If you use the --destroy flag and are zapping a raw device
or parition then zap will destroy any vgs or lvs it finds on that
device.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:30 -06:00
Andrew Schoen
50a6a543a9 ceph-volume: adds an api.lvm.remove_vg method
This method can be used to remove volume groups

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:30 -06:00
Andrew Schoen
b7f24ec451 ceph-volume: expose vg_name in api.lvm.get_api_pvs
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-18 11:12:30 -06:00
Mohamad Gebai
6d4d26fda9 rados: use WaitInterval()'s return value instead of manual timing
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-01-18 16:11:51 +01:00
Chang Liu
5981ddc199 mon: do not use per_pool_sum_delta to show recovery summary
Fixes: http://tracker.ceph.com/issues/22727

Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2018-01-18 22:54:34 +08:00
Alfredo Deza
7cee6c8d46
Merge pull request #19949 from ceph/wip-bz1498521
ceph-volume: adds --crush-device-class flag for lvm prepare and create

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-18 08:49:53 -05:00
Jason Dillaman
7096acf546
Merge pull request #19997 from Songweibin/wip-fix-typo
doc/rbd: fix typo s/morror/mirror

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-18 08:46:30 -05:00
John Spray
22d6d908a1
Merge pull request #19981 from k0ste/dashboard_iops
mgr: dashboard: show per pool IOPS on health page (#22495).

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-18 12:46:30 +00:00
Konstantin Shalygin
9fc46d52fc
mgr: dashboard: show per pool IOPS on health page (#22495).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-18 19:43:16 +07:00
Willem Jan Withagen
b185239759 common: change routines to public access
Clang complains tafter recent changes:
/home/jenkins/workspace/ceph-master/src/osd/OSD.cc:8787:8: error: 'DeleteStart' is a protected member of 'PG'
          PG::DeleteStart())));
              ^
/home/jenkins/workspace/ceph-master/src/osd/PG.h:1870:16: note: declared protected here
  TrivialEvent(DeleteStart)
               ^
/home/jenkins/workspace/ceph-master/src/osd/OSD.cc:9136:6: error: 'DeleteSome' is a protected member of 'PG'
        PG::DeleteSome())),
            ^
/home/jenkins/workspace/ceph-master/src/osd/PG.h:1871:16: note: declared protected here
  TrivialEvent(DeleteSome)
               ^
2 errors generated.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-01-18 11:46:01 +01:00
Konstantin Shalygin
1adf432545
mgr: prometheus: added osd commit/apply latency metrics (#22718).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-18 13:03:50 +07:00
songweibin
a68d08f88a doc/rbd: fix typo s/morror/mirror
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-18 11:36:32 +08:00
John Wilkins
ee7d2dd092
Merge pull request #19931 from mikechristie/wip-doc-mnc-iscsi-updates
Misc iSCSI doc updates

Reviewed-by: John Wilkins <jowilkin@redhat.com>
2018-01-17 11:00:08 -08:00
Andrew Schoen
c9f7689a7a ceph-volume: print the lvm activate success message correctly
Move the terminal.success to the methods that have access to the
correct osd_id so that they do not print None for the osd_id
in the log message.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-17 11:44:10 -06:00
Sage Weil
4e4d6466aa osd: only exit if *latest* map(s) say we are destroyed
It's possible our current map is older, we were destroyed then, but in
newer maps our osd was recreated.  This happens when the oldest map after
a recreated osd happens to land on an epoch where the osd was marked
destroyed.

Fix by only exiting if one of the newest maps says we are (still)
destroyed.

Fixes: http://tracker.ceph.com/issues/22673
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-17 10:38:29 -06:00
Casey Bodley
1789a0ee46
Merge pull request #17520 from joscollin/wip-cleanup-drop-return
rgw: Drop unnecessary return

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-17 10:18:07 -05:00
Kefu Chai
fdc1a39c7d denc: should check element's type not 'size_t'
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-17 21:30:38 +08:00
Mykola Golub
722fbb903e rbd: properly pass ceph global command line args to subprocess
When initializing the global context, global_init parses command line
arguments and removes ceph global args from the list. As a result they
are not visible for rbd command line parser and global options were
ignored when passing them to subprocesses like nbd or ggate.

Fix this by keeping a list of ceph global init command line
arguments. To build the list we compare the list of initial command
line args and those that remain after global_init parsing.

After this fix it is possible to pass any ceph global option to a
subprocess.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-17 10:00:33 +02:00
Konstantin Shalygin
55f8db1b58
mgr: prometheus: set metadata metrics value to '1' (#22717).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-17 14:06:43 +07:00
Patrick Donnelly
9478c064d7
Merge PR #19803 into master
* refs/pull/19803/head:
	mds: get rid of unnecessary if condition

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-16 20:06:37 -08:00
Patrick Donnelly
cc710979e3
Merge PR #19837 into master
* refs/pull/19837/head:
	client: avoid recursive lock in ll_get_vino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-01-16 20:06:31 -08:00
Patrick Donnelly
bbd23ca4d5
Merge PR #19860 into master
* refs/pull/19860/head:
	cephfs-journal-tool: add usage help info for header set <field>
	mds: add error log info
	cephfs-journal-tool: add "set pool_id" option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:26 -08:00
Patrick Donnelly
7a8bd1c994
Merge PR #19891 into master
* refs/pull/19891/head:
	mds: handle 'inode gets queued for recovery multiple times'
	mds: use elist to track recover queue items

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:21 -08:00
Patrick Donnelly
4412c6b541
Merge PR #19911 into master
* refs/pull/19911/head:
	cephfs: Switch MIN/MAX for std::min/max and use intarith templates

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:12 -08:00
Sage Weil
2d34e380c8 osd/PG: drop 'seed' property from Scrubber
This has been -1 for many releases now.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
5ac3bfa34c qa/suites/rados/singleton/all/divergent_priors*: unsquelch osd debug
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
a188cb27dd osd/ECBackend: debug ec scrub error paths
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
4e0f4238b9 osd: document scrub options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
6dd42392c0 osd: allow limited scrub preemption
If we receive a write within the scrub range, abort the scrub chunk and
shrink the chunk size.  If we do this too many times do not preempt and
allow the scrub to complete (to avoid scrub starvation due to client io).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
lijing
7a0c4d02df ceph-volume: update argument description that bluestore is the default
Fixes: http://tracker.ceph.com/issues/22663
Signed-off-by: Jing Li lijing@gohighsec.com
2018-01-17 10:20:24 +08:00