Commit Graph

82414 Commits

Author SHA1 Message Date
Yuan Zhou
dcf70f5f64 doc: fix librbdpy example
need to connect cluster before opening ioctx

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2018-01-19 10:41:03 +08:00
Matt Benjamin
9688fcc941 rgw: URL-decode S3 and Swift object-copy URLs
Fixes: http://tracker.ceph.com/issues/22121

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2018-01-18 17:51:09 -05:00
Patrick Donnelly
dc914ba480
Merge PR #20011 into master
* refs/pull/20011/head:
	mds: fix some typo

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-18 11:59:53 -08:00
Sage Weil
c2d28e2750
Merge pull request #18971 from liewegas/wip-pg-scrub-preempt
osd/PG: allow scrub preemption

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-01-18 12:37:48 -06:00
Yuri Weinstein
c329791978
Merge pull request #19476 from qrGitHub/wip-rgw-lack-timeSkewCheck
rgw: add time skew check in function parse_v4_auth_header

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-18 10:01:17 -08:00
Yuri Weinstein
7c575c88c9
Merge pull request #19826 from joke-lee/rgw_fix_s3website_redirect_location_string_length
rgw: fix s3website redirect location string length

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-18 09:59:42 -08:00
Yuri Weinstein
47713dc51e
Merge pull request #19918 from fangyuxiangGL/lc-omap
rgw: abort multipart if upload meta object doesn't exist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-18 09:59:17 -08:00
Sage Weil
f942ec70a3
Merge pull request #20003 from wjwithagen/fix-PG-protected
common: change routines to public access

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-18 11:47:13 -06:00
Sage Weil
0580f0125b mon/OSDMonitor: squelch 'id' arg errors
Several commands use 'id' but for other types (e.g., vector<int64_t>).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-18 11:46:14 -06:00
Sage Weil
918361e925 use stringsream::str(), not rdbuf()
Fixes: http://tracker.ceph.com/issues/22715
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-18 11:46:14 -06:00
Mohamad Gebai
6d4d26fda9 rados: use WaitInterval()'s return value instead of manual timing
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2018-01-18 16:11:51 +01:00
Alfredo Deza
7cee6c8d46
Merge pull request #19949 from ceph/wip-bz1498521
ceph-volume: adds --crush-device-class flag for lvm prepare and create

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-18 08:49:53 -05:00
Jason Dillaman
7096acf546
Merge pull request #19997 from Songweibin/wip-fix-typo
doc/rbd: fix typo s/morror/mirror

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-18 08:46:30 -05:00
John Spray
22d6d908a1
Merge pull request #19981 from k0ste/dashboard_iops
mgr: dashboard: show per pool IOPS on health page (#22495).

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-18 12:46:30 +00:00
Konstantin Shalygin
9fc46d52fc
mgr: dashboard: show per pool IOPS on health page (#22495).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-18 19:43:16 +07:00
Willem Jan Withagen
b185239759 common: change routines to public access
Clang complains tafter recent changes:
/home/jenkins/workspace/ceph-master/src/osd/OSD.cc:8787:8: error: 'DeleteStart' is a protected member of 'PG'
          PG::DeleteStart())));
              ^
/home/jenkins/workspace/ceph-master/src/osd/PG.h:1870:16: note: declared protected here
  TrivialEvent(DeleteStart)
               ^
/home/jenkins/workspace/ceph-master/src/osd/OSD.cc:9136:6: error: 'DeleteSome' is a protected member of 'PG'
        PG::DeleteSome())),
            ^
/home/jenkins/workspace/ceph-master/src/osd/PG.h:1871:16: note: declared protected here
  TrivialEvent(DeleteSome)
               ^
2 errors generated.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-01-18 11:46:01 +01:00
Konstantin Shalygin
1adf432545
mgr: prometheus: added osd commit/apply latency metrics (#22718).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-18 13:03:50 +07:00
songweibin
a68d08f88a doc/rbd: fix typo s/morror/mirror
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-18 11:36:32 +08:00
John Wilkins
ee7d2dd092
Merge pull request #19931 from mikechristie/wip-doc-mnc-iscsi-updates
Misc iSCSI doc updates

Reviewed-by: John Wilkins <jowilkin@redhat.com>
2018-01-17 11:00:08 -08:00
Andrew Schoen
c9f7689a7a ceph-volume: print the lvm activate success message correctly
Move the terminal.success to the methods that have access to the
correct osd_id so that they do not print None for the osd_id
in the log message.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-17 11:44:10 -06:00
Casey Bodley
1789a0ee46
Merge pull request #17520 from joscollin/wip-cleanup-drop-return
rgw: Drop unnecessary return

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-17 10:18:07 -05:00
Kefu Chai
fdc1a39c7d denc: should check element's type not 'size_t'
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-17 21:30:38 +08:00
Mykola Golub
722fbb903e rbd: properly pass ceph global command line args to subprocess
When initializing the global context, global_init parses command line
arguments and removes ceph global args from the list. As a result they
are not visible for rbd command line parser and global options were
ignored when passing them to subprocesses like nbd or ggate.

Fix this by keeping a list of ceph global init command line
arguments. To build the list we compare the list of initial command
line args and those that remain after global_init parsing.

After this fix it is possible to pass any ceph global option to a
subprocess.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-17 10:00:33 +02:00
Konstantin Shalygin
55f8db1b58
mgr: prometheus: set metadata metrics value to '1' (#22717).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-17 14:06:43 +07:00
Patrick Donnelly
9478c064d7
Merge PR #19803 into master
* refs/pull/19803/head:
	mds: get rid of unnecessary if condition

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-16 20:06:37 -08:00
Patrick Donnelly
cc710979e3
Merge PR #19837 into master
* refs/pull/19837/head:
	client: avoid recursive lock in ll_get_vino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-01-16 20:06:31 -08:00
Patrick Donnelly
bbd23ca4d5
Merge PR #19860 into master
* refs/pull/19860/head:
	cephfs-journal-tool: add usage help info for header set <field>
	mds: add error log info
	cephfs-journal-tool: add "set pool_id" option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:26 -08:00
Patrick Donnelly
7a8bd1c994
Merge PR #19891 into master
* refs/pull/19891/head:
	mds: handle 'inode gets queued for recovery multiple times'
	mds: use elist to track recover queue items

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:21 -08:00
Patrick Donnelly
4412c6b541
Merge PR #19911 into master
* refs/pull/19911/head:
	cephfs: Switch MIN/MAX for std::min/max and use intarith templates

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:12 -08:00
Sage Weil
2d34e380c8 osd/PG: drop 'seed' property from Scrubber
This has been -1 for many releases now.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
5ac3bfa34c qa/suites/rados/singleton/all/divergent_priors*: unsquelch osd debug
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
a188cb27dd osd/ECBackend: debug ec scrub error paths
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
4e0f4238b9 osd: document scrub options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
6dd42392c0 osd: allow limited scrub preemption
If we receive a write within the scrub range, abort the scrub chunk and
shrink the chunk size.  If we do this too many times do not preempt and
allow the scrub to complete (to avoid scrub starvation due to client io).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
lijing
7a0c4d02df ceph-volume: update argument description that bluestore is the default
Fixes: http://tracker.ceph.com/issues/22663
Signed-off-by: Jing Li lijing@gohighsec.com
2018-01-17 10:20:24 +08:00
lijing
c8bdb49c92 doc: update man page to explain ceph-volume support bluestore
Fixes: http://tracker.ceph.com/issues/22663
Signed-off-by: Jing Li lijing@gohighsec.com
2018-01-17 10:19:03 +08:00
Kefu Chai
67e5a2f35f
Merge pull request #19876 from theanalyst/build/do-cmake-args
build: do_cmake: allow ARGS to be overridden

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-17 09:50:26 +08:00
Sage Weil
d079916a95
Merge pull request #19433 from liewegas/wip-pg-removal
osd: put pg removal in op_wq

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-01-16 15:44:27 -06:00
Sage Weil
366905fb57 pybind/mgr/mgr_module: make rados handle available to all modules
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 15:02:14 -06:00
Sage Weil
d37d966891 osd/PrimaryLogPG: do on_shutdown on removal
This cleans up our reservations and misc other state in OSDService that
needs to be cleaned up.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 14:31:28 -06:00
Sage Weil
617a82c45e osd: track deleted pools' pg_nums for calculating split
This is needed to determine (quickly) whether PGs have split.  Calling
get_pg_num() on the latest map does not work when the pool has been
deleted from that map.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 14:31:28 -06:00
David Zafman
7ccb7b7023
Merge pull request #19850 from dzafman/wip-calc-stats
osd/PG: re-write of _update_calc_stats and improve pg degraded state

Fixes: http://tracker.ceph.com/issues/20059

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-01-16 11:58:49 -08:00
David Zafman
9f103f013c tests: recovery-unfound-found test needs to account for correct misplaced calculations
The test expected HEALTH_OK when in a state with misplaced objects therefore HEALTH_WARN

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-01-16 10:52:21 -08:00
Mike Christie
b56d994f3a doc: add rbd pool requirement for gwcli
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:55 -06:00
Mike Christie
4ca0d508bb doc: add daemon-reload for rbd-target-api setup
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:51 -06:00
Mike Christie
f45aafed1c doc: add gwcli manual install instructions
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:41 -06:00
Yuri Weinstein
9c2278bbbc
Merge pull request #19613 from qrGitHub/wip-rgw-optimize-bucketLCPrepare
rgw: optimize function bucket_lc_prepare

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-16 09:06:21 -08:00
Yuri Weinstein
afb35bafec
Merge pull request #19878 from cbodley/wip-rgw-get-omap-keys-cr
rgw: fix handling of ENOENT in RGWRadosGetOmapKeysCR

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-16 09:05:28 -08:00
Yuri Weinstein
36f1dc0f04
Merge pull request #19897 from cbodley/wip-rgw-put-system-obj
rgw: rgw_put_system_obj takes bufferlist

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-01-16 09:04:36 -08:00
Andrew Schoen
21f459437b ceph-volume: docs for --crush-device-class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:34 -06:00