Commit Graph

78958 Commits

Author SHA1 Message Date
Adam C. Emerson
ceed535957 rgw: Check bucket Website operations in policy
Add code to check s3:GetBucketWebsite and s3:PutBucketWebsite
operations against bucket policy.

Fixes: http://tracker.ceph.com/issues/21597
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1493896

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-28 13:54:32 -04:00
Sage Weil
d7b29acb19 qa/suites/rados/singleton/all/recovery-preemption: add test
This mirrors what I was testing locally.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-28 13:48:14 -04:00
Sage Weil
f1c01dbf5f Merge pull request #18014 from theanalyst/doc-12.2.1
doc: 12.2.1 release notes
2017-09-28 12:06:15 -05:00
Neha Ojha
4bf8d13273 osd: hold lock while accessing recovery_needs_sleep
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-09-28 09:50:24 -07:00
Jos Collin
5dab7c2259 Merge pull request #17973 from ligne/patch-1
doc: Fix typos in placement-groups.rst

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-28 15:55:09 +00:00
Abhishek Lekshmanan
d2b9956f67 doc: add 12.2.1 to releases table
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2017-09-28 17:48:34 +02:00
Abhishek Lekshmanan
91ec0e8842 doc: 12.2.1 release notes
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2017-09-28 17:48:34 +02:00
Matt Benjamin
9a50ac1222 Merge pull request #18000 from adamemerson/wip-21578
rgw: Check bucket CORS operations in policy
2017-09-28 11:20:31 -04:00
Mark Kogan
39fa911663 rgw: update vstart.sh to support ssl port notation : '--rgw_port 443s'
reference: https://github.com/civetweb/civetweb/blob/master/docs/OpenSSL.md

Fixes: http://tracker.ceph.com/issues/21151

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2017-09-28 18:02:49 +03:00
Sage Weil
bf8a109035 Merge pull request #17684 from majianpeng/bluefs-release-extents
os/bluestore/BlueFS: move release unused extents work in _flush_and_syn_log

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-28 09:42:39 -05:00
Sage Weil
4e0a983915 Merge pull request #18020 from theanalyst/doc-changelog-12.2.1
doc: add changelog for 12.2.1

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-28 08:56:12 -05:00
Abhishek Lekshmanan
fb69ba6f43 doc: add changelog for 12.2.1
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2017-09-28 15:53:35 +02:00
Sage Weil
20b0055e0d Merge pull request #17769 from optimistyzy/97_new_opt
os/bluestore/NVMEDevice: Remove using dpdk thread

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-09-28 08:30:44 -05:00
Sage Weil
eab91bfdaf Merge pull request #18001 from liewegas/wip-21417
os/bluestore: put cached attrs in correct mempool

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Varada Kari <varada.kari@gmail.com>
2017-09-28 08:30:11 -05:00
Abhishek L
7e253f87e2 Merge pull request #17755 from dillaman/wip-21353
doc/release-notes: ensure RBD users can blacklist prior to upgrade

Reviewed-By: Nathan Cutler <ncutler@suse.com>
2017-09-28 14:56:20 +02:00
Sage Weil
80c60fcde2 os/bluestore: move several buffer{ptr,list}s into cache_other mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-28 08:17:00 -04:00
Sage Weil
e7762ea147 os/bluestore: put new attrs in correct mempool too
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-28 08:16:55 -04:00
Xie Xingguo
58f329c056 Merge pull request #17966 from xiexingguo/wip-bluefs-kill-block-total
os/bluestore/BlueFS: several cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-28 19:04:31 +08:00
John Spray
0ad7bd0b43 tools: update monstore tool for fsmap, mgrmap
Fixes: http://tracker.ceph.com/issues/21577
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-28 11:07:56 +01:00
John Spray
61ceafc8bb tools: handle decode errors in monstore tool
Print a single line message instead of dumping
a backtrace.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-28 11:07:56 +01:00
Kefu Chai
f2a86506ad ceph-disk: more precise error message when a disk is specified
we raise an exception if the path is not a block device, e.g. /dev/tty,
or it's disk, e.g, /dev/sda.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-28 18:03:14 +08:00
John Spray
37f7fb76af Merge pull request #18013 from tchaikov/wip-dashboard-favicon
mgr/dashboard: use rel="icon" for favicon

Reviewed-by: John Spray <john.spray@redhat.com>
2017-09-28 09:32:17 +01:00
Xinze Chi
96a3cb698a osd: using get_rmissing instread of missing as the judgement
the below code using peer_missing iterator

Signed-off-by: Xinze Chi <xinze@xsky.com>
2017-09-28 14:50:07 +08:00
Kefu Chai
af11e5cbf6 Merge pull request #17993 from jcsp/wip-21572
mgr/dashboard: sort servers and OSDs in OSD list

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-28 14:38:26 +08:00
Kefu Chai
6b85a0caaf Merge pull request #17937 from tchaikov/wip-automake-cleanup
automake: remove files required by automake

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-09-28 14:05:16 +08:00
Kefu Chai
a6e79d91fb mgr/dashboard: use rel="icon" for favicon
shortcut is not a standard compliant link type, see
https://www.w3.org/TR/html5/links.html#linkTypes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-28 13:51:27 +08:00
Kefu Chai
cda8d1df20 Merge pull request #17991 from jcsp/wip-21570
mgr/dashboard: handle null in format_number

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-28 13:22:22 +08:00
Kefu Chai
68769fab3d Merge pull request #17986 from tchaikov/wip-doc-rgw-config
doc: fix hyper link to radosgw/config-ref

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-09-28 09:57:07 +08:00
Yuri Weinstein
7b042400a7 Merge pull request #17926 from batrick/ptl-tool
scripts: add ptl-tool for scripting merges

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-09-27 15:06:10 -07:00
Casey Bodley
9a97f5405f options: use move instead of copy in build_options()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-27 16:21:55 -04:00
Adam C. Emerson
79188d679e rgw: Check bucket GetBucketLocation in policy
Add code to check s3:GetBucketLocation against bucket policy.

Fixes: http://tracker.ceph.com/issues/21582
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1493934

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-27 16:08:56 -04:00
Sage Weil
ef6524436f os/bluestore: put attrs in mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:49:18 -04:00
Sage Weil
937379d57a buffer: add ptr::[try_]reassign_to_mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:49:17 -04:00
Adam C. Emerson
27eb13fe56 rgw: Check bucket CORS operations in policy
Add code to check s3:GetCORS and s3:PutCORS operations against bucket
policy.

Fixes: http://tracker.ceph.com/issues/21578
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1494140

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-27 15:42:27 -04:00
Sage Weil
d8c3756d26 osd/PG: handle racy preemption
If we finish recovery/backfill and go active, but also get
preempted at the same time, we can ignore the event.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:40:18 -04:00
Sage Weil
a8534cce1a osd/PG: allow local recovery reservations to be preempted
If a PG has a higher recovery priority and a lower-priority item is in
progress, allow it to be preempted.  This triggers the RecoveryCancel
or BackfillCancel event with a 0 delay, which means it will immediately
re-request a reservation (and presumably wait).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:40:18 -04:00
Sage Weil
dbc002eaa9 common/AsyncReserver: support preemption
If an (optional) preemption context is provided, use that to preempt
and existing reservation and grant a higher-priority one.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:40:18 -04:00
David Zafman
14c5c834b9 ceph-objectstore-tool: performance: Add --pgid for faster search for object by name
Fixes: http://tracker.ceph.com/issues/21327

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-09-27 12:35:41 -07:00
Adam C. Emerson
16de0fc1c5 rgw: Check bucket versioning operations in policy
Add code to check s3:GetBucketVersioning and s3:PutBucketVersioning
operations against bucket policy.

Fixes: http://tracker.ceph.com/issues/21389
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1490278

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-27 14:35:59 -04:00
Casey Bodley
a5b3db7acb rgw: include SSE-KMS headers in encrypted upload response
Fixes: http://tracker.ceph.com/issues/21576

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-27 14:26:29 -04:00
John Spray
88163749b5 mgr: respect perf counter prio_adjust in MgrClient
This awkwardly involves re-ordering some definitions
in perf_counters.h in order to refer to the prio
names defined in PerfCountersBuilder.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
0f531f7871 test: update perfcounters test for priority in output
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
99352ceced qa: add mgr module selftest task
The module self test commands give us a chance to
catch any other ceph changes that change something
that a module was relying on reading.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
ad5a31efbe mgr/prometheus: remove explicit counter list
These have had their priorities bumped up to
USEFUL, so they'll appear in the default
get_all_counters output.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
ac8320f23d mon: elevate priority of many perf counters
We can be quite liberal here, because mons are
small in number.  However, we don't want to expose
KV database counters at this database from OSDs, so
use the prio_adjust mechanism for that.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
a1cc4ba299 osd: upgrade a bunch of perf counters to PRIO_USEFUL
These are broadly the OSD-wide IO stats, which happen
to also be the ones that were named in the
prometheus plugin until I changed it to be
priority-based.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00
John Spray
66f61eeda6 common: PerfCountersBuilder helper for priorities
Let the caller set a priority as the defaul, to enable them
to create a bunch at a given priority.  This is just a
convenience.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00
John Spray
76e1ba52b1 mgr/prometheus: add a self-test command
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00
John Spray
6776d4645a mgr/influx: remove file-based config
...and also trim down the configuration to what's really
needed.  In general users don't need to pick and choose
metrics.  We could add it back if there was a strong
motivation.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00
John Spray
125294ab9d mgr/influx: enable self-test without dependencies
The idea of self-test commands is that they're self
contained and just exercise the module's calls
to the Ceph-side.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00