Commit Graph

93403 Commits

Author SHA1 Message Date
Yehuda Sadeh
ab639f2d0f test/rgw: api fixes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:04:18 -08:00
Yehuda Sadeh
5a08d063ea rgw: propagate storage class to manifest generator
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:04:18 -08:00
Yehuda Sadeh
708d339663 rgw: more storage class data structure changes
storage class also handles compression info

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:01:37 -08:00
Yehuda Sadeh
5e4201daba rgw: add support for storage class
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:01:37 -08:00
Yehuda Sadeh
cbfb05660e rgw: object write processors use tail placement rule
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 17:52:03 -08:00
Alfredo Deza
8cb6de178e
Merge pull request #25674 from alfredodeza/wip-rm37442
ceph-volume normalize comma to dot for string to int conversions 

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-01-03 13:44:06 -05:00
Patrick Donnelly
ee7d253494
Merge PR #24635 into master
* refs/pull/24635/head:
	test: add scrub control command tests
	mds: scrub abort/pause/resume/status control commands
	test: switch using "scrub start" tell interface to initiate scrub
	mds: introduce "scrub start" tell interface to initiate scrub
	mds: dump scrub formatted output when context completion
	mds: generate random scrub tag when empty
	mds: introduce C_ExecAndReply context completion class
	mds: use CInode::scrub_is_in_progress() wherever required

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-03 10:15:31 -08:00
Matt Benjamin
3dda250cad
Merge pull request #25473 from theanalyst/rgw/version-copy-fix
rgw: fix versioned obj copy generating tags
2019-01-03 10:42:31 -05:00
Kefu Chai
407750d16e
Merge pull request #25761 from tchaikov/wip-qa-health-schema
mgr/dashboard: updated API test to reflect changes in ModuleInfo

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 23:15:45 +08:00
Sage Weil
8cbaac69cf Merge PR #25736 into master
* refs/pull/25736/head:
	common/options: document some osd/rados options
	unittest_osdmap: feed options as defaults
	mon/OSDMonitor: allow osd_pool_default_pgp_num to be 0

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-03 09:03:39 -06:00
Kefu Chai
a3e37c2019
Merge pull request #25766 from tchaikov/wip-rgw-readdir-flags
pybind/rgw: pass the flags to callback function

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2019-01-03 23:01:29 +08:00
Kefu Chai
9a92825489
Merge pull request #25635 from rhcs-dashboard/36740-pool-stats-disabled-by-default
mgr/dashboard: pool stats not returned by default

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-03 22:45:54 +08:00
Patrick Donnelly
38044113a1
Merge PR #25528 into master
* refs/pull/25528/head:
	mds: log evicted clients to clog/dbg

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-03 06:43:29 -08:00
Casey Bodley
782f25e00f
Merge pull request #24845 from pritha-srivastava/wip-rgw-assume-role-fixes
rgw: Minor fixes to AssumeRole for boto compliance.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-01-03 09:24:58 -05:00
Casey Bodley
905f7103a3
Merge pull request #25180 from pritha-srivastava/wip-rgw-user-policy-fixes
rgw: Fixes to permission evaluation related to user policies.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-01-03 09:22:36 -05:00
Kefu Chai
67e19d1215
Merge pull request #25659 from Linbing/wip-fixup-read-deadlock
os/bluestore: fixup access a destroy cond cause deadlock or undefine behavior

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 22:06:27 +08:00
Sage Weil
50687a2971 Merge PR #25673 into master
* refs/pull/25673/head:
	mon/Monitor: quorum_age in JSON output as int, not string

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 07:23:57 -06:00
Kefu Chai
486c6a48d9 qa/mgr: add "module_options" to module_info_schema
it was introduced in 280c23ba. so update the schema test accordingly

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 20:44:46 +08:00
Kefu Chai
0c643f8cea pybind/rgw: pass the flags to callback function
before this change, the `flags` parameter passed to `LibRGWFS.readdir()`
will be dropped on the floor and ignored.
after this change, it will be passed to the specified callback function.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 19:00:28 +08:00
Kefu Chai
d78850bb56
Merge pull request #25580 from cyx1231st/wip-crimson-msgr-logging
crimson/net: fix addresses during banner exchange

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 17:09:09 +08:00
Yingxin
a7796ae723 crimson/net: fix address learning during banner exchange
* Don't store my_addr in `Connection`, because my_addr can be learned
  and thus changed.
* Support nonce in SocketMessenger.
* Always set nonce when set_myaddr().
* Add learned_addr() for SocketMessenger.
* Add side_t and socket_port to show the real connecting
  ports of the SocketConnection.
* Fix bannder exchange logic for addresses, including nonce, type, ip,
  port, socket_port for my_addr and peer_addr.
* Add more detailed logging prefixes for SocketConnection.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:50:31 +08:00
Yingxin
25ae94fda9 crimson/net: add logic_name to indicate the msgr role for debugging
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:46:32 +08:00
Yingxin
7a2f4bf925 crimson/net: add basic loggings for SocketConnection
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:41:44 +08:00
Kefu Chai
13c8041111
Merge pull request #25757 from gregsfortytwo/wip-doc-put-warning
doc: warn about how 'rados put' works in the manpage

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 14:21:00 +08:00
Kefu Chai
3da70776d5
Merge pull request #25706 from joscollin/wip-build-doc-librados
librados: fix admin/build-doc warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 14:18:42 +08:00
Kefu Chai
4b392e1afe
Merge pull request #25734 from tchaikov/wip-mgr-default-options
mgr: define option defaults for MgrStandbyModule as well

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:12:54 +08:00
Kefu Chai
d1f15e5ee8
Merge pull request #25735 from wjwithagen/wjw-fix-WRITE_LIFE
os/bluestore: Only use WRITE_LIFE_ when available

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:12:02 +08:00
Kefu Chai
00865b89de
Merge pull request #25746 from tchaikov/wip-pg-autoscale-mode
osd/OSDMap: set pg_autoscale_mode with setting from conf

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:10:15 +08:00
Kefu Chai
705d29b422
Merge pull request #25588 from tchaikov/wip-auth-silence-gcc-warning
cls/rbd: init local var with known value

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-01-03 14:09:20 +08:00
Kefu Chai
b0a83097eb qa/mgr: extract module_info_schema and reused it
both standby mgr and active mgr have this sub-schema. so extract it out
and reuse it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 11:01:04 +08:00
Kefu Chai
75c2d63c31 cls/rbd: init local var with known value
DirectoryState does not have an "invalid" enum so far, since it's
defined using `enum class`, init a value of this type with a known value
could be a better choice even it is always initialized before being read.

this silences the GCC warning of:

src/cls/rbd/cls_rbd.cc:3147:3: warning: ‘on_disk_directory_state’ may be
used uninitialized in this function [-Wmaybe-uninitialized]
   if (directory_state != on_disk_directory_state) {
   ^~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 10:19:02 +08:00
Kefu Chai
0e1cdcd949
Merge pull request #25687 from tchaikov/wip-pg-stats
osd/PrimaryLogPG: do not count failed read in delta_stats

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-03 09:41:46 +08:00
Greg Farnum
71a8605762 doc: warn about how 'rados put' works in the manpage
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2019-01-02 15:00:25 -08:00
Gregory Farnum
8e3da9b2d8
Merge pull request #25705 from joscollin/wip-doc-common
doc: Fix Create a Cluster url in Running Multiple Clusters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-01-02 14:21:28 -08:00
J. Eric Ivancich
090b52ec25
Merge pull request #25450 from ivancich/wip-rgw-category-cleanup
rgw: clean-up -- use enum class for stats category

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2019-01-02 17:00:28 -05:00
J. Eric Ivancich
f600e08605 rgw: clean-up -- remove unnessary "struct"s
In C++ "struct" is unnecessary when referencing a defined
struct. Clean up all uses in src/cls/rgw source files.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-01-02 15:45:19 -05:00
J. Eric Ivancich
c52636c84f rgw: clean-up use enum class for stats category
The stats entries for rgw buckets has a category, which used a
combination of uint8_t and enum RGWObjClass. Clean this up by
converting RGWObjClass to an enum class and using that
throughout. This provides type safety and better code clarity. Also,
add some source code documentation.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-01-02 15:45:19 -05:00
Alfredo Deza
91bc3a1479 ceph-volume tests.util ensure ints and strings with commas can be converted to ints
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-01-02 14:19:00 -05:00
Alfredo Deza
818902e568 ceph-volume test verify strings with a comma can be converted to ints
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-01-02 14:18:59 -05:00
Alfredo Deza
aa5323fbcf ceph-volume util normalize comma with dot for str-to-int conversion
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-01-02 14:18:59 -05:00
Alfredo Deza
6c211d691e
Merge pull request #24676 from TheJJ/cryptsetup-allow-discards
ceph-volume: enable device discards

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-02 13:23:21 -05:00
Sage Weil
9a1c487375 common/options: document some osd/rados options
Many of these are actually on the mon.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-02 11:43:15 -06:00
Sage Weil
71cb37b83a unittest_osdmap: feed options as defaults
We can't change some of these at runtime due to FLAG_CREATE.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-02 11:40:45 -06:00
Kefu Chai
7fc7a7d167 osd/OSDMap: set pg_autoscale_mode with setting from conf
* update build_simple_optioned() to set pg_autoscale_mode with the setting
  read from conf, otherwise it will be a random value in heap.
* update cli test accordingly, otherwise we will have

/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/cli/osdmaptool/create-racks.t:
failed
---
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/cli/osdmaptool/create-racks.t
+++
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/cli/osdmaptool/create-racks.t.err
@@ -796,7 +796,7 @@
   nearfull_ratio 0
   min_compat_client jewel

-  pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash
rjenkins pg_num 15296 pgp_num 15296 last_change 0 flags hashpspool
stripe_width 0 application rbd
+  pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash
rjenkins pg_num 15296 pgp_num 15296 autoscale_mode ??? last_change 0
flags hashpspool stripe_width 0 application rbd

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 01:40:28 +08:00
Kefu Chai
2538c2e18c
Merge pull request #25441 from theanalyst/decode-refcount-types
cls: refcount: add obj_refcount to ceph-dencoder

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-01-03 00:45:50 +08:00
Jonas Jelten
3333304147 ceph-volume: enable device discards
When using SSDs as encrypted OSD device, discards do not pass the
encryption layer. This option activates discard requests.

Signed-off-by: Jonas Jelten <jj@stusta.net>
2019-01-02 16:52:34 +01:00
Kefu Chai
253c1db393 mgr: define option defaults for MgrStandbyModule as well
in 0f814f38, we are using self.MODULE_OPTION_DEFAULTS as a fallback, but
the MgrStandbyModule does not have it defined. in this change,

* apply 0f814f38 to MgrStandbyModule
* apply 0228bd79 to MgrStandbyModule

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-02 22:19:50 +08:00
Venky Shankar
869b13c1a5 test: add scrub control command tests
Fixes: http://tracker.ceph.com/issues/12282
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-01-02 08:51:00 -05:00
Venky Shankar
b9153d14ee mds: scrub abort/pause/resume/status control commands
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-01-02 08:51:00 -05:00
Venky Shankar
1eb33745a8 test: switch using "scrub start" tell interface to initiate scrub
... and fixup doc too.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-01-02 08:51:00 -05:00