Yehuda Sadeh
dc808953f2
rgw: rework lifecycle parsing
...
Use new style xml parsing, instead of inheriting from XMLParser.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:23 -08:00
Zhang Shaowen
408f04ff4a
rgw: move check_date place
...
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-01-03 19:00:23 -08:00
Zhang Shaowen
9e1d2af992
rgw: remove enum defination for storage class.
...
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-01-03 19:00:22 -08:00
Zhang Shaowen
97678bb66a
rgw: support object transition in lifecycle config set.
...
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
2a8e8a98d8
rgw: check that placement rule is valid if bucket exists
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
c3b504df07
rgw: prevent creation of bucket with non-existent storage class
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
c451928019
rgw: don't try to read beyong object size
...
Otherwise even if we prefetch all the data, we'd try to issue another
request to read the rest of the object.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
dcc3c0c873
rgw: tiering: encode standard storage_class in rule explicitly
...
If it's standard storage class, don't avoid encoding it,
otherwise we can't know if it was set or not.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
3354bd4812
rgw: tiering: add support for multipart uploads
...
Encode multipart info structure in the upload meta object,
store the storage_cass info there. Use the storage class
that was set on upload init when uploading all the parts,
and when completing the upload.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:22 -08:00
Yehuda Sadeh
447b74c13a
rgw: tighten storage_class assignment
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:21 -08:00
yuliyang
f3676ebfd4
rgw: fix storage_class in rgw_bucket_dir_entry_meta::dump
...
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2019-01-03 19:00:21 -08:00
Yehuda Sadeh
85c5a95f34
rgw, cls_rgw: propagate storage class to the index
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:21 -08:00
Yehuda Sadeh
e2eea3e594
rgw: copy_obj() inherit dest rule from default bucket rule
...
Otherwise it can be empty, in which case we'll always copy data, even
if rule doesn't change.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:21 -08:00
Yehuda Sadeh
3bac92c90d
rgw: set dest placement rule when copying object
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:21 -08:00
Yehuda Sadeh
316ada445e
rgw: blacklist x-amz-storage-class header
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:21 -08:00
Yehuda Sadeh
053a765876
rgw: data obj synchronous read, use correct ioctx
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:20 -08:00
Yehuda Sadeh
1a3733fc77
rgw: encode dest storage_class when copying object
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:20 -08:00
Yehuda Sadeh
63591be687
rgw: use bl.to_str() and not bl.c_str()
...
can't rely on bufferlist to be null terminated
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:20 -08:00
Yehuda Sadeh
b55c102afc
rgw-admin: clean dumped attrs
...
don't show terminating null chars
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:20 -08:00
Yehuda Sadeh
a270c8b856
rgw: tiering fixes
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 19:00:20 -08:00
Yehuda Sadeh
ab639f2d0f
test/rgw: api fixes
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:04:18 -08:00
Yehuda Sadeh
5a08d063ea
rgw: propagate storage class to manifest generator
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:04:18 -08:00
Yehuda Sadeh
708d339663
rgw: more storage class data structure changes
...
storage class also handles compression info
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:01:37 -08:00
Yehuda Sadeh
5e4201daba
rgw: add support for storage class
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 18:01:37 -08:00
Yehuda Sadeh
cbfb05660e
rgw: object write processors use tail placement rule
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-03 17:52:03 -08:00
Alfredo Deza
8cb6de178e
Merge pull request #25674 from alfredodeza/wip-rm37442
...
ceph-volume normalize comma to dot for string to int conversions
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-01-03 13:44:06 -05:00
Patrick Donnelly
ee7d253494
Merge PR #24635 into master
...
* refs/pull/24635/head:
test: add scrub control command tests
mds: scrub abort/pause/resume/status control commands
test: switch using "scrub start" tell interface to initiate scrub
mds: introduce "scrub start" tell interface to initiate scrub
mds: dump scrub formatted output when context completion
mds: generate random scrub tag when empty
mds: introduce C_ExecAndReply context completion class
mds: use CInode::scrub_is_in_progress() wherever required
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-03 10:15:31 -08:00
Matt Benjamin
3dda250cad
Merge pull request #25473 from theanalyst/rgw/version-copy-fix
...
rgw: fix versioned obj copy generating tags
2019-01-03 10:42:31 -05:00
Kefu Chai
407750d16e
Merge pull request #25761 from tchaikov/wip-qa-health-schema
...
mgr/dashboard: updated API test to reflect changes in ModuleInfo
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 23:15:45 +08:00
Sage Weil
8cbaac69cf
Merge PR #25736 into master
...
* refs/pull/25736/head:
common/options: document some osd/rados options
unittest_osdmap: feed options as defaults
mon/OSDMonitor: allow osd_pool_default_pgp_num to be 0
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-03 09:03:39 -06:00
Kefu Chai
a3e37c2019
Merge pull request #25766 from tchaikov/wip-rgw-readdir-flags
...
pybind/rgw: pass the flags to callback function
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2019-01-03 23:01:29 +08:00
Kefu Chai
9a92825489
Merge pull request #25635 from rhcs-dashboard/36740-pool-stats-disabled-by-default
...
mgr/dashboard: pool stats not returned by default
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-03 22:45:54 +08:00
Patrick Donnelly
38044113a1
Merge PR #25528 into master
...
* refs/pull/25528/head:
mds: log evicted clients to clog/dbg
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-03 06:43:29 -08:00
Casey Bodley
782f25e00f
Merge pull request #24845 from pritha-srivastava/wip-rgw-assume-role-fixes
...
rgw: Minor fixes to AssumeRole for boto compliance.
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-01-03 09:24:58 -05:00
Casey Bodley
905f7103a3
Merge pull request #25180 from pritha-srivastava/wip-rgw-user-policy-fixes
...
rgw: Fixes to permission evaluation related to user policies.
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-01-03 09:22:36 -05:00
Kefu Chai
67e19d1215
Merge pull request #25659 from Linbing/wip-fixup-read-deadlock
...
os/bluestore: fixup access a destroy cond cause deadlock or undefine behavior
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 22:06:27 +08:00
Sage Weil
50687a2971
Merge PR #25673 into master
...
* refs/pull/25673/head:
mon/Monitor: quorum_age in JSON output as int, not string
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 07:23:57 -06:00
Kefu Chai
486c6a48d9
qa/mgr: add "module_options" to module_info_schema
...
it was introduced in 280c23ba
. so update the schema test accordingly
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 20:44:46 +08:00
Kefu Chai
0c643f8cea
pybind/rgw: pass the flags to callback function
...
before this change, the `flags` parameter passed to `LibRGWFS.readdir()`
will be dropped on the floor and ignored.
after this change, it will be passed to the specified callback function.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 19:00:28 +08:00
Kefu Chai
d78850bb56
Merge pull request #25580 from cyx1231st/wip-crimson-msgr-logging
...
crimson/net: fix addresses during banner exchange
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 17:09:09 +08:00
Yingxin
a7796ae723
crimson/net: fix address learning during banner exchange
...
* Don't store my_addr in `Connection`, because my_addr can be learned
and thus changed.
* Support nonce in SocketMessenger.
* Always set nonce when set_myaddr().
* Add learned_addr() for SocketMessenger.
* Add side_t and socket_port to show the real connecting
ports of the SocketConnection.
* Fix bannder exchange logic for addresses, including nonce, type, ip,
port, socket_port for my_addr and peer_addr.
* Add more detailed logging prefixes for SocketConnection.
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:50:31 +08:00
Yingxin
25ae94fda9
crimson/net: add logic_name to indicate the msgr role for debugging
...
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:46:32 +08:00
Yingxin
7a2f4bf925
crimson/net: add basic loggings for SocketConnection
...
Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2019-01-03 15:41:44 +08:00
Kefu Chai
13c8041111
Merge pull request #25757 from gregsfortytwo/wip-doc-put-warning
...
doc: warn about how 'rados put' works in the manpage
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 14:21:00 +08:00
Kefu Chai
3da70776d5
Merge pull request #25706 from joscollin/wip-build-doc-librados
...
librados: fix admin/build-doc warning
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-03 14:18:42 +08:00
Kefu Chai
4b392e1afe
Merge pull request #25734 from tchaikov/wip-mgr-default-options
...
mgr: define option defaults for MgrStandbyModule as well
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:12:54 +08:00
Kefu Chai
d1f15e5ee8
Merge pull request #25735 from wjwithagen/wjw-fix-WRITE_LIFE
...
os/bluestore: Only use WRITE_LIFE_ when available
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:12:02 +08:00
Kefu Chai
00865b89de
Merge pull request #25746 from tchaikov/wip-pg-autoscale-mode
...
osd/OSDMap: set pg_autoscale_mode with setting from conf
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-03 14:10:15 +08:00
Kefu Chai
705d29b422
Merge pull request #25588 from tchaikov/wip-auth-silence-gcc-warning
...
cls/rbd: init local var with known value
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-01-03 14:09:20 +08:00
Kefu Chai
b0a83097eb
qa/mgr: extract module_info_schema and reused it
...
both standby mgr and active mgr have this sub-schema. so extract it out
and reuse it.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-01-03 11:01:04 +08:00