Commit Graph

90876 Commits

Author SHA1 Message Date
Sage Weil
a02ae950b7 common/lockdep: add recursive flag for _will_lock
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:51:09 -05:00
Sage Weil
7e6a57bd26 do_cmake.sh: default to Debug build
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 10:27:04 -05:00
Sage Weil
98d25409a2 .gitignore: ignore build.*/
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 10:27:04 -05:00
Laura Paduano
3db50d5aca
Merge pull request #24219 from p-na/fix-test-scrub
mgr/dashboard: Possible fix for some dashboard timing issues

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-21 17:24:32 +02:00
Mykola Golub
b4e3935eb8
Merge pull request #24179 from dillaman/wip-36074
librbd: properly handle potential object map failures

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-21 18:15:09 +03:00
Casey Bodley
f3c258c49f rgw: add BucketChangeObserver to RGWDataChangesLog
this means that BucketTrimManager will track active buckets based on
local changes, rather than changes in remote datalogs or error repos

Fixes: http://tracker.ceph.com/issues/36034

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-09-21 10:51:10 -04:00
Casey Bodley
f05db89637 rgw: remove BucketChangeObserver from data sync thread
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-09-21 10:51:10 -04:00
Neha Ojha
57e006b7cc script/ptl-tool.py: fix BASE_PATH
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-09-21 07:07:38 -07:00
Patrick Nawracay
8daffe86a6 mgr/dashboard: Fix for some dashboard timing issues
Specifically fixes the recurringly occurring `test_osd.py` error on the
`test_scrub` method. But this change should also prevent other issues of
the same kind. Issues of "same kind" are issues which occurr due to
tests which do not immediately result in a clean cluster status and
aren't manually programmed to wait for it.

Fixes: http://tracker.ceph.com/issues/36107

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-09-21 16:01:24 +02:00
Sage Weil
9bf7c810a7 Merge PR #23985 into master
* refs/pull/23985/head:
	ceph-objectstore-tool: add back pool dne check
	qa/suites/rados/singleton/reg11184: remove old test
	ceph-objectstore-tool: import pg at original epoch
	osd: handle null pg slot on startup
	ceph-objectstore-tool: drop support for ancient export files
	osd: avoid dropping osd_lock when pg osdmaps are not laggy
	qa/standalone/osd/pg-merge.sh: add merge vs pg import test

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-09-21 08:21:53 -05:00
Sage Weil
e496446034 Merge PR #24064 into master
* refs/pull/24064/head:
	osd: simplify init of fabricated pg
	osd/PG: inherit pg history from merge source, if necessary
	osd/osd_types: increasing pg_num_pending is also an interval change
	osd: cancel pg merge if PGs are undersized
	mon/OSDMonitor: handle ready_to_merge message that cancels the merge
	osd/PG: only signal ready_to_merge if we have all replicas
	osd/PG: move all mark_clean-ish activity into try_mark_clean()
	osd/PG: use last_epoch_clean from ReadyToMerge point in time for fabricated history
	osd: send last_epoch_clean when indicating PG is ready to merge
	osd/osd_types: rename pg_num_pending_dec_epoch -> pg_num_dec_last_epoch_clean
	osd,mon: stop setting pg_num_pending_dec_epoch

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-21 08:21:33 -05:00
Kefu Chai
67c05144bb osd/PG.cc: silence "-Wsign-compare" warnings
/ceph/src/osd/PG.cc: In member function 'void
PG::choose_async_recovery_ec(const std::map<pg_shard_t, pg_info_t>&,
const pg_info_t&, std::vector<int>*, std::set<pg_shard_t>*) const':
/ceph/src/osd/PG.cc:1572:32: warning: comparison of integer expressions
of different signedness: 'long int' and 'long unsigned int'
[-Wsign-compare]
     if (approx_missing_objects > cct->_conf.get_val<uint64_t>(
         ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
         "osd_async_recovery_min_cost")) {
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/ceph/src/osd/PG.cc: In member function 'void
PG::choose_async_recovery_replicated(const std::map<pg_shard_t,
pg_info_t>&, const pg_info_t&, std::vector<int>*, std::set<pg_shard_t>*)
const':
/ceph/src/osd/PG.cc:1625:33: warning: comparison of integer expressions
of different signedness: 'long int' and 'long unsigned int'
[-Wsign-compare]
     if (approx_missing_objects  > cct->_conf.get_val<uint64_t>(
         ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
         "osd_async_recovery_min_cost")) {
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 21:04:52 +08:00
Kefu Chai
8a814b2eb6 test/objectstore: set pool for fsck test
since 0bd2546eac, we check the pool id
of object when performing fsck to ensure we are looking at the right
collection, but the test is still using the pool id set by the
constructor of hobject_t. so all objects we created in that test belong
to the POOL_META. while the collection is created with the pool id of
`555`. hence the test fails.

Fixes: http://tracker.ceph.com/issues/36099
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 19:59:39 +08:00
Venky Shankar
f65193d955 test: make rank argument mandatory when running journal_tool
Also, fix a bunch of quirky journal_tool invocations that pass
"--rank" argument as the command argument rather than passing it
as function argument.

Fixes: https://tracker.ceph.com/issues/24780
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-21 06:09:39 -04:00
Venky Shankar
5e4702e303 cephfs-journal-tool: make "--rank" argument mandatory
... and do not silenty act on the default filesystem.
Force users to specify the filesystem name and rank.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-21 06:09:39 -04:00
Venky Shankar
d5e482a6c2 cephfs-journal-tool: pass local arg vector for Journal actions
Some helper functions clobber the passed in arg vector. This
causes operations on all but the first rank to fail as the
operations for the first rank tampers with the arg vector.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-21 06:09:39 -04:00
Venky Shankar
cb19db75c7 cephfs-journal-tool: dump to per rank output file wherever necessary
cephfs-journal-tool supports operations on all ranks. Operations
such as dump/export do not write to distinct filenames hence
overwriting the data dumped or exported for the previous rank.

With this change (and further commits), for operations on all
ranks, dump/export would write to distinct filenames suffixed
by the mds rank (.0, .1, etc..). For operations on a single rank
or if there exist a single rank, the passed in filename is used
as it is.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-21 06:09:39 -04:00
Kefu Chai
f3bc838894
Merge pull request #24139 from tchaikov/wip-fix-typos
*/: fix typos in docs,messages,logs,comments

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-21 16:56:31 +08:00
Xie Xingguo
3c7c8c991d
Merge pull request #23317 from xiexingguo/wip-fix-polog-overtrim
osd/PrimaryLogPG: fix potential pg-log overtrimming

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-09-21 14:44:35 +08:00
Pritha Srivastava
c4930af028 rgw: Policy code for STS.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
2d284b3969 rgw: Changing the default auth order.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
ac6c0c1676 rgw: POST request handling for boto compliance.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
5ec01848d9 rgw: Code to make S3 and STS co-exist in same namespace.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
7b0909d97c rgw: Correcting the default value of sts max session duration.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
e96c574cd1 rgw: Check for Access Key during STS Auth.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
15efabc78d rgw: Adding documentation for STS Lite.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
fa007156aa rgw: Proper result for XML formatting.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
a3b3f26047 rgw: Adding ops for V4 authentication.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
cc2b65fa03 rgw: STS auth failures will return reject.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
d6cba8e8ad rgw: STS auth changes to make sure that other engines are not aware of session token.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
beecdcfa1f rgw: Changes according to session token format change.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
64656600ac rgw: Code for GetSessionToken REST API.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
b09fc4079e rgw: Perm mask.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
c627ef5295 rgw: STS authentication correction.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
001f057713 rgw: Added code for auth using temp credentials returned by STS.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
e0d893c670 rgw: Code for making STS Key configurable.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
a60c46ee75 rgw: Changed session token format.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
e28330343d rgw: Incorporating review comments
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
c9b2c885d1 rgw: Renamed STS related files.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
a541391c9d rgw: Added code to store arn and policy passed as part of assume role.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
168573cb6e rgw: Minor Fixes.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:33 +05:30
Pritha Srivastava
bb043894df rgw: Added code to determine token expiration time using role.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:32 +05:30
Pritha Srivastava
f0ae9cff67 rgw: Added max_session_duration and policy parsing to RGW Roles.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:32 +05:30
Pritha Srivastava
e2873cdfa6 rgw: Adding manager, handler etc for STS.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:09:32 +05:30
Pritha Srivastava
1c17c5c0f3 rgw: Added code for STS AssumeRole.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-09-21 11:08:35 +05:30
Kefu Chai
fda8befc53 tools: fix typos in user-visible message and comments
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:43:33 +08:00
Kefu Chai
98b7e6b896 tools,test: fix typos in comments and usage message
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:43:33 +08:00
Kefu Chai
a2eff2fc32 script: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:43:33 +08:00
Kefu Chai
3b062b4278 rgw: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:43:33 +08:00
Kefu Chai
1544ef05bf pybind/rados: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:43:33 +08:00