Commit Graph

98165 Commits

Author SHA1 Message Date
Sage Weil
d2c591a142 mon/OSDMonitor: require nautilus to set pg_autoscale_mode
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-10 09:31:03 -05:00
Sage Weil
7e7134aa93 mon/OSDMonitor: allow pg_num to increase when require_osd_release < N
Setting pg_num_target has no effect when we encode our OSDMap with mimic
or luminous features.  Fall back to the pre-nautilus behavior of directly
setting pg_num.

Fixes: http://tracker.ceph.com/issues/39570
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-10 09:31:03 -05:00
Casey Bodley
8107bc6aef
Merge pull request #27795 from cbodley/wip-rgw-beast-async-body
rgw: beast frontend uses yield_context to read/write body

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-10 09:05:32 -04:00
Lenz Grimmer
e7ad5ed68d
mgr/dashboard: Added Object Gateway menu tab tests (#27565)
mgr/dashboard: Added Object Gateway menu tab tests

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-05-10 12:41:09 +02:00
Nathan Cutler
ae4f94c868
Merge pull request #28042 from smithfarm/wip-doc-ceph-backport-sh
doc: improve ceph-backport.sh comment block

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-10 11:27:30 +02:00
Nathan Cutler
0b6c121805 doc: improve ceph-backport.sh comment block
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-05-10 10:22:50 +02:00
Samuel Just
d20076b7b4
Merge pull request #28048 from athanatos/sjust/wip-peering-state-cleanup
More PeeringState and related cleanups to ease use in crimson

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-09 20:34:06 -07:00
Sage Weil
5cca06aab8 Merge PR #27811 into master
* refs/pull/27811/head:
	commom: make cluster_network work.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-09 20:42:16 -05:00
Xie Xingguo
a14545d592
Merge pull request #28050 from dillaman/wip-39448
msg/async: reduce verbosity of connection timeout failures

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-05-10 08:39:15 +08:00
sjust@redhat.com
0d7115584e osd/: Move PG::_prepare_write_info into osd_types prepare_info_keymap
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:34 -07:00
Samuel Just
48ce9f4570 osd/: convert boost::optional users to std::optional
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:26 -07:00
Samuel Just
571195955c PeeringState: switch remaining boost::optional users
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:26 -07:00
Samuel Just
276023c269 src/osd: Clean up PeeringCtx ownership semantics and pointer/ref usage
PeeringCtx was a bit of a mess in terms of tracking down where the
resources were cleaned up.  This patch:
- Reworks PeeringCtx to directly own its maps/transaction
- Introduces PeeringCtxWrapper to deal with the message buffering
  internally
- Cleans up users to avoid passing pointers through the PeeringState
  interface unnecessarily.

This'll allow the PeeringCtx destructor to do its job vastly
simplifying usage in crimson.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:26 -07:00
Samuel Just
8a2ea310f5 os: break Transaction of of Objectstore, use in crimson
Transaction is needed in crimson, but not ObjectStore.

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2019-05-09 17:22:26 -07:00
Samuel Just
7b27aa1eae src/osd: refactor to use ostream_temp
The concept of emitting log lines to a central mon log is likely
to be useful for both crimson and classic, but the mechanism is
likely to be different.  Break out OstreamTemp for use in interface.

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2019-05-09 17:22:26 -07:00
Samuel Just
23a261718b PeeringState: use HBHandle
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:25 -07:00
Samuel Just
bab7ec4f49 osd/PeeringState: include MOSDPGLog.h
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:25 -07:00
Samuel Just
5eda7afb36 osd/: create interface for TPHandle, remove WorkQueue include from MissingLoc
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:25 -07:00
Samuel Just
e754dd8d8e osd/: move perf counter constants and constructors
PeeringState requires the same counters in crimson, but we
need to avoid OSD.h include in PeeringState.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:25 -07:00
Samuel Just
e41e201a0d PeeringState::ActivateCommitted: intialize epoch
Fixes: https://tracker.ceph.com/issues/39636
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-09 17:22:25 -07:00
Kefu Chai
adb8075138
Merge pull request #28053 from liu-chunmei/ceph_seastar_bugfix
crimson/osd: fix the build broken by df771861

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-10 07:14:47 +08:00
Kefu Chai
cda7429851
Merge pull request #28041 from tchaikov/wip-crimson-v1-auth
crimson/mon: fix the v1 auth

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-05-10 07:07:56 +08:00
chunmei Liu
d101593c38 crimson/osd: can't ‘operator<’ ‘ceph_release_t’ and ‘int’
Signed-off-by: chunmei Liu <chunmei.liu@intel.com>
2019-05-09 15:22:42 -07:00
Patrick Donnelly
f590518a2f
Merge PR #27717 into master
* refs/pull/27717/head:
	mds: output lock state in format dump

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-09 12:32:55 -07:00
Jason Dillaman
081b060820
Merge pull request #28009 from ricardoasmarques/rbd-feature-migrating
Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-09 14:59:16 -04:00
Jason Dillaman
6b4f9729fd msg/async: reduce verbosity of connection timeout failures
Long running clients connected to thrashing OSDs could result in a
"see no progress in more than <timeout>" message printed to stderr.
This is not an error but can result in test failures when console
output is compared against expected output.

Fixes: http://tracker.ceph.com/issues/39448
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-09 14:50:12 -04:00
Abhishek L
475a5b7a65
Merge pull request #27680 from theanalyst/aws-rest-fixes
rgw: rest client fixes for cloud sync XML outputs

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-05-09 19:55:17 +02:00
Lenz Grimmer
37699d09cc
mgr/dashboard: Remove messages.xlf (#28020)
mgr/dashboard: Remove messages.xlf

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-09 16:28:06 +02:00
Kefu Chai
3f10752347
Merge pull request #27976 from mykaul/patch-2
doc: Update link to Red Hat documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-09 21:20:17 +08:00
Kefu Chai
555f1e85f9 crimson/mon: run tick() periodically
also send keepalive to monitor in tick()

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-09 19:14:00 +08:00
Sebastian Krah
170b964012 mgr/dashboard: Remove messages.xlf
Removes the messages.xlf file from the git repository, due to a lot of merge conflicts.
It won't cause any problems, because the file is not important for building or the translation during runtime.

Fixes: https://tracker.ceph.com/issues/38003
Signed-off-by: Sebastian Krah <skrah@suse.com>
2019-05-09 12:48:18 +02:00
Kefu Chai
86b5989175 crimson/mon: fix the v1 auth
* initialize mon::Connection::global_id to `0` in the ctor.
  global_id is assigned by monitor, a zero global_id implies
  that "allocate me a new global_id please". so we should
  never use a random number on stack for the global_id.
* do not use a magic number for initializing MAuth::protocol,
  use `CEPH_AUTH_UNKNOWN` instead.
* do not try to dereference `auth` before creating it. `auth`
  is created by `create_auth()`. in which, the global_id
  is always assigned to `auth->global_id`, as it's a new session.
  so we should just call `create_auth()`.
* restructure the code to finish the authentication. to remove
  the find_if(), and use the `parallel_for_each()` loop for
  both set the active_con and closing the other pending connections.
* ask for the rotating keyring once gets authenticated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-09 17:51:38 +08:00
Zhi Zhang
751289118e mds: output lock state in format dump
dump cache in plain text will print lock state. But in json format dump,
it won't. It is not convenient to debug some MDS lock issues without
such information.

Fixes: http://tracker.ceph.com/issues/39645

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2019-05-09 17:07:24 +08:00
Sebastian Wagner
615b11b9c6
Merge pull request #26654 from sebastian-philipp/orchestrator-progress
mgr/orchestrator: add progress events to all orchestrators

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-05-09 10:41:53 +02:00
Yaniv Kaul
e54e6af80b doc: Update link to Red Hat documentation
The previous link was to version 2, which is a bit older. Fix to version 3.

Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
2019-05-09 15:37:41 +08:00
Kefu Chai
e2b3410ae9
Merge pull request #27855 from tchaikov/wip-ceph-release
src/: define ceph_release_t and use it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-09 15:16:31 +08:00
Kefu Chai
ad329c1fbf
Merge pull request #27689 from Jeegn-Chen/wip-39390-fix
os/filestore: assure sufficient leaves in pre-split

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-09 15:13:02 +08:00
Kefu Chai
e714a33b3f
Merge pull request #27925 from tchaikov/wip-38628
mgr/restful: do not use filter() for list

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2019-05-09 15:11:15 +08:00
Kefu Chai
3a0013f654
Merge pull request #27962 from xiexingguo/wip-jira-3756
mgr/DaemonServer: safe-to-destroy - do not consider irrelevant pgs

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-09 15:07:48 +08:00
Josh Durgin
b37d107c2f
Merge pull request #28036 from neha-ojha/wip-fix-ar-doc
doc/dev/osd_internals/async_recovery: update cost calculation

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-08 22:27:37 -07:00
Josh Durgin
e17535ac37
Merge pull request #28034 from letterwuyu/forward_incompat_pg_missing
ceph-object-corpus: forward_incompat pg_missing_item and pg_missing_t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-08 22:07:37 -07:00
lishuhao
26db9afc62 ceph-object-corpus: forward_incompat pg_missing_item and pg_missing_t
Signed-off-by: lishuhao <lishuhao@unitedstack.com>
2019-05-09 12:33:31 +08:00
Neha Ojha
984073e44d doc/dev/osd_internals/async_recovery: update cost calculation
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-05-08 20:19:32 -07:00
Patrick Donnelly
8170b5d5f6
Merge PR #27688 into master
* refs/pull/27688/head:
	pybind: added lseek()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-08 15:57:00 -07:00
Patrick Donnelly
8de2d27eaa
Merge PR #27482 into master
* refs/pull/27482/head:
	client: fix fuse client hang because its bad session PipeConnection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-08 14:51:22 -07:00
Patrick Donnelly
5e49c15d69
Merge PR #27761 into master
* refs/pull/27761/head:
	qa: use skipTest method instead of exception

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-05-08 14:48:03 -07:00
Patrick Donnelly
aede929b67
Merge PR #27480 into master
* refs/pull/27480/head:
	mds: check dir fragment to split dir if mkdir makes it oversized.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-05-08 14:40:42 -07:00
Casey Bodley
22dc7076a8
Merge pull request #27765 from linuxbox2/wip-rgw-crytpexcept
rgw: crypto: throw DigestException from Digest and HMAC

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-08 15:54:07 -04:00
Sage Weil
af96df1d67 Merge PR #27843 into master
* refs/pull/27843/head:
	os/bluestore: fix missing discard in BlueStore::_kv_sync_thread

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-05-08 12:09:47 -05:00
Patrick Donnelly
3333a9505a
Merge PR #27716 into master
* refs/pull/27716/head:
	cephfs-shell: fix string decoding for ls command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-08 09:04:34 -07:00