Commit Graph

100144 Commits

Author SHA1 Message Date
Patrick Nawracay
d5b508809e mgr/dashboard: Add rudimentary pool create/exist/delete test
Fixes: http://tracker.ceph.com/issues/38093

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2019-07-17 15:38:57 +02:00
Sebastian Wagner
57b96c6705
Merge branch 'master' into ansible_orchestrator 2019-07-17 15:37:11 +02:00
Igor Fedotov
5218e5ee6e os/bluestore: add slow op detector for collection listing
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-17 16:17:33 +03:00
Igor Fedotov
00af2c411d os/bluestore: parametrize latency threshold for log_latency funcs..
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-17 16:17:29 +03:00
Igor Fedotov
2f5bd9c48f os/bluestore: cleanup around slow op logging.
We don't need macros any more.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-17 16:15:03 +03:00
Yingxin Cheng
cb371d7d97 crimson/net: apply strict checks when handle addresses
* Apply strict checks at each step of addresses exchange, make sure we
  fail early when notice inconsistent addresses sent from peer;
* Throw error::bad_peer_address for address validation from peer;
* Stop learning my address before sending it out for peer as identity;
* Fix potential racing when try to learn my address by submit to core 0;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 20:07:37 +08:00
Varsha Rao
f734b29eaf mds: Move scalar type initializations of CDir data members to its header
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-17 17:07:25 +05:30
Varsha Rao
7d3a343fda mds: Reorganize class members in CDir header
Fixes: https://tracker.ceph.com/issues/40742
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-17 17:07:25 +05:30
Kefu Chai
8ce9e35e11 pybind: check "CEPH_LIBDIR" not "MAKEFLAGS"
if the used cmake generator is not "make", these environmental variables
won't be set, so let's just check for "CEPH_LIBDIR". it is set by cmake
function of `distutils_add_cython_module()` and
`distutils_install_cython_module()`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-17 18:56:41 +08:00
Ricardo Dias
5cd8b3bb36
mgr/dashboard: tests: fix tests by mocking progress service
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:50:51 +01:00
Ricardo Dias
f374e274a8
mgr/dashboard: frontend/task.service: format task title for progress tasks
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:50:50 +01:00
Ricardo Dias
96ff50e883
mgr/dashboard: add progress module tasks to list of dashboard tasks
Fixes: https://tracker.ceph.com/issues/38202

Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:50:50 +01:00
Ricardo Dias
63334ee2b2
mgr/dashboard: progress mgr module service
This service module implements helper methods to retrieve
tasks information from the progress mgr module.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:50:50 +01:00
Ricardo Dias
a3d56ebaa2
mgr/progress: persist started_at and finished_at timestamps
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:50:50 +01:00
Rishabh Dave
f290322f90 ceph_volume_client: don't convert None to str object
Fixes: http://tracker.ceph.com/issues/40800
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-17 16:07:59 +05:30
Ricardo Dias
28b57d5d1f
mgr/progress: export more event properties to json
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-17 11:21:41 +01:00
Volker Theile
84628f48a5 mgr/dashboard: Add SSO guard service.
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-17 12:03:09 +02:00
Ricardo Marques
961ba7ea1c mgr/dashboard: Validate iSCSI controls min/max value
Fixes: https://tracker.ceph.com/issues/38018

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-17 10:09:04 +01:00
Volker Theile
ee80139fa0 mgr/dashboard: Allow users to change their password on the UI
Fixes: https://tracker.ceph.com/issues/40248

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-17 11:00:58 +02:00
Yingxin Cheng
1466c65bfd crimson/net: fix crimson-osd msgr policies
Also add checks to make sure we have a valid target address with
lossless policy.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 16:37:04 +08:00
Yingxin Cheng
55bfa18fd1 crimson/net: use target_addr to store the address to reconnect
With lossless policy, we will use target_addr to reconnect to peer,
which would be more useful when we switch to entity_addrvec_t.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 16:37:04 +08:00
Yingxin Cheng
5cbd121c6c test/crimson: remove duplicated logging when connected
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 16:37:04 +08:00
Yingxin Cheng
bce34845ca crimson/net: set connection policy for v1 protocol
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 16:37:04 +08:00
Yingxin Cheng
bd9a4a238b crimson/net: use set_ephemeral_port() for non-bound port
Ephemeral port is different from the bound port when connecting, and
different from the peer_addr port when accepting.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-07-17 16:36:55 +08:00
Rishabh Dave
0d5c3a7de6 ceph_volume_client: convert string to bytes object
mount method in libcephfs's cython modules expects filesystem_name to
be a bytes object. Therefore, convert string to bytes object
beforehand.

Fixes: http://tracker.ceph.com/issues/40369
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-17 09:17:13 +05:30
Rishabh Dave
c4385ebb35 ceph_volume_client: make UTF-8 encoding explicit
Make it explicit in the method to_bytes() that encoding is with UTF-8.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-17 09:17:13 +05:30
Kefu Chai
92eaa76f3d
Merge pull request #28959 from tchaikov/wip-crimson-op-write
crimson/osd: differentiate write from writefull

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-17 11:26:43 +08:00
Sage Weil
91c2643144 doc/releases/nautilus.rst: pool stats fix was merged for 14.2.2 after all
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 20:21:56 -05:00
Ali Maredia
122b1b6695
Merge pull request #28861 from smanjara/wip-multi-meta
rgw/multisite: Don't allow certain radosgw-admin commands to run on non-master zone
2019-07-16 17:07:14 -04:00
Ali Maredia
e50628b58c
Merge pull request #28809 from joscollin/wip-fix-rgw-warning
rgw: Silence warning: control reaches end of non-void function
2019-07-16 16:57:51 -04:00
Patrick Donnelly
df78003054
Merge PR #28003 into master
* refs/pull/28003/head:
	client: do not return EEXIST for mkdirs
	pybind/mgr/volumes: print exceptions in purge thread
	pybind/mgr/volumes: refactor trash readdir
	pybind/mgr/volumes: use existing client provided recursive mkdir
	pybind/mgr/volumes: cleanup fs removal
	pybind/mgr/subvolumes: use bytes for paths
	pybind/mgr/volumes: remove unused property
	test: add basic purge queue validation test
	mgr / volumes: schedule purge job for volumes on init
	mgr / volumes: purge queue for async subvolume delete
	mgr / volumes: maintain connection pool for fs volumes
	mgr / volumes: wrap rmtree() call within try..except block
	mgr / volumes: use negative error codes everywhere
	test: cleanup removing all subvolumes before removing subvolume group

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-16 13:40:10 -07:00
Jason Dillaman
7231aab4b8 mon/mgr: add 'rbd_support' to list of always-on mgr modules
The 'rbd_support' mgr module provides many background functions that
are required by the 'rbd' CLI performance queries, as well as future
background long-running maintenance tasks.

Fixes: http://tracker.ceph.com/issues/40790
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-16 13:54:16 -04:00
Boris Ranto
ef191068d6 selinux: Allow ceph to read udev db
We are using libudev and reading the udev db files because of that. We
need to allow ceph to access these files in the SELinux policy.

Signed-off-by: Boris Ranto <branto@redhat.com>
2019-07-16 19:10:51 +02:00
Sage Weil
ac16bcc5c7 mon/MgrMonitor: make pg_autoscaler always on
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 12:10:32 -05:00
Sage Weil
7e56d39cc1 qa/tasks/ceph.conf.template: osd_pool_default_pg_autoscale_mode = off
Otherwise we'll get pg count warnings in almost every test.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 12:10:02 -05:00
Sage Weil
fc597d449f Merge PR #29030 into master
* refs/pull/29030/head:
	qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-07-16 11:31:16 -05:00
Ricardo Marques
a043fc8568
Merge pull request #28994 from smithfarm/wip-40645
build/ops: run "npm ci" with a one-hour timeout

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-16 16:48:10 +01:00
Sage Weil
97a45c9c2e qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness
The 'service' command was succeeding but not actually stopping ceph.  But
we can safely assume systemd now so get rid of the weirdness here.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:25:15 -05:00
Sage Weil
1b46267cf7 Merge PR #28839 into master
* refs/pull/28839/head:
	osd: support osd_repair_during_recovery

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-07-16 10:07:53 -05:00
Sage Weil
bb72ea8eab Merge PR #28907 into master
* refs/pull/28907/head:
	mgr/progress: added the time an event has been in progress
	mgr/progress: added the time an event has been in progress
	mgr/progress: added the time an event has been in progress
	mgr/progress: added the time an event has been in progress

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-16 10:07:37 -05:00
Sage Weil
56cd62a14d Merge PR #29027 into master
* refs/pull/29027/head:
	common/options: Set concurrent bluestore rocksdb compactions to 2

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-16 10:07:02 -05:00
Sage Weil
e7ca5a92d4 qa/tasks/ceph_manager: make upmap thrasher behave when no pools/pgs
Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:04:35 -05:00
Ricardo Dias
d36d74ef04
mgr/dashboard: pool: make _get and _wait_for_pgs class methods
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-16 15:53:44 +01:00
Sage Weil
35f15f87cb mgr/crash: nicely format 'crash info' output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 09:22:53 -05:00
Sage Weil
31f650cb20 mgr/crash: add 'crash archive <id>', 'crash archive-all' commands
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 09:22:53 -05:00
Igor Fedotov
a1246da570 os/bluestore: cleanup around allocator calls
Both stupid and bitmap allocator returs -ENOSPC if they're
unable to allocate any space. Existing callers aren't always
respect this - hence doing some cleanup.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-16 17:16:16 +03:00
Jason Dillaman
353ceeb698
Merge pull request #28820 from trociny/wip-journal-fetch-corrupt-end
journal: return error after first corruption detected

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-07-16 10:10:29 -04:00
Patrick Donnelly
b049eb9bbc
client: do not return EEXIST for mkdirs
Behavior should be similar to `mkdir -p`.

Introduced-by: 26905ca827
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-16 06:52:23 -07:00
Ricardo Marques
498eec659f
Merge pull request #28633 from p-na/wip-pna-refactor-unit-tests
mgr/dashboard: Reduce code duplication through TableActionComponent UnitTests

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-16 14:13:28 +01:00
Ricardo Marques
9804db3e83
Merge pull request #28999 from rafaelquint/bucketstest3
mgr/dashboard: RGW bucket E2E Tests

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-16 14:07:28 +01:00