Commit Graph

106479 Commits

Author SHA1 Message Date
Casey Bodley
5bb03f143e qa/rgw: remove test against hadoop trunk
hadoop's trunk fails to build with many 'package does not exist' errors:

[INFO] 100 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  48.792 s
[INFO] Finished at: 2020-01-14T13:07:36Z
[INFO] ------------------------------------------------------------------------

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-14 09:39:33 -05:00
Sebastian Wagner
0071342a98 mgr/cephadm: add progress to update_mgr()
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-14 14:17:08 +01:00
Volker Theile
ef0c626262 mgr/dashboard: Update npm package caniuse-lite
Update the package to get rid of the npm message 'Browserslist: caniuse-lite is outdated. Please run next command `npm update`'.

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-14 12:57:57 +01:00
Laura Paduano
f22247fd28
Merge pull request #32032 from votdev/issue_43088_passwd_async_validator
mgr/dashboard: Process password complexity checks immediately

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-01-14 11:15:10 +01:00
Sebastian Wagner
3ead1bee80
Merge pull request #32574 from sebastian-philipp/orchestrator-exception-add-type
mgr/orchestrator: raise_if_exception: Add exception type to message

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-14 10:57:32 +01:00
Sebastian Wagner
d4c4272806
Merge pull request #32491 from pcuzner/cephadm-deploy-grafana
cephadm: Add ability to deploy grafana container

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-01-14 10:50:31 +01:00
Rishabh Dave
5f2e33570a doc: split index.rst of dev guide
Move every section to a different file. Also, fix minor issues like
line-wrapping along.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-14 15:12:27 +05:30
Rishabh Dave
f3e154f94a doc: tweak few section titles in dev guide
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-14 15:09:54 +05:30
Rishabh Dave
2b01d75621 doc: don't display contents twice in dev guide
Content of this page is being displayed twice, once on the left side of
the page and once within the page. Display it only once at the left
side of the page.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-14 15:09:54 +05:30
Rishabh Dave
c4537b4148 doc: add guide for running tests with teuthology
The guide shows how to run integration tests using teuthology framework.

Fixes: https://tracker.ceph.com/issues/42749
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-14 15:09:51 +05:30
Kefu Chai
ecddb1dd24 common/util: use ifstream to read from /proc files
refactor `collect_sys_info()` to use ifstream, getline and boost string
helpers to read and parse the /proc/meminfo and /proc/cpuinfo. for
better readability, and it's less error-prone.

Related-To: https://tracker.ceph.com/issues/43306
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-14 16:51:38 +08:00
Xie Xingguo
65c593991d
Merge pull request #29669 from cqzcqq/fix-40117
osd/PeeringState.h: Fix pg stuck in WaitActingChange

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2020-01-14 16:50:55 +08:00
Sage Weil
3266786527 osd/PG: clean up fastinfo key when last_update does not increase
If the last_update field goes backwards, we write a full info instead of
the fastinfo key. However, a stale fastinfo key may still be present, and
it may have a last_update that looks valid to a restarting OSD.

Fixes: https://tracker.ceph.com/issues/43580
Reported-by: song <jinglesong0814@163.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-14 14:25:20 +08:00
Kefu Chai
95f28bd4a6 crimson: move PG::prepare_write() to .cc file
less cluttered this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-14 14:25:20 +08:00
Sage Weil
bf4177d041 use omap_rmkey() where appropriate
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-14 14:25:20 +08:00
Sage Weil
330e3608ea os/Transaction: add omap_rmkey
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-14 14:25:20 +08:00
David Zafman
9f7aabbe9f test: Fix wait_for_state() to wait for a PG to get into a state
To avoid confusion fix function names in osd-backfill-space.sh for how
they actually work.

Fixes: https://tracker.ceph.com/issues/43592

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-13 18:39:38 -08:00
Kefu Chai
b127d6d32e
Merge pull request #32595 from rs-fabrica/doc_install_upgrading-ceph_systemctl_use
doc/install/upgrading-ceph: systemctl in Ubuntu instructions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-14 10:29:45 +08:00
Kefu Chai
1ef9f738c4
Merge pull request #32607 from tchaikov/wip-odr-global-context
cmake: do not include global_context.cc multiple times

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-14 10:25:36 +08:00
Sage Weil
eba385b715 qa/tasks/cephadm: support crush_tunables config option
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 19:49:57 -06:00
Patrick Donnelly
dc71c4a575
Merge PR #31917 into master
* refs/pull/31917/head:
	vstart: Remove duplicate option -N

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-13 16:40:35 -08:00
Sage Weil
e7b8b5c465 ceph-volume: raw: activate: drop --all, --osd-id and --osd-fsid args
We don't need these currently.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 17:51:19 -06:00
Sage Weil
5e9d9179b1 raw: fix activate args
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 17:45:42 -06:00
Sage Weil
4e7e694fa5 raw: --osd-fsid throughout
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 17:45:42 -06:00
Sage Weil
1e9de77add ceph-volume: add raw mode
list, prepare, activate, create (prepare+activate) basic bluestore OSDs
on a single device.

No support (or plans to ever support) dmcrypt.

I think support for db/wal could be added later without much trouble.

For now, we require --no-systemd and --bluestore flags because we haven't
implemented support for anything else but suspect we will in the future,
and would like to ensure users are being explicit about what they're
asking for.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 17:45:42 -06:00
Michael Fritch
c047f627ce
test_cephadm: use container shell for ceph cmds
allow `ceph auth get-or-create` to be used without
the need for a pre-built ceph binary.

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:45:53 -07:00
Michael Fritch
4ade346b81
test_cephadm: -d debug no longer exists
the argument was renamed to `-v` verbose

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:45:46 -07:00
Michael Fritch
a652249d23
test_cephadm: clean-up whitespace (tabs -> spaces)
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:43:24 -07:00
Michael Fritch
19e20c2e89
qa/workunits/cephadm/test_cephadm: add SUDO to vgchange
2020-01-13T10:48:14.235 INFO:tasks.workunit.client.0.smithi177.stderr:+ vgchange -an test_cephadm
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Running as a non-root user. Functionality may be unavailable.
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lvm/lvmetad.socket: access failed: Permission denied
2020-01-13T10:48:14.240 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Failed to connect to lvmetad. Falling back to device scanning.
2020-01-13T10:48:14.260 INFO:tasks.workunit.client.0.smithi177.stderr:  /dev/mapper/control: open failed: Permission denied
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Failure to communicate with kernel device-mapper driver.
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Incompatible libdevmapper 1.02.145 (2017-11-03) and kernel driver (unknown version).
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lock/lvm/V_test_cephadm:aux: open failed: Permission denied
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Can't get lock for test_cephadm
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Cannot process volume group test_cephadm

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:18:24 -07:00
Michael Fritch
57f3dc87b1
qa/workunits/cephadm/test_cephadm: need to add quotes for PYTHONS var
2020-01-13T10:48:13.374 INFO:tasks.workunit.client.0.smithi177.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh: line 46: [: python3: binary operator expected

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:18:24 -07:00
Casey Bodley
4cf31062d1
Merge pull request #31873 from smanjara/wip-mdlog-crash
rgw: find oldest period and update RGWMetadataLogHistory()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-13 16:25:50 -05:00
Ali Maredia
0ed77d1c1a qa: remove s3readwrite & s3roundtrip tasks
As a result of the s3-tests python3 port, the
s3readwrite & s3roundtrip testing files were
deleted

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-01-13 15:46:31 -05:00
Ali Maredia
07a8ac5778 qa: s3tests/s3tests-website tasks no longer only use ubunutu
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-01-13 15:46:28 -05:00
Sage Weil
433c5559b1 Merge PR #32425 into master
* refs/pull/32425/head:
	cephadm: shell: do not bind ceph.conf twice

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-13 14:42:29 -06:00
Sage Weil
fe8f423345 qa/workunits/cephadm/test_cephadm: drop stray 'exit 0'
Introduced in 40b70c632d

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 14:40:51 -06:00
Rodrigo Severo
2422f6df67 doc/install/upgrading-ceph: using systemd commands in Ubuntu instructions
Before this change, we were using the "restart" command which is a symlink to
initctl(8). and it's offered by upstart. since ubuntu/vivid, ubuntu moved from
upstart to systemd.

Please see https://lists.ubuntu.com/archives/ubuntu-devel/2016-July/039465.html

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
2020-01-13 16:55:21 -03:00
Casey Bodley
090286567a
Merge pull request #31976 from cbodley/wip-39142-revisited
rgw: apply_olh_log ignores RGW_ATTR_OLH_VER decode error

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-13 14:45:39 -05:00
Casey Bodley
abe5277269
Merge pull request #32188 from cbodley/wip-qa-rgw-obj-manifest
qa/rgw: add rgw_obj and throttle tests to rgw verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-13 14:45:19 -05:00
Casey Bodley
01d7e32d07
Merge pull request #32534 from cbodley/wip-43512
rgw multisite: enforce spawn window for incremental data sync

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Eric J. Ivancich <ivancich@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2020-01-13 14:44:47 -05:00
Casey Bodley
9d4d273af7
Merge pull request #32550 from cbodley/wip-qa-rgw-multisite-admin-rest
qa/rgw: remove failing radosgw_admin_rest from multisite suite

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2020-01-13 14:43:37 -05:00
Matt Benjamin
20618a77ca
Merge pull request #31580 from cbodley/wip-rgw-spawn
rgw: beast frontend uses 512k mprotected coroutine stacks
2020-01-13 14:41:54 -05:00
Casey Bodley
82351b9874 qa/rgw: s3a-hadoop task defaults to maven-version 3.6.3
binaries for v3.6.2 are no longer available under
http://www-us.apache.org/dist/maven/maven-3/

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-13 14:15:03 -05:00
Mykola Golub
f361938e7a
Merge pull request #32578 from dillaman/wip-41556-3
rbd-mirror: remove journal-specific logic from image replay and bootstrap state machines

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-01-13 19:30:55 +02:00
Jason Dillaman
c7051ac026
Merge pull request #32614 from kalebskeithley/gcc10
librbd: added missing <string> include to PoolMetadata header

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-13 10:48:05 -05:00
kalebskeithley
84f629e1b1 librbd: added missing <string> include to PoolMetadata header
Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
2020-01-13 09:07:49 -05:00
Sebastian Wagner
24aa280b71
Merge pull request #32597 from sebastian-philipp/mgr-mypy-mgr_util-mgr_module
pyind/mgr: add mgr_module.py and mgr_util.py to mypy

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-13 11:08:28 +01:00
Lenz Grimmer
1c5f0e9208
mgr/dashboard: fix badges of SSD devices in inventory page (#32454)
mgr/dashboard: fix badges of SSD devices in inventory page

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-13 08:56:54 +00:00
Lenz Grimmer
b4da81643d
mgr/dashboard: "Promote" CRUSH options in pool form (#32210)
mgr/dashboard: "Promote" CRUSH options in pool form

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-13 08:52:29 +00:00
Rishabh Dave
853504bf8e qa/cephfs: don't run kclient tests on latest RHEL
Fixes: https://tracker.ceph.com/issues/43541
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-13 10:27:02 +05:30
Rishabh Dave
e0335ee6e9 qa/cephfs: don't test kclient on RHEL 7
https://tracker.ceph.com/issues/43539
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-13 10:27:02 +05:30