Commit Graph

84595 Commits

Author SHA1 Message Date
Sage Weil
7da45bc6b3 Partial revert "osd/PG: drop scrub machinery to wait for last_updated_applied"
This reverts commit c489112a1d (well,
part of it).

We want the scrub machinery that will wait on an EC read/modify/write
until it has been queued with the ObjectStore, but we don't need the
parts that used to worry about queued but unapplied writes in FileStore
not being visible.

Fixes: http://tracker.ceph.com/issues/23339
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 17:20:29 -05:00
Sage Weil
2f7ca451c2 osd/PrimaryLogPG: restore op_applied in PGBackend
Call it when we queue the submitted write.  For ReplicatedPG this is
inside submit_transaction(), and for ECBackend it's when we finally
submit the write for disk (possibly delayed by a read/modify/write).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 17:20:29 -05:00
Sage Weil
6da45c30dd Revert "osd/PG: remove last_updated_applied, op_applied()"
This reverts commit c1c495f097.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 17:20:29 -05:00
Sage Weil
9424ed8506 Merge PR #20879 into wip-sage-testing-20180316.201311
* refs/pull/20879/head:
	qa/rgw: disable s3tests for lifecycle_expiration

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-03-16 15:13:19 -05:00
Jason Dillaman
875f0bd6f5 mgr/dashboard: block mirroring page should show Ceph version
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-03-16 14:16:40 -04:00
Jason Dillaman
649b8e8cc5 mgr/dashboard: avoid stale path data in block iSCSI status
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-03-16 14:16:40 -04:00
Jason Dillaman
089920e2c7 mgr/dashboard: block iSCSI frontend tweaks
Label rates w/ "/s" suffix and switch throughput back to the
sparkline graph from dashboard v1.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-03-16 14:16:39 -04:00
Mykola Golub
d75973f8b3 librbd: add API function to get image name
We already have open_by_id function, so an image name may be
unknown to the user, and get_name may be useful then.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-03-16 20:05:34 +02:00
Kefu Chai
60e1207995
Merge pull request #20911 from guzhongyan/ConfM-cleanup
mon/ConfigMonitor: clean up prepare_command()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-17 00:36:10 +08:00
Kefu Chai
58a84b348a
Merge pull request #20914 from ibmibmibm/patch-1
os/memstore: Fix wrong use of lock_guard

Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-17 00:35:30 +08:00
Kefu Chai
856013cf5d
Merge pull request #20930 from badone/wip-Log-delete_type_mismatch
log: Fix AddressSanitizer: new-delete-type-mismatch

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-17 00:34:29 +08:00
Sage Weil
b1c045cf33 wa/standalong/mon/osd-pool-create: debug and increase delay
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 10:35:32 -05:00
Sage Weil
d0f6e482f8 osd/ECMsgTypes: print subchunks in ECSubRead operator<<
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 10:09:27 -05:00
Sebastian Wagner
f4d2f019c0 mgr/dashboard: Allow sourcing run-backend-api-tests.sh
This allows us to re-run tests faster. Also updated
HACKING.rst with the latest changes.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-16 14:32:23 +01:00
Jason Dillaman
9659826875
Merge pull request #20928 from dillaman/wip-dashboard-iscsi
mgr/dashboard: fix 500 error on block device iSCSI status page

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-03-16 09:19:32 -04:00
Casey Bodley
1f50f19cc1
Merge pull request #20863 from rjfd/wip-qa-fix-ssl-conflict
qa/rgw: renamed ssl task to openssl_keys

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-16 09:04:10 -04:00
Jason Dillaman
169d84c677 cls/rbd: group_image_list incorrectly flagged as RW
Fixes: http://tracker.ceph.com/issues/23388
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-03-16 08:59:08 -04:00
Jason Dillaman
3cfd3a2f2e mgr/dashboard: fix 500 error on block device iSCSI status page
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-03-16 08:28:55 -04:00
Tiago Melo
d5f8713882 mgr/dashboard: remove node/npm system installation
Node and npm are now being installed in a virtualenv, removing the need of
having it installed in the system or as a node dependency.

Now, if you want to use npm, you just need to activate the virtualenv created
on 'build/src/pybind/mgr/dashboard/node-env', and then you can execute the
same commands as you did before.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-16 12:06:22 +00:00
Ricardo Dias
6014295076
Merge pull request #20925 from rjfd/wip-dashboard-fix-qa
qa/suites/rados/mgr/tasks/dashboard_v2: add fail_on_skip = false

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-16 09:38:52 +00:00
Ricardo Dias
7b774f1bb0
qa/suites/rados/mgr/tasks/dashboard: add fail_on_skip = false
This commit prevents dashboard API tests to be tagged as failed when
some test is decorated with @skip.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-16 08:40:42 +00:00
Kefu Chai
349d7eb3ee
Merge pull request #20912 from rjfd/wip-dashboard-rename
mgr/dashboard: replace dashboard with dashboard_v2

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-16 16:36:51 +08:00
Ricardo Dias
aa205a6731
mgr/dashboard: renamed dashboard_v2 to dashboard
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-16 07:23:08 +00:00
Ricardo Dias
ed291d9e4d
mgr/dashboard: remove dashboard module
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-16 07:23:04 +00:00
Kefu Chai
23c130b338
Merge pull request #20916 from tspmelo/fix-mgr-perf-counter
mgr/dashboard_v2: fix test_perf_counters_mgr_get

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-16 11:23:02 +08:00
Kefu Chai
f836de63a3
Merge pull request #20892 from guzhongyan/fix-mgrc
mgr: fix MSG_MGR_MAP handling

Reviewed-by: John Spray <john.spray@redhat.com>
2018-03-16 11:20:48 +08:00
Josh Durgin
9b72808469
Merge pull request #19811 from neha-ojha/wip-async-recovery
osd: async recovery

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2018-03-15 15:39:34 -07:00
Sage Weil
1bd33de209
Merge pull request #20922 from idryomov/wip-osdmap-encoding-fix
osd/OSDMap: fix HAVE_FEATURE logic in encode()

Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-15 16:07:09 -05:00
Sage Weil
69642f0e14 Merge remote-tracking branch 'gh/mimic-dev2'
# Conflicts:
#	qa/standalone/osd/repro_long_log.sh
2018-03-15 16:02:30 -05:00
Sage Weil
91893003c9
Merge pull request #20917 from liewegas/wip-no-query-debug
osd: debug dispatch_context cases where queries not sent

Reviewed-by: Josh Durgin <jduring@redhat.com>
2018-03-15 15:59:58 -05:00
Sage Weil
d505f4d429
Merge pull request #20918 from liewegas/wip-less-many
qa/suites/rados: fewer msgr failures

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-15 15:59:42 -05:00
Sage Weil
596e4c2793
Merge pull request #20919 from liewegas/wip-cot
qa/standalone/osd/repro_long_log: no-mon-config for cot

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-15 15:59:22 -05:00
Neha Ojha
462d5634ea PG: dout cleanup
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 12:59:28 -07:00
Rishabh Dave
d8eb9bd3dc doc: make minor grammatical rectifications
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-03-16 00:58:38 +05:30
Neha Ojha
1b4f86cb04 PG: add async recovery and backfill to pg dout() prefix
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
e68f2f0ff0 PG: use clear_location() to clear out missing_loc
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
80c57b1ccd PG: use get_recovery_read to prevent race during recovery deletes
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
538ec88008 PG: handle async targets with missing clone in _rollback_to()
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
bec9aaf744 ECBackend: send correct stats to async_recovery_targets
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
7f6f4f90fe qa: modify TEST_recovery_sizeup() to handle async recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
6ea566d3e0 PG: want set size should not be below min_size
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
d25ad0cfa4 PG: clear missing_loc only during async_recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
8cf08f3ab8 PG: add location to missing_loc only during async_recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
b37d895a3a PG: clear out old missing_loc in issue_repop
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
20f90c5608 PG: handle degraded object in _rollback_to()
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Neha Ojha
ae6e001c5f ECBackend: update pg_log missing for async_recovery_targets
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:33 -07:00
Neha Ojha
0a1e0cbee6 PG: skip primary in peer_missing in rebuild()
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:33 -07:00
Sage Weil
52db09afe0 Merge PR #20880 into wip-sage-testing-20180315.163409
* refs/pull/20880/head:
	"Correct" license from LGPL2 to LGPL2.1

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-03-15 11:34:18 -05:00
Piotr Dałek
4900398939 test/librados: new tests for new apis
Unit tests for new apis:

* rados_omap_get_next2
* rados_write_op_omap_cmp2
* rados_write_op_omap_set2
* rados_write_op_omap_rm_keys2
* rados_read_op_omap_cmp2
* rados_read_op_omap_get_vals_by_keys2

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2018-03-15 16:37:54 +01:00
Andrew Schoen
e27f9fb281
Merge pull request #20910 from ceph/fix_callback_plugins_dir
ceph-volume: fix action plugins path in tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-15 16:14:36 +01:00