Commit Graph

86887 Commits

Author SHA1 Message Date
cuixf
488a2a9a72 osd: fix memory leak at EC read
Clean the in_progess and shard_to_read_map when the read op is complete,
to prevent memory leak and primary osd crash.

Signed-off-by: xiaofei cui <cuixiaofei@sangfor.com>
2018-06-10 22:07:27 -04:00
cuixf
3eb1679b1f osd: retry to read object attrs at EC recovery
In EC recovery read, if the object's attrs read failed or with errors, we erase the attrs we have read and
try to read it again from left shards. This will make the primary osd get the object's attrs correct and
avoid assert.

Signed-off-by: xiaofei cui <cuixiaofei@sangfor.com>
2018-06-01 06:26:56 -04:00
Yehuda Sadeh
5325701f88
Merge pull request #22194 from yehudasa/wip-fix-build
rgw: fix build

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-23 15:41:19 -07:00
Yehuda Sadeh
7fbe2b4209 rgw: fix build
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-05-23 14:11:51 -07:00
Sage Weil
671eb5302b
Merge pull request #22190 from smithfarm/wip-google-style
doc/SubmittingPatches.rst: use Google style guide for doc patches

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-23 15:06:04 -05:00
Nathan Cutler
47ff2bf0d5 doc/SubmittingPatches.rst: rv double spaces and Please
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-05-23 20:29:37 +02:00
Nathan Cutler
6f2e7cada8 doc/SubmittingPatches.rst: use Google style guide for doc patches
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-05-23 20:24:23 +02:00
Casey Bodley
12b2e591ff
Merge pull request #22186 from cbodley/wip-cmake-rgw-request
cmake: remove deleted rgw_request.cc from CMakeLists.txt

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-23 12:47:19 -04:00
Casey Bodley
04147d56ab cmake: remove deleted rgw_request.cc from CMakeLists.txt
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-23 11:53:15 -04:00
Andrew Schoen
9d0e6da2ee
Merge pull request #22116 from alfredodeza/wip-cv-ansible-deps
ceph-volume tests.functional add notario dep for ceph-ansible

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-05-23 15:08:01 +00:00
Orit Wasserman
23c4cf5b9f
Merge pull request #21439 from oritwas/wip-rgw-librgwadmin
new librgw_admin_us
2018-05-23 17:25:04 +03:00
Lenz Grimmer
f895c9d109
Merge pull request #22060 from ricardoasmarques/wip-perf-counter-breadcrumb
Add performance counters breadcrumb

Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-05-23 14:51:42 +02:00
Lenz Grimmer
bcc9b18fe5
Merge pull request #22150 from ricardoasmarques/wip-improve-no-pools-message
mgr/dashboard: Improve 'no pool' message on rbd form

Reviewed-by: Kanika Murarka <murarkakanika@gmail.com>
2018-05-23 14:49:07 +02:00
Alfredo Deza
22310f4316 ceph-volume tests.functional install new ceph-ansible dependencies
Make note that ceph-ansible's requirements.txt can't be used just yet

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-05-23 08:32:07 -04:00
Sage Weil
2a6f1633b1
Merge pull request #22158 from liewegas/wip-24222
mon/MgrMonitor: change 'unresponsive' message to info level

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-23 06:42:48 -05:00
Kefu Chai
6d30a32922
Merge pull request #22123 from liewegas/wip-24211
os/bluestore: simplify and fix SharedBlob::put()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2018-05-23 14:55:29 +08:00
Kefu Chai
4af9bf1dcd
Merge pull request #22127 from liewegas/wip-23386
crush: fix device_class_clone for unpopulated/empty weight-sets

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-05-23 14:47:49 +08:00
Kefu Chai
30a932ed1e
Merge pull request #22110 from majianpeng/bluefs-flush-dirty-devices
os/bluestore/BlueFS: only flush dirty devices when do _fsync

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-05-23 14:46:18 +08:00
Kefu Chai
7eef8b245e
Merge pull request #22129 from rzarzynski/wip-auth-fix-openssl-on-arm
auth, test: fix building on ARMs after the NSS -> OpenSSL transition

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-23 14:42:17 +08:00
Kefu Chai
0427ff7b5b
Merge pull request #22164 from dzafman/wip-test-fixes
test: Whitelist corrections

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-23 14:35:04 +08:00
Sage Weil
a8508255f4
Merge pull request #22156 from rzarzynski/wip-bug-24037
common: OpTracker doesn't visit TrackedOp when nref == 0.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-22 20:21:33 -05:00
Sage Weil
4ddbbe561c mon/MgrMonitor: change 'unresponsive' message to info level
We generate a MGR_DOWN health warning at the appropriate points; having
this at WRN level just triggers failed teuthology runs but doesn't much
value for the user.

Clear out teuthology whitelisting for this message.

Fixes: http://tracker.ceph.com/issues/24222
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-22 16:55:03 -05:00
David Zafman
ee4acb6e1f test: Whitelist corrections
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-22 14:26:46 -07:00
Radoslaw Zarzynski
574aeb8130 common: OpTracker doesn't visit TrackedOp when nref == 0.
The patch fixes a race condition that happens between
`unregister_inflight_op` and `visit_ops_in_flight` of
`OpTracker`. When a callable passed to the former one
turns the plain reference it gets into `TrackedOpRef`,
an almost-to-terminate `TrackedOp` (with `nref == 0`)
can be resurrected (`nref++`). This will be reflected
in extra call to `unregister_inflight_op` for same op
leading to e.g. use-after-free. For more details see:
https://tracker.ceph.com/issues/24037#note-5.

The fix deals with the problem by ensuring there will
be no call to the visitor for ops with zeroized `nref`.

Fixes: http://tracker.ceph.com/issues/24037
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-05-22 18:21:56 +02:00
Casey Bodley
b5797e3c21
Merge pull request #21700 from cbodley/wip-rgw-dpp
rgw: use DoutPrefixProvider to add more context to log output

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-05-22 11:21:30 -04:00
Casey Bodley
51b1542083
Merge pull request #21755 from linuxbox2/wip-unordered-gc-delay
rgw: use partial-order bucket listing in RGWLC, add configurable processing delay

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2018-05-22 11:20:31 -04:00
Casey Bodley
fa1cf95df4
Merge pull request #21838 from yehudasa/wip-rgw-async-watch
rgw: async watch registration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:19:48 -04:00
Casey Bodley
ac36897f72
Merge pull request #22024 from votdev/bug_24142
rgw: Do not modify email if argument is not set

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-05-22 11:19:24 -04:00
Casey Bodley
ab5a158a3b
Merge pull request #22100 from joscollin/wip-rgw-period
rgw: update --url in usage and doc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:15:45 -04:00
Casey Bodley
7e8ee759d1
Merge pull request #22114 from zhangsw/cleanup-rgw-cors
rgw: remove the useless is_cors_op in RGWHandler_REST_Obj_S3.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-22 11:15:22 -04:00
Sage Weil
e823c15e04
Merge pull request #22083 from liewegas/wip-21480
os/bluestore: fix flush_commit locking

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-05-22 09:47:19 -05:00
Andrew Schoen
7cd3d7ca05
Merge pull request #22062 from alfredodeza/wip-rm24031
ceph-volume dmcrypt and activate --all documentation updates 

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-05-22 13:31:22 +00:00
Lenz Grimmer
7bf6c93e78
Merge pull request #22065 from ricardoasmarques/wip-table-pagination-style
Improve table pagination style

Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-05-22 14:09:30 +02:00
Boris Ranto
af3ddefd35
Merge pull request #22149 from b-ranto/wip-fix-metadata
prometheus: Fix order of occupation values

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-22 13:46:06 +02:00
Lenz Grimmer
8411506284
Merge pull request #22031 from tspmelo/wip-jest
mgr/dashboard: Add Jest Runner

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-22 12:52:16 +02:00
Lenz Grimmer
1922fba7d7
Merge pull request #22088 from tspmelo/fix-rbd-task-metadata
mgr/dashboard: Fix RBD task metadata

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-22 12:51:10 +02:00
Ricardo Marques
4c2368a801 mgr/dashboard: Improve 'no pool' message on rbd form
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-05-22 11:32:29 +01:00
Boris Ranto
b5f16367ea prometheus: Fix order of occupation values
When we merged the PR to unify the metadata labels, we forgot to switch
the order of hostname and disk in ceph_disk_occupation metric.

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-05-22 12:04:22 +02:00
Jianpeng Ma
8c6e4d3d38 os/bluefs: only flush dirty devices when do _fsync.
Now _fsync call flush_bdev make data safely. But flush_bdev flush all
devices which don't care whether has data for this sync.
So add new api flush_bdev(std::array<bool, MAX_BDEV>& dirty_bdevs)
which only flush dirty devices for this sync op.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-05-22 16:46:55 +08:00
Kefu Chai
46904a8025
Merge pull request #22069 from tchaikov/wip-mgr-cleanup
mgr: fix typo in variable name and cleanups

Reveiwed-by: John Spray <john.spray@redhat.com>
2018-05-22 10:44:36 +08:00
Kefu Chai
6b48184f4c
Merge pull request #22077 from majianpeng/config-w/o-mgr
cmake: make -DWITH_MGR=OFF work.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-22 10:43:10 +08:00
Kefu Chai
0f8583a881
Merge pull request #22089 from jcsp/wip-24175
mgr/status: output to stdout, not stderr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-22 10:42:04 +08:00
Josh Durgin
1642bc4491
Merge pull request #22074 from dzafman/wip-parens
test: Need to escape parens in log-whitelist for grep

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 15:54:05 -07:00
Josh Durgin
6ef75a62f7
Merge pull request #22096 from yuriw/wip-yuriw-crontab
qa/tests: added filters to support distro tests for client-upgrade tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-21 15:27:39 -07:00
Yuri Weinstein
2a01e68a68 qa/tests - reverted clients upgrades for luminous runs
removed ~/rhel_only_on_ovh.yaml to be able to run on ovh
forced runs on smithi only

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-21 14:44:09 -07:00
Radoslaw Zarzynski
52af3c5da0 test/crypto: fix wrong output buffer size in AES.DecryptNoBl.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-05-21 22:21:17 +02:00
Sage Weil
452b521740 crush: fix device_class_clone for unpopulated/empty weight-sets
If the bucket is empty or does not have weight-set weights yet, avoid
crashing when populating the parent bucket.

Fixes: http://tracker.ceph.com/issues/23386
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-21 13:39:47 -05:00
Sage Weil
efde8d440b os/bluestore: move txc on_commits assignment into ctor
This avoids adjusting the oncommits without a lock after the txc is
queued on the sequencer.

This is a bit defensive since the ObjectStore caller doesn't call
flush_commit() at the same time as queue_transaction(), but the could
change in the future.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-21 13:32:30 -05:00
Matt Benjamin
aefbe28ae3
Merge pull request #22036 from linuxbox2/wip-warn-orphans
rgw: require --yes-i-really-mean-it to run radosgw-admin orphans find
2018-05-21 13:55:58 -04:00
David Zafman
4fad800043 test: Add CACHE_POOL_NO_HIT_SET to whitelist for mon/pool_ops.sh
Ignore
  cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET)

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-21 09:47:59 -07:00