Commit Graph

99284 Commits

Author SHA1 Message Date
Patrick Donnelly
0e25e4bb4e
Merge PR #27073 into master
* refs/pull/27073/head:
	qa/tasks: Check MDS failover during mon_thrash
	qa/tasks: Compare two FSStatuses
	qa/suites/fs: renamed default.yaml to mds.yaml
	qa/suites/fs: mon_thrash test for fs
	qa/tasks: Fix typo in the comment

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 15:31:55 -07:00
Patrick Donnelly
0ee0798e8a
Merge PR #28459 into master
* refs/pull/28459/head:
	mds: wake up lock waiters after forcibly changing lock state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 15:28:30 -07:00
Patrick Donnelly
fcd0c82e30
Merge PR #28642 into master
* refs/pull/28642/head:
	mds: check last laggy before marking unresponsive client stale
	mds: remove the code that skip evicting the only client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 14:56:54 -07:00
Matt Benjamin
f470839091
Merge pull request #28632 from linuxbox2/wip-rgwfile-advexp
rgw_file: advance_mtime() should consider namespace expiration
2019-07-01 14:15:28 -04:00
Casey Bodley
24ccb2f857
Merge pull request #27794 from cbodley/wip-39487
rgw: data/bilogs are trimmed when no peers are reading them

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-07-01 09:59:02 -04:00
Mykola Golub
a94cef818d
Merge pull request #28743 from dillaman/wip-40417
librbd: prevent concurrent AIO callbacks to external clients

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-01 16:47:57 +03:00
Kefu Chai
beb0c343b3
Merge pull request #28800 from tchaikov/wip-crimson-mkfs
crimson: use given osd_fsid when mkfs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-07-01 10:04:12 +08:00
Kefu Chai
3e96ad19e9
Merge pull request #28774 from falcon78921/wip-doc-40575
doc: fixed broken link in Swift Settings section

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-01 09:41:52 +08:00
James McClune
2a59842991 doc: fixed broken link in Swift Settings section
Fixes: https://tracker.ceph.com/issues/40575

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-06-30 14:34:23 -04:00
Kefu Chai
42a21a435e
Merge pull request #28786 from tchaikov/wip-const-head
osd/PrimaryLogPG: more constness

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-30 23:44:51 +08:00
Kefu Chai
7b17f983f3 crimson: use given osd_fsid when mkfs
MemStore does not have this feature, but CyanStore needs it. because
`qa/tasks/ceph.py` uses following steps when creating/starting an OSD

1. ceph-osd --mkfs --mkkey -i <osd_id> --monmap <monmap>
2. read the osd_fsid of osd.<osd_id>
3. ceph osd new <osd_fsid> <osd_id>

when we mkfs for the OSD, the osd_fsid is still unknown. so we cannot
use the configured one, as it is always empty. in that case, we need to
use a random uuid, and persist it to both ${osd_data}/fsid and
superblock.osd_fsid

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-30 23:42:55 +08:00
Kefu Chai
5f0f83589f
Merge pull request #28719 from majianpeng/remove-unused-code-XioMessenger
msg/Message: Remove used code about XioMessenger.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-30 15:55:08 +08:00
Kefu Chai
db09ea8531
Merge pull request #28794 from tchaikov/wip-crimson-option-help-seastar
crimson/osd: add "--help-seastar" command line option

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-30 15:52:32 +08:00
Kefu Chai
9e3e5d435e doc/dev/crimson.rst: update with stuff related to seastar options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 23:16:42 +08:00
Kefu Chai
b8b205a3ae
Merge pull request #28792 from tchaikov/wip-crimson-logging
common/config_values: set seastar logging level per that of ceph

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-29 23:02:39 +08:00
Kefu Chai
c8dac70afd
Merge pull request #28790 from tchaikov/wip-crimson-unknown-objectstore
crimson/osd: abort on unsupported objectstore type

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-29 22:54:15 +08:00
Kefu Chai
67bc3e0a03 crimson/osd: add "--help-seastar" command line option
so we can

* have access to the available command line options offered by Seastar.
* tell if the executable we are playing around is ceph-osd or crimson-osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 22:48:05 +08:00
Kefu Chai
a66c27ad26 doc/dev/crimson.rst: update logging related doc
as crimson's logging levels are now connected those of ceph, there is no
need to note down the difference between them anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 21:41:00 +08:00
Kefu Chai
253d05306c common/config_values: set seastar logging level as well
when the logging level of a subsys changes, update seastar accordingly

before this change, seastar logging levels of different logger are not
connected to ceph's logging levels of different subsystem.

after this change, they are connected. whenever a subsys's logging level
changes, the corresponding seastar logger is updated as well.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 21:38:22 +08:00
Kefu Chai
513e49b396 common/dout.h: extract log level mapping out
so we can reuse it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 21:38:22 +08:00
Kefu Chai
dc4d8082d0 crimson/osd: revert 9813f7d6
since we have a proper PeeringState implementation, there is no need to
fake an active+clean PG anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 21:38:22 +08:00
Kefu Chai
d5dbee1ff6 crimson/osd: abort on unsupported objectstore type
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 20:03:20 +08:00
Kefu Chai
cf64928412 crimson/osd: add editor variables/options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 20:03:20 +08:00
Kefu Chai
02388911ae crimson/common: implement "__ceph_abortf()"
the macro of `ceph_abort_msgf()` is implemented using it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 20:03:20 +08:00
Kefu Chai
8b4c62f520 crimson/osd: add a space before function name
for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 20:03:20 +08:00
Kefu Chai
713a9a09e4 crimson/osd: use get_osdmap_epoch()
always prefer using the interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 20:03:20 +08:00
Kefu Chai
85478ea111 osd/PrimaryLogPG: more constness
use `hobject_t::get_head()` instead of relying on the fact that head
object's snap is `CEPH_NOSNAP`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-29 14:32:08 +08:00
Kefu Chai
e2af7fe04f
Merge pull request #28780 from varshar16/wip-doc-update-sepia-link
doc: Updates link to Sepia lab

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-29 12:12:36 +08:00
Matt Benjamin
0dd78c1b61
Merge pull request #28664 from linuxbox2/wip-rgwfile-faststats
rgw_file: introduce fast S3 Unix stats (immutable)
2019-06-28 19:09:00 -04:00
Ali Maredia
9789f10537
Merge pull request #28783 from cbodley/wip-rgw-object-lock-get-params
rgw: fix MalformedXML errors in PutBucketObjectLock/PutObjRetention
2019-06-28 16:36:32 -04:00
Matt Benjamin
6bf2786d28 rgw_file: introduce fast S3 Unix stats (immutable)
For objects originating in S3/Swift, it is frequently acceptable
to synthesize c/mtime and size stats from meta attributes in the RGW
bucket index entry.

Synthetic stat behavior is not compatible with mutation of file
ownership and permissions via SETATTR.  In future, current xattr-based,
mutable, Unix stats may be moved to the bucket index.  For now, use
synthetic stats only when a new option rgw_nfs_s3_fast_attrs is present.

Fixes: http://tracker.ceph.com/issues/40456

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-28 16:29:56 -04:00
Matt Benjamin
3dc3407302
Merge pull request #27964 from Kriechi/fix-rgw-ldap-username
docs: fix rgw_ldap_dnattr username token
2019-06-28 16:17:34 -04:00
Casey Bodley
3553c6ee8b
Merge pull request #28724 from ivancich/wip-abort-multipart-fix
rgw: multipart upload abort is best-effort

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-28 15:25:12 -04:00
Ali Maredia
da1bc86c16
Merge pull request #28102 from albIN7/liv2
RGW:Listobjectsv2
2019-06-28 14:58:54 -04:00
Casey Bodley
33a00eee3c rgw: fix MalformedXML errors in PutBucketObjectLock/PutObjRetention
RGWPutBucketObjectLock was not calling get_params(), so the 'data' it
was trying to parse was empty

RGWPutObjRetention was calling get_params() a second time, which
overwrote the 'data' from the first call

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-28 14:54:58 -04:00
Sage Weil
b4757f32a7 Merge PR #28491 into master
* refs/pull/28491/head:
	doc/rados/operations: add safe-to-destroy check to OSD replacement workflow

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-06-28 13:44:18 -05:00
J. Eric Ivancich
36df505d55
Merge pull request #28781 from ivancich/wip-fix-source-permissions
src/: remove execute permissions on nine source files

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-28 13:00:00 -04:00
Neha Ojha
bad43f856d
Merge pull request #28775 from neha-ojha/wip-doc-delete-sleep
doc/rados/configuration/osd-config-ref.rst: document osd_delete_sleep

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-28 09:11:00 -07:00
J. Eric Ivancich
a8c0791334 misc: remove execute permissions on nine source files
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-06-28 11:33:08 -04:00
Matt Benjamin
277da96437
Merge pull request #28565 from linuxbox2/wip-rgwfile-eof
rgw_file: fix readdir eof() calc--caller stop implies !eof
2019-06-28 11:05:42 -04:00
Jason Dillaman
ca6bfd1914 qa/valgrind.supp: drop boost::lockfree::queue suppression
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-06-28 10:56:16 -04:00
Jason Dillaman
b595568218 cmake: boost valgrind fixes for boost::lockfree::queue
The issue has been fixed upstream under lockfree commit
7e23dac52d08ed1a099de9a6fb8bcdefbb06d2da but is not yet available in
a boost release.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-06-28 10:56:03 -04:00
Varsha Rao
709f76c528 doc: Updates link to Sepia lab
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-06-28 19:47:50 +05:30
Jason Dillaman
a28d3207e4
Merge pull request #28761 from lixiaoy1/pmem_osd
os/bluestore: fix pmem osd build problem

Reviewed-by: Jason Dillaman <dllaman@redhat.com>
2019-06-28 07:42:43 -04:00
Kefu Chai
7a31610dd1
Merge pull request #28776 from badone/wip-minimimal-config-no-longer-valid
do_cmake.sh: Add a heading to the minimal config

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-28 17:38:40 +08:00
lixiaoy1
6f842ac6af os/bluestore: fix pmem osd build problem
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2019-06-28 04:45:43 -04:00
Brad Hubbard
f313ea3948 do_cmake.sh: Add a heading to the minimal config
Post #28634 the minimal ceph config is invalid without a header.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-06-28 15:46:30 +10:00
Kefu Chai
4987bea98c
Merge pull request #28771 from athanatos/sjust/wip-schedule-event-on-commit
crimson/osd/pg: start_operation for read_state, schedule_event_on_commit

Reviewed-by: Yingxin Cheng <yingxincheng@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-28 12:14:19 +08:00
Neha Ojha
981babc8fa doc/rados/configuration/osd-config-ref.rst: document osd_delete_sleep
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-27 17:21:58 -07:00
Samuel Just
517ba56868 crimson/osd/pg: start_operation for read_state, schedule_event_on_commit
This way they'll be holding the appropriate pipeline stage.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-06-27 12:38:17 -07:00