Commit Graph

98299 Commits

Author SHA1 Message Date
Jason Dillaman
081b060820
Merge pull request #28009 from ricardoasmarques/rbd-feature-migrating
Add 'RBD_FEATURE_MIGRATING' to rbd.pyx

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-09 14:59:16 -04:00
Abhishek Lekshmanan
59c768713e doc: rgw: document v6 endpoint options
document that v6 endpoints only binds to ipv6

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-09 20:56:46 +02:00
Abhishek Lekshmanan
3a57fcdd11 rgw: beast: bind both v4 and v6 ports when using a port argument
This commit adds binding to both v4 and v6 port when specifying a port argument,
endpoint *only* binds to v4 or v6 depending on the address specified. Failure to
bind when the protocol is not supported is not treated as an error and we warn
and continue then.

Fixes: http://tracker.ceph.com/issues/39038
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-09 20:56:21 +02:00
Abhishek Lekshmanan
ef8329f203 doc: add a note on reshard object expirer fixes in PendingReleaseNotes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-09 20:51:50 +02:00
Abhishek Lekshmanan
40bf082da2 doc: add a troubleshooting note on resharding expirer fixes
Added a note about the commands added to support stale expired object deletion

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-09 20:51:50 +02:00
Jason Dillaman
6b4f9729fd msg/async: reduce verbosity of connection timeout failures
Long running clients connected to thrashing OSDs could result in a
"see no progress in more than <timeout>" message printed to stderr.
This is not an error but can result in test failures when console
output is compared against expected output.

Fixes: http://tracker.ceph.com/issues/39448
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-09 14:50:12 -04:00
Abhishek L
475a5b7a65
Merge pull request #27680 from theanalyst/aws-rest-fixes
rgw: rest client fixes for cloud sync XML outputs

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-05-09 19:55:17 +02:00
Mykola Golub
109267b5ee librados_test_stub: update get_min_compatible_osd to octopus
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:19:21 +01:00
Mykola Golub
1bc7b114ea cls/rbd: provide async version of copyup method
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:19:21 +01:00
Mykola Golub
00e3d9fbc4 librbd: allow to provide sparse read result
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:19:21 +01:00
Mykola Golub
5f0c2c434f osdc/striper: make possible to assemble sparse read result
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:11:46 +01:00
Mykola Golub
5992477013 librados_test_stub: pass snap context to "create" method
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:11:46 +01:00
Mykola Golub
02c8e8352e cls/rbd: add sparse_copyup method
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-05-09 18:11:46 +01:00
Igor Fedotov
054355934a os/bluestore: protect BlueFS::FileReader::buf
Now this buffer might be accessed from BlueRocksRandomAccessFile
which is intended for multi-threading access. Hence we need a
proper protection for the buffer.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-05-09 19:26:29 +03:00
letterwuyu
c04a3ccdd2 osd: make max_num_intervals of ObjectCleanRegions a configuration option
Signed-off-by: lishuhao <lishuhao@unitedstack.com>
2019-05-09 22:31:32 +08:00
Lenz Grimmer
37699d09cc
mgr/dashboard: Remove messages.xlf (#28020)
mgr/dashboard: Remove messages.xlf

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-09 16:28:06 +02:00
Casey Bodley
8df991c5cc test/rgw: add multisite test_bucket_creation_time()
does not create any buckets itself, but checks that all creation times
match on buckets created by other tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-09 10:07:55 -04:00
J. Eric Ivancich
12452c4a91 rgw: allow radosgw-admin to list bucket w --allow-unordered
Presently the `radosgw-admin bucket list --bucket=<bucket>` lists the
objects in lexical order. This can be an expensive operation since
objects are not stored in bucket index shards in order and a selection
sort process is done across all bucket index shards.

By allowing the user to add the "--allow-unordered" command-line flag,
a more efficient bucket listing is enabled. This is particularly
important for buckets with a large number of objects.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-09 09:29:05 -04:00
Kefu Chai
3f10752347
Merge pull request #27976 from mykaul/patch-2
doc: Update link to Red Hat documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-09 21:20:17 +08:00
Sidharth Anupkrishnan
9f40c783db qa: fs Ignore getfattr errors for ceph.dir.pin
Signed-off-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2019-05-09 18:46:21 +05:30
Kefu Chai
555f1e85f9 crimson/mon: run tick() periodically
also send keepalive to monitor in tick()

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-09 19:14:00 +08:00
Igor Fedotov
4f89409d41 os/bluestore: log 'buffered' in KernelDevice::read_random
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-05-09 14:13:42 +03:00
Igor Fedotov
f37cb01bc1 os/bluestore: support RocksDB prefetching at BlueFS
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-05-09 14:13:42 +03:00
Igor Fedotov
baee044eae os/bluestore: call BlueFS::_init_logger earlier.
So one can use perf counters during log replay.

Signed-off-by: Igor Fedotov <ifedotov@susu.com>
2019-05-09 14:13:42 +03:00
Igor Fedotov
55ffa5e943 tools/ceph-objectstore-tool: dump perf counters on competion.
Performed  if debug mode is enabled

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-05-09 14:13:42 +03:00
Igor Fedotov
dce3e2f3f4 os/bluestore: optimize mapping offset to extent in BlueFS.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-05-09 14:13:42 +03:00
Varsha Rao
e89287673c cephfs-shell: Fix mkdir relative path error
Directory is not created for relative path. This patch fixes it.

Fixes: https://tracker.ceph.com/issues/39507
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-09 16:22:45 +05:30
Sebastian Krah
170b964012 mgr/dashboard: Remove messages.xlf
Removes the messages.xlf file from the git repository, due to a lot of merge conflicts.
It won't cause any problems, because the file is not important for building or the translation during runtime.

Fixes: https://tracker.ceph.com/issues/38003
Signed-off-by: Sebastian Krah <skrah@suse.com>
2019-05-09 12:48:18 +02:00
Kefu Chai
86b5989175 crimson/mon: fix the v1 auth
* initialize mon::Connection::global_id to `0` in the ctor.
  global_id is assigned by monitor, a zero global_id implies
  that "allocate me a new global_id please". so we should
  never use a random number on stack for the global_id.
* do not use a magic number for initializing MAuth::protocol,
  use `CEPH_AUTH_UNKNOWN` instead.
* do not try to dereference `auth` before creating it. `auth`
  is created by `create_auth()`. in which, the global_id
  is always assigned to `auth->global_id`, as it's a new session.
  so we should just call `create_auth()`.
* restructure the code to finish the authentication. to remove
  the find_if(), and use the `parallel_for_each()` loop for
  both set the active_con and closing the other pending connections.
* ask for the rotating keyring once gets authenticated.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-09 17:51:38 +08:00
Zhi Zhang
751289118e mds: output lock state in format dump
dump cache in plain text will print lock state. But in json format dump,
it won't. It is not convenient to debug some MDS lock issues without
such information.

Fixes: http://tracker.ceph.com/issues/39645

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2019-05-09 17:07:24 +08:00
Sebastian Wagner
615b11b9c6
Merge pull request #26654 from sebastian-philipp/orchestrator-progress
mgr/orchestrator: add progress events to all orchestrators

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-05-09 10:41:53 +02:00
Varsha Rao
07263fe0f2 cephfs-shell: Add stat command
This patch adds stat command to cephfs-shell.

Fixes: https://tracker.ceph.com/issues/38829
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-05-09 13:53:04 +05:30
Yaniv Kaul
e54e6af80b doc: Update link to Red Hat documentation
The previous link was to version 2, which is a bit older. Fix to version 3.

Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
2019-05-09 15:37:41 +08:00
Kefu Chai
e2b3410ae9
Merge pull request #27855 from tchaikov/wip-ceph-release
src/: define ceph_release_t and use it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-09 15:16:31 +08:00
Kefu Chai
ad329c1fbf
Merge pull request #27689 from Jeegn-Chen/wip-39390-fix
os/filestore: assure sufficient leaves in pre-split

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-09 15:13:02 +08:00
Kefu Chai
e714a33b3f
Merge pull request #27925 from tchaikov/wip-38628
mgr/restful: do not use filter() for list

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2019-05-09 15:11:15 +08:00
Kefu Chai
3a0013f654
Merge pull request #27962 from xiexingguo/wip-jira-3756
mgr/DaemonServer: safe-to-destroy - do not consider irrelevant pgs

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-09 15:07:48 +08:00
Ricardo Dias
1d7506fdce
systemd: ceph-mgr: set MemoryDenyWriteExecute to false
Fixes: http://tracker.ceph.com/issues/39628

Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-05-09 07:36:43 +01:00
Milind Changire
d187e9b0a9 cephfs-shell: add quota management
Quotas can be managed by:
$ quota get dir
$ quota set {--max_files MAX_FILES} {--max_bytes MAX_BYTES} dir

Fixes: http://tracker.ceph.com/issues/39165
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-05-09 11:55:05 +05:30
Milind Changire
73ada8d1d9 cephfs-shell: teuthology tests
* mkdir
* get
* put

Fixes: http://tracker.ceph.com/issues/39526
Signed-off-by: Milind Changire <mchangir@redhat.com>
2019-05-09 11:37:31 +05:30
Josh Durgin
b37d107c2f
Merge pull request #28036 from neha-ojha/wip-fix-ar-doc
doc/dev/osd_internals/async_recovery: update cost calculation

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-08 22:27:37 -07:00
Josh Durgin
e17535ac37
Merge pull request #28034 from letterwuyu/forward_incompat_pg_missing
ceph-object-corpus: forward_incompat pg_missing_item and pg_missing_t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-08 22:07:37 -07:00
lishuhao
26db9afc62 ceph-object-corpus: forward_incompat pg_missing_item and pg_missing_t
Signed-off-by: lishuhao <lishuhao@unitedstack.com>
2019-05-09 12:33:31 +08:00
Neha Ojha
984073e44d doc/dev/osd_internals/async_recovery: update cost calculation
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-05-08 20:19:32 -07:00
Patrick Donnelly
8170b5d5f6
Merge PR #27688 into master
* refs/pull/27688/head:
	pybind: added lseek()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-08 15:57:00 -07:00
David Zafman
d1ad129dd4 osd: Remove unused pg_log_t::copy_range()
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-08 15:38:56 -07:00
David Zafman
b698e34fc8 osd: Fix off by 1 error in trim handling of osd_pg_log_dups_tracked
Move log message out of loop so it doesn't repeat for no reason

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-08 15:38:56 -07:00
Patrick Donnelly
8de2d27eaa
Merge PR #27482 into master
* refs/pull/27482/head:
	client: fix fuse client hang because its bad session PipeConnection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-08 14:51:22 -07:00
Patrick Donnelly
5e49c15d69
Merge PR #27761 into master
* refs/pull/27761/head:
	qa: use skipTest method instead of exception

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-05-08 14:48:03 -07:00
Patrick Donnelly
aede929b67
Merge PR #27480 into master
* refs/pull/27480/head:
	mds: check dir fragment to split dir if mkdir makes it oversized.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-05-08 14:40:42 -07:00