Commit Graph

50031 Commits

Author SHA1 Message Date
Casey Bodley
be06128bfe rgw: remove unused RGWRemoteMetaLog::list_shards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:18 -08:00
Casey Bodley
c13e7ee74a rgw: remove unused class RGWReadMDLogShardInfo
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:18 -08:00
Casey Bodley
10cdb8866b rgw: remove unused clone_shards() in metadata sync
clone_shards() was an exact duplicate for fetch()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:18 -08:00
Casey Bodley
1999c57d8c rgw: remove unneeded RGWRados arg for RGWMetadataLog
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:18 -08:00
Orit Wasserman
3cb199a457 rgw: we need to clear the id in create_default in case of a race
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-02-18 14:04:18 -08:00
Yehuda Sadeh
10cda14b51 rgw-admin: command to list sync error logs
$ radosgw-admin sync error list

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 14:04:18 -08:00
Yehuda Sadeh
288501429e rgw: set quota when converting regionmap
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 13:56:51 -08:00
Jason Dillaman
3d8d9da348 librbd: update image name upon rename operations
Previously the image could not have been renamed twice without
re-opening the image.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:51 -05:00
Jason Dillaman
ad78558a66 librbd: missing owner lock on snap rollback cache invalidation
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:51 -05:00
Jason Dillaman
e01b406762 librbd: journal replay should execute ops in clean context
lockdep will complain about loop cycles that won't cause an
issue in reality as replay and record are two different
journal states.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:51 -05:00
Jason Dillaman
bc2ae0ef56 librbd: use AIO notifications to prevent blocking ops
If two or more images share the same CephContext, notifications
from one image can block the work queue which will potentially
block acknowledging the notification until after it times out.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:51 -05:00
Jason Dillaman
9d0b5b9e5e librbd: cleanup header update notifications
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:51 -05:00
Jason Dillaman
2c656171e4 Revert "librbd: lock notifications should be executed outside librados thread"
This reverts commit d898995b0e.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:50 -05:00
Jason Dillaman
dd5c9e5503 librbd: support for AIO notifications
The header update and lock notifications might be invoked
from the librados AIO thread.  Update the close state
machine to flush any potential AIO notifications.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 15:45:50 -05:00
Greg Farnum
12a55d6b1a rstats: enable by default on client; move test workunit to its own dir
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-02-18 12:44:22 -08:00
Gregory Farnum
957c77d570 Merge pull request #7323 from ukernel/wip-client-dirsize
client: add option to control how directory size is calculated

This lets you disable rstats if your workload is unhappy about directories
changing size (eg, tar of recently-moved/created/untarred files).

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-02-18 12:47:05 -08:00
Yehuda Sadeh
3687a0d9fd Merge pull request #7457 from weiqiaomiao/w1
Rgw: check the return value when call fe->run()

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 08:16:23 -08:00
Yehuda Sadeh
210b075d02 Merge pull request #7666 from rzarzynski/wip-rgw-sysreq-over-swift
rgw: add support for system requests over Swift API

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 08:08:13 -08:00
Yehuda Sadeh
55689f9b4f Merge pull request #7678 from linuxbox2/rgw-sigusr1
rgw: move signal.h dependency from rgw_front.h

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 08:04:19 -08:00
Loic Dachary
ff9f928821 Merge pull request #7 from Abhishekvrshny/fix-release-notes-unicode
Fix unicode encoding for non-ASCII characters in title and author names

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-02-18 22:15:24 +07:00
Abhishek Varshney
284075cc0f Fix unicode encoding for non-ASCII characters in title and author names
Signed-off-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2016-02-18 20:38:57 +05:30
Greg Farnum
bf24e351d9 Merge branch 'greg-pr-7034' 2016-02-18 06:41:23 -08:00
Kefu Chai
138d771862 Merge pull request #7679 from linuxbox2/rgw-ssconst
sstring.hh: return type from str_len(...) need not be const

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-18 21:58:19 +08:00
Mehdi Abaakouk
0fb387faed pybind: rados cleanup
This change uses:
* a pystring to store ioctx state like other state attributes and like
  previous binding
* use __dealloc__ instead of __del__ to ensure Object are freed correctly

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-18 11:26:26 +01:00
Loic Dachary
b3f8dd8c79 scripts: ceph-release-notes fixes --strict
When --strict,

* Do not take into account the merge message. This is is not used
  for backports
* Avoid duplicates by storing the issues in a set
* Display the list of PRs when more than one are found for a single
  issue.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-18 15:10:14 +07:00
Loic Dachary
b7524c0a68 release-notes: draft v0.94.6 release notes
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-18 15:09:44 +07:00
Dongsheng Yang
7ee9968971 ceph-disk: make some arguments as required if necessary
There is no default value for these arguments, and they are
necessary. Then make them as required.

Fixes 9666

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2016-02-18 13:54:02 +08:00
Gregory Farnum
037852eab5 Merge pull request #7684 from ceph/wip-pybind-install
pybind: use correct subdir for rados install-exec rule

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-02-17 16:45:10 -08:00
Greg Farnum
493a073e99 Merge branch 'wip-sharded-scan' of git://github.com/jcsp/ceph into greg-pr-7034
Conflicts:
	src/osdc/Objecter.cc
2016-02-17 15:49:51 -08:00
Josh Durgin
c8b9a79bbd pybind: use correct subdir for rados install-exec rule
This fixes package builds and 'make install'

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-02-17 15:44:45 -08:00
Josh Durgin
196d324b09 Merge pull request #7621 from sileht/sileht/rados-cython
python binding of librados with cython

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-17 10:05:20 -08:00
Radoslaw Zarzynski
aa87becbeb rgw: remove unnecessary overloads in RGWHTTPArgs.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-17 18:30:06 +01:00
Matt Benjamin
27b991a55d sstring.hh: return type from str_len(...) need not be const
Removes a compile warning.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-17 11:17:22 -05:00
Matt Benjamin
ebfc6bfd10 rgw: move signal.h dependency from rgw_front.h
Missed in refactoring of rgw_main.cc.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-02-17 10:46:21 -05:00
Mehdi Abaakouk
67f95c8f66 Update the documentation
Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 15:16:56 +01:00
Mehdi Abaakouk
c4162b5988 librbdpy: Use new rados lib
Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 12:32:39 +01:00
Mehdi Abaakouk
7216b06bc5 ceph.in: Use new python rados module
This implements run_in_thread inside the ceph command itself.

And fixes the ceph command bootstrap when it run inside the
source tree to correctly load the new rados python module.

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 12:32:38 +01:00
Mehdi Abaakouk
82869f004e Fix rpm/deb packaging
Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 12:32:38 +01:00
Mehdi Abaakouk
3c40524042 Remove old rados pybinding
Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 12:32:38 +01:00
Mehdi Abaakouk
9997b32d0b Cython Rados module
Notable changes:

* run_in_thread have disapeared
* timeout argument of some methods are ignored
* rados_create_write_op/rados_create_read_op returns WriteOp/ReadOp
  instead of the pointer address
* rados_monitor_log callback 'arg' arguments was broken in previous python
  binding (callback was called with the pointer address instead pointed object)
* object attributes that was pointer addresses are now private and not accessible in python

Some tests have been added to cover all methods

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-17 12:32:38 +01:00
Kefu Chai
22c6d3549e Merge pull request #7603 from roidayan/xio_fixes
Xio fixes

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-02-17 17:21:29 +08:00
Josh Durgin
a2c90b513b Revert "librbd: use task finisher per CephContext"
Since notify handling was made async from the librados threads in
d898995b0e tests can crash during
image close when exclusive locking is enabled.

This occurs because flushing the watches no longer guarantees that all
notifies have been completely handled, and since these are run from
the TaskFinisher attached to the CephContext, notifies added to the
TaskFinisher run after the ImageCtx they refer to has been
destroyed. The notify for exclusive lock release runs into this in
this case.

Looking into this also made me notice that sharing a single
TaskFinisher is not safe currently since all events are cancelled by
ImageWatcher::unregister_watch(), not just those scheduled by that
image.

Example crash backtrace from test_rbd.py:

    at librados/IoCtxImpl.cc:1332

This reverts commit 96563c1515.

Fixes: #14780
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-02-16 17:12:31 -08:00
Radoslaw Zarzynski
52b7f1d696 rgw: support system requests over Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-16 23:54:07 +01:00
Radoslaw Zarzynski
cd357b6a49 rgw: enable access to system arguments of RGWHTTPArgs.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-16 23:54:07 +01:00
Mehdi Abaakouk
d3ac713d88 Move pybind rbd module into it own directory
To allow to create a autonomous rados module with cython.
We move the current librbdpy to the rbd sub directory.

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-16 18:41:09 +01:00
Kefu Chai
64c1d54354 Merge pull request #7520 from renhwsky/renhw-wip-mon-monitor
mon/monitor: some clean up

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-16 22:04:24 +08:00
Gregory Farnum
fd4d97c027 Merge pull request #7629 from ceph/wip-14750-op-timeouts
Objecter: detect laggy ops with objecter_timeout, not osd_timeout

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2016-02-15 20:39:55 -08:00
Gregory Farnum
0284090464 Merge pull request #7655 from gregsfortytwo/wip-metarequest-lock
client: removed unused Mutex from MetaRequest

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2016-02-15 20:36:47 -08:00
Gregory Farnum
42afb5b523 Merge pull request #7616 from gregsfortytwo/wip-timer-14697
mds: don't double-shutdown the timer when suiciding

Reviewed-by: John Spray <john.spray@redhat.com>
2016-02-15 20:35:32 -08:00
Gregory Farnum
da83441201 Merge pull request #7490 from x11562/mds_mdstype_ref
mds: function parameter 'df' should be passed by reference

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-02-15 20:34:43 -08:00