Commit Graph

71891 Commits

Author SHA1 Message Date
Sage Weil
7e79a4eadc Merge pull request #14627 from badone/wip-peering-state-timing
osd: Implement peering state timing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-03 21:37:39 -05:00
Sage Weil
1de3820063 Merge pull request #14709 from majianpeng/luestore-txc-finalize-kv
os/blueStore: In osd_tp_thread, call _txc_finalize_kv.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-05-03 21:37:07 -05:00
Sage Weil
4a4f019418 Merge pull request #14932 from markhpc/wip-rocksdb-compaction-readahead
common/config_opts.h: compaction readahead for bluestore/rocksdb

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-03 21:36:20 -05:00
Kefu Chai
87633bd91f test/librbd: remove duplicated explicit template specializations
to avoid violation of ODR

Fixes: http://tracker.ceph.com/issues/18938
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-04 09:40:07 +08:00
Jason Dillaman
74bd4f230a rbd-mirror: ensure missing images are re-synced when detected
Fixes: http://tracker.ceph.com/issues/19811
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-03 21:36:21 -04:00
Vasu Kulkarni
df44582c91 default vpm is trusty and for master we need latest which is xenial
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-05-03 17:47:37 -07:00
Vasu Kulkarni
e58dd3938a install mgr on the node
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-05-03 16:47:14 -07:00
Casey Bodley
c124b05e91 Merge pull request #14879 from wjwithagen/wip-wjw-reduce-noise-3
cls/log/cls_log.cc: reduce logging noise

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 13:19:29 -04:00
Kefu Chai
bd41cc3746 Merge pull request #14928 from drunkard/master
doc: remove deprecated subcommand in man/8/ceph.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-04 00:31:21 +08:00
Yuri Weinstein
1cce4c7f68 Merge pull request #14723 from neha-ojha/objclass-sdk
osd: objclass sdk

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-03 09:28:59 -07:00
Yuri Weinstein
45d13a477a Merge pull request #14917 from yuriw/wip-add-overrite-cls
qa/added overrides

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-03 09:27:30 -07:00
Willem Jan Withagen
d76010900b cls/log/cls_log.cc: reduce logging noise
- The other reference in the source as already at 20.
      ./src/cls/timeindex/cls_timeindex.cc:85:
	CLS_LOG(20, "storing entry at %s", index.c_str());

   And we need not always know where in the log items are stored.
   So it looks like a leftover debug feature.

Fixes: http://tracker.ceph.com/issues/19835
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-05-03 18:07:23 +02:00
Kefu Chai
33cdc2aa0f Merge pull request #14913 from liewegas/wip-19826
mon: do not prime_pg_temp creating pgs; clean up pg create conditions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-03 23:56:07 +08:00
Jianpeng Ma
fcc7799e0a common/Finisher: No waite_for_empty no signal.
Avoid every time to send a signal because wait_for_empty is rare event.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 23:37:52 +08:00
Casey Bodley
21a943da45 rgw: RGWPeriodPusher spawns http thread before cr thread
Fixes: http://tracker.ceph.com/issues/19834

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 11:32:38 -04:00
Casey Bodley
c61cdeeb99 radosgw-admin: 'period pull' reads endpoints from current period
by finding remote endpoints from the current period, 'period pull' no
longer needs to initialize RGWRados for zone[group]_conn_map

Fixes: http://tracker.ceph.com/issues/19554

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
ec2a866cf7 radosgw-admin: commit_period gets remote connection from new period
Fixes: http://tracker.ceph.com/issues/19554

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
416b41acea radosgw-admin: send_to_remote_gateway takes RGWRESTConn*
callers are responsible for providing their own remote connection

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
f527342a8d radosgw-admin: get remote connections from given period/zonegroup
helper functions to create connections to arbitrary remotes, rather
than depending on RGWRados to construct them in zone[group]_conn_map

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
d53c0591d4 rgw: enable move on RGWRESTConn
added custom move construct/assign because std::atomic is not movable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:23 -04:00
Jason Dillaman
6d42133cf3 rbd: removed spurious error message from mirror pool commands
If the pool was empty, the rbd CLI would report the error
"rbd: failed to list images within pool".

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-03 10:49:09 -04:00
Jianpeng Ma
ca9335c52f common/Finisher: batch handle perfcounter.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 22:13:34 +08:00
Jianpeng Ma
671fc9144c common/perf_counter: make tinc() handle batch-processing
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 22:13:31 +08:00
Mark Nelson
b110a353f0 common/config_opts.h: compaction readahead for bluestore/rocksdb
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-05-03 07:34:55 -05:00
Mykola Golub
dd75531298 Merge pull request #14903 from dillaman/wip-19413
cls_rbd: default initialize snapshot namespace for legacy clients

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-03 15:25:12 +03:00
Mykola Golub
1698b8f13b Merge pull request #14875 from dillaman/wip-rbd-trash-parent
rbd: info command should indicate if parent is in trash

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-03 15:24:30 +03:00
Sage Weil
7d392de48b Merge pull request #14929 from tchaikov/wip-disable-isal-on-arm
test/compressor: disable isal tests if not available

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-03 07:23:10 -05:00
Kefu Chai
da1161cbd8 qa/tasks/ceph_manager: always fix pgp_num when done with thrashosd task
Fixes: http://tracker.ceph.com/issues/19771
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 18:28:27 +08:00
Kefu Chai
4da64aa5ab logclient: use the seq id of the 1st log entry when resetting session
because do_log() does not update last_log (see LogClient::get_next_seq())
and log_queue atomically, and log_queue is updated *after* last_log, so
we can not use them to figure out the number of log entries to be sent.
so, we choose to trust log_queue in this change.

Fixes: http://tracker.ceph.com/issues/19427
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 17:04:38 +08:00
Kefu Chai
b71ca04489 test/compressor: disable isal tests if not available
the isal-zlib compressor plugin is not supported on non-intel archs, and
if the user does not have a capable yasm compiler, neither will he/she
get this plugin.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 16:24:28 +08:00
Drunkard Zhang
2df20b2b4b doc: cleanup in doc/man/8/ceph.rst
Subcommand doc has been removed in 904913b37f,
this is cleanup.

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-05-03 15:45:35 +08:00
John Spray
43d26b9147 systemd: update mgr auth caps
Granting it 'allow *' on mon and osd so that
it can use MCommand to remote control daemons.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
John Spray
3746e209d8 mgr: embed Client instance for mds_command
Now plugins can talk to MDS daemons.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
John Spray
bff87c5555 client: enable using external Objecter
To enable places that already have an objecter
(such as ceph-mgr) to avoid spinning up another
one inside Client.

This will also be a path to re-using the librados
objecter in multiple instances of libcephfs in the
same process, a la nfs-ganesha.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
Jos Collin
e348713003 dmclock: ‘std::function’ has not been declared
The following error appears during make:

ceph/src/dmclock/test/test_test_client.cc:14:0:
ceph/src/dmclock/test/../sim/src/sim_recs.h:40:12: error: ‘std::function’ has not been declared
       std::function<void()> code) {

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-05-03 10:18:54 +05:30
Yan, Zheng
d0b3d4aee0 Merge pull request #14822 from jan--f/fuse-normalize-wire-o_flags
fs/ceph-fuse: normalize file open flags on the wire
2017-05-03 11:11:57 +08:00
Kefu Chai
a9fdc4aad4 Merge pull request #14909 from joscollin/wip-dmclock-error
dmclock: error: ‘function’ in namespace ‘std’ does not name a template type

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-03 11:07:29 +08:00
Kefu Chai
c26d30de9e Merge pull request #14748 from smithfarm/wip-teuthology-worker
doc: mention teuthology-worker security group

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-05-03 11:01:20 +08:00
John Spray
abd9f26793 pybind/rados: enable construction with CephContext
The CephContext pointer is passed around inside
a Python capsule.  It would have initially been
created by some other (non-cython) bit of C++
code, such as ceph-mgr.

This enables mgr modules to instantiate librados
with all the same config/auth/id as the mgr daemon
that they are running within.  Useful if you
want to spin up e.g. a librbd instance.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
07cae6214b mgr: add get_context() to python interface
For modules that would like a CephContext* inside
a capsule, suitable for passing to librados constructor.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
92a894c53f vstart: give mgr full mds/osd caps for tell
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
954c0b9c90 mgr: expose tell (MMonCommand) functionality
To enable plugins to talk directly to daemons when they
want to.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
562089d2a1 mgr: expose Objecter to PyModules
Same motivation as exposing MonClient: so that modules
can get at the command sending code.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
Sage Weil
d7cd4ad2e3 mon/OSDMonitor: skip new pgs for prime_pg_temp
If the pg didn't previously exist we don't need to (and can't) prime
pg_temp for it.  This avoids crashing on mapping.get().

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-02 20:42:34 -05:00
Yuri Weinstein
9cb79d2fe3 qa/added overrides
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2017-05-02 15:06:49 -07:00
Jason Dillaman
f6531fd077 qa/workunits/rbd: add additional OpenStack services
The Ocata release requires additional services to be running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-02 15:43:36 -04:00
Casey Bodley
b4655405d5 Merge pull request #14412 from mikulely/cleanup-civetweb-port
rgw: drop unused port var

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-02 13:05:00 -04:00
Yuri Weinstein
279050e4eb Merge pull request #13451 from xiexingguo/wip-add-up-primary-sum
mon/PGMap: add up_primary pg number field for pg-dump cmd

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-02 09:09:10 -07:00
Yuri Weinstein
0fd1689cf8 Merge pull request #14497 from tchaikov/wip-pybind-better-error-msg
pybind: better error msg

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-02 09:07:29 -07:00
Yuri Weinstein
35171b97a3 Merge pull request #14687 from jcsp/wip-mgr-suite
qa/suites: move mgr tests into rados suite

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 09:06:51 -07:00