Commit Graph

72011 Commits

Author SHA1 Message Date
Jianpeng Ma
fcc7799e0a common/Finisher: No waite_for_empty no signal.
Avoid every time to send a signal because wait_for_empty is rare event.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 23:37:52 +08:00
Casey Bodley
21a943da45 rgw: RGWPeriodPusher spawns http thread before cr thread
Fixes: http://tracker.ceph.com/issues/19834

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 11:32:38 -04:00
Sage Weil
041e308520 os/bluestore/BlueFS: _write_super is always synchronous
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-03 10:23:01 -05:00
Sage Weil
beed83f764 os/bluestore/KernelBlockDevice: sync write() method
Avoid aio machinery (and context switching) and do a simple
synchronous (O_DIRECT) write.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-03 10:23:01 -05:00
Casey Bodley
c61cdeeb99 radosgw-admin: 'period pull' reads endpoints from current period
by finding remote endpoints from the current period, 'period pull' no
longer needs to initialize RGWRados for zone[group]_conn_map

Fixes: http://tracker.ceph.com/issues/19554

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
ec2a866cf7 radosgw-admin: commit_period gets remote connection from new period
Fixes: http://tracker.ceph.com/issues/19554

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
416b41acea radosgw-admin: send_to_remote_gateway takes RGWRESTConn*
callers are responsible for providing their own remote connection

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
f527342a8d radosgw-admin: get remote connections from given period/zonegroup
helper functions to create connections to arbitrary remotes, rather
than depending on RGWRados to construct them in zone[group]_conn_map

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:33 -04:00
Casey Bodley
d53c0591d4 rgw: enable move on RGWRESTConn
added custom move construct/assign because std::atomic is not movable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-03 10:52:23 -04:00
Jason Dillaman
6d42133cf3 rbd: removed spurious error message from mirror pool commands
If the pool was empty, the rbd CLI would report the error
"rbd: failed to list images within pool".

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-03 10:49:09 -04:00
Jianpeng Ma
ca9335c52f common/Finisher: batch handle perfcounter.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 22:13:34 +08:00
Jianpeng Ma
671fc9144c common/perf_counter: make tinc() handle batch-processing
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-03 22:13:31 +08:00
Mark Nelson
b110a353f0 common/config_opts.h: compaction readahead for bluestore/rocksdb
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2017-05-03 07:34:55 -05:00
Mykola Golub
dd75531298 Merge pull request #14903 from dillaman/wip-19413
cls_rbd: default initialize snapshot namespace for legacy clients

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-03 15:25:12 +03:00
Mykola Golub
1698b8f13b Merge pull request #14875 from dillaman/wip-rbd-trash-parent
rbd: info command should indicate if parent is in trash

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-03 15:24:30 +03:00
Sage Weil
7d392de48b Merge pull request #14929 from tchaikov/wip-disable-isal-on-arm
test/compressor: disable isal tests if not available

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-03 07:23:10 -05:00
Kefu Chai
da1161cbd8 qa/tasks/ceph_manager: always fix pgp_num when done with thrashosd task
Fixes: http://tracker.ceph.com/issues/19771
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 18:28:27 +08:00
Kefu Chai
4da64aa5ab logclient: use the seq id of the 1st log entry when resetting session
because do_log() does not update last_log (see LogClient::get_next_seq())
and log_queue atomically, and log_queue is updated *after* last_log, so
we can not use them to figure out the number of log entries to be sent.
so, we choose to trust log_queue in this change.

Fixes: http://tracker.ceph.com/issues/19427
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 17:04:38 +08:00
Kefu Chai
b71ca04489 test/compressor: disable isal tests if not available
the isal-zlib compressor plugin is not supported on non-intel archs, and
if the user does not have a capable yasm compiler, neither will he/she
get this plugin.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-05-03 16:24:28 +08:00
Drunkard Zhang
2df20b2b4b doc: cleanup in doc/man/8/ceph.rst
Subcommand doc has been removed in 904913b37f,
this is cleanup.

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-05-03 15:45:35 +08:00
fang yuxiang
4e21f7ea21 rgw: don't do unneccesary write if buffer with zero length
Don't do unneccesary write if buffer with zero length,
or there will be one more shadow stripe rados object with size 0

Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>
2017-05-03 14:01:42 +08:00
John Spray
43d26b9147 systemd: update mgr auth caps
Granting it 'allow *' on mon and osd so that
it can use MCommand to remote control daemons.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
John Spray
3746e209d8 mgr: embed Client instance for mds_command
Now plugins can talk to MDS daemons.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
John Spray
bff87c5555 client: enable using external Objecter
To enable places that already have an objecter
(such as ceph-mgr) to avoid spinning up another
one inside Client.

This will also be a path to re-using the librados
objecter in multiple instances of libcephfs in the
same process, a la nfs-ganesha.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 13:37:52 +08:00
Jos Collin
e348713003 dmclock: ‘std::function’ has not been declared
The following error appears during make:

ceph/src/dmclock/test/test_test_client.cc:14:0:
ceph/src/dmclock/test/../sim/src/sim_recs.h:40:12: error: ‘std::function’ has not been declared
       std::function<void()> code) {

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-05-03 10:18:54 +05:30
Yan, Zheng
d0b3d4aee0 Merge pull request #14822 from jan--f/fuse-normalize-wire-o_flags
fs/ceph-fuse: normalize file open flags on the wire
2017-05-03 11:11:57 +08:00
Kefu Chai
a9fdc4aad4 Merge pull request #14909 from joscollin/wip-dmclock-error
dmclock: error: ‘function’ in namespace ‘std’ does not name a template type

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-03 11:07:29 +08:00
Kefu Chai
c26d30de9e Merge pull request #14748 from smithfarm/wip-teuthology-worker
doc: mention teuthology-worker security group

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-05-03 11:01:20 +08:00
John Spray
abd9f26793 pybind/rados: enable construction with CephContext
The CephContext pointer is passed around inside
a Python capsule.  It would have initially been
created by some other (non-cython) bit of C++
code, such as ceph-mgr.

This enables mgr modules to instantiate librados
with all the same config/auth/id as the mgr daemon
that they are running within.  Useful if you
want to spin up e.g. a librbd instance.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
07cae6214b mgr: add get_context() to python interface
For modules that would like a CephContext* inside
a capsule, suitable for passing to librados constructor.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
92a894c53f vstart: give mgr full mds/osd caps for tell
Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
954c0b9c90 mgr: expose tell (MMonCommand) functionality
To enable plugins to talk directly to daemons when they
want to.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
John Spray
562089d2a1 mgr: expose Objecter to PyModules
Same motivation as exposing MonClient: so that modules
can get at the command sending code.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-03 10:37:17 +08:00
Sage Weil
d7cd4ad2e3 mon/OSDMonitor: skip new pgs for prime_pg_temp
If the pg didn't previously exist we don't need to (and can't) prime
pg_temp for it.  This avoids crashing on mapping.get().

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-02 20:42:34 -05:00
Yuri Weinstein
9cb79d2fe3 qa/added overrides
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2017-05-02 15:06:49 -07:00
Jason Dillaman
f6531fd077 qa/workunits/rbd: add additional OpenStack services
The Ocata release requires additional services to be running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-02 15:43:36 -04:00
Casey Bodley
b4655405d5 Merge pull request #14412 from mikulely/cleanup-civetweb-port
rgw: drop unused port var

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-02 13:05:00 -04:00
Yuri Weinstein
279050e4eb Merge pull request #13451 from xiexingguo/wip-add-up-primary-sum
mon/PGMap: add up_primary pg number field for pg-dump cmd

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-02 09:09:10 -07:00
Yuri Weinstein
0fd1689cf8 Merge pull request #14497 from tchaikov/wip-pybind-better-error-msg
pybind: better error msg

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-02 09:07:29 -07:00
Yuri Weinstein
35171b97a3 Merge pull request #14687 from jcsp/wip-mgr-suite
qa/suites: move mgr tests into rados suite

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 09:06:51 -07:00
Yuri Weinstein
3dbc29ba75 Merge pull request #14810 from liewegas/wip-status
mon: show inactive % in ceph status

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-02 09:06:13 -07:00
Yuri Weinstein
76e94a0a11 Merge pull request #14821 from badone/wip-no-death-coredumps
tests: Don't dump core when using EXPECT_DEATH

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-02 09:05:32 -07:00
Yuri Weinstein
0807f384bf Merge pull request #14857 from joscollin/wip-arch-cpuid
arch: use __get_cpuid instead of do_cpuid

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-02 09:04:09 -07:00
Sage Weil
94a873090e Merge pull request #12669 from hjwsm1989/unfound-objects
osd/PG: fix possible overflow on unfound objects

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-05-02 10:54:19 -05:00
Sage Weil
56104449da Merge pull request #12882 from wonzhq/pglog-fixes
osd: pglog trimming fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 10:53:26 -05:00
Sage Weil
fcd64d75ab Merge pull request #14444 from liewegas/wip-past-intervals
osd: simplify past_intervals representation

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-02 10:51:37 -05:00
Sage Weil
3b4e4d0077 Merge pull request #14898 from tchaikov/wip-clean-pending_created_pgs
mon/OSDMonitor: cleanup pending_created_pgs after done with it

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 10:51:12 -05:00
Sage Weil
7f97f363e8 Merge pull request #14904 from tchaikov/wip-19638-followon
osd: stop mgrc earlier in shutdown()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 10:50:52 -05:00
Sage Weil
3e53e47e6b osd: fix legacy pg create conditions
1- in reality we don't really care if pg_temp is set.
2- compare against acting_primary since that's what actually matters.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-02 10:49:28 -05:00
Sage Weil
003113ff67 mon/OSDMonitor: fix prime_pg_temp vs creating condition
We want to *skip* creating PGs.

Fixes: http://tracker.ceph.com/issues/19826
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-02 10:49:00 -05:00