Commit Graph

73550 Commits

Author SHA1 Message Date
Orit Wasserman
1ee15336da rgw: get_bucket_header will return -ENOENT when there is no header
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:39 -07:00
Orit Wasserman
f384708196 rgw: add guard class for bucket index lock
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:39 -07:00
Orit Wasserman
830ea53831 rgw: add reshard_pool_ctx
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:38 -07:00
Orit Wasserman
be156d086d rgw: check for exisiting entries in cls_rgw_reshard_add
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:38 -07:00
Orit Wasserman
0af96c178a rgw: use pointer for is_truncated
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:38 -07:00
Orit Wasserman
ea334d3fdf rgw: cls_rgw_reshard use helper function the generate key
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:37 -07:00
Orit Wasserman
ae6a5eac37 rgw: limit op.max and add extra entry to handle tuncation in cls_rgw_reshard_list
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:37 -07:00
Orit Wasserman
59c0c30ac0 rgw: use .rgw.log:reshard pool for resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:37 -07:00
Orit Wasserman
a7154a6a73 rgw: remove RGWReshard::get_head
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:36 -07:00
Orit Wasserman
5828d4a670 rgw: replace dout with ldout
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:36 -07:00
Orit Wasserman
822a5fbd47 rgw: remove cls_reshard_get_head
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:36 -07:00
Orit Wasserman
149bfc4337 rgw: store resharding information in bucket header
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:35 -07:00
Orit Wasserman
9e43e7f0bb rgw: handle correctly when there is no bucket or it doesn't have resharding flag
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:35 -07:00
Orit Wasserman
3b41ca025b rgw: block on bucket index operation when resharding the index
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:35 -07:00
Orit Wasserman
18c16f971e rgw: add RGWReshard object to RGWRados
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:34 -07:00
Orit Wasserman
c000a15fed rgw: Add lock/unlock bucket instance and block_while_resharding methods
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:34 -07:00
Orit Wasserman
2d23898b27 rgw: add cls_rgw_get_resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:34 -07:00
Orit Wasserman
11e7cb1eb4 radosgw-admin: implement reshard execute command
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:33 -07:00
Orit Wasserman
3858171490 radsogw-admin add create_new_bucket_instance
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:32 -07:00
Orit Wasserman
8e30c37865 rgw: use const string for oid in get_bucket_instance_from_oid
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:32 -07:00
Orit Wasserman
8b497b06d7 rgw: add RGWReshard::clear_bucket_resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:31 -07:00
Orit Wasserman
0f53c5dce5 rgw: add RGWReshard::set_bucket_resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:31 -07:00
Orit Wasserman
98d85722a3 rgw: add missing handles for set_resharding, clear_resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:17:14 -07:00
John Spray
f76208cbec doc: fix syntax on code snippets in cephfs/multimds
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-05 20:46:06 +01:00
Sage Weil
e320c24286 mon/LogMonitor: 'log last [num]' command
Default to 20 lines of log if not specified.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 15:37:15 -04:00
Sage Weil
0ee4bafff6 common/LogEntry: make LogSummary::contains() efficient
A linear search here is dumb.  Use an unordered_set.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 15:31:05 -04:00
Sage Weil
f1239e2e80 common/LogEntry: make prune size tunable (and raise 50 -> 1024)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 15:17:44 -04:00
Willem Jan Withagen
591e8d1314 core: include/types.h, introduce host_to_ceph_errno
- As preparation for interconnecting ceph_daemons on
   different platfoms

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-06-05 21:05:28 +02:00
Sage Weil
3134fbbea5 Merge pull request #14657 from chardan/jfw-wip-halflife_atomic_t-mothra
messenger,client,compressor: migrate atomic_t to std::atomic

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 13:35:27 -05:00
Sage Weil
92d4866b6e Merge pull request #15380 from xiexingguo/wip-cache-trim
os/bluestore: move cache_trim into MempoolThread

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-06-05 13:35:01 -05:00
Sage Weil
52a983080c Merge pull request #15409 from Liuchang0812/wip-support-mon-target-in-pybind
pybind: support mon target in pybind

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-05 13:34:33 -05:00
Sage Weil
765b9d25e4 Merge pull request #15469 from wjwithagen/wip-wjw-revert-wvla
build: revert -Wvla from #15342

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 13:33:41 -05:00
Sage Weil
06f097c4ac Merge pull request #15470 from xiexingguo/wip-rm-false-assert
os/bluestore: fix false asserts in Cache::trim_all()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 13:33:16 -05:00
Sage Weil
ac7c2c1174 Merge pull request #15478 from xiexingguo/wip-perf-avg-time
common/perf_counters: add average time for PERFCOUNTER_TIME

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 13:32:53 -05:00
Sage Weil
3f32f34082 qa/workunits/cephtool/test.sh: fix osd full health detail grep
This changed with the switch to OSDMonitor doing the fullness
and pgmonitor getting disabled.

Fixes: http://tracker.ceph.com/issues/20187
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 14:23:12 -04:00
Jason Dillaman
f1b05a2b06 rbd: properly decode features when using image name optional
Fixes: http://tracker.ceph.com/issues/20185
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-06-05 13:17:19 -04:00
Boris Ranto
e69086645d selinux: Install ceph-base before ceph-selinux
We need to have ceph-base installed before ceph-selinux to use ceph-disk
in %post script. The default ordering is random and so the installation
randomly failed to relabel the files.

Fixes: http://tracker.ceph.com/issues/20184
Signed-off-by: Boris Ranto <branto@redhat.com>
2017-06-05 18:49:06 +02:00
Sage Weil
6a4f651140 mgr/DaemonServer: stop spamming log with pg stats
This clutters up the log.  We should instead log to health, or other
important events.

Note that we still have ceph health logged at regular intervals, so some
of this will surface there.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 12:11:27 -04:00
Joao Eduardo Luis
e80faf198b doc/man: document new mon commands
Includes brief description for `ceph osd new`, `ceph osd destroy` and
`ceph osd purge`.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
8ab3a1dbf5 qa/workunits: add cephtool test for new commands
Tests `ceph osd new`, `ceph osd destroy` and `ceph osd purge`.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
9e0d3de6b2 qa/workunits: adjust expected return on cephtool
We changed the behavior of `osd create` to return EEXIST instead of
EINVAL if an uuid exists with a different `id` than the one the user
provides.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
b3464b3486 mon/OSDMonitor: make destroy and purge idempotent
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
0df321b5e4 mon/OSDMonitor: have create behavior on new
`osd new` will eventually replace `osd create`, and so we want to keep
as close of a behavior as possible. Some concessions needed to be made
however, specifically in terms of what the command arguments mean for
one command and the other.

For instance, and we think this is possibly the most contentious
decision, while specifying the `id` is absolutely optional, once it has
been specified we will take one of the following approaches:

 1. the osd is destroyed, and as such we will recreate the replacement
    osd.

 2. the osd exists and is not destroyed, thus we will assume it is an
    attempt at an idempotent operation; if not idempotent, fail because
    we then assume the osd was meant to be destroyed but it is not.

A commit should follow this patch series documenting the new commands.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
c9e6cac1cf mon: add osd new
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:41 +01:00
Joao Eduardo Luis
52c0bffb0e mon/OSDMonitor: rework osd create
We're splitting the chunk of code from `prepare_command_impl()` into two
functions: one will validate if we can perform the command, and the
other will perform the update.

This will allow us to reuse the code in `osd new`.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:40 +01:00
Joao Eduardo Luis
b115673771 mon/AuthMon: spin-off some functions for later reuse
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:40 +01:00
Joao Eduardo Luis
e5a867332e mon: add 'osd purge'
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:40 +01:00
Joao Eduardo Luis
a8b397a2b5 mon/OSDMonitor: spin-off osd and crush rm functions
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:40 +01:00
Joao Eduardo Luis
e1b2109400 mon/OSDMonitor: make them includes beautiful
These were annoying me.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-06-05 15:31:40 +01:00
Sage Weil
ba1ee4536f os/bluestore: fix warning
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-05 10:27:12 -04:00