1
0
mirror of https://github.com/ceph/ceph synced 2025-03-11 02:39:05 +00:00
Commit Graph

82450 Commits

Author SHA1 Message Date
Nathan Cutler
e020ec3343 build/ops: cmake: do not guard certain tools with WITH_TESTS
As a follow-up to d7b493a710 we need to stop guarding

    ceph-osdomap-tool
    ceph-monstore-tool

with WITH_TESTS because they have been moved out of the ceph-test package.

(N.B. ceph-kvstore-tool was also moved out of ceph-test, but apparently never
had the guard.)

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 23:20:57 +01:00
Nathan Cutler
d048cb2cd8 build/ops: rpm: let ctest benefit from memory calculation
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 23:20:57 +01:00
Nathan Cutler
0cf627b4e3 build/ops: rpm: override %_smp_mflags if not enough memory
Sometimes the build machine has lots of processor cores and not enough
memory to successfully build Ceph on all of them at once. Calculate
how many parallel build processes we can sustain with the memory we
have and set a lower build parallelism if necessary. Never exceed
the value set by %_smp_mflags even if memory is aplenty.

Credits to Tomáš Chvátal for the original idea and implementation.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 23:20:56 +01:00
Nathan Cutler
353ff67780 build/ops: rpm: fix Group for rados-objclass-devel subpackage
Fixes RPMLINT warning "non-standard-group Development/Libraries"

Also, the Group: line is only needed for SUSE so put it in an appropriate
distro conditional.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 23:20:50 +01:00
Nathan Cutler
290d9094d6 build/ops: rpm: introduce _remote_tarball_prefix macro
With this macro, we can use a single Source0 line for all supported distros.
RH/CentOS/Fedora needs the prefix, while SUSE builds in the OBS use a local
tarball.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 17:16:26 +01:00
sysrich
2305bf06f8 build/ops: rpm: use %_fillupdir macro in openSUSE/SLES
Replace references to /var/adm/fillup-templates with new %_fillupdir macro

Fixes: https://bugzilla.opensuse.org/show_bug.cgi?id=1069468
Signed-off-by: Richard Brown <rbrown@suse.com>
2018-01-24 17:16:26 +01:00
Nathan Cutler
dd08d17fdf build/ops: rpm: reconstruct SUSE bconds
Disable java build completely. Enable lttng build on SLES only, and only for
certain architectures.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-24 17:16:26 +01:00
Sage Weil
1c2ac30803
Merge pull request from liewegas/wip-msgr2-goals
doc/dev/msgr2.rst: a few notes on protocol goals

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-01-24 04:22:38 -06:00
Sage Weil
73934df3b0 doc/dev/msgr2.rst: a few notes on protocol goals
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-23 17:40:43 -06:00
Alfredo Deza
1ed0062eb6
Merge pull request from ceph/wip-rm22653
ceph-volume: adds a --destroy flag to ceph-volume lvm zap

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-01-23 14:24:55 -05:00
Jason Dillaman
ccd16d2215
Merge pull request from mikechristie/wip-doc-mnc-update-iscsi-client
doc: update ceph iscsi kernel and package info

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-23 09:11:32 -05:00
Jason Dillaman
4dbcd4dd89
Merge pull request from thmour/thmour_rbdtrash
rbd: replace trash delay option, add rbd trash purge command

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-23 08:35:51 -05:00
Jason Dillaman
80f6c5cc4b
Merge pull request from liewegas/wip-rbd-validate
common/options,librbd/Utils: refactor RBD feature validation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-23 08:34:58 -05:00
Theofilos Mouratidis
b9e4aa94b7 rbd trash: replace cli delay option, add rbd trash purge command
Replaced the delay argument for the trash move
command with a string acceptable by /bin/date, e.g.:

$ rbd trash move --pool foo --image bar --expires-in "2 weeks"

Added a "rbd trash purge" command that deletes any expired
image from the trash, has also a command to alter the current
expiration date with the "--older-than" argument which accepts
again a valid argument for /bin/date, e.g.:

$rbd trash purge mypool --older-than "2017-08-20"

There is also the "threshold" argument which tries to remove the
oldest trashed images (by deferment end time) until the pool space
is freed up to a percentage point, e.g.:

$ rbd trash purge mypool --threshold 0.9

If mypool uses 1GB it will try to remove trashed images until the
pool usage becomes equal to or lower than 900MB.

Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>
2018-01-23 11:41:54 +01:00
John Spray
cd70aa2cf3
Merge pull request from jcsp/wip-mgr-minor
mgr: remove a few junk lines

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-23 10:17:50 +00:00
John Spray
e1af667314 mgr: remove a few junk lines
Signed-off-by: John Spray <john.spray@redhat.com>
2018-01-23 10:17:15 +00:00
Kefu Chai
04d90a7d2c
Merge pull request from liewegas/wip-22673
osd: only exit if *latest* map(s) say we are destroyed

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-23 15:48:11 +08:00
Sage Weil
3911a2ae49
Merge pull request from ceph/wip-rm22427
doc/ceph-volume OSD use the fsid file, not the osd_fsid
2018-01-22 18:16:10 -06:00
Sage Weil
d431de74de
Merge pull request from k0ste/prometheus_metadata
mgr: prometheus: set metadata metrics value to '1' ().

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-01-22 18:15:34 -06:00
Sage Weil
eafa6e0ef6
Merge pull request from k0ste/prometheus_latency
mgr: prometheus: added osd commit/apply latency metrics ().

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-22 18:14:12 -06:00
Sage Weil
f9e02d51d7
Merge pull request from tchaikov/wip-denc-size-t-featured
denc: should check element's type not 'size_t'

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-22 17:51:34 -06:00
Sage Weil
6f7e54dbf7
Merge pull request from mogeb/steady-clock-rados
rados: use WaitInterval()'s return value instead of manual timing

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 17:51:02 -06:00
Sage Weil
ffe3eb10ed
Merge pull request from tchaikov/wip-22419
osd: update store with options after pg is created 

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 17:50:07 -06:00
Sage Weil
92f7b56250
Merge pull request from liewegas/wip-name-shadowing
mon/OSDMonitor: rename outer name declaration to avoid shadowing

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 17:49:09 -06:00
Sage Weil
6eb85b3ac6
Merge pull request from cbodley/wip-crypto--
crypto: remove cryptopp library

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 17:48:20 -06:00
Sage Weil
b4c91da985
Merge pull request from tchaikov/wip-osx-build
osdc,os,osd: fix build on osx

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-22 17:48:00 -06:00
Sage Weil
12e6166397
Merge pull request from tchaikov/wip-22711
test: reduce the chance to have degraded PGs

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 17:46:30 -06:00
Mike Christie
3ab71020a5 doc: fix ceph-iscsi-config version number
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-22 17:10:04 -06:00
Alfredo Deza
a5f26c622b doc/ceph-volume OSD use the fsid file, not the osd_fsid
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-01-22 15:16:40 -05:00
Alfredo Deza
b020674f1e
Merge pull request from gohighsec/default_bluestore
doc: update man page to explain ceph-volume support bluestore

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-01-22 14:42:58 -05:00
Matt Benjamin
debb6b9040
Merge pull request from linuxbox2/wip-rgw-altlatchfix
rgw_file: alternate fix deadlock on lru eviction
2018-01-22 13:50:39 -05:00
Sage Weil
b44bd85bbf
Merge pull request from tchaikov/wip-doc-cxx11
doc/dev/cxx: add C++11 ABI related doc
2018-01-22 10:49:14 -06:00
Casey Bodley
42f5d04269
Merge pull request from qrGitHub/wip-rgw-unused-variable4
rgw: drop unused variable bucket_instance_ids

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-01-22 10:16:03 -05:00
John Spray
b25efca3ac
Merge pull request from shinobu-x/sk_mgr_daemonserver_using_get_val
mgr/DaemonServer.cc: [Cleanup] Change to using  get_val template function

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-22 14:30:26 +00:00
Sage Weil
fc8bbaf002
Merge pull request from myoungwon/wip-manifest-rados-op-promote
osd, librados: add a rados op (TIER_PROMOTE)

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 08:21:24 -06:00
John Spray
6e1b4b159e
Merge pull request from shangzhong/doc-cephfs-multimds
doc: redundant "cephfs" when set the "allow_multimds"

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-22 14:20:40 +00:00
John Spray
c05d96330d
Merge pull request from jan--f/mgr-prometheus-standby-mondown
pybind/mgr/prometheus: add StandbyModule and handle failed MON cluster

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-22 13:29:48 +00:00
Kefu Chai
74c9cfc466 test: reduce the chance to have degraded PGs
in test_mon_osd_misc(), there is good chance that the cluster chooses
to use an unbalanced weight because of the data distribution at that moment.
but this setting could prevent the CRUSH from choosing enough number of
OSDs for test_mon_cephdf_commands(), where 32 PGs are to be created. so
it's more likely that the CRUSH fails to pick enough OSDs for all PGs.
that's why we have a curr_object_copies_rate = 0.5.

so, in this change, pg=pgp=1 is specified for the new pool.

Fixes: http://tracker.ceph.com/issues/22711
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-22 21:24:58 +08:00
Jan Fajerski
4a45b02539 qa/tasks/mgr: add test_prometheus; smoke tests for prometheus module
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-01-22 13:21:45 +01:00
Jan Fajerski
ff471d485c pybing/mgr/prometheus: tidy up cherrypy engine start and stop
Calling cherrypy.engine.block() in the stanby module results in a failing
mgr failover.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-01-22 13:21:09 +01:00
Kefu Chai
85847c50e6
Merge pull request from ovh/bp-reorder-mimic-fields
osd_types.cc: reorder fields in serialized pg_stat_t

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 19:58:50 +08:00
Kefu Chai
d3785b4338
Merge pull request from runsisi/wip-cmake
cmake: do not find bzip2/lz4 for rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 19:58:24 +08:00
Kefu Chai
8cbee479da
Merge pull request from badone/wip-better-prepare_command_pool_set-E2BIG-error-message
mon/OSDMonitor: Better prepare_command_pool_set E2BIG error message

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 19:58:01 +08:00
Kefu Chai
979921244c
Merge pull request from david-z/wip-rocksdb-dump-mem
kv/RocksDB: get index and filter blocks memory usage

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-22 19:57:24 +08:00
Shangzhong Zhu
e7d555b033 doc: redundant "cephfs" when set the "allow_multimds"
Signed-off-by: Shangzhong Zhu <zhu.shangzhong@zte.com.cn>
2018-01-22 19:46:16 +08:00
John Spray
67abd1248b
Merge pull request from tchaikov/wip-standby-module-get-config
pybind/mgr/mgr_module: add default param for MgrStandbyModule.get_con…

Reviewed-by: John Spray <john.spray@redhat.com>
2018-01-22 10:53:49 +00:00
Kefu Chai
bc7de8b124 pybind/mgr/mgr_module: add default param for MgrStandbyModule.get_config()
this matches its counterpart of MgrModule.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-22 16:58:12 +08:00
Kefu Chai
41fd3503d0
Merge pull request from renhwztetecs/renhw-wip-common-time
common/time: add time.h for Alpine build

Reviewed-by: John Coyle <dx9err@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 16:38:24 +08:00
Kefu Chai
f5e7a8da11
Merge pull request from smithfarm/wip-rip-rcceph
build/ops: rpm: rip out rcceph script

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 16:36:23 +08:00
Kefu Chai
43b2e512e6 osd: update store with options after pg is created
Fixes: http://tracker.ceph.com/issues/22419
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-22 16:10:38 +08:00