Commit Graph

82548 Commits

Author SHA1 Message Date
Sage Weil
4e4d6466aa osd: only exit if *latest* map(s) say we are destroyed
It's possible our current map is older, we were destroyed then, but in
newer maps our osd was recreated.  This happens when the oldest map after
a recreated osd happens to land on an epoch where the osd was marked
destroyed.

Fix by only exiting if one of the newest maps says we are (still)
destroyed.

Fixes: http://tracker.ceph.com/issues/22673
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-17 10:38:29 -06:00
Casey Bodley
1789a0ee46
Merge pull request #17520 from joscollin/wip-cleanup-drop-return
rgw: Drop unnecessary return

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-17 10:18:07 -05:00
Kefu Chai
fdc1a39c7d denc: should check element's type not 'size_t'
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-17 21:30:38 +08:00
Mykola Golub
722fbb903e rbd: properly pass ceph global command line args to subprocess
When initializing the global context, global_init parses command line
arguments and removes ceph global args from the list. As a result they
are not visible for rbd command line parser and global options were
ignored when passing them to subprocesses like nbd or ggate.

Fix this by keeping a list of ceph global init command line
arguments. To build the list we compare the list of initial command
line args and those that remain after global_init parsing.

After this fix it is possible to pass any ceph global option to a
subprocess.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-17 10:00:33 +02:00
Konstantin Shalygin
55f8db1b58
mgr: prometheus: set metadata metrics value to '1' (#22717).
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-01-17 14:06:43 +07:00
Patrick Donnelly
9478c064d7
Merge PR #19803 into master
* refs/pull/19803/head:
	mds: get rid of unnecessary if condition

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-16 20:06:37 -08:00
Patrick Donnelly
cc710979e3
Merge PR #19837 into master
* refs/pull/19837/head:
	client: avoid recursive lock in ll_get_vino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-01-16 20:06:31 -08:00
Patrick Donnelly
bbd23ca4d5
Merge PR #19860 into master
* refs/pull/19860/head:
	cephfs-journal-tool: add usage help info for header set <field>
	mds: add error log info
	cephfs-journal-tool: add "set pool_id" option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:26 -08:00
Patrick Donnelly
7a8bd1c994
Merge PR #19891 into master
* refs/pull/19891/head:
	mds: handle 'inode gets queued for recovery multiple times'
	mds: use elist to track recover queue items

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:21 -08:00
Patrick Donnelly
4412c6b541
Merge PR #19911 into master
* refs/pull/19911/head:
	cephfs: Switch MIN/MAX for std::min/max and use intarith templates

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-16 20:06:12 -08:00
Sage Weil
2d34e380c8 osd/PG: drop 'seed' property from Scrubber
This has been -1 for many releases now.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
5ac3bfa34c qa/suites/rados/singleton/all/divergent_priors*: unsquelch osd debug
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
a188cb27dd osd/ECBackend: debug ec scrub error paths
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
4e0f4238b9 osd: document scrub options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
Sage Weil
6dd42392c0 osd: allow limited scrub preemption
If we receive a write within the scrub range, abort the scrub chunk and
shrink the chunk size.  If we do this too many times do not preempt and
allow the scrub to complete (to avoid scrub starvation due to client io).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 21:52:09 -06:00
lijing
7a0c4d02df ceph-volume: update argument description that bluestore is the default
Fixes: http://tracker.ceph.com/issues/22663
Signed-off-by: Jing Li lijing@gohighsec.com
2018-01-17 10:20:24 +08:00
lijing
c8bdb49c92 doc: update man page to explain ceph-volume support bluestore
Fixes: http://tracker.ceph.com/issues/22663
Signed-off-by: Jing Li lijing@gohighsec.com
2018-01-17 10:19:03 +08:00
Kefu Chai
67e5a2f35f
Merge pull request #19876 from theanalyst/build/do-cmake-args
build: do_cmake: allow ARGS to be overridden

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-17 09:50:26 +08:00
Sage Weil
d079916a95
Merge pull request #19433 from liewegas/wip-pg-removal
osd: put pg removal in op_wq

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-01-16 15:44:27 -06:00
Sage Weil
366905fb57 pybind/mgr/mgr_module: make rados handle available to all modules
Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 15:02:14 -06:00
Sage Weil
d37d966891 osd/PrimaryLogPG: do on_shutdown on removal
This cleans up our reservations and misc other state in OSDService that
needs to be cleaned up.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 14:31:28 -06:00
Sage Weil
617a82c45e osd: track deleted pools' pg_nums for calculating split
This is needed to determine (quickly) whether PGs have split.  Calling
get_pg_num() on the latest map does not work when the pool has been
deleted from that map.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 14:31:28 -06:00
David Zafman
7ccb7b7023
Merge pull request #19850 from dzafman/wip-calc-stats
osd/PG: re-write of _update_calc_stats and improve pg degraded state

Fixes: http://tracker.ceph.com/issues/20059

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-01-16 11:58:49 -08:00
David Zafman
9f103f013c tests: recovery-unfound-found test needs to account for correct misplaced calculations
The test expected HEALTH_OK when in a state with misplaced objects therefore HEALTH_WARN

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-01-16 10:52:21 -08:00
Mike Christie
b56d994f3a doc: add rbd pool requirement for gwcli
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:55 -06:00
Mike Christie
4ca0d508bb doc: add daemon-reload for rbd-target-api setup
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:51 -06:00
Mike Christie
f45aafed1c doc: add gwcli manual install instructions
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-16 12:48:41 -06:00
Yuri Weinstein
9c2278bbbc
Merge pull request #19613 from qrGitHub/wip-rgw-optimize-bucketLCPrepare
rgw: optimize function bucket_lc_prepare

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-01-16 09:06:21 -08:00
Yuri Weinstein
afb35bafec
Merge pull request #19878 from cbodley/wip-rgw-get-omap-keys-cr
rgw: fix handling of ENOENT in RGWRadosGetOmapKeysCR

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-01-16 09:05:28 -08:00
Yuri Weinstein
36f1dc0f04
Merge pull request #19897 from cbodley/wip-rgw-put-system-obj
rgw: rgw_put_system_obj takes bufferlist

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-01-16 09:04:36 -08:00
Andrew Schoen
21f459437b ceph-volume: docs for --crush-device-class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:34 -06:00
Andrew Schoen
3404d8bba5 ceph-volume: adds crush_device_class to json metadata for 'osd new'
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:34 -06:00
Andrew Schoen
36a388d72a ceph-volume: adds crush_device_class to the functional tests
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:33 -06:00
Andrew Schoen
11da218563 ceph-volume: add crush_device_class to lvm metadata
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:33 -06:00
Andrew Schoen
bf468bc373 ceph-volume: adds a --crush-device-class flag to lvm create and prepare
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-01-16 09:20:33 -06:00
Kefu Chai
31f9af83b3
Merge pull request #19945 from tchaikov/wip-deprecated-in-cxx17
librbd,librados: do not include stdbool.h in C++ headers

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-01-16 22:16:43 +08:00
Kefu Chai
cff35427ef
Merge pull request #19261 from dillaman/wip-22286
mgr: disconnect unregistered service daemon when report received

Reviewed-By: Kefu Chai <kchai@redhat.com>
2018-01-16 22:15:47 +08:00
Sage Weil
5f9911bc4a
Merge pull request #19942 from shinobu-x/wip-sk-minmax-ms_async_op_threads
common: Add min/max of ms_async_op_threads

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-16 07:33:22 -06:00
Sage Weil
fdc3f5c24c
Merge pull request #19397 from xxhdx1985126/master
mon: update PaxosService::cached_first_committed in PaxosService::maybe_trim()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-16 07:33:09 -06:00
Sage Weil
bf16f59887 osd: piecewise scrub
Perform scrub in stages, with each unit of work requeuing an item in the
work queue.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-16 06:54:06 -06:00
runsisi
08a4de142f cmake: do not find bzip2/lz4 for rocksdb
RocksDB has compression disabled by default[1] and it's never been enabled[2],
so do not link these compression libraries implicitly

[1] https://github.com/ceph/rocksdb/blob/master/CMakeLists.txt#L76
[2] https://github.com/ceph/ceph/blob/master/cmake/modules/BuildRocksDB.cmake

Signed-off-by: runsisi <runsisi@zte.com.cn>
2018-01-16 19:44:44 +08:00
Piotr Dałek
0230fe6733 osd_types.cc: don't store 32 least siognificant bits of state twice
a25221e551 introduced a new, 64bit
pg state field, retaining encoding and decoding of least significant
32 bits for compatibility reasons.
This commit also adds encoding of entire 64bit state field, meaning
that the least significant bits are encoded and decoded twice.
Fix this by encoding each half of 64bit field separately.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2018-01-16 11:04:24 +01:00
Piotr Dałek
ae7472fb07 osd_types.cc: reorder encoding/decoding of fields in pg_stat_t
Fields state, purged_snaps and snaptrimq_len are new to Mimic.
Reorder them in a way that newest field (snaptrimq_len) is before
two others and uses other encoding version, so the pull request
https://github.com/ceph/ceph/pull/19520 can be backported to Luminous
without breaking Luminous -> Mimic upgrade.
This also changes encoding/decoding version back to 24 as both state
and purged snaps were added post-Luminous and pre-Mimic, so we can
push it into a single struct version and keep snaptrimq_len into other
version.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2018-01-16 10:28:58 +01:00
Mike Christie
f80f083d0a doc: separate gwcli install from post install setup steps
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-15 13:02:24 -06:00
Mike Christie
3cc367dc6e doc: add note to clarify trusted_ip_list use
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-15 13:02:20 -06:00
Mike Christie
3806f9750d doc: update esx instructions
Signed-off-by: Mike Christie <mchristi@redhat.com>
2018-01-15 13:02:13 -06:00
Jason Dillaman
aab2defaca
Merge pull request #19822 from trociny/wip-ggate-ceph-globals
rbd-ggate: fix parsing ceph global options

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-01-15 08:51:34 -05:00
Kefu Chai
0c38eb87e2
Merge pull request #19673 from zouaiguo/wip_erase_code
mon/OSDMonitor.cc : set erasure-code-profile to "" when create replicated pools.

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-15 18:34:34 +08:00
Nathan Cutler
2049155ea5 doc: mention rcceph drop in PendingReleaseNotes
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-15 11:24:05 +01:00
Nathan Cutler
a24afcdcd3 build/ops: rpm: rip out rcceph script
"rcceph" is a SysVinit-style command-line interface for stopping, starting,
enabling, etc. all ceph-osd and ceph-mon systemd units on a machine, in one go.

Since the same functionality is provided by ceph-{osd,mon}.target, the script
is obsolete. It is also unmaintained. Judging from the absence of recent
mentions of the script online, I guess it is no longer used.

Leaving dead code in the tree can cause confusion, especially when the code is
packaged and shipped to customers. Therefore I propose to rip it out.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-15 11:22:07 +01:00