Commit Graph

118505 Commits

Author SHA1 Message Date
Kefu Chai
ab7cdde56b
Merge pull request #38758 from tchaikov/wip-crimson-cleanup
crimson/os: do not let omap_get_values() return input_output_error

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-01-05 01:39:14 +08:00
Kefu Chai
dd9f4a9345
Merge pull request #38757 from rosinL/wip-remove-unused-options
common/options: remove ununsed options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-04 23:32:18 +08:00
Kefu Chai
889a6b451c crimson/os: do not let omap_get_values() return input_output_error
BlueStore only returns 0 or -ENOENT. so no need to handle the cases
where the return value is neither of them.

but Seastore might return EIO, so keep the interface unchanged.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 23:28:15 +08:00
ofriedma
6b9b228861
Merge pull request #38616 from ofriedma/wip-ofriedma-dist-cache
rgw: distribute cache for exclusive put
2021-01-04 17:11:37 +02:00
Kefu Chai
d39c1794a5
Merge pull request #38663 from tchaikov/wip-crimson-recovery-cleanups
crimson/osd: fixes and cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-01-04 22:54:10 +08:00
luo rixin
a5f9ca1571 common/options: remove ununsed options
Signed-off-by: luo rixin <luorixin@huawei.com>
2021-01-04 20:40:54 +08:00
haoyixing
5c25778258 mon/PGMap: align to same side when output ceph df / ceph df detail
Aligns are not in the same side when showing raw storage usage and
pools, change to the same side.

Signed-off-by: haoyixing <haoyixing@kuaishou.com>
2021-01-04 19:59:16 +08:00
Kefu Chai
a51f8f2612
Merge pull request #38676 from ronen-fr/wip-48690
qa/standalone/scrub/osd-scrub-snaps.sh: fix Python print syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-04 19:04:45 +08:00
Nathan Cutler
ea851e71fd
Merge pull request #38603 from smithfarm/wip-48604
rpm: require smartmontools on SUSE

Reviewed-by: Volker Theile <vtheile@suse.com>
2021-01-04 10:58:54 +01:00
Kefu Chai
65fa1c1e64 common/ConfUtils: pass string_view instead of string
pass string_view as the section_name when reading options from a
ConfFile. as there is no need to create a temporary string object
if the section name is a `const char*` literal.

also, update the caller site in `common/config.cc` accordingly as a
cleanup. as it's not necessary to pass a `const char*` for the section
name even without this change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 17:29:58 +08:00
Kefu Chai
362ccec7a6 vstart: format the customized options in ceph.conf
better formatted in ceph.conf, no extra spaces and tabs anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 15:02:00 +08:00
Kefu Chai
d72c9205dc cmake: only display the result of checking nasm once
if nasm is able to emit AVX512 instructions, we can assume that it's
able to generate AVX2 instructions as well. so no need to print "Found
nasm" multiple times.

and by chaining mutual exclusive branches with "elseif", we can have
better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 01:34:46 +08:00
Kefu Chai
de78439775 cmake: drop duplicated variable
not_arch_x32 replicates ${_support_x64}. and a variable starts with
"not" is just difficult to parse. so drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 01:34:46 +08:00
Mykola Golub
5fbae26e9e
Merge pull request #38694 from dillaman/wip-migration-import
librbd/migration: tweaks and initial set of documentation

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-01-03 11:07:20 +02:00
Kefu Chai
3c8e115e93 osd/scrub_machine: pass an instance of event to post_event()
instead of passing an intrusive_ptr<> to it, pass an instance of event
to post_event(). for couple reasons:

* post_event() is able to create an intrusive_ptr<> from the event
  passed to it using event.intrusive_from_this() which creates a clone
  of the original event. but since the overhead of creating scrub events
  is relative low. and presumably, it is not the bottleneck of the
  overall performance of Ceph, so it should be fine.
* simpler this way. so we don't need to repeat
  `boost::intrusive_ptr<EventName>(new EventName{})`
* more consistent this way. we use the same variant of `post_event()`
  elsewhere.
* for silencing the warning from GCC-11, like:
../src/osd/scrub_machine.cc:323:64: note: returned from ‘static void* boost::statechart::event<MostDerived, Allocator>::operator new(std::size_t) [with MostDerived = Scrub::GotReplicas; Allocator =
std::allocator<boost::statechart::none>]’
../src/osd/scrub_machine.cc: In constructor ‘Scrub::WaitReplicas::WaitReplicas(boost::statechart::state<Scrub::WaitReplicas, Scrub::ActiveScrubbing>::my_context)’:
../src/osd/scrub_machine.cc:346:64: warning: ‘static void boost::statechart::event<MostDerived, Allocator>::operator delete(void*) [with MostDerived = Scrub::GotReplicas; Allocator =
std::allocator<boost::statechart::none>]’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete]
  346 |   post_event(boost::intrusive_ptr<GotReplicas>(new GotReplicas{}));
      |
  this warning is a false alarm. but it is distracting.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-03 12:45:35 +08:00
Jason Dillaman
c2bf642ecf doc/rbd: incorporate external data source support for live-migration
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
7044a9d6ff librbd/migration: fixed missing return statements on stream error path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
0c51b58f67 librbd/migration: optionally pull S3 keys from MON config store
This allows the S3 keys to be better protected since the MON can
be configured to restrict access to keys by user and the results
can be encrypted in transit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
9eb47021b8 librbd: helper utility to retrieve config from the MON config store
A special "config://" URI prefix can be used to denote configuration
settings that should be (securely) pulled from the MON config store.
This will be first used in a follow-up commit to support storing
the S3 access and secret keys in the MON config store.

This "config://" syntax is already in-use by RGW and ceph-iscsi for
pulling secrets when deployed via cephadm.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
d22ca3d978 librbd/migration: require snapshot when importing from native source
Since we cannot mark the source image read-only when running in import-only
migration mode, we should require the user to provide a snapshot to ensure
that data cannot change while the migration is running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:53 -05:00
Kefu Chai
df2d50925e ceph.in: remove unused indent
no need to put `if True`. it was used when removing unused variables.
but it'd be better to have less indent for better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
3d777c93ee ceph.in: do not apply rados.cstr() to a bytes
since the parameter is already a bytes instance, there is no need to encode it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
f99bd29363 pybind/rados: correct annotation of {mon,pg,osd}_command
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
5b651e6142 pybind/ceph_argparse: no need to import print()
we are already in a python3 world.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
b90791e2c2 pybind/ceph_argparse: PEP8 related cleanups
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
ea18b69e36 ceph.in: return bytes as outbuf in error path
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
9220af325f ceph.in,ceph_argparse: add type annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
d2d1c23a51
Merge pull request #30027 from majianpeng/optimize-mutex-contention
os/bluestore: optimize mutex contention

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-01-01 12:12:43 +08:00
Kefu Chai
bd0553730b
Merge pull request #36088 from rhcs-dashboard/fix-45822-master
mgr/dashboard:minimize console log traces of Ceph backend API test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-01-01 12:10:25 +08:00
Kefu Chai
a6e87d3142
Merge pull request #38651 from ifed01/wip-ifed-new-omap-naming
os/bluestore: introduce new "per-pg" naming scheme for omap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-01-01 12:06:39 +08:00
Kefu Chai
7ddcbcc970
Merge pull request #38680 from ifed01/wip-ifed-rocksdb-options-annex
os/bluestore: introduce bluestore_rocksdb_options_annex config parame…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-01-01 12:01:55 +08:00
Jason Dillaman
73f6326272
Merge pull request #38738 from ronen-fr/wip-ronenf-rawformat
librbd/migration: removing an unused capture

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-31 08:00:37 -05:00
Kefu Chai
85d686ce77
Merge pull request #38709 from wuhongsong/aios_be_truncated
blk: add upper bound of bluestore_deferred_batch_ops* options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-31 19:41:37 +08:00
Zac Dover
702cedf327 doc/dev: restructure basic-workflow.rst
- Rewrote a sentence about forking.
- s/exactly how to proceed/how to proceed/
- Changed titles to present participles
- Rewrote "Fixing the Bug Locally" to improve its elegance.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-12-31 15:18:34 +10:00
Mykola Golub
1bfac6181a
Merge pull request #38655 from dillaman/wip-47828
librbd: ensure stripe unit is at least 512 bytes

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-30 16:15:47 +02:00
Ronen Friedman
af06f41121 librbd/migration: removing an unused capture
...silencing a compiler warning.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-30 08:35:00 +02:00
Changcheng Liu
92f5b75395 librbd/cache/pwl: correct update previous_sync_point_entry
Always update previous_sync_point_entry value whatever its old
value.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-12-30 13:30:41 +08:00
Kefu Chai
431e6540d4
Merge pull request #38733 from ukernel/wip-yanzheng-email
mailmap: update affiliation for Yan, Zheng

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-30 11:23:57 +08:00
Kefu Chai
3ed7dccb84
Merge pull request #38237 from myoungwon/wip-fix-clone-size-mismatch
osd: fix clone size mismatch when deduped object is evicted

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-30 11:19:51 +08:00
Yan, Zheng
6fce6672d1 mailmap: update affiliation for Yan, Zheng
Signed-off-by: "Yan, Zheng" <ukernel@gmail.com>
2020-12-30 10:48:06 +08:00
Kefu Chai
ff580cd0f8
Merge pull request #37704 from Huber-ming/log_error
radosgw-admin: fix error message when datalog list

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-12-30 00:31:02 +08:00
hzwuhongsong
e81400b8c2 blk: add upper bound of bluestore_deferred_batch_ops* options
so the number of pending io does not overflow when being passed to submit_batch().

Signed-off-by: hzwuhongsong <hzwuhongsong@corp.netease.com>
2020-12-29 16:32:57 +08:00
Kefu Chai
b106a03dcd
Merge pull request #38728 from xxhdx1985126/wip-crimson-osd_op-no-splice
crimson/osd: do not splice osd_op indata

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-29 15:52:41 +08:00
Xuehan Xu
fdb00bb573 crimson/osd: make sure PGBackend's modification operations not change osd_op state
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-12-29 15:19:52 +08:00
Xuehan Xu
282a518bbf crimson/osd: do not splice osd_op indata
As each osd_op's indata holds only its own data, there's no need to drop their it.
On the other hand, indata is still needed when osd_op needs to be redone in case of
acting set change.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-12-29 12:06:43 +08:00
Kiefer Chang
850d2fcac2
Merge pull request #38633 from rhcs-dashboard/fix-logs-copy-button
mgr/dashboard: Fix for copy2Clipboard failing to copy on the first time

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2020-12-28 21:12:14 +08:00
Avan Thakkar
b6a11c8b4d mgr/dashboard: Fix for copy2Clipboard failing to copy on the first time.
Fixes: https://tracker.ceph.com/issues/48601

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Fix for the copy2Clipboard button to work on the first click itself.
2020-12-28 12:40:07 +05:30
Kefu Chai
ce2ba5cb87
Merge pull request #37267 from TheJJ/fix-up-acting-docs
doc: fix up and acting set explanation

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-28 14:38:12 +08:00
Jonas Jelten
cb300ee6b8 doc: fix and improve the explainations of up and acting osd sets
acting = where clients requests are processed
up = where pgs were planned to be by crush+upmap

Fixes: https://tracker.ceph.com/issues/48718

Signed-off-by: Jonas Jelten <jj@sft.lol>
2020-12-27 18:33:36 +01:00
Jonas Jelten
c98ad17dff mailmap: update mail for Jonas Jelten
Signed-off-by: Jonas Jelten <jj@sft.lol>
2020-12-27 18:33:36 +01:00