Commit Graph

126246 Commits

Author SHA1 Message Date
Sebastian Wagner
90f4cc017a
doc/cephadm: monitoring: Add "Adding Alertmanager webhooks"
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-30 13:14:44 +02:00
Sebastian Wagner
d176130866
doc/cephadm: monitoring: Add "Setting up Grafana"
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-30 12:26:23 +02:00
Sebastian Wagner
5aa5fea8ee
doc/cephadm: monitoring: move "deploying w/o" up
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-30 12:23:13 +02:00
Sebastian Wagner
efd79a4adc
doc/cephadm: monitoring: default placements
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-30 12:20:53 +02:00
Ilya Dryomov
42a250fe2d
Merge pull request #42959 from idryomov/wip-krbd-escape-match-sysattr
krbd: escape udev_enumerate_add_match_sysattr values

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-08-30 11:25:31 +02:00
Deepika Upadhyay
879f2056cb
Merge pull request #42913 from yaarith/update-sudoers-smartctl
rpm, debian: move smartmontools and nvme-cli to ceph-base

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-08-30 14:26:03 +05:30
Deepika Upadhyay
69a5ae539f
Merge pull request #42770 from ktdreyer/no-lsb-release
Remove dependency on lsb_release

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-08-30 14:13:02 +05:30
Kefu Chai
0917e204e9
Merge pull request #42961 from tchaikov/wip-docker-test
test/docker-test.sh: add support for fedora 34 and debian stretch

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2021-08-30 07:42:53 +08:00
Kefu Chai
005cd1063d test/docker-test.sh: add support for fedora 34 and debian strech
and drop fedora-31, fedora32, debian-jessie and ubuntu-16.04 since
they are not maintained anymore. see

- https://fedoraproject.org/wiki/End_of_life
- https://wiki.debian.org/LTS
- https://wiki.ubuntu.com/Releases

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2021-08-29 21:52:01 +08:00
Ilya Dryomov
8841029b0a krbd: escape udev_enumerate_add_match_sysattr values
libudev uses fnmatch(3) for matching attributes, meaning that shell
glob pattern matching is employed instead of literal string matching.
Escape glob metacharacters to suppress pattern matching.

Fixes: https://tracker.ceph.com/issues/52425
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-28 11:05:28 +02:00
Samuel Just
5844080385
Merge pull request #42957 from athanatos/sjust/wip-lba-rewrite-working
crimson: add object_info, log support to crimson-store-nbd, fix lba btree bugs

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-08-28 00:14:22 -07:00
Samuel Just
1b0e6fcdcd crimson/os/seastore/lba_manager/btree: don't assert deltas are empty
We use the contents to update counters when transactions conflict,
deltas may validly be empty there.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-28 04:57:04 +00:00
Samuel Just
364faaf3f8 crimson/os/seastore/cache: retire_extent_addr: add addr asserts
retire_extent_addr can only be called on absolute or record-relative
addrs.  Record-relative addrs are only valid on extents allocated as
part of the current transaction.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-28 04:57:04 +00:00
Samuel Just
036193fbda crimson/os/seastore/lba_manager/btree: fix get_val() paddr value from iterator
This was causing a stray RETIRED_PLACEHOLDER to be created resulting in
a segment cleaner segfault in release on an invalid segment and a crash
upon adding a duplicate lba btree pin since the returned addr didn't
match the addr of the INITIAL_PENDING extent on the transaction.

Fixes: https://tracker.ceph.com/issues/52434
Fixes: https://tracker.ceph.com/issues/52435
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-28 04:57:04 +00:00
Samuel Just
6e747abde3 crimson/tools/store_nbd: add log emulation to fs_driver
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-28 04:57:02 +00:00
Patrick Donnelly
09d876bc07 Merge PR #42899 into master
* refs/pull/42899/head:
	src/client: fix dump mds twice

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:31:04 -04:00
Patrick Donnelly
8b17095962 Merge PR #42751 into master
* refs/pull/42751/head:
	cephfs-mirror: shutdown ClusterWatcher on termination

Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-08-27 21:30:22 -04:00
Patrick Donnelly
297fcdce24 Merge PR #42687 into master
* refs/pull/42687/head:
	qa: test the "ms_mode" options in kclient workflows

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:29:17 -04:00
Patrick Donnelly
d64b40fef2 Merge PR #42620 into master
* refs/pull/42620/head:
	mds: switch mds_lock to fair mutex
	common/Timer: make SafeTimer a template
	common/fair_mutex: add is_locked_by_me support
	common: do not compile condition_variable_debug in none debug mode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:28:02 -04:00
Patrick Donnelly
ec69208deb Merge PR #38481 into master
* refs/pull/38481/head:
	qa/vstart_runner: inherit methods instead of duplicating them
	qa/ceph_manager: make it possible to reuse few methods
	qa/vstart_runner: don't use "shell=False" in run_ceph_w()
	qa/ceph_manager: minor refactor

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:26:41 -04:00
Kefu Chai
d50c5e8ced
Merge pull request #42955 from tchaikov/wip-fio-tag
cmake: use ceph repo with tag

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-28 08:08:48 +08:00
Samuel Just
efe81ea7de crimson/tools/store_nbd: add object_info emulation to fs_driver
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-27 15:41:48 -07:00
Samuel Just
fdc5eeeabd crimson/common/interruptible_future: move int future refcounting to trace
We probably want to add a dedicated subsys for this, but for now it's just
too much for debug level.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-27 15:41:48 -07:00
Samuel Just
e9ec8283f3 crimson/tools/store_nbd/fs_driver: collid should be the msb
This way, objects in a collection will sort together.  Probably
a typo.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-27 15:41:48 -07:00
Neha Ojha
b2bdb5095b
Merge pull request #39377 from ifed01/wip-ifed-fix-huge-omap-rename
os/bluestore: cap omap naming scheme upgrade transaction

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-08-27 11:30:30 -07:00
Neha Ojha
72b0f42c8f
Merge pull request #42918 from ifed01/wip-ifed-fix-52398
test/store_test: fix broken test case

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-27 11:29:20 -07:00
Ilya Dryomov
afc0590ce0
Merge pull request #42926 from zdover23/wip-doc-2021-08-26-nomad-cleanup-cherry-picker
doc: clean rbd-nomad.rst

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-27 19:04:05 +02:00
Kefu Chai
d7771002ef cmake: use ceph repo with tag
to address following warning:

fatal: reference is not a tree: 7f02f21f53ccd5e2448086f8e9015489693dd2dc
CMake Error at /home/jenkins-build/build/workspace/ceph-pull-requests/build/fio_ext-prefix/tmp/fio_ext-gitclone.cmake:40 (message):
  Failed to checkout tag: '7f02f21f53ccd5e2448086f8e9015489693dd2dc'

it seems that the shallow option does not work with a sha1 tag option,
let's continue using the ceph repo with a tag.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2021-08-28 00:14:58 +08:00
Kefu Chai
983fd8ae21
Merge pull request #42944 from dengchl01/dengchl01
mgr/restful/api/crush.py: delete unused reference

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-08-27 21:48:18 +08:00
Daniel Gryniewicz
58d24c20db
Merge pull request #39933 from linuxbox2/wip-bl-opslog
rgw: permit logging of list-bucket (and any other no-bucket op)

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-08-27 09:47:43 -04:00
Kefu Chai
cd7b14102c
Merge pull request #42934 from tchaikov/wip-fio-cxx
cmake: use upstream repo for fio

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-08-27 21:41:50 +08:00
Ilya Dryomov
7b3fe154e5 doc/rbd/rbd-nomad: fix indentation in config snippets
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-27 14:12:35 +02:00
Zac Dover
977e6cffb3 doc: clean rbd-nomad.rst
This PR improves the rbd-nomad.rst file.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-08-27 14:12:35 +02:00
Samuel Just
bd94f885ab
Merge pull request #42901 from athanatos/sjust/wip-lba-rewrite
crimson/os/seastore: replace lba btree implementation with simpler, more correct iterator based implementation

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-08-26 22:38:46 -07:00
dengchl01
4a32451b48
mgr/restful/api/crush.py: delete unused reference
This commit delete unused reference of the crush page.

Signed-off-by: Charlie Developer <dengchl01@inspur.com>
2021-08-27 11:19:27 +08:00
Patrick Donnelly
1b1f108449 Merge PR #42530 into master
* refs/pull/42530/head:
	qa: ignore expected metadata cluster log error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-08-26 22:36:28 -04:00
Samuel Just
dc4fe22f6b crimson/os/seastore/lba_manager: replace btree implementation
Replace previous implementation with one based around an internal
iterator interface.  Besides simplifying the implementation and
removing duplicate lookups in the allocation pathway, this implementation
should correct a design problem in the prior implementation wherein
LBALeafNode::find_hole couldn't see the first element of the subsequent
node and therefore assumed that there was one at get_meta().end.

This patch removes the btree logic from lba_btree_node_impl.* leaving
the LBAInternalNode and LBALeafNode layout in lba_btree_node.*.
lba_btree.h/cc now have the main btree update/query logic.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 19:10:45 -07:00
Neha Ojha
c696e943c4
Merge pull request #42941 from kamoltat/ksirivad-add-release-notes-quincy
PendingReleaseNotes: add autoscaler profile

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-26 15:39:30 -07:00
Samuel Just
150d2ee14b crimson/os/seastore/seastore_types: add lba_root_t::set_depth
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
b5431795dc crimson/os/seastore/lba_manager: fix comment
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
4706a9ed05 crimson/common/fixed_kv_node_layout: add iterator operator-- and misc
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
3234973c82 crimson/os/seastore: remove unneeded TransactionManager::find_hole
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
6da9921686 crimson/tools/store_nbd/tm_driver: reset segment_manager in mkfs()
Otherwise, instantiating segment_manager in mount() results in two
instances and a duplicate metric exception.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
d560b198a1 crimson/os/seastore/cache: fix formatting in get_extent
In particular, this->invalidate and *ref.get() are superfluous.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
90df2634f0 key_value_store/kv_flat_btree_async: add using namespace std
Not worth annotating the specific elements of std used.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:13 -07:00
Samuel Just
cd044ad1cc crimson/os/seastore: get_next_dirty_extents: record in transaction read set
Record the extents in the read set after wait_io() as in get_extent.  This
should ensure that the interruptible_future machinery will handle the
event that one of them gets invalidated prior to beging rewritten.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:09 -07:00
Samuel Just
0423a1c34e crimson/os/seastore/segment_manager/block: add segment_size to make_superblock debugging
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:09 -07:00
Samuel Just
4bbbfdd64a test/crimson/seastore/test_btree_lba_manager: add better merge test
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:09 -07:00
Samuel Just
e9048de8be test/crimson/seastore/test_transaction_manager: update find_hole_assert_trigger
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-08-26 13:49:09 -07:00
chunmei-liu
430300f0f3 crimson/seastore:: add find_hole/add_pin assert test case
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2021-08-26 13:49:09 -07:00