Commit Graph

131101 Commits

Author SHA1 Message Date
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Ronen Friedman
c5684e44b9
Merge pull request #46226 from ronen-fr/wip-rf-cln-typesh
osd: cleanup object_stat_sum_t initialization

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-15 09:31:51 +03:00
Venky Shankar
42b74f497e
Merge pull request #45886 from lxbsz/wip-55283
qa: add filesystem/file sync stuck test support

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:14:51 +05:30
Venky Shankar
3f55262ea9
Merge pull request #45955 from lxbsz/wip-55240
mds: trigger to flush the mdlog in handle_find_ino()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:13:17 +05:30
Venky Shankar
450cdbaab5
Merge pull request #46063 from vshankar/wip-55170
mds: fetch all dirfrag entries when no dentry keys are requested

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:12:13 +05:30
Venky Shankar
8beaa5e5db
Merge pull request #46153 from lxbsz/wip-54411-1
client: force send global open_files/metadata metrics

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:11:17 +05:30
Samuel Just
8dc7cb108e
Merge pull request #46258 from xxhdx1985126/wip-backref-minor-bug-fixes
crimson/os/seastore/cache: backref buffer minor bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-13 12:25:44 -07:00
zdover23
ecb948ab1a
Merge pull request #46154 from zdover23/wip-doc-2022-04-14-dev-guide-basic-workflow
doc/dev: update basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-14 01:40:19 +10:00
Ernesto Puerta
cfa5d0fe2d
Merge pull request #45581 from MrFreezeex/jsonnet-multiline-cleanup
ceph-mixin: rewrite promql queries to multiline

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-05-13 16:21:30 +02:00
Kefu Chai
417774f60b
Merge pull request #46142 from tchaikov/wip-cmake-fuse
cmake: mark FUSE REQUIRED if WITH_FUSE

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 20:58:14 +08:00
Venky Shankar
a00fd5f873
Merge pull request #46237 from vshankar/wip-add-multids-stray-check-for-upgrade
doc: add note about checking pending stray directory entries before initiating upgrade

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 18:10:16 +05:30
Xuehan Xu
0ad9c3ff8b crimson/os/seastore/cache: backref buffer minor bug fix
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 20:16:29 +08:00
Venky Shankar
92724156e6 doc: add note about checking pending stray directory entries before initiating upgrade
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 16:24:14 +05:30
Venky Shankar
c325d50d9b
Merge pull request #46236 from vshankar/wip-manual-upgrade-add-check
doc: add setting/unsetting `mon_mds_skip_sanity` config for manual ceph-mds upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 15:52:20 +05:30
Ernesto Puerta
b6f6246e9b
Merge pull request #46206 from votdev/issue_55578_prom_am_silence
mgr/dashboard: Creating and editing Prometheus AlertManager silences is buggy

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2022-05-13 11:12:38 +02:00
Yingxin
58eb062361
Merge pull request #46256 from xxhdx1985126/wip-backref-big-buffer
crimson/os/seastore: use a whole large backref buffer in cache instea…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:50:22 +08:00
Xuehan Xu
aab8bb0fa0 crimson/os/seastore: use a whole large backref buffer in cache instead of several small bufs
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 12:44:53 +08:00
Kefu Chai
26f8b9f7fc
Merge pull request #45368 from a16bitsysop/nasm
nasm-wrapper: ignore -O flags passed

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-13 10:58:12 +08:00
Samuel Just
ecd871a098
Merge pull request #46244 from tchaikov/wip-bump-up-seastar
crimson: bump up seastar

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-12 12:43:55 -07:00
Nizamudeen A
61ed55b8f7
Merge pull request #46227 from rhcs-dashboard/angular-production-fix
mgr/dashboard: avoid overriding the configuration in package.json

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-05-12 20:33:06 +05:30
Kefu Chai
0ef91ba0d5 seastar: bump up seastar submodule to recent master
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-12 21:30:50 +08:00
Kefu Chai
29ed445646 crimson: replace DERIVE metrics with COUNTER metrics
in a recent change in Seastar, DERIVE metric was dropped in favor
of COUNTER.

in this change, all DERIVE metrics are replaced with COUNTER metrics.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-12 21:30:50 +08:00
Kefu Chai
56875e9c26
Merge pull request #46239 from tchaikov/wip-crimson-nbd
crimson/tools/store_nbd: s/get_paddr/get_val/

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-12 20:21:55 +08:00
Ernesto Puerta
62dbb254a6
Merge pull request #46231 from rhcs-dashboard/update-id-email
githubmap: Email and Id updated

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-05-12 14:08:50 +02:00
Venky Shankar
153634f1de
Merge pull request #45950 from rishabh-d-dave/qa-cephfs-test_acls
qa/cephfs: minor fixes for xfstests_dev.py and test_acls.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 15:21:14 +05:30
Venky Shankar
29793ca78c
Merge pull request #45829 from dparmar18/fix_put
cephfs-shell: fix put and get cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 15:16:14 +05:30
Venky Shankar
44a0199114
Merge pull request #45834 from ajarr/wip-53996
qa/suites/fs/upgrade: change octopus installations and references

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 15:14:53 +05:30
Venky Shankar
18681c5d51
Merge pull request #46161 from joscollin/wip-B55516-extra-data
qa: fix is_addr_blocklisted() to get blocklisted clients from 'osd dump' 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 15:12:57 +05:30
Venky Shankar
806551ad95
Merge pull request #46192 from rishabh-d-dave/qa-cephfs-mount-omit_sudo-no-effect
qa/cephfs: omit_sudo must be passed to underlying method...

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 15:11:01 +05:30
Kefu Chai
9b66089601
Merge pull request #45185 from a16bitsysop/quincy-32bit
src/os/bluestore/BlueStore.cc: Use static_cast<uint64_t> fix for 32bit

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-12 17:24:07 +08:00
Kefu Chai
bf23e257af crimson/tools/store_nbd: s/get_paddr/get_val/
it is a follow-up change of ec89b17f2a
which breaks the build of the nbd tool.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-12 17:04:45 +08:00
Duncan Bellamy
6190f90a5d src/os/bluestore/BlueStore.cc: Use static_cast<uint64_t> to fix 32bit compilation
Fixes: https://tracker.ceph.com/issues/54415

Signed-off-by: Duncan Bellamy <dunk@denkimushi.com>
2022-05-12 13:36:44 +08:00
Venky Shankar
70ef761997 doc: add setting/unsetting mon_mds_skip_sanity config for manual ceph-mds upgrade
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-05-12 10:55:02 +05:30
Samuel Just
6f78f2f42e
Merge pull request #46136 from athanatos/sjust/wip-crimson-operation-refactor-for-review
crimson: refactor osd operation pipeline

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-05-11 19:06:53 -07:00
Samuel Just
12d0955b5f
Merge pull request #45390 from xxhdx1985126/wip-backref2
crimson/os/seastore: add back-reference

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-11 13:51:13 -07:00
Soumya Koduri
98087586c4
Merge pull request #46126 from soumyakoduri/wip-skoduri-dbstore-vstart
rgw/dbstore: Support user creation via `radosgw-admin`

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-05-11 23:31:29 +05:30
Sarthak0702
7f05a9089a githubmap: Email and Id upadted
Signed-off-by: Sarthak0702 <sarthak.dev.0702@gmail.com>
2022-05-11 23:24:46 +05:30
Casey Bodley
f0e30f67ab
Merge pull request #45064 from s-t-e-v-e-n-k/no-direct-use-of-nose
test: No direct use of nose

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-05-11 12:28:48 -04:00
Yuri Weinstein
3bc0354bc4
Merge pull request #45762 from NitzanMordhai/wip-nitzan-test-cls-lock-expiered-locks
cls_lock: check expired lock before unlock

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2022-05-11 07:34:42 -07:00
Yuri Weinstein
6322d1aaae
Merge pull request #45529 from NitzanMordhai/wip-nitzan-pglog-dups-not-trimmed
osd/PGLog.cc: Trim duplicates by number of entries

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-11 07:34:12 -07:00
Yuri Weinstein
7268e4574c
Merge pull request #44839 from NitzanMordhai/wip-nitzan-mon-ok-to-stop
mon/Monitor: Validate monitor ids during 'mon ok-to-stop' cmd

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-05-11 07:32:49 -07:00
Nizamudeen A
48fe886bb5 mgr/dashboard: avoid overriding the configuration in package.json
the warning in npm run build is `Option "configuration" was already specified with value "en-US". The
new value "production" will override it.`

This causes the dist for production env to be created in dist/ whereas
it should be dist/en-US (or whatever npm_config_locale. That prevented
from dashboard to load and cause the cephadm e2e checks to fail.

https://jenkins.ceph.com/job/ceph-dashboard-cephadm-e2e-nightly-master/185/consoleFull#57532618373a8703b-5adb-41c5-84a0-8cf4e065ba3d

Related to https://github.com/ceph/ceph/pull/46143

Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-05-11 19:41:33 +05:30
dparmar18
1e3fb3c874 qa: testcase test_get_without_target_name fixed
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:16:29 +05:30
dparmar18
db8ff8b809 doc/man/cephfs-shell.rst: get cmd must accept both path mandatorily
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:16:28 +05:30
dparmar18
689927b0e5 cephfs-shell: get cmd must get both path and should validate them
Description:
- While using `get` command, `local_path` parameter is optional. Changing it
  to mandatory.
  - Rationale: Till now, there used to be a default path of `local_path` as
               `default='.'` but wasn't mentioned anywhere. It led to confusion.
               On top of it, considering get command to be a ssh inspired utlity,
               or any other CLI tool that copies file between filesystems, source
               and destination path are always mandatory. Therefore in order to
               simulate this behavior in cephfs-shell`s command(s), my opinion is
               to make get command accept both the paths.

- Added checks to make sure:
	1) File does exist at `remote_path`
	2) File with the same name doesn't exist in `local_path`
	3) Removed code that would run through the directory and if it finds
	   nothing in `root_src_dir`, then it will try to do:
	   `os.makedirs(root_dst_dir + b'/' + root_src_dir)`, but it will
	   never be empty as 1) takes care of it.

Fixes: https://tracker.ceph.com/issues/55216

Signed-off-by: dparmar18 <dparmar@redhat.com>
2022-05-11 17:16:28 +05:30
dparmar18
aa9938aacb qa: added testcase to check get cmd doesn't create subdirs on its own
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:16:28 +05:30
dparmar18
4da419ed24 qa: path in test_get_with_target_name() fixed
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:16:28 +05:30
dparmar18
64df8c2cdf cephfs-shell: get command should never create a directory on its own
Descrption: When using the get command on a single file, it would append the remote path to
            source path and create directories that shouldn't be created. For instance,
            file 'foo.txt' resides at `/dir1/dir2/` and `get` command is used to copy it to
            /tmp/foo then it would do `/tmp/dir1/dir2/foo.txt` which is not the expected
            behavior. Therefore this PR intends to correct this behavior.

Fixes: https://tracker.ceph.com/issues/55112

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:16:28 +05:30
dparmar18
31ce2eff60 qa: removed test_without_target_dir
Rationale: get and put now demand both the paths mandatorily.
           Also testing of get and put without target paths
           have been take of in other tests in class TestGetAndPut().

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:11:27 +05:30
dparmar18
70e21a92df doc/man/cephfs-shell.rst: put cmd must accept both path mandatorily
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-05-11 17:10:36 +05:30