Commit Graph

132399 Commits

Author SHA1 Message Date
Pere Diaz Bou
90869173ee mgr/dashboard: fix linting errors
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
3c308804d5 mgr/dashboard: add rbd list sorting support
Support sorting with name, pool name and namespace

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
5386dd1cb3 mgr/dashboard: update rbd list api version to 2
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
c832464998 mgr/dashboard: debounce reload data with serverSide
Whenever we use serverSide (paginate through backend) we should
debounce reloadData since it might call api calls too much times.

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
68ef0b83e9 mgr/dashboard: add rbd list search and disable sorting
- Disable sorting in each column because it will not be possible to
sort with this pagination implementation.
- Add search capabilities to the rbd list pagination endpoint.

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
08b6f22807 mgr/dashboard: fix rbd list tests
X-Total-Count header was missing from rbdservice.list spy mock

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Nizamudeen A
a27eea3e8c mgr/dashboard: fix frontend unit tests
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
4060061014 mgr/dashboard: if null tablecontext then create empty one
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
27f40514eb mgr/dashboard: more linting
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
78523ec030 mgr/dashboard: fix tests and iscsi rbd list
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
dbf2552ca5 mgr/dashboard: bind serverSide to externalPaging
Count won't be used unless externalPaging is set to true.
remove paginated import

task list service needed to be updated in order to have extra
params. This commit introduces that param.

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Pere Diaz Bou
efd9a8ba5c mgr/dashboard: rbd pagination poc
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Ernesto Puerta
1647216bf4
Merge pull request #46510 from nSedrickm/accessibility-improvements
mgr/dashboard: improve accessibility of login page 

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-07-12 17:19:30 +02:00
Yuri Weinstein
bafe199b9d
Merge pull request #46764 from Matan-B/wip-matanb-osd-cleanup
osd: MOSDPGCreate, MOSDScrub cleanup

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-07-12 06:35:13 -07:00
Venky Shankar
8323b6fef5
Merge pull request #46950 from dparmar18/fix_dirfrags_doc
doc/cephfs/dirfrags: clarify the unit of threshold limits

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2022-07-12 12:26:45 +05:30
zdover23
edd4e553ef
Merge pull request #47045 from zdover23/wip-doc-2022-07-12-dev-guide-dependabot-GitHub-typo
doc/dev: s/github/GitHub/ in essentials.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-07-12 04:24:38 +10:00
zdover23
24252cb6dd
Merge pull request #47031 from zdover23/wip-doc-2022-07-10-internals-cephfs-delayed-deletion-edit
doc/dev: edit delayed-delete.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-07-12 04:17:44 +10:00
Zac Dover
f7581e05b0 doc/dev: s/github/GitHub/ in essentials.rst
This addresses a typo that Anthony D'Atri pointed out in
PR#47032. It didn't get addressed there, so it's being
addressed here.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-07-12 02:58:18 +10:00
zdover23
a4b30caf2f
Merge pull request #47032 from zdover23/wip-doc-2022-07-10-dev-guide-dependabot
doc/dev: add Dependabot section to essentials.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-07-12 02:28:28 +10:00
Zac Dover
2711e8de80 doc/dev: add Dependabot section to essentials.rst
This PR adds a section to the Developer Guide chapter
"Essentials" that explains what Dependabot is. This
section is adapted from an email from Ernesto Puerta
to the CLT that was sent on 08 Jul 2022.

Co-authored-by: Ernesto Puerta <epuertat@redhat.com>>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-07-12 01:29:00 +10:00
Samuel Just
1b2dc7a872
Merge pull request #45519 from zhscn/wip-split-extent
crimson: split ObjectDataBlock when overwriting

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-10 22:22:21 -07:00
Kefu Chai
ea34156f1e
Merge pull request #47036 from tchaikov/wip-spec-with-crimson
ceph.spec.in: fixes for "with seastar"

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-11 11:33:53 +08:00
Zhang Song
114502a060 test/crimson/seastore: add test case for splitting ObjectDataBlock
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-07-11 10:23:37 +08:00
Zhang Song
2f02c07c3c test/crimson/seastore: add test case for TransactionManager::map_existing_extent
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-07-11 10:23:37 +08:00
zhscn
ec90bcbfec crimson/os/seastore: update TransactionManager::get_extent_if_live
TransactionManager::get_extents_if_live should return a list of
extents that are located in range paddr~len. When SegmentCleaner
invokes get_extents_if_live, the target extent may have been split into
multiple pieces by other transaction, so only search the paddr as key
will lose other pieces need to be rewritten.

Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-07-11 10:23:37 +08:00
Zhang Song
d352cac9ab crimson/os/seastore: split ObjectDataBlock when overwriting
Signed-off-by: Zhang Song <zhangsong325@gmail.com>

fix obj
2022-07-11 10:23:37 +08:00
Zhang Song
84400c374d crimson/os/seastore: introduce TransactionManager::map_existing_extent
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-07-11 10:23:34 +08:00
Zhang Song
97dcfbaed6 crimson/os/seastore: new extent state: EXIST_CLEAN and EXIST_MUTATION_PENDING
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-07-11 09:59:16 +08:00
Kefu Chai
00d326ec6d
Merge pull request #47029 from tchaikov/wip-link-against-ceph-common
cmake: link librados applications against ceph-common

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-11 08:27:21 +08:00
Kefu Chai
875b8b87a3
Merge pull request #47030 from tchaikov/wip-crimson-cleanup
crimson/osd: drop unused .cc file

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-11 08:26:30 +08:00
Kefu Chai
25708a5450
Merge pull request #47033 from tchaikov/wip-crimson-modified-by
crimson/osd: use a named type for user_modify

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-11 08:26:11 +08:00
Kefu Chai
40039e7b00 ceph.spec.in: disable WITH_JAEGER if "with seastar"
this is an intermediate solution for building crimson rpm packages.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-10 20:22:58 -04:00
Kefu Chai
be0b9534db ceph.spec.in: enable WITH_SEASTAR if "with seastar"
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-10 20:22:58 -04:00
Zac Dover
c186c5ec6c doc/dev: edit delayed-delete.rst
This PR improves the English in the "CephFS Delayed
Deletion" chapter of the Ceph Internals Guide (which
is stored in the doc/dev/ directory).

There was no pressing need to rewrite this. I just saw
that it could be tightened up, and I had the fifteen
minutes I needed to do it.

Co-author: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-07-11 01:33:51 +10:00
Kefu Chai
e8e2cca187
Merge pull request #46895 from tchaikov/wip-more-constness
osd, crimson: add more constness

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-10 17:27:42 +08:00
Kefu Chai
a3826d2ae5 crimson/osd: use a named type for user_modify
for better readability

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-10 00:28:58 -04:00
Kefu Chai
33f576a9c0
Merge pull request #46862 from kamoltat/wip-ksirivad-fix-56392
mon/Elector: make paxos_size() an int

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-10 11:35:56 +08:00
Kefu Chai
d84a001d01
Merge pull request #46923 from rzarzynski/wip-crimson-opexec-reformat-switch
crimson/osd: clean up the op dispatch on OpsExecuter

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-10 11:23:29 +08:00
Kefu Chai
41814d123d crimson/osd: drop unused .cc file
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-09 21:45:47 +08:00
Kefu Chai
cebff5786d cmake: link librados applications against ceph-common
to address link failures like:

[100%] Linking CXX executable ../../../bin/unittest_global_doublefree
/opt/rh/gcc-toolset-12/root/usr/bin/ld: /opt/rh/gcc-toolset-12/root/usr/lib/gcc/x86_64-redhat-linux/12/libstdc++_nonshared.a(sstream-inst80.o): undefined reference to symbol '_ZTVNSt7__cxx1119basic_ostringstreamIwSt11char_traitsIwESaIwEEE@@GLIBCXX_3.4.21'
/opt/rh/gcc-toolset-12/root/usr/bin/ld: /usr/lib64/libstdc++.so.6: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status

this happens when using gcc-toolset to build the tree.

because neither librados.so nor libcephfs exposes libstdc++ symbols
to executable linking against it. while CMake uses "c++" to link
C++ executables. the "c++" executable comes from GTS links the C++
executables agaist
/opt/rh/gcc-toolset-12/root/usr/lib/gcc/x86_64-redhat-linux/12/libstdc++.so,
which in turn is a ld script:

```
$ cat /opt/rh/gcc-toolset-12/root/usr/lib/gcc/x86_64-redhat-linux/12/libstdc++.so
/* GNU ld script
   Use the shared library, but some functions are only in
   the static library, so try that secondarily.  */
OUTPUT_FORMAT(elf64-x86-64)
INPUT ( /usr/lib64/libstdc++.so.6 -lstdc++_nonshared )
```

but the thing is, stdc++_nonshared references some symbols
provided by libstdc++.so.6, and it is listed before it. that's
why "ld" is not able to resolve the referenced symbols used by
the executable, despite that they are provided by libstdc++ in
this case.

in this change, ceph-common is added to the linkage of executables
linked against librados and/or libcephfs, even the executables
in question does not reference ceph-common symbols. unlike librados,
libcephfs and librgw, ceph-common is an internal library, which does
not hide *any* symbols from its consumer, it is also able to provide
symbols from C++ standard library linked by it. so, in our case,
we can link the C++ executables against ceph-common for accessing
the C++ standard library. the reason why we don't link aginst libstdc++
explictly is that, we should leave this to the C++ compiler instead of
referencing a specific C++ standard library explictly by its name.
what if user wants to link against libc++ instead of libstdc++?
another fix could be to remove '-Wl,--as-needed' linker options
from the command line linking the librados applications, so the linker
does not ignore the symbols from libstdc++ when resolving the ones
referenced by stdc++_nonshared, but that would be complicated.

please note, linking against ceph-common does not change the linkage
of

* Ceph executables compiled using non-gcc-toolset toolchain, because we
  always pass '-Wl,--as-needed' to "c++" when linking executables,
  so "ld" should be able to drop ceph-common even we instruct it
  to link against ceph-common. so it would be a no-op in this case.
* 3rd party librados executables compiled using non-gcc-toolset toolchain,
  but linked against librados compiled using gcc-toolset toolchain.
  because they still link against the /usr/lib64/libstdc++.so.6, when
  these executables are compiled and linked. and librados is always
  able to access libceph-common. so librados is safe.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-09 21:02:04 +08:00
Kefu Chai
cc33ff6fef
Merge pull request #47023 from tchaikov/wip-doc-crimson
doc/dev/crimson: Correct the link to Scylla

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-07-09 08:42:00 +08:00
Kefu Chai
f877a4f3eb doc/dev/crimson: Correct the link to Scylla
the old one brings us to 404.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-09 00:03:16 +08:00
Rishabh Dave
15ccc52a81
Merge pull request #46861 from ajarr/fix-54108
qa/suites/fs: skip check-counters for iogen workload

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2022-07-08 19:36:22 +05:30
Rishabh Dave
d5f9883e0f
Merge pull request #46833 from kotreshhr/standby-replay-blocklist-assert
mds: Don't blocklist clients in any replay state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2022-07-08 19:33:10 +05:30
Rishabh Dave
17b6d4374d
Merge pull request #46191 from rishabh-d-dave/qa-cephfs-mount-rm-sudo
qa/cephfs: remove sudo parameter from run_shell()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-07-08 19:30:16 +05:30
Rishabh Dave
9f95f96dc0
Merge pull request #45998 from dparmar18/implement_ln_cephfs_shell
cephfs-shell: ln command implementation

Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2022-07-08 19:26:34 +05:30
Yuri Weinstein
aaac9994b1
Merge pull request #46225 from inspur-wyq/wip-bluestore-deferred_stable
os/bluestore: use swap for deferred_stable when not bluefs_layout.single_shared_device()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2022-07-08 03:34:37 -07:00
Soumya Koduri
634b1fec89
Merge pull request #46853 from soumyakoduri/wip-skoduri-dbstore-lc
rgw/dbstore: Lifecycle support

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-08 13:58:57 +05:30
Sébastien Han
0e25447289
Merge pull request #47015 from ljflores/wip-stale-bot-schedule
.github/workflows: run the stale bot every hour
2022-07-08 10:27:41 +02:00
Venky Shankar
e9b7e9b4ec
Merge pull request #46951 from dparmar18/fix_caps_doc
doc/cephfs/capabilities: Fixed some typos

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by:  Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-07-08 10:29:40 +05:30