Temporarily disable teuthology cron jobs before
the Reef dev freeze. This commit is intended to
lessen the load on the teuthology queue as we
test final patches for Reef, but should be reverted
after the dev freeze.
Signed-off-by: Laura Flores <lflores@redhat.com>
This commit adds unit test coverage to the read balancing
feature, including small vs. large osdmap scenarios,
random osdmap scenarios, and scenarios that involve
tweaking primary affinity on an OSD.
Signed-off-by: Laura Flores <lflores@redhat.com>
This commit adds the capability to balance reads on a
given osdmap with the osdmaptool. The user has the option
of performing a "dry run" of read balancing OR taking it a
step further and applying the results to a live cluster.
Performing a "dry run" would involve simply running an
osdmaptool command and inspecting the results.
The template for the command is:
`osdmaptool <osd map file> --read <file for command output> --read-pool <pool name>`
An example command a user might run is:
`osdmaptool om --read out.txt --read-pool default.rgw.control`
This commit also adds a `--vstart` flag that allows a user to print ceph
commands in the outfile formatted for a vstart cluster. An example command
a user might run is:
`./bin/osdmaptool om --vstart --read out.txt --read-pool default.rgw.control`
The out.txt file would contain ceph commands prefixed with `./bin/`.
The `--vstart` flag may also be applied to an `--upmap` osdmaptool command.
If the user wants to apply read balancing results from their dry run to a
live cluster, they may either manually apply the ceph commands from the out
file, or run `source <outfile>`.
Signed-off-by: Laura Flores <lflores@redhat.com>
This commit implements two functions:
1. calc_desired_primary_distribution
Based on the number of pgs in a pool and the pool's
replica count, we calculate the ideal number of primary
pgs that should be assigned to each OSD on that pool in
order for reads to be balanced.
2. balance_primaries
This is the overall algorithm used to balance reads (primary
pgs) in a pool. Based on the first function, we re-distribute
primaries on the OSDs in a pool so each OSD has the ideal
number of primaries. This is done without data movement.
Signed-off-by: Laura Flores <lflores@redhat.com>
Document that this warning can happen even when the OSDs' limits
haven't hit the backfill_full_ratio.
Signed-off-by: Ponnuvel Palaniyappan <pponnuvel@gmail.com>
The ceph config file option (from the client section) "client quota df"
is mentioned in "CephFS Client Capabilities" document but not in the
"CephFS Quota" document. Adding information about this option to this
document too would make it easier for CephFS users to discover,
understand and use this option.
Signed-off-by: Rishabh Dave <ridave@redhat.com>
CephFS users, especially new users, would find it easier to discover,
understand and use CephFS Quota when basic information (like setting,
viewing and removing CephFS quota from a CephFS directory) is mentioned
in the documentation before advanced information (like limitations &
implementation details of CephFS Quota).
Signed-off-by: Rishabh Dave <ridave@redhat.com>
The "results" directory in xfstests-dev repo contains logs that are
created by it during execution of its tests. Copying this directory to
Ceph log directory saves it from being erased during tear down conducted
by teuthology test runner. These logs allow deeper inspection in to the
cause of failure of tests.
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Create user "fsgqa2" and, since xfstests-dev's README uses option "-m"
while creating user "fsgqa", do the same in our codebase.
Creating user "fsgqa2" is optional along with other users according to
xfstests-dev's README. Create all these users is a preventive step since
tests needing user/users maybe skipped during execution.
Signed-off-by: Rishabh Dave <ridave@redhat.com>
In xfstests-dev repo, local.config options "SCRATCH_DEV" and
"SCRATCH_MNT" were enabled in commit
2ba6b87105 but TODO comment for the
wasn't deleted. Let's delete that and use format string instead of
format function on regular string.
Signed-off-by: Rishabh Dave <ridave@redhat.com>
The intention of this re-arrangement is to make it easier for developers
to use an already cloned and built xfstests-dev repo with
vstart_runner.py.
The re-arrangements are -
* move tearDown() closer to setUp() (so that devs can
enable/disable parts of them easily),
* carve out separate methods (so that these codeblocks can be disabled
in a single go) for -
** deleting groups and users,
** deleting xfstests-dev and xfsprogs-dev repo and
** building xfstests-dev repo
* carve out method for deleting xfstests-dev and xfsprogs-dev repos
* add self.xfstests_repo_path comment (for devs to set path to
xfstests-dev repo), and,
* add a note showing how to use already cloned and built xfstests-dev
repo
Signed-off-by: Rishabh Dave <ridave@redhat.com>
* refs/pull/45669/head:
client: switch to use 32 bits ext_num_fwd
client: switch to use 32 bits ext_num_retry
ceph_fs.h: add 32 bits extended num_retry and num_fwd support
ceph_fs.h: switch to use its own encode/decode helpers
Reviewed-by: Venky Shankar <vshankar@redhat.com>
From the xfstests-dev's README doc set DIFF_LENGTH to 0 will print
the full diff instead of the default 10.
This will be very helpful to debug the test failures, or we will
lose many valuable debug infomation.
Signed-off-by: Xiubo Li <xiubli@redhat.com>
Improve the pragmatics of the top matter of multisite.rst. Organize the
text into sections, where doing so makes the nature of multi-site
configurations clearer.
Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
In terms of `CXXFLAGS` this commit does for `examples/librbd`
exactly what be838652fa already
did to `examples/librados`. Together they cover the purpose
of the long-waiting PR #44738.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Commit dc69033763 moves cephfs-shell from
"<CEPH-REPO-ROOT>/src/tools/cephfs/" to
"<CEPH-REPO-ROOT>/src/tools/cephfs/shell" but cephfs-shell's location in
src/vstart.sh and qa/tasks/cephfs/test_cephfs_shell.py is left
un-updated. This produces a broken vstart_environment.sh and broken
export command in test_cephfs_shell.py.
Introduced-by: dc69033763
Fixes: https://tracker.ceph.com/issues/58795
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Fix a link in the doc/radosgw/session-tags.rst file that was intended to
link to the doc/radosgw/keycloak.rst file.
Signed-off-by: Zac Dover <zac.dover@proton.me>
