Commit Graph

130813 Commits

Author SHA1 Message Date
Vikhyat Umrao
d59e376b13 docs/releases: update quincy release notes tracker 55383 known issue
Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2022-05-03 09:38:21 -07:00
Samuel Just
628120df10
Merge pull request #46079 from ronen-fr/wip-rf-log-mock
common: make LogChannel mockable

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-03 08:02:34 -07:00
Daniel Gryniewicz
94f21e5aea
Merge pull request #46115 from dang/wip-dang-split-init
RGW - Split RGWRados initialization

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Soumya Koduri <skaduri@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
2022-05-03 08:02:51 -04:00
Anthony D'Atri
844f849148
Merge pull request #46066 from bluikko/patch-4
doc/cephadm/services: Add missing ceph command to orch apply commands
2022-05-02 22:54:06 -07:00
zdover23
42dd40365b
Merge pull request #46109 from bluikko/pgcalc_links
doc/rados: fix pgcalc links

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-05-03 08:39:12 +10:00
Ali Maredia
d634f0690b
Merge pull request #44494 from mdw-at-linuxbox/wip-master-mankey
rgw/crypt: sse-s3 changes

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-05-02 16:57:55 -04:00
Adam King
3f5e9454d6
Merge pull request #45843 from ajarr/wip-mgr-nfs-output-message
mgr/nfs: clarify in the output message

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-05-02 13:40:36 -04:00
Yuri Weinstein
83041da20d
Merge pull request #46095 from aclamk/wip-aclamk-unbounded-wholespace-iterator
kv/RocksDBStore: Remove ability to bound WholeSpaceIterator

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2022-05-02 10:14:33 -07:00
Daniel Gryniewicz
c9fdc3260a RGW - Split RGWRados initialization
The inter-connectedness of RadosStore and RGWRados resulted in a
segfault during RGWRados::init_complete due to the rados pointer not
being set in RadosStore yet.

Split the calls to RGWRados::initialize and RGWRados::init_complete, so
that we can set up RadosStore between them, allowing the services
created in RGWRados::init_complete to access the RadosStore.

Fixes: https://tracker.ceph.com/issues/55512

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-05-02 12:01:09 -04:00
Yuval Lifshitz
ba0bf61aac
Merge pull request #45842 from yuvalif/wip-yuval-const-notifications
rgw/notifications: make the interfaces const when possible
2022-05-02 17:01:52 +03:00
Ronen Friedman
af84a842d7
Merge pull request #46100 from ronen-fr/wip-rf-80cls-v1
osd/scrub: reformat scrub files to 80 cols

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-05-02 16:16:04 +03:00
Venky Shankar
ff144995a8
Merge pull request #45889 from lxbsz/wip-mds-clienup
mds: remove duplicated code

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-02 15:05:27 +05:30
Venky Shankar
8eac948482
Merge pull request #45983 from lxbsz/client_warning
client: fix compile warning

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-02 15:05:02 +05:30
Ville Ojamo
7e1dc46964 doc/radosgw: fix pgcalc link
The pgcalc tool has moved to the "old" ceph site so update
the link to avoid a 404.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-05-02 16:01:51 +07:00
Ville Ojamo
45f8d746ac doc/rados/operations: fix pgcalc link
The pgcalc tool has moved to the "old" ceph site so update
the link to avoid a 404.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-05-02 15:59:26 +07:00
Kefu Chai
c7ba165dac
Merge pull request #46051 from Matan-B/wip-matanb-ipv6-mount
mount/conf: Fix IPv6 parsing

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-05-02 16:33:58 +08:00
Anthony D'Atri
ec56816c80
Merge pull request #46102 from bluikko/ioctx_get_stats_docs
doc/rados/api: fix invalid RST syntax and don't sudo for vim
2022-05-02 00:11:14 -07:00
Venky Shankar
6aed497da8
Merge pull request #44305 from kotreshhr/vstart-fixes
qa: Fix a few tracebacks in vstart_runner 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-02 12:07:07 +05:30
Ville Ojamo
4a0e856acd pybind/rados: fix typo in get_stats documentation
Ioctx.get_stats() had a typo in return value documentation
block so add the "c" in "objects".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-05-02 11:52:14 +07:00
Ville Ojamo
04b8cf09b3 doc/rados/api: fix invalid RST syntax and don't sudo for vim
Fix invalid syntax where "linenos:" was printed in the
final rendered documentation instead of being used as
formatting syntax.

There is no need to use sudo for editing a source file
so run vim without sudo.

Change the whole block to use bash prompt since it is
a command.

Also modify the preceding text to hopefully not bold it.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-05-02 11:50:52 +07:00
Samuel Just
249a57d28a
Merge pull request #45794 from Matan-B/wip-matanb-c-submit_txn
crimson/osd: submit_transaction() refactoring

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-01 13:02:47 -07:00
Matan Breizman
48bf0beecd crimson/osd: submit_transaction() refactoring
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-05-01 10:42:31 +00:00
Yuval Lifshitz
514eb89a3b
Merge pull request #45810 from zenomri/wip-rgw-lua-bucketname
rgw: support bucket name in lua pre request execution
2022-05-01 13:10:39 +03:00
Matan Breizman
5be921f334 mount/conf: Fix IPv6 parsing
Fixes: https://tracker.ceph.com/issues/47300

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-05-01 09:27:38 +00:00
Omri Zeneva
cd97a30bed rgw: support bucket name in pre request context
because bucket object is created only after authentication,
if bucket object is null upon accessing Request.Bucket.Name, we return req_state->init_state.url_bucket

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2022-05-01 10:31:03 +03:00
bluikko
4d96410826 doc/cephadm/services: Add missing ceph command to orch apply
In cephadm service management documentation several of the
ceph orch commands are missing the ceph part, mostly in
ceph orch apply commands but not all of them.

Add ceph in the front of the command to make them consistent
with all other commands.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2022-05-01 10:39:47 +07:00
J. Eric Ivancich
2c12dbb7f3
Merge pull request #46030 from ivancich/wip-fix-bucket-index-new
rgw: remove entries from bucket index shards directly in limited cases

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-04-30 19:29:19 -04:00
J. Eric Ivancich
73cab2a423
Merge pull request #45990 from cbodley/wip-55339
rgw: RGWPutLC does not require Content-MD5

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-04-30 17:32:52 -04:00
Anthony D'Atri
94e23f22dc
Merge pull request #46098 from anthonyeleven/anthonyeleven/submitting_patches_improvement
SubmittingPatches: Improve SubmittingPatches example
2022-04-30 11:01:28 -07:00
J. Eric Ivancich
69d44d8ab5
Merge pull request #45873 from BenoitKnecht/rgw-opa-segv
rgw: Avoid segfault when OPA authz is enabled

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-04-30 11:27:29 -04:00
J. Eric Ivancich
8310bd5762
Merge pull request #45882 from ivancich/wip-index-completion-mgr-crash
rgw: address crash and race in RGWIndexCompletionManager

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-04-30 11:26:15 -04:00
Ronen Friedman
ab64ebb909 common: make LogChannel mockable
Adding LoggerSinkSet, an abstract API that enables unit-testing
of OSD components that emit cluster-log messages, and trapping the
logs.

First usage example is in the Scrubber backend unit-tests.
The log "implementation" there (note the error counter that
can be used to determine tests success):

 class MockLog : public LoggerSinkSet {
 public:
  void warn(std::stringstream& s) override
  {
    std::cout << "\n<<warn>> " << s.str() << std::endl;
  }
  void error(std::stringstream& s) override
  {
    err_count++;
    std::cout << "\n<<error>> " << s.str() << std::endl;
  }
  ...

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-04-30 14:57:28 +00:00
Ronen Friedman
7e2ba75f07 osd/scrub: reformat scrub files to 80 cols
Reformatting the OSD scrub code files to match styleguide.
Specifically:
- force 80-cols lines; and
- (sadly) force 'use tabs' (replacing each 8 indentation
  blanks with a tab.

clang-format version used: 13
Configuration file used is detailed in PR comment.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-04-30 13:43:58 +00:00
Anthony D'Atri
0b32c65063 SubmittingPatches: Improve SubmittingPatches example
The example commit didn't show the convention of prefixing the message with
the relative directory path where the file lives, which has led new
contributors to innocently submit changes that aren't formatted ideally.
This adds a path to the example.

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-04-30 01:06:28 -07:00
Liu-Chunmei
1a6b2c6b9e
Merge pull request #46011 from liu-chunmei/seastore_omap_set/get_header
crimson/seastore: add OMAP_GET/SET_HEADER

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-04-29 22:05:58 -07:00
Adam Kupczyk
6b9b93829c kv/RocksDBStore: Remove feature to make WholeSpaceIterator based on bounded iterator
Iterator-bounding feature is introduced to make RocksDB iterators limited, so they
would less likely traverse over tombstones.
This is used when listing keys in fixed range, for example OMAPS for specific object.

It is problematic when extending this logic to WholeSpaceIterator,
since prefix must be taken into account.

Fixes: https://tracker.ceph.com/issues/55444

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2022-04-30 00:08:32 +02:00
chunmei-liu
c73df59c1d crimson/seastore: add OMAP_GET/SET_HEADER
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-04-29 15:05:47 -07:00
Mark Nelson
9c453a92fa
Merge pull request #45993 from markhpc/wip-crimson-argparse
crimson/osd: fix argument parsing after seastar changes
2022-04-29 13:42:28 -05:00
Daniel Gryniewicz
b286e3f3a3
Merge pull request #45987 from dang/wip-dang-zipper-standalone
RGW - Allow starting RGW/dbstore without connecting to Mons
2022-04-29 11:58:02 -04:00
zdover23
1ffef5da9e
Merge pull request #46044 from zdover23/wip-doc-2022-04-27-reef-PendingReleaseNotes-cleanup
doc: clean up PendingReleaseNotes for reef

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-04-29 07:39:43 +10:00
J. Eric Ivancich
de36f46276 rgw: address technical debt in RGWBucket::check_bad_index_multipart
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-04-28 13:35:23 -04:00
Yuval Lifshitz
cc5354e1c4
Merge pull request #43371 from liavt/master
rgw: notifications on object replication
2022-04-28 19:12:55 +03:00
Matt Benjamin
5d4e82be3b
Merge pull request #46023 from linuxbox2/wip-dbstore-shutdown
rgw: dbstore: add mechanism to signal gc_worker to exit
2022-04-28 10:14:35 -04:00
Guillaume Abrioux
dbca95185e
Merge pull request #46053 from guits/cv-quick-change-log-level
ceph-volume: only warn when config file isn't found
2022-04-28 10:13:14 +02:00
Marcus Watts
9235cf95c1 qa/rgw - run sse-s3 test cases only if configured or requested
This commit adds logic to automatically detect when sse-s3 is
available and if not, disables sse-s3 tests by default.
Configuration opions are provided to override the default either way.

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2022-04-27 21:14:55 -04:00
Laura Flores
7ecbc830f8
Merge pull request #46009 from ljflores/wip-link-submitting-backports 2022-04-27 18:01:30 -05:00
Daniel Gryniewicz
4d1a039772 RGW - Allow radosgw-admin to work on other stores
For debugging purposes, allow radosgw-admin to run with stores other
than RadosStore.  Many operations will still fail (by crashing), so care
must be taken when running this way.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-04-27 14:04:36 -04:00
Daniel Gryniewicz
0c50cecb29 RGW - Allow starting RGW/dbstore without connecting to Mons
DBStore, and some other Stores like Motr, don't need to connect to the
Mons to work.  However, startup automatically connects to the mons.
There's provision to not connect, but the split isn't quite right.  We
need to call global_pre_init() to get config from the file, to determine
which store to start, but we then need to decide before calling
global_init() whether the configured store needs to connect to the mons.

This requires a slight change to global_init() to set no_mon_config from
the new flags.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-04-27 14:04:36 -04:00
Ilya Dryomov
7d7fb643da
Merge pull request #46025 from CongMinYin/fix-endianness-issue-encoding
librbd/cache/pwl: fix bit field endianness issue

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-27 18:22:43 +02:00
Ramana Raja
3adb70a24d doc/mgr/nfs: Add commands to check the statuses
.. of NFS and ingress services after creating/deleting a NFS cluster.
The `nfs cluster info` command is not sufficient to show that the
NFS cluster is created/deleted as expected.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-04-27 12:12:36 -04:00