Commit Graph

126969 Commits

Author SHA1 Message Date
Patrick Donnelly
a5675535ba
qa: only set frag confs for workloads
Otherwise these local conf overrides prevent functional testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-07 15:08:34 -04:00
Patrick Donnelly
5ae32803e5
mds: improve debugging for fragment size check
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-07 15:08:31 -04:00
Matt Benjamin
103b6cc355
Merge pull request #43442 from linuxbox2/wip-rgwadmin-logfix
qa/rgw: fix ops log tests to handle non-bucket ops (which are now valid)
2021-10-07 11:04:16 -04:00
Kefu Chai
263b734ed5
Merge pull request #43448 from rzarzynski/wip-crimson-monmap-moredbgs
crimson, monmap: inform about errors when interacting with DNS

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-07 22:14:03 +08:00
Patrick Donnelly
2363078751
Merge PR #43231 into master
* refs/pull/43231/head:
	qa: fix promotion test

Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-10-07 09:16:34 -04:00
Radoslaw Zarzynski
ad3d47f582 crimson, monmap: inform about errors in MonMap::init_with_dns_srv().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-07 11:20:03 +00:00
Radoslaw Zarzynski
62a4638bf7 crimson, monmap: limit the scope of the seastar namespace inclusion.
More consistency that way. This also enables us to define the usual
`logger()` function without having a clash with `seastar::logger`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-07 11:20:03 +00:00
Venky Shankar
05b4772da8
Merge pull request #43384 from bosc0/master
mgr: Add check to prevent mgr from crashing

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-10-07 14:10:12 +05:30
Kefu Chai
8613642834
Merge pull request #41445 from guits/cephadm_quick_patch
cephadm: add daemon_name in daemon description

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-07 06:48:05 +08:00
Kefu Chai
958b22e3ab
Merge pull request #43335 from liewegas/debug-51815
mon,auth: fix proposal (and mon db rebuild) of rotating secrets

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-10-07 06:45:45 +08:00
Kefu Chai
351ebd68f5
Merge pull request #43379 from myoungwon/wip-evict-range
osd: trim corresponding chunks on tier_evict

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-07 06:44:33 +08:00
Kefu Chai
0a0cb8eac9
Merge pull request #43378 from ivancich/wip-build-without-mgr
rados: build minimally when "WITH_MGR" is off

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-07 06:43:25 +08:00
Kefu Chai
90d2e8ad9b
Merge pull request #43360 from jianwei1216/fix-shard-threads-cannot-wakeup-bug
osd: fix shard-threads cannot wakeup bug

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-07 06:41:54 +08:00
Kefu Chai
b2e806eedb
Merge pull request #43307 from taodd/recv_stamp_fix
msg/async/ProtocolV2: Set the recv_stamp at the beginning of receiving a message

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Dan Hill <daniel.hill@canonical.com>
2021-10-07 06:33:21 +08:00
Kefu Chai
22d9a69f9c
Merge pull request #43380 from myoungwon/wip-dont-promote-dirty
osd: do not promote objects if op is is_dirty

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-07 06:31:32 +08:00
Kefu Chai
ea586cdcf5
Merge pull request #43435 from rzarzynski/wip-crimson-pickv2only
crimson/osd: pick only v2 addresses.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-10-07 06:19:54 +08:00
Matt Benjamin
788da98cde qa/rgw: fix ops log tests to handle non-bucket ops (which are now valid)
After 3863eb89512f1698b8e56f1f1ffc78a6ca8d5826--rgw: permit logging of
list-bucket (and any other no-bucket op-- the radosgw ops-log
contains entries for ops with no associated buckets--e.g., list_buckets.
When examining such a log object in the radosgw_admin task, don't assert
that it has any bucket name.

Fixes: https://tracker.ceph.com/issues/52647

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-10-06 16:08:06 -04:00
Ernesto Puerta
df89e6a174
Merge pull request #43256 from rhcs-dashboard/fix-48845-master
qa/mgr/dashboard/test_pool: don't check HEALTH_OK

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-06 21:49:12 +02:00
Neha Ojha
363b223844
Merge pull request #42964 from trociny/wip-52448
osd: re-cache peer_bytes on every peering state activate

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-10-06 09:26:16 -07:00
Radoslaw Zarzynski
c7f2056f74 crimson/osd: pick only v2 addresses.
Otherwise we'll run into an assertion failure when binding:

```
INFO  2021-10-05 15:14:51,075 [shard 0] osd - picked address v2:0.0.0.0:0/0
INFO  2021-10-05 15:14:51,075 [shard 0] osd - picked address v1:0.0.0.0:0/0
ceph-osd: /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-8025-geb9c0f59/rpm/el8/BUILD/ceph-17.0.0-8025-geb9c0f59/src/crimson/net/SocketMessenger.cc:89: crimson::errorator<crimson::unthrowable_wrapper<const std::error_code&, ((const std::error_code&)(& crimson::ec<std::errc::address_in_use>))>, crimson::unthrowable_wrapper<const std::error_code&, ((const std::error_code&)(& crimson::ec<std::errc::address_not_available>))> >::future<> crimson::net::SocketMessenger::try_bind(const entity_addrvec_t&, uint32_t, uint32_t): Assertion `addrs.size() == 1' failed.
Aborting on shard 0.
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-06 14:44:02 +00:00
Patrick Donnelly
ed8e8b7600
Merge PR #43399 into master
* refs/pull/43399/head:
	mgr/volumes/fs/operations: fix various flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:17:49 -04:00
Patrick Donnelly
dcf333f403
Merge PR #43398 into master
* refs/pull/43398/head:
	mgr/volumes/fs: fix flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:17:19 -04:00
Patrick Donnelly
4e723b7c82
Merge PR #43397 into master
* refs/pull/43397/head:
	mgr/volumes/fs: fix flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:16:50 -04:00
Patrick Donnelly
59ec54aa73
Merge PR #43395 into master
* refs/pull/43395/head:
	mgr/volumes/fs/operations/versions: fix various flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:16:19 -04:00
Patrick Donnelly
4f60a67115
Merge PR #43392 into master
* refs/pull/43392/head:
	mgr/volumes/fs/operations: fix various flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:15:47 -04:00
Patrick Donnelly
d5287440ba
Merge PR #43391 into master
* refs/pull/43391/head:
	mgr/volumes/fs/vol_spec.py: fix flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:15:18 -04:00
Patrick Donnelly
7f6aa14be5
Merge PR #43390 into master
* refs/pull/43390/head:
	mgr/volumes/fs/operations : Fix flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:14:49 -04:00
Patrick Donnelly
a8a7680e5f
Merge PR #43387 into master
* refs/pull/43387/head:
	mgr/volumes: fix various flake8 issues

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:14:06 -04:00
Patrick Donnelly
2c1f6819af
Merge PR #43375 into master
* refs/pull/43375/head:
	mgr/volumes/fs: add extra blank line

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-05 20:13:34 -04:00
Patrick Donnelly
02516d6231
Merge PR #43357 into master
* refs/pull/43357/head:
	mgr/nfs: stick to lazy evaluation of logger messages
	mgr/nfs: change _cmd_rgw_export_create_rgw() name
	mgr/nfs: don't log fsal keys
	mgr/nfs: Add more debug log messages

Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2021-10-05 20:12:44 -04:00
Patrick Donnelly
b56623342e
qa: fix promotion test
The test is not needing to check that the new MDS becomes active, only
that a replacement occurs.

Fixes: https://tracker.ceph.com/issues/52677
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-05 19:57:18 -04:00
Yuri Weinstein
d5759e030b
Merge pull request #42977 from amathuria/wip-amathuri-scrub-duration
osd/scrub: Add scrub duration to pg dump stats

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2021-10-05 07:49:03 -07:00
Jianwei Zhang
566b60b3f6 osd: wake up more shard workers when new osdmap is consumed
Reproduce:
(1) ceph cluster not running any client IO
(2) only ceph osd in osd.14 operation

Reason:
(1) one shard-queue has three shard-threads
(2) one or some PeeringOp's epoch > osdmap's epoch held by current osd,
    and these PeeringOp _add_slot_waiter()
(3) shard-queue become empty and three shard-threads cond.wait()
(4) new osdmap consume and it _wake_pg_slot()
    Problem in here
	1> OSDShard::consume() exec loop all pg's slot wait
 	   and requeue more than one PeeringOp to shard-queue
        2> but it only notify one shard-thread to wakeup,
           the other two shard-threads continue cond.wait()
	3> OSD::ShardedOpWQ::_enqueue() found the shard-queue not empty
	   and not notify all shard-thread to wakeup

     In a period of time, only one shard-thread of 3 shard-threads is running.

Fixes: https://tracker.ceph.com/issues/52781
Signed-off-by: Jianwei Zhang <jianwei1216@qq.com>
Change-Id: I4617db2fd95082007e6d9fa2b60f17f2a6296b5b
2021-10-05 22:16:12 +08:00
Deepika Upadhyay
e4db160015
Merge pull request #43175 from ideepika/wip-supress-jaeger-cmake-logs
cmake,rgw: use jaeger-base target, as a dependency for building dbstore

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-10-05 14:00:50 +05:30
Josh Durgin
eb9c0f5982
Merge pull request #43410 from zdover23/wip-doc-2021-10-04-min-hardware-typo
docs/start: fix min. hardware rec. typo

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-10-04 11:02:06 -07:00
Zac Dover
14151f2abe docs/start: fix min. hardware rec. typo
The minimum hardware recommendations said that we
recommended a minimum of "24GB+ per daemon".

I changed this to read "2-4GB+ per daemon".

Reddit actually caught this one:
https://www.reddit.com/r/ceph/comments/q14ey2/cephs_mon_minimum_requirements/

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-10-05 02:57:51 +10:00
Deepika Upadhyay
463193bcaf cmake,rgw: use jaeger-base target, as a dependency for building dbstore
* dbstore also has tracing dependencies and missing linking for libraries
* use `using` keyword in common/tracer.cc to silence unused method
  warnings
* log building of external project jaegertracing, opentracing into build
  file, (done to reduce external project build verbosity)

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-10-04 13:52:49 +05:30
Sage Weil
0bc19b5449
Merge pull request #43402 from liewegas/doc-general-rep
doc/foundation: Martin is new general member rep
2021-10-03 13:42:45 -05:00
Patrick Donnelly
66cc38db1c
Merge PR #43383 into master
* refs/pull/43383/head:
	doc: fixed typo in terminology

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-10-02 12:27:40 -04:00
Sage Weil
df5be4ba93 doc/foundation: Martin is new general member rep
Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-02 10:49:46 -05:00
crossbears
fb88546dae mgr/volumes/fs/operations: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51390
Signed-off-by: Zoey <jingyasu@my.yorku.ca>
2021-10-01 19:52:55 -04:00
Eunice Lee
00e1df1d43 mgr/volumes/fs/vol_spec.py: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51384

Signed-off-by: Eunice Lee <eunice337@gmail.com>
2021-10-01 15:59:58 -07:00
Hargun Kaur
5b292130f2 mgr/volumes/fs: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51407

Signed-off-by: Hargun Kaur <hargunalone@gmail.com>
2021-10-01 22:39:33 +00:00
Gokcen Iskender
c8af51d302
mgr/volumes/fs/operations/versions: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51403
Signed-off-by: Gokcen Iskender <gokceng@gmail.com>
2021-10-01 15:16:29 -07:00
Eunice Lee
add94f1e48 mgr/volumes/fs: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51381

Signed-off-by: Eunice Lee <eunice337@gmail.com>
2021-10-01 15:11:28 -07:00
Gokcen Iskender
364d38e26a
mgr/volumes/fs/operations: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51398
Signed-off-by: Gokcen Iskender <gokceng@gmail.com>
2021-10-01 15:09:07 -07:00
Anuradha Kulkarni
e0ddb81358 mgr/volumes/fs/operations : Fix flake8 issues
Fixes : https://tracker.ceph.com/issues/51396

Signed-off-by: Anuradha Kulkarni <anuradhak1990@gmail.com>
2021-10-01 18:00:27 -04:00
Almen Ng
4d3e366e0b mgr/volumes: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51380

Signed-off-by: Almen Ng <almen000509@gmail.com>
2021-10-01 17:28:34 -04:00
Sage Weil
d83d12b90f ceph-monstore-tool: include rotating keys in rebuilt mon
This avoids an initial period after mon restart in which there are no
rotating keys and authentication can fail.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-01 14:42:35 -04:00
Sage Weil
18864380cc mon,auth: fix proposal of rotating keys
Instead of updating the live CephxKeyServer's rotating_keys and also
including them in a paxos proposal, propose new keys only in the proposal,
and only make them live once they are committed.  This keeps mons fully in
sync and avoids any inconsistency between the live behavior and committed
state (e.g., stale or divergent keys being applied and passed out to
daemons).

Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-01 14:42:35 -04:00