Commit Graph

120445 Commits

Author SHA1 Message Date
Patrick Donnelly
ec13ed7c50
Merge PR #39724 into master
* refs/pull/39724/head:
	qa: skip exit-on-first-failure option for valgrind on ubuntu
	mds,qa: exit instead of respawn under valgrind
	qa: skip chdir for fuse_mount
	qa: ignore all slow request warnings
	qa: add new mds beacon grace mon config
	qa: wait for MDS to join fsmap
	qa: move get_valgrind_args to qa

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-04 13:32:10 -08:00
Patrick Donnelly
fd04c30296
Merge PR #39354 into master
* refs/pull/39354/head:
	mds/client: create cephfs errno aliases

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:28:59 -08:00
Patrick Donnelly
13c50a9923
Merge PR #38684 into master
* refs/pull/38684/head:
	qa: add _check_scrub_status helper to simplify the code
	qa: add run_scrub helper in filesystem class
	qa: add get_scrub_status helper in filesystem class
	qa: wait the scrub task to complete
	qa: remove passed_validation check for test_damage
	qa: move wait_until_scrub_complete helper to filesystem class
	mds: simplify the C_MDS_EnqueueScrub finish code

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:27:45 -08:00
Yuri Weinstein
8d83441c2f
Merge pull request #39835 from yuriw/wip-yuriw-crontab-master
qa/tests: moved nautilus and octopus tests to run on gibba and -p 70 …

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-04 13:23:20 -08:00
Sage Weil
d07cff2aa6 Merge PR #39832 into master
* refs/pull/39832/head:
	mgr/DaemonServer: osd ok-to-stop: return json when there are unknown PGs

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 16:08:14 -05:00
Sage Weil
c7e1d20e32 Merge PR #39726 into master
* refs/pull/39726/head:
	mgr/cephadm: document ok_to_stop output argument for clarity
	mgr/DaemonServer: make warning language a bit friendlier
	mgr/cephadm/upgrade: improve language a bit
	mgr/cephadm/upgrade: restart multiple osds at once
	mgr/cephadm: gather other osds that are safe to stop
	mgr/cephadm: optional pass 'known' through to ok_to_stop
	mgr/cephadm/upgrade: log start/stop/pause/resume

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 14:31:57 -05:00
Harish Munjulur
9d15a4eb72
Merge pull request #38741 from BryceCao/wip-standardize-request
rgw : add the check for bucket handler if http args exist object_exclusive sub_resource
2021-03-04 11:07:17 -08:00
Harish Munjulur
3eec40adb9
Merge pull request #39790 from yuvalif/wip-yuval-fix-49557
rgw/notification: fix persistent notification hang when ack-levl=none
2021-03-04 11:05:30 -08:00
Harish Munjulur
50d509ef45
Merge pull request #39782 from yuvalif/wip-yuval-fix-49552
rgw/notification: fixing the "persistent=false" flag
2021-03-04 11:05:14 -08:00
Harish Munjulur
9bd2a5d1d9
Merge pull request #39515 from CloudFerro/gc_max_objs
rgw: limit rgw_gc_max_objs to RGW_SHARDS_PRIME_1
2021-03-04 11:03:56 -08:00
Harish Munjulur
dfcdc912e9
Merge pull request #39380 from leseb/rgw-svc-map-name
rgw: register daemon in service map with more details
2021-03-04 11:03:19 -08:00
Yuri Weinstein
4845755730 qa/tests: moved nautilus and octopus tests to run on gibba and -p 70 for smoke tests
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-03-04 10:57:56 -08:00
Sage Weil
2a1c3997cd mgr/cephadm: document ok_to_stop output argument for clarity
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 12:01:28 -05:00
Sage Weil
defc019c6a Merge PR #39823 into master
* refs/pull/39823/head:
	qa/tasks/cephadm: remove mirror code

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 11:41:28 -05:00
Sebastian Wagner
aec8aa96cb
Merge pull request #39822 from mgfritch/cephadm-custom-container-sample
cephadm: split custom container args into argv

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-04 16:23:26 +01:00
Sebastian Wagner
7744777de1
Merge pull request #39699 from mgfritch/cephadm-bin-flake8-quotes
cephadm: introduce flake8 and flake8-quotes

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-03-04 15:59:07 +01:00
Sage Weil
2cce16537c mgr/DaemonServer: osd ok-to-stop: return json when there are unknown PGs
In 791952cc01 we switched to return JSON
both on success and fail to describe which PGs are affected or are blocking
the ability to stop/restart OSDs.  Do the same for the case where
some PG states are unknown (i.e., just after a mgr restart) so that
the cephadm upgrade process can unconditionally expect a JSON result.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 08:41:07 -05:00
Sage Weil
208407c5c0 qa/tasks/cephadm: remove mirror code
This is being done from ansible now.  Also, it breaks when
the conf file has unqualified-search-registries but not 'registry'
entries.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 07:39:15 -06:00
Kefu Chai
dbab7e24f3
Merge pull request #39831 from xxhdx1985126/wip-crimson-io-sequencer-bug
crimson/osd: do not pass lvalue of the lambda to seastar::futurize_invoke

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 21:10:36 +08:00
Matt Benjamin
c0e65f7496
Merge pull request #39656 from pritha-srivastava/wip-rgw-sts-user-fix
rgw/sts: fix for encoding/decoding user namespace
2021-03-04 07:57:58 -05:00
Ernesto Puerta
434530dd55
Merge pull request #39452 from rhcs-dashboard/wip-49283-master
mgr/dashboard: report mgr fsid 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-03-04 13:53:06 +01:00
Xuehan Xu
a44cac9041 crimson/osd: do not pass lvalue of the lambda to seastar::futurize_invoke
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 20:31:24 +08:00
Kefu Chai
5b55f6709f
Merge pull request #39815 from sebastian-philipp/github-cephadm-minor
.github: Minor cephadm changes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 19:06:08 +08:00
Kefu Chai
cb7c0b41c5
Merge pull request #39827 from xxhdx1985126/wip-crimson-minor-bugs
crimson/osd: capture error_code by value in PG::handle_failed_op

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 18:33:25 +08:00
Kefu Chai
762b27af2c
Merge pull request #39812 from rzarzynski/wip-crimson-admin-config-help
crimson/admin: add support for 'config help'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 17:45:16 +08:00
Xuehan Xu
1df4ab9425 crimson/osd: capture error_code by value in PG::handle_failed_op
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 17:20:28 +08:00
Ernesto Puerta
461d17c29a
Merge pull request #39801 from rhcs-dashboard/49574-fix-pyjwt
mgr/dashboard: fix issues related with PyJWT versions >=2.0.0

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-03-04 09:53:42 +01:00
Nathan Cutler
18627bfeb0
Merge pull request #39755 from smithfarm/wip-49550
rpm: use PMDK system libraries on SUSE

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-03-04 09:29:47 +01:00
Patrick Donnelly
61ea12852f
Merge PR #39799 into master
* refs/pull/39799/head:
	doc: update affiliation for myoungwon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-03 20:05:22 -08:00
myoungwon oh
d0c56ec3ef doc: update affiliation for myoungwon
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-03-04 09:33:41 +09:00
Michael Fritch
1474477375
cephadm: split custom container args into argv
introduced by usage of `shlex` in 3ea514c5

Fixes: https://tracker.ceph.com/issues/49590
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 13:48:12 -07:00
Nathan Cutler
30df650e64 rpm: use PMDK system libraries on SUSE
As of a49d1dbb32, when the rbd_rwl_cache and
rbd_ssd_cache bconds are enabled and WITH_SYSTEM_PMDK is disabled (as it is by
default), the RPM build attempts to

    git clone https://github.com/ceph/pmdk.git

but of course that won't work in the OBS, where the build workers have no
Internet connectivity.

Fortunately, the openSUSE/SLE versions targeted by Ceph master and pacific ship
the necessary PMDK libraries as RPM packages.

Fixes: a49d1dbb32
Fixes: https://tracker.ceph.com/issues/49550
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2021-03-03 20:46:20 +01:00
Nathan Cutler
ef0384dc50
Merge pull request #39765 from smithfarm/wip-ncpus-for-obs
rpm: set build parallelism from memory on SUSE

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
2021-03-03 20:44:20 +01:00
Patrick Donnelly
7bb6845e87
Merge PR #39682 into master
* refs/pull/39682/head:
	vstart_runner: remove duplicate methods from LocalCephManager

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 10:05:35 -08:00
Patrick Donnelly
3107a1f1f8
Merge PR #39780 into master
* refs/pull/39780/head:
	qa/vstart_runner: dont log "not Ceph bin" msg too often

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-03 10:04:23 -08:00
Patrick Donnelly
c9c64eb66b
Merge PR #39681 into master
* refs/pull/39681/head:
	vstart_runner: define path to ceph binary and use it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-03 10:02:41 -08:00
Patrick Donnelly
ec1b82fd24
qa: skip exit-on-first-failure option for valgrind on ubuntu
The valgrind version is too old.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
5faf0ee0f3
mds,qa: exit instead of respawn under valgrind
valgrind can't handle execve of /proc/self/exe:

    2021-02-27T05:52:37.813 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:01:03:20.556 41218== execve(0x18546740(/proc/self/exe), 0x18546670, 0x133ef310) failed, errno 2
    2021-02-27T05:52:37.813 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:01:03:20.556 41218== EXEC FAILED: I can't recover from execve() failing, so I'm dying.
    2021-02-27T05:52:37.813 INFO:tasks.ceph.mds.d.smithi073.stderr:==00:01:03:20.556 41218== Add more stringent tests in PRE(sys_execve), or work out how to recover.

So configure the MDS to just exit so it can be restarted by QA infra (the
daemon watchdog).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
3e5e03d4d2
qa: skip chdir for fuse_mount
The use of chdir will muck up the use of nsenter with valgrind:

    2021-03-03T02:13:49.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0
    2021-03-03T02:13:49.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse
    2021-03-03T02:13:49.914 INFO:teuthology.orchestra.run:Running command with timeout 30
    2021-03-03T02:13:49.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections
    2021-03-03T02:13:49.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi144.stderr:nsenter: failed to execute cd: No such file or directory

It's not necessary to chdir at all to do the mount, so don't.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
1d85c9d535
qa: ignore all slow request warnings
Generalize the ignorelist for:

    2021-02-27T05:54:27.644 INFO:teuthology.orchestra.run.smithi002.stdout:2021-02-27T05:20:24.513041+0000 mds.d (mds.0) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 183.680676 secs

From: /ceph/teuthology-archive/pdonnell-2021-02-26_23:40:39-fs-wip-pdonnell-testing-20210226.181017-distro-basic-smithi/5917580/teuthology.log

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
dcac1dbe62
qa: add new mds beacon grace mon config
Otherwise the mons don't observe it.

Fixes: https://tracker.ceph.com/issues/49507
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
911b9a55bb
qa: wait for MDS to join fsmap
When running under valgrind, MDS may be slow to be added to the FSMap
(especially if mons are in valgrind too). The file system creation that
follows will throw unnecessary warnings about insufficient standbys if
no MDS is available.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:21 -08:00
Patrick Donnelly
3681e3a1a8
qa: move get_valgrind_args to qa
This method is unused in the teuthology repo. The helper method better
belongs here where it is more easily modified.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 09:30:08 -08:00
Casey Bodley
38bb60b1e0
Merge pull request #39382 from gauravsitlani/master
rgw: added missing documentation on "pubsub" in rgw_enable_apis

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-03-03 12:13:16 -05:00
Nathan Cutler
4d47f8a928
Merge pull request #39762 from smithfarm/wip-support-leap-15.3
rpm/luarocks: simplify conditional and support Leap 15.3

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
2021-03-03 18:05:07 +01:00
Michael Fritch
d6323e3e01
cephadm: fixup alrady -> already
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 09:33:32 -07:00
Michael Fritch
55788a0bdb
cephadm: Change outer quotes to avoid escaping inner quotes (Q003)
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 09:33:32 -07:00
Michael Fritch
3b8656d496
cephadm: Remove bad quotes from multiline string (Q001)
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 09:33:32 -07:00
Michael Fritch
6ca31b99e1
cephadm: Remove bad quotes (Q000)
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 09:33:32 -07:00
Michael Fritch
49f25f56ae
cephadm: introduce flake8-quotes
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 09:33:32 -07:00