Commit Graph

120460 Commits

Author SHA1 Message Date
Lucian Petrut
618a340168 cephfs: disable inode emulation on Windows
cephfs will use fake inodes when sizeof(ino_t) < 8. On Windows,
ino_t is defined as unsigned short (2B), which isn't enough.

On the other hand, most "native" Windows structures, including the
Dokan ones, are using 64b identifiers.

That being considered, we'll disable inode emulation on Windows.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2021-03-05 07:59:48 +00:00
Josh Durgin
03c91f7326
Merge pull request #39824 from batrick/nightly-partitions
qa: allow specifying partition size for nightlies

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-03-04 18:15:56 -08:00
Kefu Chai
3cbeb056ea
Merge pull request #39457 from tchaikov/wip-sphinx-rtd-theme
doc: switch to sphinx_rtd_theme theme

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-05 10:08:12 +08:00
Neha Ojha
22d94c61c4
Merge pull request #39842 from liewegas/smoke-timeout
src/test/smoke.sh: increase timeout

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-04 18:05:35 -08:00
Kefu Chai
0a49cb156d
Merge pull request #39840 from rzarzynski/wip-crimson-notify_reply_t
crimson/osd: fix the serialization of notify_reply_t.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-05 10:05:13 +08:00
Kefu Chai
14c9572eb2 doc/_theme: customize sphinx_rtd_theme
* move the breadcrumbs to the top
* add border around admonition elements
* use different colors and fonts for section headers
* add decoration lines at the bottom of breadcrumbs
* remove left and right borders in tables
* override the injected versions, the name of theme
  is different from "sphinx_rtd_theme", but the
  versions element is still displayed at the
  bottom-left corner as "versions.html" defines.
  without overriding .rst-badge CSS styling,
  readthedocs puts the injected versions at
  the default bottom-right corner, see
  2a519f1146/readthedocs/api/v2/templates/restapi/footer.html

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-05 09:59:16 +08:00
Sage Weil
69d7aa9bf1 src/test/smoke.sh: increase timeout
Fixes: https://tracker.ceph.com/issues/47419
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 17:34:00 -06:00
Patrick Donnelly
1ef08db575
qa: schedule random subset
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:43:27 -08:00
Patrick Donnelly
6863d36213
qa: allow specifying partition size for nightlies
I did some visual cleanup too but mostly this changeset is to support
specifying subsets for each suite type. For now, only "fs" suite is
using partitions different from rados.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:41:34 -08:00
Patrick Donnelly
cab87f956b
Merge PR #39787 into master
* refs/pull/39787/head:
	qa: Update featureful_client suite to use octopus instead of nautilus

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:33:14 -08:00
Patrick Donnelly
ec13ed7c50
Merge PR #39724 into master
* refs/pull/39724/head:
	qa: skip exit-on-first-failure option for valgrind on ubuntu
	mds,qa: exit instead of respawn under valgrind
	qa: skip chdir for fuse_mount
	qa: ignore all slow request warnings
	qa: add new mds beacon grace mon config
	qa: wait for MDS to join fsmap
	qa: move get_valgrind_args to qa

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-04 13:32:10 -08:00
Patrick Donnelly
fd04c30296
Merge PR #39354 into master
* refs/pull/39354/head:
	mds/client: create cephfs errno aliases

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:28:59 -08:00
Patrick Donnelly
13c50a9923
Merge PR #38684 into master
* refs/pull/38684/head:
	qa: add _check_scrub_status helper to simplify the code
	qa: add run_scrub helper in filesystem class
	qa: add get_scrub_status helper in filesystem class
	qa: wait the scrub task to complete
	qa: remove passed_validation check for test_damage
	qa: move wait_until_scrub_complete helper to filesystem class
	mds: simplify the C_MDS_EnqueueScrub finish code

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:27:45 -08:00
Yuri Weinstein
8d83441c2f
Merge pull request #39835 from yuriw/wip-yuriw-crontab-master
qa/tests: moved nautilus and octopus tests to run on gibba and -p 70 …

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-04 13:23:20 -08:00
Sage Weil
d07cff2aa6 Merge PR #39832 into master
* refs/pull/39832/head:
	mgr/DaemonServer: osd ok-to-stop: return json when there are unknown PGs

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 16:08:14 -05:00
Sage Weil
c7e1d20e32 Merge PR #39726 into master
* refs/pull/39726/head:
	mgr/cephadm: document ok_to_stop output argument for clarity
	mgr/DaemonServer: make warning language a bit friendlier
	mgr/cephadm/upgrade: improve language a bit
	mgr/cephadm/upgrade: restart multiple osds at once
	mgr/cephadm: gather other osds that are safe to stop
	mgr/cephadm: optional pass 'known' through to ok_to_stop
	mgr/cephadm/upgrade: log start/stop/pause/resume

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 14:31:57 -05:00
Harish Munjulur
9d15a4eb72
Merge pull request #38741 from BryceCao/wip-standardize-request
rgw : add the check for bucket handler if http args exist object_exclusive sub_resource
2021-03-04 11:07:17 -08:00
Harish Munjulur
3eec40adb9
Merge pull request #39790 from yuvalif/wip-yuval-fix-49557
rgw/notification: fix persistent notification hang when ack-levl=none
2021-03-04 11:05:30 -08:00
Harish Munjulur
50d509ef45
Merge pull request #39782 from yuvalif/wip-yuval-fix-49552
rgw/notification: fixing the "persistent=false" flag
2021-03-04 11:05:14 -08:00
Harish Munjulur
9bd2a5d1d9
Merge pull request #39515 from CloudFerro/gc_max_objs
rgw: limit rgw_gc_max_objs to RGW_SHARDS_PRIME_1
2021-03-04 11:03:56 -08:00
Harish Munjulur
dfcdc912e9
Merge pull request #39380 from leseb/rgw-svc-map-name
rgw: register daemon in service map with more details
2021-03-04 11:03:19 -08:00
Yuri Weinstein
4845755730 qa/tests: moved nautilus and octopus tests to run on gibba and -p 70 for smoke tests
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-03-04 10:57:56 -08:00
Radoslaw Zarzynski
0b79eba1c0 crimson/osd: fix the serialization of notify_reply_t.
The `LibRadosWatchNotify.WatchNotify2` was expecting
data in the very raw form:

```cpp
  std::map<std::pair<uint64_t,uint64_t>, bufferlist> reply_map;
  std::set<std::pair<uint64_t,uint64_t> > missed_map;
  auto reply_p = reply.cbegin();
  decode(reply_map, reply_p);
  decode(missed_map, reply_p);
```

while the serialization of `notify_reply_t` was appending
extra preamable with versioning data.

This was the root cause of the following problem:
```
2021-03-04T15:40:03.001 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: Running main() from gmock_main.cc
2021-03-04T15:40:03.001 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [==========] Running 11 tests from 2 test suites.
2021-03-04T15:40:03.002 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [----------] Global test environment set-up.
2021-03-04T15:40:03.002 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [----------] 10 tests from LibRadosWatchNotify
2021-03-04T15:40:03.002 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [ RUN      ] LibRadosWatchNotify.WatchNotify
2021-03-04T15:40:03.002 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: watch_notify_test_cb
2021-03-04T15:40:03.003 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [       OK ] LibRadosWatchNotify.WatchNotify (744 ms)
2021-03-04T15:40:03.003 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [ RUN      ] LibRadosWatchNotify.Watch2Delete
2021-03-04T15:40:03.003 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: waiting up to 300 for disconnect notification ...
2021-03-04T15:40:03.003 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: watch_notify2_test_errcb cookie 94023196839536 err -107
2021-03-04T15:40:03.004 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [       OK ] LibRadosWatchNotify.Watch2Delete (3123 ms)
2021-03-04T15:40:03.004 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [ RUN      ] LibRadosWatchNotify.AioWatchDelete
2021-03-04T15:40:03.004 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: waiting up to 300 for disconnect notification ...
2021-03-04T15:40:03.004 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: watch_notify2_test_errcb cookie 94023196851488 err -107
2021-03-04T15:40:03.005 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [       OK ] LibRadosWatchNotify.AioWatchDelete (5086 ms)
2021-03-04T15:40:03.005 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: [ RUN      ] LibRadosWatchNotify.WatchNotify2
2021-03-04T15:40:03.005 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: watch_notify2_test_cb from 4394 notify_id 120259084288 cookie 94023196869248
2021-03-04T15:40:03.005 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: unknown file: Failure
2021-03-04T15:40:03.006 INFO:tasks.workunit.client.0.smithi058.stdout:         api_watch_notify: C++ exception with description "End of buffer" thrown in the test body.```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-03-04 18:23:56 +00:00
Radoslaw Zarzynski
09910c9352 crimson/osd: improve debugs around sending notify_reply_t.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-03-04 18:23:56 +00:00
Sage Weil
2a1c3997cd mgr/cephadm: document ok_to_stop output argument for clarity
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 12:01:28 -05:00
Sage Weil
defc019c6a Merge PR #39823 into master
* refs/pull/39823/head:
	qa/tasks/cephadm: remove mirror code

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-03-04 11:41:28 -05:00
Sebastian Wagner
aec8aa96cb
Merge pull request #39822 from mgfritch/cephadm-custom-container-sample
cephadm: split custom container args into argv

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-04 16:23:26 +01:00
Sebastian Wagner
7744777de1
Merge pull request #39699 from mgfritch/cephadm-bin-flake8-quotes
cephadm: introduce flake8 and flake8-quotes

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-03-04 15:59:07 +01:00
Sage Weil
2cce16537c mgr/DaemonServer: osd ok-to-stop: return json when there are unknown PGs
In 791952cc01 we switched to return JSON
both on success and fail to describe which PGs are affected or are blocking
the ability to stop/restart OSDs.  Do the same for the case where
some PG states are unknown (i.e., just after a mgr restart) so that
the cephadm upgrade process can unconditionally expect a JSON result.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 08:41:07 -05:00
Sage Weil
208407c5c0 qa/tasks/cephadm: remove mirror code
This is being done from ansible now.  Also, it breaks when
the conf file has unqualified-search-registries but not 'registry'
entries.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-04 07:39:15 -06:00
Kefu Chai
dbab7e24f3
Merge pull request #39831 from xxhdx1985126/wip-crimson-io-sequencer-bug
crimson/osd: do not pass lvalue of the lambda to seastar::futurize_invoke

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 21:10:36 +08:00
Matt Benjamin
c0e65f7496
Merge pull request #39656 from pritha-srivastava/wip-rgw-sts-user-fix
rgw/sts: fix for encoding/decoding user namespace
2021-03-04 07:57:58 -05:00
Ernesto Puerta
434530dd55
Merge pull request #39452 from rhcs-dashboard/wip-49283-master
mgr/dashboard: report mgr fsid 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-03-04 13:53:06 +01:00
Xuehan Xu
a44cac9041 crimson/osd: do not pass lvalue of the lambda to seastar::futurize_invoke
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 20:31:24 +08:00
Kefu Chai
5b55f6709f
Merge pull request #39815 from sebastian-philipp/github-cephadm-minor
.github: Minor cephadm changes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 19:06:08 +08:00
Kefu Chai
c7ab9845f5 doc: import layout.html from sphinx_rtd_theme
so we can customize it later

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-04 19:00:47 +08:00
Kefu Chai
275c6bd1b7 doc: switch to sphinx_rtd_theme
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-04 19:00:47 +08:00
Kefu Chai
cb7c0b41c5
Merge pull request #39827 from xxhdx1985126/wip-crimson-minor-bugs
crimson/osd: capture error_code by value in PG::handle_failed_op

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 18:33:25 +08:00
Kefu Chai
762b27af2c
Merge pull request #39812 from rzarzynski/wip-crimson-admin-config-help
crimson/admin: add support for 'config help'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-04 17:45:16 +08:00
Xuehan Xu
1df4ab9425 crimson/osd: capture error_code by value in PG::handle_failed_op
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-04 17:20:28 +08:00
Ernesto Puerta
461d17c29a
Merge pull request #39801 from rhcs-dashboard/49574-fix-pyjwt
mgr/dashboard: fix issues related with PyJWT versions >=2.0.0

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-03-04 09:53:42 +01:00
Nathan Cutler
18627bfeb0
Merge pull request #39755 from smithfarm/wip-49550
rpm: use PMDK system libraries on SUSE

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-03-04 09:29:47 +01:00
Patrick Donnelly
61ea12852f
Merge PR #39799 into master
* refs/pull/39799/head:
	doc: update affiliation for myoungwon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-03 20:05:22 -08:00
myoungwon oh
d0c56ec3ef doc: update affiliation for myoungwon
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-03-04 09:33:41 +09:00
Michael Fritch
1474477375
cephadm: split custom container args into argv
introduced by usage of `shlex` in 3ea514c5

Fixes: https://tracker.ceph.com/issues/49590
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-03 13:48:12 -07:00
Nathan Cutler
30df650e64 rpm: use PMDK system libraries on SUSE
As of a49d1dbb32, when the rbd_rwl_cache and
rbd_ssd_cache bconds are enabled and WITH_SYSTEM_PMDK is disabled (as it is by
default), the RPM build attempts to

    git clone https://github.com/ceph/pmdk.git

but of course that won't work in the OBS, where the build workers have no
Internet connectivity.

Fortunately, the openSUSE/SLE versions targeted by Ceph master and pacific ship
the necessary PMDK libraries as RPM packages.

Fixes: a49d1dbb32
Fixes: https://tracker.ceph.com/issues/49550
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2021-03-03 20:46:20 +01:00
Nathan Cutler
ef0384dc50
Merge pull request #39765 from smithfarm/wip-ncpus-for-obs
rpm: set build parallelism from memory on SUSE

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
2021-03-03 20:44:20 +01:00
Patrick Donnelly
7bb6845e87
Merge PR #39682 into master
* refs/pull/39682/head:
	vstart_runner: remove duplicate methods from LocalCephManager

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-03 10:05:35 -08:00
Patrick Donnelly
3107a1f1f8
Merge PR #39780 into master
* refs/pull/39780/head:
	qa/vstart_runner: dont log "not Ceph bin" msg too often

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-03 10:04:23 -08:00
Patrick Donnelly
c9c64eb66b
Merge PR #39681 into master
* refs/pull/39681/head:
	vstart_runner: define path to ceph binary and use it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-03 10:02:41 -08:00