Commit Graph

115975 Commits

Author SHA1 Message Date
Xiubo Li
833eca15f2 qa/tasks: add a 'parallel' option support for the cram task
For the ceph-iscsi test case we need to run the tests sequentially,
because the client test will depend on the gateway ones.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-12 21:46:34 +08:00
Tatjana Dehler
1edaa17181
Merge pull request #37154 from bk201/wip-47397
mgr/dashboard: fix the error when exporting CephFS path "/" in NFS exports

Reviewed-by: Laura Paduano lpaduano@suse.com
Reviewed-by: Stephan Müller smueller@suse.com
Reviewed-by: Varsha Rao varao@redhat.com
2020-10-12 14:32:39 +02:00
Venky Shankar
a95b364e3e test: add tests for validating MDS metrics via perf stats module
Fixes: http://tracker.ceph.com/issues/24285
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
5afdf26943 test: Filesystem class helpers to grow and shrink MDS cluster
These routines were test specific. Make them a part of Filesystem
class.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
7523aef6e8 mgr/stats: mds performance stats module
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
e739b831b7 mds: support sending empty perf metrics to ceph-manager
Right now, there are no per-mds metrics that are tracked and
sent by mds. However, such metrics will get added soon. So,
send empty performance metrics to ceph-manager for now.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Ramana Raja
d1d5d61884 qa/tasks/cephfs: Refactor test_volumes
... into smaller test classes. This enables breaking up the volumes yaml
into smaller yaml fragments.

Fixes: https://tracker.ceph.com/issues/47160
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-10-12 13:54:40 +05:30
Kefu Chai
130c2715d9
Merge pull request #37628 from changchengx/mail_update
mailmap: update Intel employee mail/org

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-12 15:43:30 +08:00
Changcheng Liu
6ab6021ab4 msg: remove unnecessary assignment
memset(&header, 0, sizeof(header)) clear the variable to
be 0.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-12 12:59:09 +08:00
Changcheng Liu
08e82e2cc7 msg: remove outdated comments
Parameter "features" has been removed in commit 0dbe8fd398.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-12 12:58:35 +08:00
Changcheng Liu
1e8c30a1e1 mailmap: update Intel employee mail/org
1. "changcheng.liu@aliyun.com" need be classified into intel until now.
   This reverts part of commit: df07e9f3
2. add "Yuan Lu <yuan.y.lu@intel.com>" in mailmap

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-12 10:10:06 +08:00
Matt Benjamin
118c5ee78b
Merge pull request #36942 from rosinL/wip-fix-librgw
rgw/rgw_file: Fix the incorrect lru object eviction
2020-10-11 11:14:06 -04:00
Yuval Lifshitz
fb7c5b45a7 rgw/file: add missing brackets around if statement
also some small style issues
issues were detected by pvs-studio static analyzer

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-11 09:51:00 +03:00
lixiaoy1
5f2ffc12ee rbd/cache: save full cach path instead of folder
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-10 10:24:31 -04:00
lixiaoy1
6b9ac3d805 rbd/cache: remove unsupported poolset
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-10 09:48:03 -04:00
Kefu Chai
af3be4b725 include/interval_set: do not inherit from std::iterator
std::iterator is deprecated in C++17, so drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-10 20:58:04 +08:00
lixiaoy1
5e950803bb rbd/cache: remove unnecessary WriteLogCache
Remove the class librbd::cache::WriteLogCache.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-10 08:52:08 -04:00
Kefu Chai
63b40dbc5b
Merge pull request #37580 from aclamk/wip-bluestore-fix-2q-cache
os/bluestore: fix memory accounting in TwoQBufferCacheShard

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-10-10 19:42:11 +08:00
Kefu Chai
774653ab60
Merge pull request #37325 from badone/wip-angular-cli-analytics-dont-prompt
mgr/dashboard: Don't prompt for analytics during @angular/cli install

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-10-10 19:41:07 +08:00
Kefu Chai
7341f96808
Merge pull request #37542 from SUSE/wip-fix-47745
cephadm: allow uid/gid == 0 in copy_tree, copy_files, move_files

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-10-10 19:38:33 +08:00
Kefu Chai
72d2eb7d32
Merge pull request #37559 from wjwithagen/wjw-fix-iterator
include: explicitly define all types needed for libc++ iterator

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-10 19:37:16 +08:00
Kefu Chai
d3f1b1988a
Merge pull request #37104 from sebastian-philipp/cephadm-serve.py-2
mgr/cephadm: move functions that do remote calls to serve.py

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-10-10 19:35:48 +08:00
Patrick Donnelly
07ea8f5bca
Merge PR #37441 into master
* refs/pull/37441/head:
	qa: fix proc exit status check

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-10-09 18:41:24 -07:00
luo rixin
ce2ea1d675 common/options: remove unavailable values of osd_op_queue
Signed-off-by: luo rixin <luorixin@huawei.com>
2020-10-10 09:28:17 +08:00
Dimitri Savineau
a8a64d5417 cephadm: allow ntpsec service
ntpsec is available starting Ubuntu Focal (20.04) and Debian Buster (10)
as an alternate NTP daemon.

Fixes: https://tracker.ceph.com/issues/47525

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
2020-10-09 13:50:32 -04:00
Lenz Grimmer
a333b8db2c
Merge pull request #36979 from tspmelo/wip-npm-update-20-8
mgr/dashboard: Update npm packages

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-10-09 15:56:00 +02:00
luo rixin
f209733872 rgw/rgw_file: Fix the incorrect lru object eviction
In func lookup_fh, when RGWFileHandle not be found in fh_cache, it
need to recycle an object and create an new RGWFileHandle. When there
are multi threads use lookup_fh to find and create RGWFileHandle concurrently,
it must to make sure evict lru object from the partiton of fh_cache which new
RGWFileHandle will be inserted to.

Fixes: https://tracker.ceph.com/issues/47235

Signed-off-by: luo rixin <luorixin@huawei.com>
2020-10-09 20:44:53 +08:00
Lenz Grimmer
6fadf9e147
Merge pull request #37449 from ceph/47676-zone-empty-realm-id
mgr/dashboard: get rgw daemon zonegroup name from mgr

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-10-09 14:32:10 +02:00
Lenz Grimmer
661aa031ee
Merge pull request #37375 from ceph/47615-fix-endpoint-responses
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-09 13:43:52 +02:00
Lenz Grimmer
16e8df214c
Merge pull request #37064 from bk201/wip-47372
mgr/dashboard: fix error when typing existing paths in the Ganesha form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-10-09 13:42:30 +02:00
Lenz Grimmer
b1a0cad22a
Merge pull request #37596 from rhcs-dashboard/telemetry_link_cleanup
mgr/dashboard: Improve HTML formatting of the telemetry report preview

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-09 13:40:32 +02:00
Varsha Rao
d18117ebfa doc/cephfs/nfs: Remove outdated doc related to rook
The doc is outdated because the mentioned orch commands have changed[1] and
using dashboard backend script to create exports is buggy[2].

[1] https://docs.ceph.com/en/latest/mgr/orchestrator/#current-implementation-status
[2] https://github.com/rook/rook/issues/6147

Fixes: https://tracker.ceph.com/issues/47784
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-10-09 16:20:46 +05:30
Tiago Melo
ad4bbcd32a mgr/dashboard: Update npm packages
Angular 10.1 includes extraction of TS translations,
so @locl/cli is no longer needed.

Updating Angular automatically removed the usage of base tsconfig.

Downgraded css-loader to be able to use css modules.

angular-tree-component has been deprecated and
replaced by @circlon/angular-tree-component

Fixes: https://tracker.ceph.com/issues/47289

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-10-09 10:07:11 +00:00
Jan Fajerski
65eafe0b54 Merge PR #32778 into master
* refs/pull/32778/head:
	msg: Use sockets instead of pipes for wakeup events on win32
	common: Convert remote errors on win32
	common,msg: Initialize Windows WSA and TLS
	common,os,kv: Define aligned_free
	common: avoid CLOCK_*_COARSE warnings on win32
	global: Windows support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-09 11:22:01 +02:00
Kefu Chai
1c152da4e0 osd/OSD: remove unused #include
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-09 16:49:17 +08:00
Kefu Chai
56a4ba77d6 cls/fifo: cast ceph_le64 to uint64_t before printing it
silences warning like:

../src/cls/fifo/cls_fifo.cc: In member function ‘int rados::cls::fifo::{anonymous}::EntryReader::get_next_entry(ceph::buffer::v15_2_0::list*, uint64_t*, ceph::real_time*)’:
../src/include/rados/objclass.h:33:18: warning: format ‘%llu’ expects argument of type ‘long long unsigned int’, but argument 7 has type ‘ceph_le64’ {aka ‘ceph_le<long long unsigned int>’} [-Wformat=]
   33 |   cls_log(level, "<cls> %s:%d: " fmt, __FILE__, __LINE__, ##__VA_ARGS__)
../src/include/rados/objclass.h:33:18: note: in definition of macro ‘CLS_LOG’
   33 |   cls_log(level, "<cls> %s:%d: " fmt, __FILE__, __LINE__, ##__VA_ARGS__)
      |                  ^~~~~~~~~~~~~~~
../src/cls/fifo/cls_fifo.cc:703:48: note: format string is defined here
  703 |   CLS_LOG(10, "%s():%d: pre_header.pre_size=%llu", __func__, __LINE__,
      |                                             ~~~^
      |                                                |
      |                                                long long unsigned int

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-09 16:49:17 +08:00
Patrick Donnelly
2cb09bd4bd
Merge PR #36554 into master
* refs/pull/36554/head:
	mgr/volumes: Make number of cloner threads configurable

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Shyamsundar R <srangana@redhat.com>
2020-10-08 13:25:15 -07:00
Patrick Donnelly
5c9f77cb65
Merge PR #36457 into master
* refs/pull/36457/head:
	qa/tasks/cephfs: fix fs authorize cmd args
	mds: add root_squash mode in MDS auth caps
	vstart_runner: add write_file and sudo_write_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 13:23:34 -07:00
Patrick Donnelly
eef744a88f
Merge PR #36556 into master
* refs/pull/36556/head:
	doc: cephfs mirroring design document

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 12:43:39 -07:00
Neha Ojha
343107766e
Merge pull request #37483 from dzafman/wip-46405
osd/osd-rep-recov-eio.sh: TEST_rados_repair_warning:  return 1

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-10-08 11:44:00 -07:00
Nathan Cutler
6d1f1f63b7
Merge pull request #37500 from ricardoasmarques/fix-bootstrap-container-init
cephadm: Fix error setting 'mgr/cephadm/container_init' config

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-10-08 20:04:02 +02:00
Mykola Golub
37cc998bad librbd: fix race on watcher unregister
It was possible that "unregister_watch" would get stuck forever
in "m_async_op_tracker.wait_for_ops", waiting for unqueiesce
notifications to complete, which had been already canceled
when "unregister" called "TaskFinisher::cancel_all".

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-10-08 18:12:11 +01:00
J. Eric Ivancich
f0e539b304
Merge pull request #37582 from ivancich/wip-fix-bucket-list-namespace
rgw: fix setting of namespace in ordered and unordered bucket listing

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-10-08 13:01:36 -04:00
J. Eric Ivancich
3f522f0712
Merge pull request #37572 from ivancich/wip-orphan-list-namespace-locator
rgw: allow rgw-orphan-list to note when rados objects are in namespace

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-10-08 13:00:51 -04:00
J. Eric Ivancich
de6ae6f6cc
Merge pull request #37511 from ivancich/wip-paginate-rgw-bucket-list
rgw: radosgw-admin should paginate internally when listing bucket

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-10-08 12:59:55 -04:00
Tiago Melo
a7ca0631d6 qa/mgr: Remove _wait_for_expected_get_result
Fixes: https://tracker.ceph.com/issues/47793

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-10-08 15:58:06 +00:00
Yuval Lifshitz
fe0bddb7ab build/doc: remove Doxyfile as doxygen run via make
also update document doxygen behavior
this is to complete: https://github.com/ceph/ceph/pull/35027

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-08 17:00:59 +03:00
Nizamudeen A
bd067a6038 mgr/dashboard: Improve HTML formatting of the telemetry report preview
Convert the string "Community Data License Agreement - Sharing - Version 1.0" to a clickable link

Fixes: https://tracker.ceph.com/issues/47790
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-10-08 17:20:34 +05:30
Lenz Grimmer
98a8f533b8
Merge pull request #37584 from rhcs-dashboard/report-preview-helper
mgr/dashboard: Add short descriptions to the telemetry report preview

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-08 13:15:58 +02:00
Jan Fajerski
f68197eca4 Merge PR #37591 into master
* refs/pull/37591/head:
	ceph-volume: don't exit before empty report can be printed

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-10-08 11:52:56 +02:00