Commit Graph

115932 Commits

Author SHA1 Message Date
Kefu Chai
b0b3e32d04
Merge pull request #37626 from tchaikov/wip-drop-std-iterator
include/interval_set: do not inherit from std::iterator

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2020-10-14 16:04:14 +08:00
Kefu Chai
ade1a6e394
Merge pull request #37455 from smithfarm/wip-spec-file-cleanup
rpm: three spec file cleanups

Reviewed-by: Tim Serong <tserong@suse.com>
2020-10-14 15:43:30 +08:00
Patrick Donnelly
493f216c1e
Merge PR #37583 into master
* refs/pull/37583/head:
	mgr/volumes/nfs: Fix wrong error message for pseudo path

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:27:02 -07:00
Patrick Donnelly
bd7a847734
Merge PR #37585 into master
* refs/pull/37585/head:
	doc/cephfs/nfs: Remove outdated doc related to rook

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:26:02 -07:00
zdover23
9822fb49a7
Merge pull request #37610 from anthonyeleven/doc-rados-troubleshooting
doc/rados/troubleshooting: clarity and modernization

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-10-14 02:32:24 +10:00
Patrick Donnelly
c2be93c981
Merge PR #36537 into master
* refs/pull/36537/head:
	qa/cephfs: update ephemeral pin tests
	mds: distribute dirfrags for ephemeral distributed directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 09:29:04 -07:00
Yan, Zheng
e76abf517b qa/cephfs: update ephemeral pin tests
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-10-13 20:52:40 +08:00
Yan, Zheng
bb5ebd395f mds: distribute dirfrags for ephemeral distributed directory
Instead of distribute individual dir inodes inside the ephemeral
distributed dir. Distributing dirfrags can limit number of subtrees
created by the ephemeral dist pin.

This patch also unifies codes that handle export pin and ephemeral pin.

Fixes: https://tracker.ceph.com/issues/46696
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-10-13 20:51:42 +08:00
Yuval Lifshitz
2dd7d113f2
Merge pull request #35477 from yuvalif/add_lua_to_rgw
rgw/lua: embedding lua in rgw in s3 request context
2020-10-13 12:42:48 +03:00
Mykola Golub
c9d5c492df
Merge pull request #37581 from dillaman/wip-librbd-exclusive-lock-shutdown
librbd: avoid failing IO with -ESHUTDOWN when disabling exclusive-lock

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-10-13 10:44:58 +03:00
Kefu Chai
8ae611e584
Merge pull request #37613 from tchaikov/wip-cls-osd-cleanup
cls, osd: cleanups

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-13 14:23:29 +08:00
Yuval Lifshitz
9e5f319169
Merge pull request #37537 from yuvalif/missing_brackets_in_rgw_file
rgw/file: missing brackets around if statement
2020-10-13 08:06:31 +03:00
Yuval Lifshitz
2b034f2eb2
Merge pull request #37538 from yuvalif/potential_crash_in_kafka
fix potential crash in rgw_kafka
2020-10-13 08:04:18 +03:00
Yuval Lifshitz
426e6f526c
Merge pull request #37599 from yuvalif/remove_doxyfile
cmake: remove Doxyfile as doxygen run via make
2020-10-13 08:03:39 +03:00
Yuval Lifshitz
c6e8fa39cd
Merge pull request #37534 from yuvalif/fix_ownership_in_role_applier
rgw/auth: fix copy&paste bug in RoleApplier::is_owner_of
2020-10-13 08:02:40 +03:00
Patrick Donnelly
daa2f85156
Merge PR #29951 into master
* refs/pull/29951/head:
	test: add tests for validating MDS metrics via `perf stats` module
	test: Filesystem class helpers to grow and shrink MDS cluster
	mgr/stats: mds performance stats module
	mds: support sending empty perf metrics to ceph-manager

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-12 18:50:33 -07:00
zdover23
0f3bce753a
Merge pull request #37541 from anthonyeleven/osd-internals-tweaks
doc/dev: doc/dev/osd_internals capitalization, formatting, clarity

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-10-13 06:01:05 +10:00
Yuval Lifshitz
270d1117bb rgw/lua: run lua scripts in s3 requests context
for more details on design and
remaining work see:
https://gist.github.com/yuvalif/60d5984c28af89ba17443ce947540c1f

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-12 22:23:37 +03:00
Anthony D'Atri
8a4c4cb393 doc/rados/troubleshooting: clarity and modernization
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-10-12 10:22:16 -07:00
Patrick Donnelly
473d8e9a60
Merge PR #37593 into master
* refs/pull/37593/head:
	qa/tasks/cephfs: Refactor test_volumes

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-12 07:42:13 -07:00
Tatjana Dehler
1edaa17181
Merge pull request #37154 from bk201/wip-47397
mgr/dashboard: fix the error when exporting CephFS path "/" in NFS exports

Reviewed-by: Laura Paduano lpaduano@suse.com
Reviewed-by: Stephan Müller smueller@suse.com
Reviewed-by: Varsha Rao varao@redhat.com
2020-10-12 14:32:39 +02:00
Venky Shankar
a95b364e3e test: add tests for validating MDS metrics via perf stats module
Fixes: http://tracker.ceph.com/issues/24285
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
5afdf26943 test: Filesystem class helpers to grow and shrink MDS cluster
These routines were test specific. Make them a part of Filesystem
class.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
7523aef6e8 mgr/stats: mds performance stats module
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
e739b831b7 mds: support sending empty perf metrics to ceph-manager
Right now, there are no per-mds metrics that are tracked and
sent by mds. However, such metrics will get added soon. So,
send empty performance metrics to ceph-manager for now.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Ramana Raja
d1d5d61884 qa/tasks/cephfs: Refactor test_volumes
... into smaller test classes. This enables breaking up the volumes yaml
into smaller yaml fragments.

Fixes: https://tracker.ceph.com/issues/47160
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-10-12 13:54:40 +05:30
Kefu Chai
130c2715d9
Merge pull request #37628 from changchengx/mail_update
mailmap: update Intel employee mail/org

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-12 15:43:30 +08:00
Changcheng Liu
1e8c30a1e1 mailmap: update Intel employee mail/org
1. "changcheng.liu@aliyun.com" need be classified into intel until now.
   This reverts part of commit: df07e9f3
2. add "Yuan Lu <yuan.y.lu@intel.com>" in mailmap

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-12 10:10:06 +08:00
Matt Benjamin
118c5ee78b
Merge pull request #36942 from rosinL/wip-fix-librgw
rgw/rgw_file: Fix the incorrect lru object eviction
2020-10-11 11:14:06 -04:00
Yuval Lifshitz
fb7c5b45a7 rgw/file: add missing brackets around if statement
also some small style issues
issues were detected by pvs-studio static analyzer

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-11 09:51:00 +03:00
Kefu Chai
af3be4b725 include/interval_set: do not inherit from std::iterator
std::iterator is deprecated in C++17, so drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-10 20:58:04 +08:00
Kefu Chai
63b40dbc5b
Merge pull request #37580 from aclamk/wip-bluestore-fix-2q-cache
os/bluestore: fix memory accounting in TwoQBufferCacheShard

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-10-10 19:42:11 +08:00
Kefu Chai
774653ab60
Merge pull request #37325 from badone/wip-angular-cli-analytics-dont-prompt
mgr/dashboard: Don't prompt for analytics during @angular/cli install

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-10-10 19:41:07 +08:00
Kefu Chai
7341f96808
Merge pull request #37542 from SUSE/wip-fix-47745
cephadm: allow uid/gid == 0 in copy_tree, copy_files, move_files

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-10-10 19:38:33 +08:00
Kefu Chai
72d2eb7d32
Merge pull request #37559 from wjwithagen/wjw-fix-iterator
include: explicitly define all types needed for libc++ iterator

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-10 19:37:16 +08:00
Kefu Chai
d3f1b1988a
Merge pull request #37104 from sebastian-philipp/cephadm-serve.py-2
mgr/cephadm: move functions that do remote calls to serve.py

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-10-10 19:35:48 +08:00
Patrick Donnelly
07ea8f5bca
Merge PR #37441 into master
* refs/pull/37441/head:
	qa: fix proc exit status check

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-10-09 18:41:24 -07:00
Lenz Grimmer
a333b8db2c
Merge pull request #36979 from tspmelo/wip-npm-update-20-8
mgr/dashboard: Update npm packages

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-10-09 15:56:00 +02:00
luo rixin
f209733872 rgw/rgw_file: Fix the incorrect lru object eviction
In func lookup_fh, when RGWFileHandle not be found in fh_cache, it
need to recycle an object and create an new RGWFileHandle. When there
are multi threads use lookup_fh to find and create RGWFileHandle concurrently,
it must to make sure evict lru object from the partiton of fh_cache which new
RGWFileHandle will be inserted to.

Fixes: https://tracker.ceph.com/issues/47235

Signed-off-by: luo rixin <luorixin@huawei.com>
2020-10-09 20:44:53 +08:00
Lenz Grimmer
6fadf9e147
Merge pull request #37449 from ceph/47676-zone-empty-realm-id
mgr/dashboard: get rgw daemon zonegroup name from mgr

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-10-09 14:32:10 +02:00
Lenz Grimmer
661aa031ee
Merge pull request #37375 from ceph/47615-fix-endpoint-responses
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-09 13:43:52 +02:00
Lenz Grimmer
16e8df214c
Merge pull request #37064 from bk201/wip-47372
mgr/dashboard: fix error when typing existing paths in the Ganesha form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-10-09 13:42:30 +02:00
Lenz Grimmer
b1a0cad22a
Merge pull request #37596 from rhcs-dashboard/telemetry_link_cleanup
mgr/dashboard: Improve HTML formatting of the telemetry report preview

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-09 13:40:32 +02:00
Varsha Rao
d18117ebfa doc/cephfs/nfs: Remove outdated doc related to rook
The doc is outdated because the mentioned orch commands have changed[1] and
using dashboard backend script to create exports is buggy[2].

[1] https://docs.ceph.com/en/latest/mgr/orchestrator/#current-implementation-status
[2] https://github.com/rook/rook/issues/6147

Fixes: https://tracker.ceph.com/issues/47784
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-10-09 16:20:46 +05:30
Tiago Melo
ad4bbcd32a mgr/dashboard: Update npm packages
Angular 10.1 includes extraction of TS translations,
so @locl/cli is no longer needed.

Updating Angular automatically removed the usage of base tsconfig.

Downgraded css-loader to be able to use css modules.

angular-tree-component has been deprecated and
replaced by @circlon/angular-tree-component

Fixes: https://tracker.ceph.com/issues/47289

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-10-09 10:07:11 +00:00
Jan Fajerski
65eafe0b54 Merge PR #32778 into master
* refs/pull/32778/head:
	msg: Use sockets instead of pipes for wakeup events on win32
	common: Convert remote errors on win32
	common,msg: Initialize Windows WSA and TLS
	common,os,kv: Define aligned_free
	common: avoid CLOCK_*_COARSE warnings on win32
	global: Windows support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-09 11:22:01 +02:00
Kefu Chai
1c152da4e0 osd/OSD: remove unused #include
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-09 16:49:17 +08:00
Kefu Chai
56a4ba77d6 cls/fifo: cast ceph_le64 to uint64_t before printing it
silences warning like:

../src/cls/fifo/cls_fifo.cc: In member function ‘int rados::cls::fifo::{anonymous}::EntryReader::get_next_entry(ceph::buffer::v15_2_0::list*, uint64_t*, ceph::real_time*)’:
../src/include/rados/objclass.h:33:18: warning: format ‘%llu’ expects argument of type ‘long long unsigned int’, but argument 7 has type ‘ceph_le64’ {aka ‘ceph_le<long long unsigned int>’} [-Wformat=]
   33 |   cls_log(level, "<cls> %s:%d: " fmt, __FILE__, __LINE__, ##__VA_ARGS__)
../src/include/rados/objclass.h:33:18: note: in definition of macro ‘CLS_LOG’
   33 |   cls_log(level, "<cls> %s:%d: " fmt, __FILE__, __LINE__, ##__VA_ARGS__)
      |                  ^~~~~~~~~~~~~~~
../src/cls/fifo/cls_fifo.cc:703:48: note: format string is defined here
  703 |   CLS_LOG(10, "%s():%d: pre_header.pre_size=%llu", __func__, __LINE__,
      |                                             ~~~^
      |                                                |
      |                                                long long unsigned int

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-09 16:49:17 +08:00
Patrick Donnelly
2cb09bd4bd
Merge PR #36554 into master
* refs/pull/36554/head:
	mgr/volumes: Make number of cloner threads configurable

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Shyamsundar R <srangana@redhat.com>
2020-10-08 13:25:15 -07:00
Patrick Donnelly
5c9f77cb65
Merge PR #36457 into master
* refs/pull/36457/head:
	qa/tasks/cephfs: fix fs authorize cmd args
	mds: add root_squash mode in MDS auth caps
	vstart_runner: add write_file and sudo_write_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 13:23:34 -07:00