Commit Graph

88469 Commits

Author SHA1 Message Date
Kefu Chai
c675f2b1a1
Merge pull request #22964 from tchaikov/wip-import-pub-key-without-hkp-server
install-deps.sh: import ubuntu-toolchain-r's key without keyserver

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2018-07-14 15:47:00 +08:00
Kefu Chai
7d2c188053 crimson/net: use boost::thread_unsafe_counter for refcounting Connection
seastar is basically single threaded.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-14 15:34:31 +08:00
Kefu Chai
8e855e512f crimson/net: add Connection::get_peer_type()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-14 15:34:23 +08:00
Yan, Zheng
0f735f4031 mds: health warning for slow metadata IO
Fixes: http://tracker.ceph.com/issues/24879
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-14 09:44:36 +08:00
Patrick Donnelly
8eea2dbf5a
Merge PR #22971 into master
* refs/pull/22971/head:
	qa: optionally use old fs name during cephfs remount
	qa: remove dead code
	qa: run asok command on correct machine
2018-07-13 18:16:51 -07:00
Patrick Donnelly
1ad8d86bd0
qa: optionally use old fs name during cephfs remount
This fixes errors caused by remount done by some tests (test_recovery_pool.py)
where the fs name is not given.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 18:16:06 -07:00
Patrick Donnelly
a2ff87d4e2
qa: remove dead code
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 18:15:03 -07:00
Patrick Donnelly
08bb5a244f
ceph-debug-docker: install python3 cephfs/rados packages
Fixes: http://tracker.ceph.com/issues/24870

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 17:08:26 -07:00
Patrick Donnelly
fa25d6c8d1
qa: run asok command on correct machine
The MDS may not be on the same machine where the cluster command is run.

Fixes: http://tracker.ceph.com/issues/24858

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 16:07:30 -07:00
Matt Benjamin
bca1b09973 rgw_file: deep stat handling
A change to the exact-match behavior in leaf stat operations is
required to support instantiation of a full path hierarchy when
one or more intervening directories has not been enumerated.

Fixes: http://tracker.ceph.com/issues/24915

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2018-07-13 17:35:05 -04:00
Patrick Donnelly
333444e8aa
Merge PR #21885 into master
* refs/pull/21885/head:
	qa: update cluster log health warning message
	qa: add tests for client features
	mds: evict clients that lack required features
	mds: cleanup MDSRank::evict_client
	mds: infer client version by client metadata and connection's features
	mds: introduce "ceph fs set <fs_name> min_compat_client <release_name>"
	mds: tell client why it's rejected
	mds: introduce cephfs' own feature bits
	mds: make Server::prepare_force_open_sessions() update client metadata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 13:57:17 -07:00
Patrick Donnelly
9298e3ae9c
Merge PR #23018 into master
* refs/pull/23018/head:
	qa: use 4 mds cluster for multifs tests

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-13 13:57:10 -07:00
Patrick Donnelly
3b7233a402
qa: use 4 mds cluster for multifs tests
Fixes: http://tracker.ceph.com/issues/24899

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 12:11:44 -07:00
Patrick Donnelly
87dcaab130
qa: update cluster log health warning message
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 12:06:11 -07:00
Matt Benjamin
d36d6815e5
Merge pull request #23033 from linuxbox2/wip-rgw-409
rgw: do not ignore EEXIST in RGWPutObj::execute
2018-07-13 12:36:24 -04:00
Kefu Chai
e2c348ebce
Merge pull request #23020 from tchaikov/wip-config-value-friend
common/config_values: friend md_config_impl<>

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-07-13 23:32:47 +08:00
Matt Benjamin
7c18258e54 rgw: do not ignore EEXIST in RGWPutObj::execute
The existing logic appears able to cause propagation of a failed
exclusive create to the client, when it should instead have been
retried, due to disagreement about the logical write offset. (The
value of ofs here could be > 0 due to the operation of a stacked
write filter [e.g., compressor], when the RADOS write offset was
0 and hence an exclusive write that should be retried).

Rationale for fix by Casey.

http://tracker.ceph.com/issues/22790

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2018-07-13 11:08:32 -04:00
Casey Bodley
326971931d radosgw-admin: 'sync error trim' loops until complete
a single call to time_log_trim() will trim a maximum of 1000 entries.
now loops until a return code of -ENODATA indicates that all entries
in the given range were trimmed

an optional --trim-delay-ms option can be used to limit the frequency
of osd ops

Fixes: http://tracker.ceph.com/issues/24873

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-13 10:56:29 -04:00
Kefu Chai
0bf02e8fe5 rbd-ggate: filter out ceph options from args
we can just filter out ceph options from command line args instead of
parsing config in env variables, conf files and argvs.

the config-parsing steps were modeled after the ones in rbd-nbd.cc, but
the whole purpose of reading configurations from env/conf-file is to get
the "rbd_default_pool" for setting cfg->poolname. apparently, this does
not apply to rbd-ggate, where global_init() will take care of all the
trivial work to populate the settings. moreover, `config` is not
read after being initialized in main.cc. so drop it.

Signed-off-by: Mykola Golub <mgolub@suse.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-13 21:06:32 +08:00
Alfredo Deza
9a426d0666 ceph-volume lvm.auto help menu and dynamic strategy loading
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:21 -04:00
Alfredo Deza
7fa5317e2f ceph-volume lvm.auto move auto as a sub-command of lvm
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:20 -04:00
Alfredo Deza
079e4c3f31 ceph-volume tests verify Size() behavior
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:20 -04:00
Alfredo Deza
165b944c61 ceph-volume util.disk capture real size when inspecting disks
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:20 -04:00
Alfredo Deza
c13b12c5be ceph-volume util.disk create a Size class for sizing representations and calculations
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:20 -04:00
Alfredo Deza
b9bc2eb628 ceph-volume main remove auto as a top-level command
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:19 -04:00
Alfredo Deza
2e9da02633 ceph-volume api.lvm extract sizing method into its own utility
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-13 09:00:19 -04:00
Kefu Chai
6147ed1bbd common/config_values: friend md_config_impl<>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-13 15:05:15 +08:00
Patrick Donnelly
9f6e99db6f
Merge PR #22995 into master
* refs/pull/22995/head:
	qa: use root to find client admin socket

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-07-12 21:38:36 -07:00
Yanhu Cao
9d0413d525 common/ceph_strings: add request_flush_mdlog op names to ceph_session_op_name()
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2018-07-13 11:19:05 +08:00
Radoslaw Zarzynski
bb20018e7e osd: avoid unneeded ref-counting in PrimaryLogPG::log_op_stats.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-07-13 02:31:11 +02:00
Radoslaw Zarzynski
6f4ec6abcf osd: clean up PrimaryLogPG::log_op_stats.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-07-13 02:31:05 +02:00
Jeff Layton
88a955733d client: wire up ceph_ll_fallocate
We have ceph_fallocate, but we need the analogous call for the lowlevel
interface as well. Add ceph_ll_fallocate.

Tracker: http://tracker.ceph.com/issues/24893
Signed-off-by: Jeff Layton <jlayton@kernel.org>
2018-07-12 14:47:03 -04:00
Patrick Donnelly
441a2730e5
qa: add tests for client features
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-12 10:12:12 -07:00
Noah Watkins
dc8577432f mgr/pybind: stricter object test
avoid false successful tests from typos

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-07-12 09:28:09 -07:00
Noah Watkins
b5487abb8b mgr/pybind: expose erasure code profiles
handles the insights cases that had been using Ceph CLI
`erasure-code-profile ls/get` to access the same data.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-07-12 09:27:48 -07:00
Yan, Zheng
4414f4e20d
mds: evict clients that lack required features
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-12 08:21:16 -07:00
Kefu Chai
3e8ddaf301
Merge pull request #22938 from tchaikov/wip-bundled-dpdk
cmake: do not depend on ${DPDK_LIBRARIES} if not using bundled dpdk

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-12 23:10:54 +08:00
Kefu Chai
813cd5d591 tools/rbd: assert(g_ceph_context) not g_conf
this addresses a warning introduced by f528475d:

src/tools/rbd/action/Create.cc:59:19: warning: the address of
'ConfigProxy& g_conf()' will never be NULL [-Waddress]
     assert(g_conf != nullptr);
            ~~~~~~~^~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-12 22:28:46 +08:00
Yan, Zheng
e147020a99 mds: cleanup MDSRank::evict_client
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-12 22:08:45 +08:00
Yan, Zheng
44148347ec mds: infer client version by client metadata and connection's features
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-12 22:08:45 +08:00
Yan, Zheng
eeac2c76ba mds: introduce "ceph fs set <fs_name> min_compat_client <release_name>"
The command set the oldest version of client that is allowed to connect
to mds.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-12 22:08:45 +08:00
Yan, Zheng
43c1193915 mds: tell client why it's rejected
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2018-07-12 22:08:44 +08:00
Yan, Zheng
353fcee10a mds: introduce cephfs' own feature bits
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/14456
2018-07-12 22:08:44 +08:00
Yan, Zheng
c740000044 mds: make Server::prepare_force_open_sessions() update client metadata
The function is used for opening sessions for importing caps. It didn't
set client metadata for new sessions.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-12 22:08:44 +08:00
alfonsomthd
9f06cfb7c6 mgr/dashboard: created common Card component for info shown in landing page:
Info encapsulated in cd-info-card selector:
- Overall health status, MON/OSD/MDS/MGR status

Fixes: https://tracker.ceph.com/issues/24778

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2018-07-12 15:23:47 +02:00
Kefu Chai
1e9a79d92f
Merge pull request #22594 from wido/mgr-pg-states
mgr: Centralize PG_STATES to MgrModule

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2018-07-12 20:44:59 +08:00
Kefu Chai
467411ba6b
Merge pull request #22952 from tchaikov/wip-cmake-atomic
cmake: should link against libatomic if libcxx/libstdc++ does not off…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-12 20:40:41 +08:00
Kefu Chai
d33d295055 cmake: link libcrimson against libceph-common
as libcrimson uses symbols exposed by the later, among other things, the
Authorization related stuff.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-12 17:54:45 +08:00
Kefu Chai
2a6bec88c3 cmake: remove unittest_seastar_{messenger,echo} from tests
unittest_seastar_echo cannot be run as unittest w/o starting two
instances.
unittest_seastar_messenger times out. need to RCA it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-12 17:54:45 +08:00
Kefu Chai
abca980589 common: extract SubProcess impl into .cc
cleanup the header dependencies and speed-up the compiling

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-12 17:54:45 +08:00