Commit Graph

117202 Commits

Author SHA1 Message Date
Lucian Petrut
ae2bb42806 rbd: add "help" command to rbd-wnbd
At the moment, "rbd-wnbd" says that "help" is an unsupported command,
only "rbd-wnbd -h" works. This isn't very user friendly.

Although "rbd-wnbd" isn't supposed to be used directly in most cases,
users might want to retrieve device specific arguments that can be
passed using "rbd device -o".

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2020-11-22 17:37:13 +00:00
J. Eric Ivancich
cf18f7e9cd
Merge pull request #38228 from ivancich/wip-rgw-gc-defer-should-not-enqueue
rgw: during GC defer, prevent new GC enqueue

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-11-22 10:36:48 -05:00
Kefu Chai
b7e8d11d09
Merge pull request #38231 from anthonyeleven/anthonyeleven/docs-40579
doc/rados/operations: POOL_NEAR_FULL on OSD_NEAR_FULL

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 21:24:56 +08:00
JiangYu
125674b662 blk/kernel/io_uring: do not guard liburing backend with __x86_64__ anymore
Signed-off-by: JiangYu <lnsyyj@hotmail.com>

Let the liburing library to ensure the support of the iouring system call back-end CPU instruction set.
2020-11-22 11:39:40 +00:00
Anthony D'Atri
7fde53bbb1 doc/rados/operations: POOL_NEAR_FULL on OSD_NEAR_FULL
Fixes: https://tracker.ceph.com/issues/40579
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-22 00:02:54 -08:00
Anthony D'Atri
61a7eb8647 doc/rados/operations: enhance primary affinity section
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-21 23:57:31 -08:00
Kefu Chai
d3cf17da15
Merge pull request #38090 from anthonyeleven/anthonyeleven/docs-47339
doc/releases: correct spelling

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 14:03:09 +08:00
Kefu Chai
46ad0835c1
Merge pull request #37900 from jhonxue/master
os/bluestore/StupidAllocator: choose the right bin when bdev_block_size changed

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-11-22 13:42:46 +08:00
Kefu Chai
ed77641a53
Merge pull request #38161 from petrutlucian94/msg_timeout
msg: use timeout when initiating connection

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:41:33 +08:00
Kefu Chai
6a52585e61
Merge pull request #38070 from dvanders/dvanders_trimto
mon/OSDMonitor, mon/PaxosService: additional debug outputs when trimming

Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:39:44 +08:00
Kefu Chai
57f385f6b8
Merge pull request #38148 from jhonxue/wip-fix-bluestore-avl-allocator
os/bluestore: do not call _block_picker() again if already searched from start()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:39:09 +08:00
Kefu Chai
b6c92fd80c
Merge pull request #38128 from tchaikov/wip-mon-add-space-in-log
mon/OSDMonitor: add a space after function name in logging message

Reviewed-by: Joao Eduardo Luis <joao@suse.com>
2020-11-22 13:36:25 +08:00
Anthony D'Atri
b3cede6dbc doc/releases: correct spelling
Fixes: https://tracker.ceph.com/issues/47339
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-21 18:32:40 -08:00
Kefu Chai
2d5830650c
Merge pull request #38227 from tchaikov/wip-store-test
test/store_test: pass raw Formatter pointer as expected

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2020-11-22 09:59:08 +08:00
Willem Jan Withagen
80ae2d286c librbd: Fix variable declaration in capture list in lambda
Fixes: https://github.com/ceph/ceph/pull/38000
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-11-21 23:25:13 +01:00
J. Eric Ivancich
2603485bcb rgw: during GC defer, prevent new GC enqueue
With the new queue-based GC code, when a GC defer operation is
performed, it adds an "urgent" record to prevent GC from removing
objects that are still being read. It does not check whether the
objects are on the GC queue or not and that's OK for the urgent
record.

The code *also* adds a new GC entry to the queue to cause GC to occur
at a later time. This would be incorrect if there was no GC entry to
begin with, however. In such a case this would cause GC to delete tail
objects when no user-initiated remove has happend. In other words a
READ could cause a DELETE of tail objects and therefore data loss.

This fix prevents such a new GC entry from being enqueued, thus
preventing the data loss in this rare case. There is a new risk that
tail object orphans to be created, but as an immediate fix to prevent
data loss, this is appropriate and it is a rare event. A follow-on PR
that will handle these cases is likely.

This PR adds a level 0 log entry as a way to potentially confirm this
case is being triggered in real-world cases. In time, this log entry
should be deleted.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-11-21 13:52:16 -05:00
Kefu Chai
a8749d198e test/store_test: pass raw Formatter pointer as expected
this addresses the FTBFS regression introduced by
f153a7031e

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-22 01:16:01 +08:00
Mykola Golub
4040082610
Merge pull request #38196 from dillaman/wip-48296
pybind/mgr/rbd_support: delay creation of progress module events

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-21 15:41:16 +02:00
Kefu Chai
8f26ecb35d
Merge pull request #38223 from Rethan/fix_formatter_pointer
test: free Formatter pointers

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-21 19:01:33 +08:00
haoyixing
f153a7031e test/: use unique_ptr for some formatter whose pointers were not released.
some code under test use formatter to output, but Formatter *f
was not freed like elsewere. So use unique_ptr to avoid this.

Signed-off-by: haoyixing <haoyixing@kuaishou.com>
2020-11-21 17:09:38 +08:00
Neha Ojha
0ba966763e
Merge pull request #38220 from neha-ojha/wip-fix-label-2
.github/labeler.yml: fix pybind and common rules

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-11-20 14:50:10 -08:00
Neha Ojha
1f538d4e65 .github/labeler.yml: fix pybind and common rules
Noticed it didn't work in https://github.com/ceph/ceph/pull/38206

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-11-20 19:53:29 +00:00
Daniel Gryniewicz
e8dac81153
Merge pull request #38193 from dang/wip-dang-zipper-9
RGW - Zipper 9: Write path
2020-11-20 14:33:45 -05:00
Daniel Gryniewicz
8208d8450e Zipper - ObjectProcessor
Fix the ObjectProcessor classes to use Zipper APIs

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2020-11-20 12:38:29 -05:00
Casey Bodley
c2a1edbd8c
Merge pull request #37734 from matthewoliver/rgw_swift_dlo_fix
rgw: Check all shards for user manifest parts

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-11-20 11:55:58 -05:00
Ernesto Puerta
dcd3403a75
Merge pull request #38062 from s0nea/wip-dashboard-new-password
mgr/dashboard: amend the look & feel of the login password form

Reviewed-by: nizamial09 <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-11-20 17:47:27 +01:00
Ernesto Puerta
e238c6f6e7
Merge pull request #37740 from s0nea/wip-dashboard-ceph-input-validation
mgr/dashboard: validate username while creation

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-20 17:45:44 +01:00
Ernesto Puerta
85c538a5b3
Merge pull request #37719 from tspmelo/wip-rbd-invalid-name
mgr/dashboard: RBD: Disable actions when name is not valid

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-11-20 17:43:55 +01:00
Mykola Golub
a886061ec9
Merge pull request #38000 from dillaman/wip-librbd-migration-3
librbd: http-based migration source

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-20 18:37:08 +02:00
Kefu Chai
7d691a0388
Merge pull request #38214 from rzarzynski/wip-crimson-pg-drop-undefined-declarations
crimson: drop two undefined method declarations from PG

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-20 23:55:17 +08:00
Kefu Chai
4b940cfb97
Merge pull request #38216 from rzarzynski/wip-crimson-no-pg-in-opsexecuter
crimson: make OpsExecuter unaware about the giant PG class

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-20 23:52:24 +08:00
Daniel Gryniewicz
e3013cb091 Remove copy from ceph::static_ptr
The copy functionality of ceph::static_ptr is unused, and it means that
nothing containing a std::unique_ptr (or any other non-copyable type)
can be put into a static_ptr.

Remove the copy functionality, so that unique_ptr can be used in
static_ptr.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2020-11-20 10:28:30 -05:00
Daniel Gryniewicz
c590759da0 Zipper - Assorted cleanups
- Move cluste stat into public header, allowing more zipper cleanup
- Swift versioning
- Implement a MPSerializer for Zipper.
- Add Lifecycle APIs to Zipper.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2020-11-20 10:28:30 -05:00
Daniel Gryniewicz
0905425cf1 Zipper - WriteOp
Add WriteOp to the Zipper API, and use it.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2020-11-20 10:28:30 -05:00
Jason Dillaman
2ea32d3524
Merge pull request #38122 from lxbsz/rbdmap_init
rbd: drop initd-based systems for rbdmap

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-20 10:17:20 -05:00
Sebastian Wagner
d9879eb001
Merge pull request #37576 from p-se/doc-cephadm-custom-monitoring-templates
mgr/cephadm: document setting custom monitoring templates for configuration files

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-11-20 16:15:39 +01:00
Sebastian Wagner
66f647b00b
Merge pull request #37696 from p-se/cephadm-monitoring-grafana-tls
doc/cepham: instructions for custom Grafana TLS certs

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-11-20 15:42:28 +01:00
Kefu Chai
4070fb546d
Merge pull request #38210 from rzarzynski/wip-crimson-fix-warning-in-with_locked_obc
crimson: fix a warning in PG::with_lock_obc().

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-20 22:14:51 +08:00
Radoslaw Zarzynski
d10d267224 crimson: OpsExecuter stores only const reference to MOSDOp.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 14:49:01 +01:00
Radoslaw Zarzynski
0136695af5 crimson: make OpsExecuter unaware about PG.
`PG` is heavy-weight class with many responsibilities.
Exposing it to lower-layer may suggest there is far more
coupling between them than in reality.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 14:49:01 +01:00
Radoslaw Zarzynski
2aa627caea crimson: drop the declared but undefined PG::do_pgnls().
`PgOpsExecuter` takes care; it's not not a responsibility
of `PG` anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 14:48:15 +01:00
Radoslaw Zarzynski
784a798374 crimson: drop the declared but undefined PG::do_osd_op().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 14:48:15 +01:00
Radoslaw Zarzynski
9f27a83274 crimson: comment on why OpsExecuter needs PG.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 14:45:59 +01:00
Lucian Petrut
bfb0dbf006 rbd: update "rbd-wnbd show" error handling
We'll update the "rbd-wnbd show" command to return -ENOENT
when the specified mapping doesn't exist, instead of returning
-EINVAL. At the moment, it's impossible to tell if the operation
failed because of an error or the mapping simply doesn't exist.

Worth mentioning that on Windows, we can use 32b for the exit code,
which is a bit more flexible.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2020-11-20 12:42:18 +00:00
Kefu Chai
178ac34c7c
Merge pull request #38061 from tchaikov/wip-48012
mgr/dashboard: use http://docs.ceph.com/en/${release}/ for the domain…

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2020-11-20 20:27:00 +08:00
Radoslaw Zarzynski
f9d69d4524 crimson: fix a warning in PG::with_lock_obc().
Without the fix, on a build with `NDEBUG` set,
GCC complains:

```
crimson/osd/pg.cc:869:35: warning: control reaches end of non-void function [-Wreturn-type]
  869 |   const hobject_t oid = get_oid(*m);
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-20 12:54:12 +01:00
Ricardo Marques
c6e6eb5ef5 mgr/orchestrator: Sort 'ceph orch device ls' by host
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-11-20 11:53:28 +00:00
Dan van der Ster
191d9fa4ab mgr/balancer: fix available pgs sent to calc_pg_upmaps
Fix the calculation of how many PGs are available to be balanced
each iteration.

Fixes: https://tracker.ceph.com/issues/48309
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2020-11-20 12:09:43 +01:00
lixiaoy1
8be1718f73 librbd/plugin: delete field m_image_ctx
librbd::plugin::ParentCache may be shared by more than one images.

Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-11-20 06:06:15 -05:00
Kefu Chai
568baa761d
Merge pull request #38177 from jhonxue/fix-test-objectstore-allocator
test/objectstore: handle -ENOSPC returned by allocate()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-20 18:52:46 +08:00