Commit Graph

697 Commits

Author SHA1 Message Date
zdover23
0d5d2f4e90
Merge pull request #35950 from zdover23/wip-doc-dev-guide-add-zdover-to-lead-list
doc/devel: add zdover to leads list
2020-07-16 00:37:46 +10:00
Zac Dover
e75da03da6 doc/devel: add zdover to leads list
This commit adds "zdover" to the list of
leads as the Docs Lead.

Fixes: https://tracker.ceph.com/issues/46378
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-07-15 20:59:06 +10:00
Zac Dover
4510af8cf8 doc/dev: remove extraneous word "guidance".
This bug changes the sentence "If your patches emit
messages to the Ceph cluster log, please consult this
guidance:" to "If your patches emit messages to the
Ceph cluster log, please consult this:". This new sentence
is more natural and idiomatic.

Fixes: https://tracker.ceph.com/issues/46363
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-07-14 00:19:19 +10:00
Dan Mick
832ed27afa
Merge pull request #35717 from dmick/wip-cephadm-doc
doc/dev/cephadm.rst: clarify, fix spelling nits
2020-07-11 00:13:06 -07:00
Josh Durgin
bf453f0449
Merge pull request #35949 from zdover23/wip-doc-dev-guide-essentials-2020-07-07
doc/devel: repair sentences in "Essentials" page

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-07-08 11:22:54 -07:00
myoungwon oh
942c73bf07
Merge pull request #35338 from myoungwon/wip-doc-manifet-snap
doc/dev/osd_internals/manifest.rst: add information about clone snap refcounting

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-07-08 18:57:13 +09:00
Zac Dover
9dbc7c715d doc/devel: repair sentences in "Essentials" page
This commit fixes a few sentences in the "Essentials" page
that aren't as well-formed as they might have been. This commit
fixes the issue detailed in the tracker link, as well as a couple
of other improvements that I couldn't resist in the heat of the
moment.

Fixes: https://tracker.ceph.com/issues/46362
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-07-07 07:10:55 +10:00
Kefu Chai
527e55d485
Merge pull request #35546 from agayev/zoned-fm
os/bluestore: Introduce zoned freelist manager.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-07-06 20:42:48 +08:00
Abutalib Aghayev
da70e5e6c1 doc/dev: Update zoned-storage.rst to indicate that OSDs can now be written to after restart on zoned devices.
Signed-off-by: Abutalib Aghayev <agayev@cs.cmu.edu>
2020-07-03 09:34:31 -04:00
Dan Mick
d108444fed doc/dev/cephadm.rst: clarify, fix spelling nits
Signed-off-by: Dan Mick <dmick@redhat.com>
2020-07-03 01:44:06 +00:00
Jakub Wilk
e3cc60e631 doc/dev/osd_internals: fix typos
Signed-off-by: Jakub Wilk <jwilk@jwilk.net>
2020-07-01 11:56:25 +02:00
Kefu Chai
7948e2de78
Merge pull request #35657 from athanatos/sjust/wip-lba-replay
crimson/seastore: add extent replay support, implement for lba tree nodes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-06-30 18:52:24 +08:00
Sebastian Wagner
4e711fdad0 doc/dev: remove confusing.txt
* Last change was from 2011
* the file is not referenced anywhere
* the referenced file `cephconfig.jpg` doesn't exist

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-06-25 10:21:37 +02:00
Sebastian Wagner
b8ea9b0b8f
Merge pull request #35653 from ideepika/fix-cpatch
src/cstart: fix typo in cstart script

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2020-06-23 11:01:55 +02:00
Kefu Chai
aaf83eb2b5
Merge pull request #35294 from agayev/punch-hole
os/bluestore: Add missing punch_hole call so that object offsets are …

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-06-20 21:26:24 +08:00
Kefu Chai
4536a09f7e
Merge pull request #35078 from idryomov/wip-msgr21
msg/async: New msgr2 crc and secure modes (msgr2.1)

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-06-20 19:53:11 +08:00
Samuel Just
753cca09bb doc/dev/seastore.rst: update TODOs
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-06-19 12:59:26 -07:00
Deepika Upadhyay
4390de26d8 src/cstart: fix typo in cstart script
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-06-18 14:52:29 +00:00
Ilya Dryomov
5eea038b71 doc/dev/msgr2: fix inconsistencies and update for msgr2.1
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-06-17 21:56:52 +02:00
Patrick Donnelly
efe4de1290
Merge PR #35541 into master
* refs/pull/35541/head:
	doc/dev: mention -l, -e and -n among useful options
	doc/dev: add info on how to retest QA changes without rebuilding

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-06-15 16:41:43 -07:00
Abutalib Aghayev
2a41d8672b doc/dev: Update zoned-storage.rst to indicate that OSDs can now restart with HM-SMR drives.
Signed-off-by: Abutalib Aghayev <agayev@cs.cmu.edu>
2020-06-12 10:52:56 -04:00
Janne Johansson
69fae9937d doc/dev/deduplication.rst: fix a spelling nit
Signed-off-by: Janne Johansson <icepic.dz@gmail.com>
2020-06-12 15:57:22 +08:00
Rishabh Dave
8ce1cce974 doc/dev: mention -l, -e and -n among useful options
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-06-11 18:28:39 +05:30
Rishabh Dave
322896feca doc/dev: add info on how to retest QA changes without rebuilding
Add a section to "Running tests using teuthology" in "Developer's Guide"
that explains how to retest a branch without rebuilding binaries.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-06-11 18:27:21 +05:30
Samuel Just
6efed8f151 doc/dev/seastore.rst: add a bit of information about lba tree etc
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-06-02 16:56:41 -07:00
Samuel Just
bf156a08a6 doc/dev/osd_internals/manifest.rst: add information about clone snap refcounting
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-06-01 07:56:22 -04:00
Kefu Chai
857f55dee8
Merge pull request #35111 from agayev/hm-smr
os/bluestore: Enable writing data to HM-SMR hard drives.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-27 21:55:50 +08:00
Abutalib Aghayev
ab865ca002 os/bluestore: Enable writing data to HM-SMR hard drives.
Signed-off-by: Abutalib Aghayev <agayev@cs.cmu.edu>
2020-05-22 12:37:24 -04:00
Samuel Just
2e8572496b
Merge pull request #35112 from athanatos/sjust/wip-manifest-doc
doc: update manifest.rst with plans for manifest work

Reviewed-by: Myoungwon Oh <omwmw@sk.com>
2020-05-20 10:07:15 -07:00
Samuel Just
d8269b0819 doc/dev/osd_internals:manifest.rst: clarification for manifest design and future steps
I've added a few significant changes:
* TIER_PROMOTE purely ensures that data is resident in the base pool
* Add EVICT_CHUNK to permit a tiering agent to selectively cold space
  from HEAD/snapshots independently of SET_CHUNK.
* Avoid using DIRTY entirely for dedup targets.
* Instead of modifying clone_range when updating clone manifests, simply
  update ReplicatedBackend::calc_*_subsets to also consider the clone
  obc manifest.

I've also added sections on how tiering agents are rbd/rgw are meant
to interact as well as on testing.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-05-19 21:59:45 -07:00
myoungwon oh
59cab79b21 doc: more information on future work for manifest tiering
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:08 -07:00
Samuel Just
ac7af27ffc doc: more information on status and future work for manifest tiering
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:08 -07:00
Samuel Just
be4093a61e doc: add more information for manifest tiering
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:04 -07:00
Shraddha Agrawal
fdbe00d47c doc: add machine type in teuthology commands
This commit adds mandatory --machine-type flag in teuthology
command examples in docs.

Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>
2020-05-19 19:34:49 +05:30
Kefu Chai
62e14068ab
Merge pull request #34913 from athanatos/sjust/wip-seastore-journal
crimson/os/seastore: initial PR

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-15 17:50:02 +08:00
Samuel Just
e5966d18a7 dec/dev/seastore.rst: add more detailed design information and status
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-05-14 23:45:05 -07:00
Sebastian Wagner
4985a9ddfc doc/dev/cephadm: Note regarding network calls form CLI handlers
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-12 10:58:21 +02:00
Gregory Farnum
6fae077e9e
Merge pull request #33576 from lxbsz/fuse
unshare-ns-mount: add isolating netns for mount helper support

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-04-21 22:12:37 -07:00
myoungwon oh
c873a7af08 doc: break deduplication.rst int several files
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-04-21 23:23:07 -04:00
Kefu Chai
c6e48ef0f0 doc/dev/developer_guide: use python3 to launch vstart_runner.py
as vstart_runner.py is compatible with python3, and so is the tests
under `qa/` directory.

and use `pip` to install teuthology, simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 18:31:37 +08:00
Kefu Chai
c4a0acd91d
Merge pull request #34576 from jdurgin/wip-object-corpus
ceph-object-corpus: update to octopus

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-18 11:59:55 +08:00
Josh Durgin
fb3c6bd0cd doc: add object corpus to release checklist
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-04-16 00:53:17 -04:00
Kefu Chai
a1f42101cf doc/dev/corpus.rst: tweak formatting
* use `shell` lexer, otherwise the Python one is used, and the rendered
  result does not look right
* be consistent when indenting -- either use tab or spaces, otherwise
  the indent in code block would be wrong.
* double quote the variables in text

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-16 11:12:25 +08:00
Xiubo Li
f0c67256b9 qa/vstart_runner: add unsharing network namespace support
This will isolate the network namespace for each mount point with
a private ip address and iptables, etc.

For the kill() stuff it will just do DOWN the veth interface instead
of sending ipmi request for kernel mount and kill the fuse processes
for the fuse mount. This could avoid sending the socket FIN to the
ceph cluster.

Fixes: https://tracker.ceph.com/issues/44044
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-14 07:47:03 -04:00
Sage Weil
d3d1ea5507 Merge PR #34272 into master
* refs/pull/34272/head:
	mgr/PyModuleRegistry: ignore 'obsolete' modules
	qa/suites/fs/upgrade: start with msgr2
	qa/suites/fs/upgrade: s/mimic/nautilus/
	qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
	qa/standalone/mon/msgr-v2-transition: remove test
	mon/MgrMonitor: disable orchestrator_cli if >= octopus
	qa/suites/ugprade: remove mimic -> pacific upgrade tests
	qa/standalone/mon/misc: update TEST_mon_features
	mon/MgrMap: use always_on_modules from most recent release
	mon/MonCommands: require-osd-release pacific
	qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
	doc/dev/release-kickoff-checklist: include ceph-build change
	qa/workunits/cephtool/test.sh: fix require-osd-release test
	mon/MgrMonitor: define mgr modules for pacific
	doc/dev/release-checklists: generalize
	doc/dev/release-kickoff-checklist: quotes
	qa/suites/rados/thrash-old-clients/1-install/octopus
	qa/releases/pacific.yaml
	mds/cephfs_features: CEPHFS_CURRENT_RELEASE
	doc/dev/release-kickoff-checklist: a few other items
	osd: remove redundant check
	mon/OSDMonitor: make pacific changes
	mon/mon_types: add mon pacific feature
	include/ceph_features: define SERVER_PACIFIC
	include/ceph_features: fix whitespace
	mon: persistent INCOMPAT_PACIFIC item
	ceph-volume: __release__ == pacific
	script: update backport scripts for now-released octopus
	common: pacific release constants
	doc/dev/release-kickoff-checklist
	src/ceph_release: pacific, 16, dev
	CMakeLists: 16.0.0

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-04-12 17:33:57 -05:00
Kefu Chai
0cb56e0f13 doc: use plantweb as fallback of sphinx-ditaa
RTD does not support installing system packages, the only ways to install
dependencies are setuptools and pip. while ditaa is a tool written in
Java. so we need to find a native python tool allowing us to render ditaa
images. plantweb is able to the web service for rendering the ditaa
diagram. so let's use it as a fallback if "ditaa" is not around.

also start a new line after the directive, otherwise planweb server will
return 500 at seeing the diagram.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 08:38:06 +08:00
Sage Weil
3c7d5291de qa/suites/ugprade: remove mimic -> pacific upgrade tests
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
279c437994 qa/standalone/mon/misc: update TEST_mon_features
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
cc99c3bc24 mon/MonCommands: require-osd-release pacific
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Sage Weil
3d8d2e0768 doc/dev/release-kickoff-checklist: include ceph-build change
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00