Commit Graph

84926 Commits

Author SHA1 Message Date
Patrick Donnelly
ebd0fcd067
Merge PR #16779 into master
* refs/pull/16779/head:
	mds: cleanup MDCache::open_snaprealms()
	mds: make sure snaptable version > 0
	mds: don't consider CEPH_INO_LOST_AND_FOUND as base inode
	mds: replace MAX() with std::max()
	tools/cephfs: make cephfs-data-scan create snaprealm for base inodes
	qa/cephfs: don't run TestSnapshots.test_kill_mdstable on kclient
	qa/cephfs: adjust check of 'cephfs-table-tool all show snap' output
	mds: don't warn unconnected snaplrealms in cluster log
	mds: update CInode/CDentry's first according to global snapshot seq
	qa/cephfs: add tests for snapclient cache
	qa/cephfs: add tests for snaptable transaction
	mds: add asok command that dumps cached snap infos
	qa/cephfs: add tests for multimds snapshot
	client: don't mark snap directory complete when its dirstat is empty
	qa/workunits/snaps: add snaprealm split test
	mds: make sure mds has uptodate mdsmap before checking 'allows_snaps'
	client: fix incorrect snaprealm when adding caps
	qa/workunits/snaps: add hardlink snapshot test
	mds: add incompat feature and bump protocol for snapshot changes
	mds: detach inode with single hardlink from global snaprealm
	mds: record hardlink snaps in inode's snaprealm
	mds: attach inode with multiple hardlinks to dummy global snaprealm
	mds: cleanup rename code
	mds: ensure xlocker has uptodate lock state
	mds: simplify SnapRealm::build_snap_{set,trace}
	mds: record global last_created/last_destroyed in snaptable
	mds: pop projected snaprealm before inode's parent changes
	mds: keep isnap lock in sync state
	mds: handle mksnap vs resolve_snapname race
	mds: cleanup snaprealm past parents open check
	mds: rollback snaprealms when rolling back slave request
	mds: send updated snaprealms along with slave requests
	mds: explict notification for snap update
	mds: send snap related messages centrally during mds recovery
	mds: synchronize snaptable caches when mds recovers
	mds: introduce MDCache::maybe_finish_slave_resolve()
	mds: notify all mds about prepared snaptable update
	mds: record snaps in old snaprealm when moving inode into new snaprealm
	mds: cache snaptable in snapclient
	mds: recover snaptable client when mds enters resolve state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-03 15:41:19 -07:00
Zack Cerza
dd5e15a33d qa/suites/cephmetrics: Add new facets
For EPEL and containerized prometheus/grafana

Signed-off-by: Zack Cerza <zack@redhat.com>
2018-04-03 15:44:33 -06:00
Zack Cerza
177b444b8d qa/suites/cephmetrics: Update ceph-ansible config
This is taken from the ceph-ansible suite.

Signed-off-by: Zack Cerza <zack@redhat.com>
2018-04-03 15:44:33 -06:00
Patrick Donnelly
d4ee7b5056
Merge PR #20915 into master
* refs/pull/20915/head:
	Add config doc for exporting CephFS over NFS

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-04-03 12:52:48 -07:00
David Zafman
5cfb8241f4 osd: Fix stale scrub stats when a primary takes over
Fixes: http://tracker.ceph.com/issues/23267

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-03 12:51:06 -07:00
Patrick Donnelly
b1f8e9f948
Merge PR #21003 into master
* refs/pull/21003/head:
	client: lookup . on non-directory inode
	client: avoid may_lookup for lookup . and lookup ..

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-04-03 11:38:43 -07:00
Patrick Donnelly
a09b37721c
Merge PR #21221 into master
* refs/pull/21221/head:
	client: fix _read return for invalid offset

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-03 11:36:58 -07:00
Patrick Donnelly
4fd23a1eae
client: fix _read return for invalid offset
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-03 11:34:35 -07:00
Patrick Donnelly
30fb3129bc
Merge PR #21088 into master
* refs/pull/21088/head:
	client: fixup warning

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-03 11:33:55 -07:00
John Wilkins
9b8c048192
Merge pull request #21050 from falcon78921/wip-doc-falcon78921
doc: updated add primary storage documentation for latest CloudStack release (4.11)

reviewed-by: John Wilkins <jowilkin@redhat.com>
2018-04-03 09:55:06 -07:00
David Galloway
34e0ecd105
Merge pull request #21218 from ceph/wip-dgall-crontab
test:qa:infra - Run update daily and use bash
2018-04-03 12:27:34 -04:00
David Galloway
07186a5b87 test:qa:infra - Run update daily and use bash
bash has the path for `source` to activate the virtualenv.  sh doesn't.

[skip ci]

Signed-off-by: David Galloway <dgallowa@redhat.com>
2018-04-03 11:39:13 -04:00
Sage Weil
2284e133af osd: fast dispatch peering events (part 1)
This is a big commit that lays out the infrastructure changes to fast
dispatch the remaining peering events.  It's hard to separate it all out
so this probably doesn't quite build; it's just easier to review as a
separate patch.

- lock ordering for pg_map has changed:
  before:
    OSD::pg_map_lock
      PG::lock
        ShardData::lock

  after:
    PG::lock
      ShardData::lock
        OSD::pg_map_lock

- queue items are now annotated with whether they can proceed without a
pg at all (e.g., query) or can instantiate a pg (e.g., notify log etc).

- There is some wonkiness around getting the initial Initialize event to
a newly-created PG.  I don't love it but it gets the job done for now.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
ac142c3cc0 osd: queue null events without PG lock
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
f9aea5da93 osd: move part of wake_pg_waiters into helper
We'll need this shortly.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
8e8c7cce1f osd: use MTrim peering event for trimming
This is simpler and cleaner than handling log trimming as a special case.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
cf5cd222ce osd: fast dispatch backfill and recovery reservation events
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
25da186ab8 osd: move M{Backfill,Recovery}Reserve event logic into message
Better encapsulation!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
3b904547fb messages/MOSDPeeringOp: add
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
aea80d9afb osd/PG: move peering event type out of PG class
We will create these directly from peering Messages shortly.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
beb8dd5b1a osd/PG: keep epoch, not map ref, of last osdmap for lsat persisted epoch
No need to pin the map in memory!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
a6fef5a61b osd/PG: remove old update_store_on_load()
This isn't needed post-luminous.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:12:35 -05:00
Sage Weil
643253c326 Merge tag 'v13.0.2'
v13.0.2
2018-04-03 10:08:22 -05:00
Sage Weil
e2dde5ff01 buffer: kill push_front
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
792fd4f44d tools/RadosDump: avoid bufferlist::push_front
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
7c701962bb os/filestore/FileJournal: avoid push_front
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
e9e06589b4 erasure-code: avoid bufferlist::push_front
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
dee38ca52a buffer: kill claim_prepend
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
89e62bb96d unittest_compression: avoid claim_prepend
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
186163606e os/bluestore: avoid claim_prepend
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Sage Weil
ad9168f396 osdc/Striper: rewrite assemble_result without push_front or claim_prepend
Make a single forward pass across the map while still avoiding tailing
zeroes in the !zero_tail case.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-03 10:07:05 -05:00
Ricardo Marques
803dd504d2 mgr/dashboard: Add CdDatePipe
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-03 15:55:50 +01:00
Kefu Chai
35dcbcab6e common/hobject: fix the sort order of hobject
we *cannot* change the sort order of hobject. and to avoid duplicated
comparisions, we can check for empty keys, and do not compare the names
again if both hobjects being compared have empty keys.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-03 22:46:57 +08:00
Patrick Donnelly
0186795496
Merge PR #21180 into master
* refs/pull/21180/head:
	vstart_runner: examine check_status before error

Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-03 06:51:18 -07:00
Jason Dillaman
3b08c0609c Merge pull request #20460 from colletj/v1_image_creation_disallow
librbd: disallow creation of v1 image format

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-03 09:18:39 -04:00
Jason Dillaman
98bae81f17
Merge pull request #21202 from tchaikov/wip-rbd-replay
rbd-replay: remove boost dependency

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-03 09:14:39 -04:00
Jason Dillaman
ccb2646a03
Merge pull request #21142 from dragonylffly/wip-fix-ebusy
rbd-nbd: fix ebusy when do map

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-03 07:39:15 -04:00
Jason Dillaman
de03571aa7
Merge pull request #21157 from trociny/wip-23526
journal: limit number of appends sent in one librados op 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-03 07:38:40 -04:00
Yan, Zheng
5e79179d2b mds: PendingReleaseNotes and dev doc for open file table
Fixes: http://tracker.ceph.com/issues/23532
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-04-03 17:06:07 +08:00
Jan Fajerski
428236de8b mon/MgrMonitor: daemon id is under who in cmdmap, return name not id
Fixes: http://tracker.ceph.com/issues/23330

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-04-03 10:44:43 +02:00
Kefu Chai
440c597df3 rbd-replay: remove boost dependency
quite a few facilies are now available in standard library now after we
switched to C++17.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-03 16:30:47 +08:00
Volker Theile
1ac6a07909 mgr/dashboard: Remove useless code
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-03 09:36:21 +02:00
Patrick Donnelly
8b7892f6c9
Merge PR #20855 into master
* refs/pull/20855/head:
	client: add the fuse parameter max_write

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-02 21:15:20 -07:00
Patrick Donnelly
9d8037f8da
Merge PR #21096 into master
* refs/pull/21096/head:
	pybind/cephfs: added comments to cephfs.pyx

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-02 21:10:56 -07:00
Yuri Weinstein
9b7b5a7673
Merge pull request #21183 from neha-ojha/wip-minor-fix-perf-suite
qa/suites/perf-basic: add desc regarding test machines

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-04-02 13:56:08 -07:00
Sage Weil
7f975b09e2 os/filestore: advertise vdo in filestore metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-02 15:19:36 -05:00
Sage Weil
88d655a7fa os/filestore: implement thin provisioning utilization stats for VDO
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-02 15:19:35 -05:00
Sage Weil
d9655a2c19 os/bluestore/KernelDevice: advertise vdo and physical_size in metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-02 15:19:19 -05:00
Sage Weil
97ca41ce18 os/bluestore/KernelDevice: implement thin utilization stats for VDO
Detect if we are a VDO device.  If so, pull the stats out of sysfs so that
we can report meaningful utilization numbers.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-02 15:19:19 -05:00
Sage Weil
266d1649cf os/bluestore: hook to expose utilization of thinly-provisioned device
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-02 15:19:19 -05:00