Commit Graph

40537 Commits

Author SHA1 Message Date
Yann Dupont
0df83f649d mailmap: Javier Guerra affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
a9ccd550da mailmap: Thomas Johnson affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
336957cda4 mailmap: Alfredo Deza affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
5f8a0d6b8b mailmap: Vicente Cheng affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
ec0ad937e3 mailmap: Fix Xan Peng affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
e72311626c mailmap: Zhicheng Wei affiliation.
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
1bc0960720 mailmap: Pete Zaitcev affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
eb4f10013f mailmap: Alexis Normand affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
341218c6a2 mailmap: Florian Marsylle affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:58 +00:00
Yann Dupont
698905c10a mailmap: Robin Dehu affiliation
Signed-off-by: Yann Dupont <yann@objoo.org>
2015-03-20 21:06:52 +00:00
Gregory Farnum
1e463ada30 Merge pull request #4103 from ceph/wip-error-str
mds: fix error_str formatting in scrub output

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-20 10:59:26 -07:00
Gregory Farnum
7291f733c2 Merge pull request #4116 from ceph/wip-10368
mds: call wait_for_safe twice in command_flush_journal

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-20 10:50:56 -07:00
John Spray
035ab3c0e3 mds: call wait_for_safe twice in command_flush_journal
...so that we wait until everyone who was waiting for the first
wait_for_safe has run their completion before we proceed, thus
avoiding the possibility that those completions will execute
during our trimming and cause problems.

Fixes: #10368
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 17:11:39 +00:00
Yan, Zheng
4c24d0cc07 auth: reinitialize NSS modules after fork()
Fixes: #11128
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-03-21 01:08:11 +08:00
Yan, Zheng
f183cd7c21 auth: properly return error of cephx_calc_client_server_challenge
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-03-21 01:05:08 +08:00
Bosse Klykken
bee7f24ed5 Minor fix: Documentation referred to bootstrap-osd instead of bootstrap-mds
Signed-off-by: Bosse Klykken <larkly@gmail.com>
2015-03-20 15:21:42 +01:00
John Spray
c087025f22 mds: improved doxygen comments in StrayManager
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:48 +00:00
John Spray
0ae624e68d mds: update StrayManager op limit on mds_max_purge_ops_per_pg
Previously was only updating on mds_max_purge_ops

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
3a0caf9bbb mds: fix parent check in MDCache::eval_remote
This code path wasn't touched until the change
in "mds/Server: fix stray reintegration".  Now we
see that it will crash in fsstress in some circumstances
when the client is doing a link operation, where
we are checking the projected linkage on the DN
before going into this function, but not the projected
parenthood of the inode.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
91867b2b74 mds: make purge op limit dynamic based on PGs/MDSs
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
2f1e10c11a mds: throttle purge stray operations
Pull out the stray-handling code into a separate StrayManager
class.

There is an additional improvement to stray reintegration here,
by passing the DN that triggered the reintegration through,
we should make a better choice about *which* hardlink to
reintegrate the inode into, rather than just picking the first.

Fixes: #10390
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
de157d9476 common/config_opts: add purge throttle options
These are to be respected by the MDS in the number
of concurrent RADOS delete operations and
number of files to be purged at once.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
f180b64c59 osdc: make op count in Filer::purge configurable
Previously this was simply hardcoded to do up to
10 RADOS delete ops at a time.  Make this a config
option so that Filer consumers (like the MDS) can
know how many concurrent operations will be done
on their behalf.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
763e26c41e mds: eval stray on remove dentry replica
This happens because when handling an MCacheExpire,
we expire inodes first and then dentries, so when
the inodes are put() their dentries still are replicated
so eval_stray fails.  Do an explicit call to maybe_eval_stray
when handling the expire for the dentry in order to catch
this.

One hits this path when migrating a stray away from
a stopping MDS rank.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
28a10164f3 mds: expire other ranks' mydirs during 'stopping'
Avoids the surviving MDSs thinking their base dir is still
replicated after a rank has been stopped.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
John Spray
a01e9b1f1b mds/Server: fix stray reintegration
This was checking tracei's primary parent DN for remoteness
as a condition to calling eval_remote.  However, the *primary*
parent DN in this case is the stray, which is not remote.

The correct check is tracedn (the remote dentry that got us here)
rather than tracei->get_parent_dn() (the primary dentry for the
inode that we have looked up).

This leads to eval_remote being invoked, and reintegration
of stray hard-linked inodes working.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-20 12:32:47 +00:00
Loic Dachary
b94189f9c0 Merge pull request #4114 from apeters1971/wip-isa-lrucache
erasure-code: make ErasureCodeIsaTableCache drop entries according to LRU

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-03-20 11:35:32 +01:00
Andreas Peters
9999238396 erasure-code: make ErasureCodeIsaTableCache drop entries according to LRU
There was a bug in the arguments used by the splice function to move elements from the LRU list to the head of the list.
To simplify the implementation the direction of the LRU list has been changed e.g. newest entries are pushed in front.

Signed-off-by: Andreas-Joachim Peters <andreas.joachim.peters@cern.ch>
2015-03-20 10:56:46 +01:00
Loic Dachary
b5e82bb8c5 Merge pull request #4084 from ceph/wip-switch-to-breathe
Wip switch to breathe

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-03-20 10:33:10 +01:00
Kefu Chai
9e9595291d doc: s/Asphyxiate/Breathe/ in documenting.rst
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-03-20 17:17:53 +08:00
Kefu Chai
e69e85079b doc: enable doxygen for enum
* since we switched to breathe, which supports rendering enum
  types

Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-03-20 17:17:53 +08:00
Kefu Chai
cd69ded7af doc: Switch doxygen integration back to breathe
* asphyxiate needs more toolings, see
  https://github.com/ceph/asphyxiate/issues/1
* this commit basically reverts c96064
* use `autodoxygen` directive to doxygen referenced source files
* do not call `doxygen` explicitly in `build-doc`, `autodoxygen`
  will take care of it.

Fixes: #6115
Fixes: #6115
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-03-20 17:17:16 +08:00
Yan, Zheng
b57e13fd3c test/libcephfs/flock.cc: don't release lock before EWOULDBLOCK check
make sure the main thread/process not release the file lock before
workers execute the operation that supposes to return EWOULDBLOCK.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-03-20 16:01:05 +08:00
Yan, Zheng
ce244ca940 test/libcephfs/flock.cc: fix synchronization points
In the threesome test cases, the main thread/process call PING_WORKER()
twice at each synchronization point. It's possible that one worker gets
both notifications and takes two steps forward, another worker gets no
notification.

The fix is use seperate semaphores for odd/even number synchronization
points.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-03-20 16:00:59 +08:00
Haomai Wang
f31ffa7549 Merge pull request #3983 from yuyuyu101/wip-async-fix-3
Wip async fix 3

Reviewed-by: Sage Weil <sage@redhat.com>
2015-03-20 11:23:18 +08:00
Haomai Wang
b0c30f6743 Thread.cc: Make set_affinity private and correct behavior
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2015-03-20 11:00:56 +08:00
Jianpeng Ma
537e88ec7d qa/cephtool: Using add-cache rather than add to test ceph health.
Don't forget set cachemode.
By the way, For test max_target_bytes, don't reply on /etc/passwd
because different host have different size of /etc/passwd.
Avoid met this bug, i create a tmp file.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-03-20 09:55:39 +08:00
Jianpeng Ma
def4fc4ae5 osdc: add epoch_t last_force_resend in Op/LingerOp.
Using this field record the pg_poo_t::last_force_op_resend to avoid op
endless when osd reply with redirect.

Fixes: #11026
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-20 09:37:48 +08:00
Sage Weil
b509bc7931 doc/release-notes: more hammer release notes
Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-19 17:24:33 -07:00
Sage Weil
c56773021c Merge pull request #4085 from ceph/wip-11160
rgw: don't use rgw_socket_path if frontend is configured

Reviewed-by: Sage Weil <sage@redhat.com>
2015-03-19 17:19:59 -07:00
Sage Weil
ef4d5d8bcf Merge pull request #4107 from ceph/wip-11102
osd: only complain about stored vs actual digest if all peers support it

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-03-19 17:16:45 -07:00
Sage Weil
bf814d5248 doc/release-notes: make hammer note about filestore format upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-19 17:16:15 -07:00
Sage Weil
477ac92984 osd: only complain about stored vs actual digest if all peers support it
If we have a mixed cluster of hammer and pre-hammer OSDs, we will fall back
to using 0 as the initial crc32c value.  However, if the primary has a
stored digest, it currently compares its value to the reported value (w/
the wrong initial value) and complains.

There are two possible fixes:
 - avoid storing a digest if all peers don't support it, or
 - avoid complaining on scrub if all peers don't support it.

The latter is easier, and this fix also has the benefit of fixing the bug
even for clusters where this has already happened.

Fixes: #11102
Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-19 16:27:17 -07:00
Samuel Just
9a2ff34d75 PG::find_best_info: reject infos with old last_epoch_started
See doc/dev/osd_internals/last_epoch_started.rst

Reviewed-by: Sage Weil <sage@redhat.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-03-19 15:30:41 -07:00
John Spray
8af2b43263 Merge pull request #3885 from Ved-vampir/master
common: add perf counters description

Reviewed-by: John Spray <john.spray@redhat.com>
2015-03-19 22:05:31 +00:00
John Spray
3ee11b567c Merge pull request #3840 from ceph/wip-libcephfs-fsetxattr
libcephfs: add ceph_f{get,set,list,remove)_xattr

Reviewed-by: John Spray <john.spray@redhat.com>
2015-03-19 22:03:04 +00:00
John Spray
67fdb1c16c Merge pull request #3750 from ceph/wip-dump-cache
mds: Add 'dump cache' asok

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-19 22:00:48 +00:00
John Spray
936e003c95 mds: implement 'dump cache' asok command
Retains old text format output when user specifies
a filename, else returns JSON.  JSON output will
cope less well with large caches, but will be more
useful for automated tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-19 21:27:35 +00:00
John Spray
abb4a73ac9 mds: use MDSCacheObject::dump in CDir::dump
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-19 21:27:34 +00:00
John Spray
107e7c9712 mds: add CDentry::dump
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-19 21:27:34 +00:00