Commit Graph

50511 Commits

Author SHA1 Message Date
Yan, Zheng
5a9944d731 mds: properly free CInode::ValidationContinuation
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-07 15:59:12 +08:00
Yan, Zheng
94bc0fb373 mds: don't crash when scrub finds bad fragstat/rstat
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-07 15:59:12 +08:00
Yan, Zheng
a9ca637fca mds: check both frag_stat and nest_stat when validating inode
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-07 15:59:12 +08:00
Yan, Zheng
f29091b5c5 mds: check dirfrag rstat when dirfrag is fetched
This avoids the problem that dirfrag becomes imcomplete before
ValidationContinuation::_dirfrags() get called;

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-07 15:59:12 +08:00
Yan, Zheng
0ea991e45b mds: skip scrubbing dentries not modified since last scrub
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-07 15:59:12 +08:00
Loic Dachary
7e95acb494 Merge pull request #7946 from SUSE/wip-doc-dev-teuth
doc/dev: integrate testing into the narrative

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-03-07 10:12:28 +07:00
Nathan Cutler
5b570653f5 doc/dev: integrate testing into the narrative
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-03-06 20:41:35 +01:00
Yehuda Sadeh
6018ccd6c4 Merge pull request #7862 from theanalyst/rgw/doc-insecure-keystone
doc: rgw explain keystone's verify ssl switch

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-05 09:29:46 -08:00
Yehuda Sadeh
a794ea5f7e Merge pull request #7887 from cbodley/wip-rgw-test-multi-period
test/rgw: add multisite test for meta sync across periods

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-05 09:25:27 -08:00
Yehuda Sadeh
2286463b15 Merge pull request #7827 from cbodley/wip-rgw-period-meta-logs
rgw: fixes for per-period metadata logs

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-05 09:25:01 -08:00
Loic Dachary
a9493f23ce Merge pull request #7941 from SUSE/wip-teuos-intro
doc: detailed description of bugfixing workflow

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-03-05 21:55:13 +07:00
Nathan Cutler
a0572bc55c doc: detailed description of bugfixing workflow
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-03-05 15:54:09 +01:00
Loic Dachary
19f6c8d488 Merge pull request #7933 from ceph/wip-doc-dist-ceph-detect-init
doc: add ceph-detect-init(8) source to dist tarball

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-03-05 08:09:36 +07:00
Josh Durgin
56ca57329b Merge pull request #7937 from saru95/patch--1
ceph_daemon.py: Resolved ImportError to work with python3

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-03-04 14:45:12 -08:00
Zack Cerza
28cc0ca66d Merge pull request #7936 from ceph/wip-fix-debian-build
debian/changelog: Remove stray 'v' in version
2016-03-04 15:12:37 -07:00
Sarthak Munshi
9e47cef30c ceph_daemon.py: Resolved ImportError to work with python3
Signed-off-by: Sarthak Munshi <sarthakmunshi@gmail.com>
2016-03-05 03:35:50 +05:30
Casey Bodley
9a6771a864 rgw: fix for RGWCoroutinesManager::run() return value
the 'int ret' variable of the inner scope was shadowing an 'int ret'
variable in the outer scope, so we weren't propagating any of the error
codes

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:09 -05:00
Casey Bodley
5434db9335 rgw: use current period for InitSyncStatus
the InitSyncStatus coroutine records the position to start incremental
sync after finishing a full sync.  this should be the master's marker
from the current period, rather than its oldest log period

this also adds a check to run_sync() that restarts a full sync if it
sees that our sync period is behind the master's oldest log period

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:09 -05:00
Casey Bodley
762c075bb2 rgw: meta log rest handlers avoid get_log()
RGWMetadataManager::get_log() will allocate a log and keep it in memory.
this could lead to a potential denial of service by making requests with
lots of different period ids

RGWMetadataLog if effectively stateless (the only state is a set of
modified_shards, which are not touched by any of the rest api calls), so
we can use a temporary instead of calling get_log()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:09 -05:00
Casey Bodley
faa60bc1a9 rgw: pull first log period from master if not found locally
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:09 -05:00
Casey Bodley
1353fe514b rgw: implement find_oldest_log_period for RGWMetadataManager
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:09 -05:00
Casey Bodley
1b4d1e303b rgw: period history behaves with no current_period
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
8044dcb048 rgw: initialize async_rados before meta_mgr
RGWMetadataManager::init() will depend on async_rados

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
f8804b34a4 rgw: make RGWMetadataLog::get_shard_oid public and const
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
b8a4a9d9a4 rgw: add RGWStatObjCR for async raw_obj_stat
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
dbb934056b rgw: only write meta sync shard markers if can_adjust_marker
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
873cf39882 rgw: make RGWMetaSyncCR wakeups thread-safe
now that the shards will be coming and going after startup, they need to
be reference counted and protected by a mutex

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Casey Bodley
da5f3e7e37 rgw-admin: add read_current_period_id() helper function
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-03-04 17:04:08 -05:00
Dan Mick
0f7730c8f4 debian/changelog: Remove stray 'v' in version
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2016-03-04 11:42:08 -08:00
Orit Wasserman
ede8deeb46 Merge pull request #7918 from ceph/wip-rgw-payer-yehuda
rgw: link payer info to usage logging

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-03-04 19:37:21 +01:00
Ken Dreyer
c8ec17aa1d doc: add ceph-detect-init(8) source to dist tarball
Prior to this commit, the tarball from "make dist" did not include the
ceph-detect-init(8) man page rST source.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-03-04 09:35:46 -07:00
Orit Wasserman
d720540eef Merge pull request #7929 from yehudasa/wip-submodules-fix
submodules: revert an accidental change

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-03-04 16:47:22 +01:00
Samuel Just
fc88f488ce Merge pull request #7910 from ceph/wip-14955
buffer: increment history alloc as well in raw_combined

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-04 07:02:47 -08:00
Yehuda Sadeh
2f7d1c9d2c submodules: revert an accidental change
revert changes that went in in commit f1ac0de5bf.
This affects ceph-erasure-code-corpus, civetweb

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-04 06:54:49 -08:00
Orit Wasserman
2fe0f8eb54 Merge pull request #7916 from ceph/wip-14975
rgw: adjust error code when bucket does not exist in copy operation
rgw: don't override error when initializing zonegroup

Fixes: #14975

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-03-04 12:25:37 +01:00
Javier M. Mellid
4727d4261d rgw: avoid showing payer when payer == owner
If the payer matches the owner it shows the owner only.

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-03-03 16:07:39 -08:00
Yehuda Sadeh
155a53d649 Merge pull request #7786 from ceph/wip-rgw-indexless
rgw: indexless buckets (Yehuda Sadeh)

 - can define a policy, for which buckets are indexless
 - users can then create buckets under the specified placement target
 - indexless buckets will not be synced across zones
 - does not work with (s3) versioned buckets

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 14:18:25 -08:00
Yehuda Sadeh
b7d022f61a rgw: indexless buckets
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 14:06:19 -08:00
Yehuda Sadeh
f1ac0de5bf rgw: configurable index type
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 14:04:19 -08:00
Yehuda Sadeh
905b1d9aa9 rgw: don't override error when initializing zonegroup
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 13:56:37 -08:00
Yehuda Sadeh
0b48c8688b rgw: adjust error code when bucket does not exist in copy operation
Fixes: #14975

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 13:49:39 -08:00
Yehuda Sadeh
bc60ba3ea9 Merge pull request #7764 from rzarzynski/wip-rgw-etag-dlo
rgw: multiple improvements regarding etag calculation for SLO/DLO of Swift API.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-03-03 13:43:27 -08:00
Samuel Just
1335871f3f buffer: increment history alloc as well in raw_combined
Introduced in 73dcd26fc8

Fixes: #14955
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-03-03 11:07:29 -08:00
Sage Weil
be3544f162 Merge remote-tracking branch 'gh/jewel' 2016-03-03 13:35:13 -05:00
Sage Weil
ea45099808 v10.0.4
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-03 13:34:46 -05:00
Loic Dachary
3a1b307d4d Merge pull request #7897 from branch-predictor/bp-bench-errors-fatal
common/obj_bencher.cc: make verify error fatal

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-03-03 23:15:45 +07:00
Piotr Dałek
658bba85c4 common/obj_bencher.cc: make verify error fatal
When run without "--no-verify", all verification errors are noted,
but they are not forwarded/reported anywhere else but to cerr, which
will cause automated testing to ignore them. Make seq_read_bench and
rand_read_bench return -EIO on any verification error which will,
in turn, return it back to caller.

Fixes: #14971
Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>
2016-03-03 16:04:12 +01:00
Sage Weil
799ea24b42 Merge pull request #7757 from ukernel/jewel-14684
mon/MDSMonitor.cc: properly note beacon when health metrics changes

Reviewed-by: John Spray <john.spray@redhat.com>
2016-03-03 09:37:50 -05:00
Sage Weil
9483cae681 Merge pull request #7882 from branch-predictor/bp-unconfuse-health-1
mon: unconfuse object count skew message

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-03 09:15:29 -05:00
Piotr Dałek
f792a3f613 PGMonitor: unconfuse object count skew message
"Pool <pool> has too few pgs" is okay assuming it does not take other
pools into account. And since it does, it is confusing in the following
scenario:

1. Create two pools, one with small pg count and one with large
   pg count
2. Put a whole lot of objects in smaller pool, resulting in "too few
   pgs" warning on that pool, which is expected behavior.
3. Put a whole lot of objects in larger pool, warning goes away.
   Suddenly smaller pool has plenty of PGs?

Current message suggests adding more nodes (or PGs) to pool, when
actually it's warning about significantly more objects in that
particular pool than in the other pools.

Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>
2016-03-03 15:01:56 +01:00