Commit Graph

44940 Commits

Author SHA1 Message Date
Sage Weil
cdccf1106e osd/PG: compensate for sloppy hobject scrub bounds from hammer
Hammer is sloppy about the hobject_t's it uses for the scrub bounds in that
the pool isn't set.  (Hammer FileStore doesn't care, but post-hammer is
much more careful about this sort of thing.)

Compensate by setting the pool on any scrub messages we receive.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 11:38:41 -04:00
Sage Weil
acda626d03 osd: avoid duplicate MMonGetOSDMap requests
These are relatively expensive (we grab the full map from the mon) so we
should avoid duplicating our requests.

Track which requests are in flight.  Only send a new request when new
maps are asked for.  Resend requests when there is a new mon session.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 11:36:30 -04:00
Loic Dachary
18a985affd Merge pull request #6072 from yuyuyu101/update-org
Update org

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-09-24 16:19:43 +02:00
Haomai Wang
f4bf14dd9b Update Xinze affinity
Signed-off-by: Haomai Wang <haomai@xsky.com>
2015-09-24 21:58:51 +08:00
Kefu Chai
d50f5429bd Merge pull request #6066 from dachary/wip-ceph-detect-init
build/ops: ceph-detect-init must ignore .cache

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-24 21:57:31 +08:00
Haomai Wang
eb28eeff0c Update Chen Min affinity
Signed-off-by: Haomai Wang <haomai@xsky.com>
2015-09-24 21:56:49 +08:00
Haomai Wang
58b8a8f26e Update Tianshan affinity
Signed-off-by: Haomai Wang <haomai@xsky.com>
2015-09-24 21:55:21 +08:00
Haomai Wang
58ad7b7949 Update Haomai Wang affinity
Signed-off-by: Haomai Wang <haomai@xsky.com>
2015-09-24 21:53:28 +08:00
Wido den Hollander
3ed6045d24 docs: Update docs to make it clear that there are mirrors worldwide 2015-09-24 15:14:52 +02:00
John Spray
efdaa930d2 mds: fix error reformatting subtreemap_test events
Rare outside of vstart clusters, but if someone did
ever have one of these events in their journal and
try to update to latest ceph, they would end up
with bogus expire_pos on the reformatted events.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-09-24 13:12:03 +01:00
John Spray
557df13b32 tools/cephfs: detect malformed ESubtreeMap::expire_pos
Signed-off-by: John Spray <john.spray@redhat.com>
2015-09-24 13:12:03 +01:00
Kefu Chai
6f11b82f30 Merge pull request #6063 from dachary/wip-tar-v7
build/ops: make dist needs files with names > 99 characters

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-24 17:23:03 +08:00
Loic Dachary
627756e05f build/ops: ceph-detect-init must ignore .cache
In case the test fails, it may leave files behind:

src/ceph-detect-init/.cache/v/cache/lastfailed

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-24 10:54:35 +02:00
Orit Wasserman
2028ba2b49 Merge pull request #5694 from guce/rgw_improve_key_operate
rgw: improve convenience for key operate.
2015-09-24 10:08:13 +02:00
Lu Shi
9c8200bb5d librbd:reads larger than cache size hang.
Fixes:#13164

Signed-off-by: Lu Shi <shi.lu@h3c.com>
2015-09-24 16:06:52 +08:00
Loic Dachary
396702aabf build/ops: make dist needs files with names > 99 characters
When running make distdir=ceph-9.0.3-1870-gfd861bb dist, a few files
have names longer than 99 characters and discarded, which then causes
the resulting tarbal to be incomplete:

tar: ceph-9.0.3-1870-gfd861bb/src/rocksdb/utilities/write_batch_with_index/write_batch_with_index_internal.cc: file name is too long (max 99); not dumped
tar: ceph-9.0.3-1870-gfd861bb/src/rocksdb/utilities/write_batch_with_index/write_batch_with_index_internal.h: file name is too long (max 99); not dumped

Use the tar-ustar format instead of the legacy v7
format (http://www.gnu.org/software/automake/manual/automake.html#Options). It
is unlikely machines with a C++11 compiler also have an antique tar
binary that would only support v7.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-24 08:07:20 +02:00
Xinze Chi
5f7b3f5cde filestore: fix peek_queue for OpSequencer
Fixes: #13209
Signed-off-by: Xinze Chi <xinze@xsky.com>
2015-09-24 10:22:18 +08:00
Samuel Just
c053499011 osd/: eliminate unnecessary pg_hit_set_history_t::current_info
The only field actually relevant from this structure is .begin, which
duplicates the information in hit_set_start_stamp less well.  The problem
is that the starting point of the currently open hit set is ephemeral
state which shouldn't go into the pg_info_t structure.

This also caused 13185  since pg_info_t.hit_set.current_info gets default
constructed with use_gmt = true regardless of the pool setting.  This
becomes a problem in hit_set_persist since the oid is generated using
the pool setting, rather than the use_gmt value in current_info which
is placed into the history list.  That discrepancy then causes a crash
in hit set trim.  There would also be a related bug if the pool setting
is changed between when current_info is constructed and when it is
written out.

Since current_info isn't actually useful, I'm removing it so that we
don't later rely on invalid fields.

Fixes: 13185
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-09-23 16:20:08 -07:00
Sage Weil
fd861bb250 Merge pull request #6053 from ceph/wip-cmake-dang
Wip cmake dang
2015-09-23 17:00:48 -04:00
Sage Weil
2805246a74 Merge pull request #6056 from guangyy/wip-13198
osd: print min_last_epoch_clean along with pg dump

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-23 16:59:06 -04:00
Sage Weil
704cd5d30d Merge remote-tracking branch 'gh/wip-aarch64' 2015-09-23 15:08:22 -04:00
Guang Yang
f5359f2314 osd: print min_last_epoch_clean along with pg dump
Fixes: 13198
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>
2015-09-23 15:58:02 +00:00
Sage Weil
ef909ccbdc mon/Elector: do a trivial write on every election cycle
Currently we already do a small write when the *first* election in
a round happens (to update the election epoch).  If the backend
happens to fail while we are already in the midst of elections,
however, we may continue to call elections without verifying we
are still writeable.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-23 10:58:15 -04:00
Sage Weil
2fb7b1f0e3 mon/MonitorDBStore: assert/crash if there is a write error
Do this globally intead of relying on teh zillion mon callers to
check the error code.  There are no cases where we want to
tolerate a commit failure.

Fixes: #13089
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-23 10:58:13 -04:00
Daniel Gryniewicz
b1401e5124 CMake - fix check for UDEV
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:55 -04:00
Daniel Gryniewicz
0b27024698 CMake - fix check for FUSE
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:55 -04:00
Daniel Gryniewicz
a866a8947d CMake - add check for libedit
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
4d02f8746c CMake - fix check for Snappy
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
3570dd5625 CMake - add check for XFS
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
571215ef20 CMake - fix check for AIO
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
6adf1cbb33 CMake - fix check for blkid
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
1a4262c31a CMake - add check for libcurl
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
a6c8b46101 CMake - fix check for fcgi
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
88f7df7d1a CMake - add check for libuuid
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
a18b649c1e CMake - fix check for leveldb
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
cb7fe45823 CMake - fix check for expat
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
a7ce8f5d68 CMake - Add check for keyutils
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
dcf647ec04 CMake - fix check for NSS
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Daniel Gryniewicz
b02e0f9bfe CMake - fix libatomic_ops and gperftools checks
Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>
2015-09-23 10:55:54 -04:00
Sage Weil
3afd5178ff Merge remote-tracking branch 'gh/infernalis' 2015-09-23 10:46:51 -04:00
Sage Weil
3123b2c5d3 arch/arm: s/false/0/
arch/arm.c: In function 'ceph_arch_arm_probe':
arch/arm.c:54:28: error: 'false' undeclared (first use in this function)
  ceph_arch_aarch64_crc32 = false;  // sorry!
                            ^
arch/arm.c:54:28: note: each undeclared identifier is reported only once for each function it appears in

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-23 08:20:39 -04:00
guce
7e5980b4a3 rgw: improve convenience for key operate.
1.key-type assignments based on context if it wasn't specified
In user    operate context, key-type assignment to KEY_TYPE_S3
In subuser operate context, key-type assignment to KEY_TYPE_SWIFT
In key     operate context, key-type assignment based on user type

2.fix RGWSubUserPool::add()
When create subuser generate secret by default

3.fix RGWAccessKeyPool::generate_key()
Avoid wrong key's username when create user and subuser at the same time
Check empty secret

Signed-off-by: Ce Gu <guce@h3c.com>
2015-09-23 09:52:16 +08:00
Samuel Just
36e4a80c39 ReplicatedPG::hit_set_setup: fix hit_set_remove_all call
We only want to do it if the pool config changed AND we are
primary && active.

fd38902dd4 partially fixed a related
bug.  This should be backported along with it.

Fixes: 13192
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-09-22 17:40:48 -07:00
Samuel Just
8e5a801b43 osd/: assert in HitSet constructor if type is TYPE_NONE as well
Otherwise impl is unpopulated and we risk segfaults in several
methods.  It also seems like it would always indicate a bug.

Signed-off-by: Samuel Just <sjust@redhat.com>
2015-09-22 17:39:31 -07:00
Sage Weil
68b5a8d10e Merge pull request #6037 from liewegas/wip-12407
init-radosgw: fix restart w/ multiple instances

Reviewed-by: Pavan Rallabhandi <pavan.rallabhandi@sandisk.com>
2015-09-22 15:12:17 -04:00
Samuel Just
d422f2820d OSDService::agent_entry: don't use PG::operator<< without pg lock
Fixes: #13199
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-09-22 11:44:20 -07:00
Orit Wasserman
f1ead76f80 Merge pull request #5928 from ceph/wip-12819-infernalis
Wip 12819 infernalis
2015-09-22 20:29:10 +02:00
Loic Dachary
8e6bf15fc9 Merge pull request #6006 from dachary/wip-12936-shec
erasure-code: workaround i386 optimization bug with SHEC

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-22 20:27:57 +02:00
Sage Weil
e17c8e1a7a init-radosgw: specify pid file to start-stop-daemon
This fixes restart when multiple instances are running.

Fixes: #12407
Tested-by: Pavan Rallabhandi <pavan.rallabhandi@sandisk.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-22 14:13:43 -04:00
Sage Weil
fb5f058a92 Merge remote-tracking branch 'gh/infernalis' 2015-09-22 14:04:44 -04:00