Commit Graph

50851 Commits

Author SHA1 Message Date
Yan, Zheng
9e3441733c ceph_test_libcephfs: shutdown without closing file/dir
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-09 14:40:06 +08:00
Yan, Zheng
8fc1b1b095 client: close opened dirs when umounting
Fixes: #14996
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-09 14:40:06 +08:00
x11562
f4b210e79e rgw: remove unused vector
Signed-off-by: Na Xie <xie.na@h3c.com>
2016-03-09 10:50:41 +08:00
Josh Durgin
2c01f91168 Merge pull request #7986 from liewegas/wip-xxhash
xxhash: use clone of xxhash.git; add .gitignore

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-03-08 15:22:26 -08:00
Sage Weil
aab91667c4 xxHash: add .gitignore for build artifacts
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 16:18:00 -05:00
Sage Weil
517a9d6d52 .gitmodules: use github.com/ceph/xxHash clone
This lets us add our own commits, if necessary.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 16:04:31 -05:00
Sage Weil
bdcc84042c qa/workunits/rest/test.py: add confirmation to 'mds setmap'
Broken when we added the confirmation in
fc3554e36a

Fixes: #14606
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 14:34:40 -05:00
Sage Weil
433afce628 mon: initialize last_* timestamps on new pgs to creation time
Currently, when you create a pool, until the PGs peer you generate a health
error like

            8 pgs are stuck inactive for more than 300 seconds

which is inaccurate and misleading.  Instead, set the timestamps to the
creation time so that warnings don't appear until it's clear they're stuck.

Fixes: #14952
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 13:46:58 -05:00
Jason Dillaman
b705a71b9f librbd: refresh image if required before replaying journal ops
Fixes: #14908

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 13:20:24 -05:00
Sage Weil
1c99dc2f4f doc/release-notes: v10.0.4
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 11:37:12 -05:00
Sage Weil
bc565e054e Merge pull request #7966 from dachary/wip-release-notes
release-notes: draft v10.0.4 release notes
2016-03-08 11:33:52 -05:00
Sage Weil
8384f16de2 Merge pull request #7880 from SUSE/wip_keyring_permisions_for_mon_deamon_14950
mon: fix keyring permissions

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-08 11:22:08 -05:00
Sage Weil
46007d271f Merge pull request #7121 from efirs/ef_eversion_t_no_sprintf
osd: Replace snprintf with faster implementation in eversion_t::get_key_name

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-03-08 11:21:42 -05:00
Sage Weil
34b7c824f9 Merge pull request #7141 from jecluis/wip-mon-clockskew
mon: make clock skew checks sane

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-03-08 11:21:20 -05:00
Sage Weil
b533cf107a Merge pull request #7899 from liewegas/wip-osd-markdown
test/osd: Relax the timing intervals in osd-markdown.sh
2016-03-08 11:20:54 -05:00
Sage Weil
84caba5277 Merge pull request #7900 from liewegas/wip-bluefs-alignment
osd: bluefs: fix alignment for odd page sizes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-08 11:20:43 -05:00
Sage Weil
bdd2ddb387 Merge pull request #7904 from liewegas/wip-log-delete
log: use delete[]

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2016-03-08 11:20:10 -05:00
Jason Dillaman
4ded44aa5e journal: possible race condition during fetch playback
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 11:01:33 -05:00
Jason Dillaman
3982895286 test: fix errors introduced by rebase to master
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 10:35:41 -05:00
Jason Dillaman
b37f135c64 journal: clean up playback notification handling
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 10:08:13 -05:00
Jason Dillaman
b710374001 tests: updated test cases for librbd journal tag allocation
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:44 -05:00
Jason Dillaman
21d959529c journal: properly handle tag transition
Now that the tag concept has been re-used for delineating epochs for
librbd, we need playback to properly handle the cases where the active
playback tag abruptly ends and a newer tag is inserted in the first
splay offset object.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:44 -05:00
Jason Dillaman
3325b871ee journal: additional debug messages surrounding commit updates
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
8444da8480 librbd: improved debugging for journal client / tag processing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
16d5e695c3 librbd: allocate new journal tag when acquiring exclusive lock
The journal tag tracks a write epoch within the image, so before
allowing writes to proceed, ensure the journal entries will be
stored under a new epoch.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
cbcfedf7d6 librbd: add tag handling to journal state machine
The journal will not retrieve the tag class for the image within
the journal in addition to the most recently allocated tag. Also
added helper methods to allocate new tags.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
a4dd788588 journal: helper method to retrieve in-memory client data
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
708c72cb0a rbd-mirror: local pool id no longer stored in client registration
The remote pool name should match the remote pool name.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
dbcbaa6e5c librbd: update journal client and tag data structures
The mirror peer now holds remote's image id as well as a collection
of bootstrap sync points.  The tag now contains uuids to map back
to the owning pool.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
9892fd782c librbd: allocate new uuid when enabling mirroring
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Jason Dillaman
174359baab cls_rbd: support for uuid to represent a mirrored pool
This uuid will be used as the client id for remote peer image
journals.  This will allow the uuid to be also utilized within
the librbd journal tag for tracking epoch ownership.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 09:03:43 -05:00
Ken Dreyer
19798efdd1 Merge pull request #7742 from ErwanAliasr1/evelu-spec
Adding build requires

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2016-03-08 06:51:44 -07:00
Kefu Chai
92628f5699 common/strtol.cc: fix the coverity warnings
* promote the compared types properly to address the signed/unsigned
  comparison warnings. this also fixes the potential problems of
  slicing a compared type down to a "smaller" type before the
  comparison.
* check for the width of resulting type and shift bits caused by SI
  prefix to avoid the -Wshift-count-overflow warnings. this again
  is a potential issue, as shifting n bits of an integer of m bits
  width, where n >= m, leads to undefined behaviour.
* add a test for the 2nd fixed issue.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-03-08 20:57:45 +08:00
Jason Dillaman
7fd230f6e8 rbd-mirror: integrate single thread pool for all processing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 07:11:51 -05:00
Jason Dillaman
3496e7772d librbd: own the lifecycle of the journaler's threads
This is the first step in merging the journal threads into the
librbd singleton thread pool.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 07:11:51 -05:00
Jason Dillaman
f983b80a95 journal: use provided work queue and timer
This avoids the need to open two threads per journaler.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 07:11:51 -05:00
Jason Dillaman
a00eae006d journal: pass metadata instead of finisher to FutureImpl
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-08 07:11:51 -05:00
Kefu Chai
37f3fc9ea4 Merge pull request #7972 from badone/wip-CMakeLists-dup-line
cmake: Remove duplicate find_package libcurl line.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-03-08 19:31:25 +08:00
xinxin shu
052075e61f librbd: skip truncate request if object does not exist
Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2016-03-08 13:56:35 +08:00
Loic Dachary
d8cdb5fe08 scripts: ceph-release-note rewrite PR title case
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-08 12:03:42 +07:00
Loic Dachary
bf61156670 release-notes: draft v10.0.4 release notes
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-08 12:03:42 +07:00
Sage Weil
c88b863c7f Merge pull request #7959 from kmroz/wip-add-rgw-to-stopsh
script: add missing stop_rgw variable to stop.sh script

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-07 21:04:01 -05:00
Greg Farnum
ca0eed076b Merge branch 'wip-damage-table' of git://github.com/jcsp/ceph into greg-fs-testing
Conflicts:
	src/mds/MDCache.cc

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-07 16:29:28 -08:00
Greg Farnum
976358111d Merge branch 'wip-scrub-repair' of git://github.com/ukernel/ceph into greg-fs-testing
https://github.com/ceph/ceph/pull/6682

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-07 16:19:39 -08:00
Sage Weil
796331d6a1 Merge branch 'master' of github.com:ceph/ceph 2016-03-07 15:58:44 -05:00
Sage Weil
37f14a5d94 Merge branch 'wip-conf-root' of https://github.com/liewegas/ceph
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Conflicts:
	src/common/config.cc
2016-03-07 15:36:13 -05:00
Josh Durgin
9ef7bb15bd Merge pull request #7914 from dillaman/wip-tests-template-specialization
test: correct librbd errors discovered with unoptimized cmake build

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-03-07 12:07:51 -08:00
Erwan Velu
754d2103e1 packaging: Moving Cython into distro specific area
To get the spec file into a consistent state, let's move Cython into the distro
specific are of the spec file.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-03-07 20:27:07 +01:00
Erwan Velu
019d9e17a7 packaging: Adding redhat-rpm-config
Some part of the rados compilation process is expecting redhat-hardened-cc1.
That's surely because of the FORTIFY compilation flag.

redhat-hardened-cc1 is part of the redhat-rpm-config so let's put it as a build
dependency.

The typical output when this issue is occuring :

cd ./pybind/rados; CPPFLAGS="-iquote \/ceph/src/include -D__CEPH__ -D_FILE_OFFSET_BITS=64 -D_THREAD_SAFE -D__STDC_FORMAT_MACROS -D_GNU_SOURCE -DCEPH_LIBDIR=\"/usr/local/lib\" -DCEPH_PKGLIBDIR=\"/usr/local/lib/ceph\" -DGTEST_USE_OWN_TR1_TUPLE=0 -D_REENTRANT    " CFLAGS="-iquote \/ceph/src/include -Wall -Wtype-limits -Wignored-qualifiers -Winit-self -Wpointer-arith  -fno-strict-aliasing -fsigned-char -rdynamic -O2 -g -pipe -Wall -Wp,-U_FORTIFY_SOURCE -Wp,-D_FORTIFY_SOURCE=2 -fexceptions --param=ssp-buffer-size=4 -fPIE -fstack-protector-strong  -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free  -g -O2" LDFLAGS="-L\/ceph/src/.libs -Wl,--as-needed  -Wl,-z,relro -Wl,-z,now  -latomic_ops " CYTHON_BUILD_DIR="/ceph/src/build" /bin/python ./setup.py build \
--build-base /ceph/src/build \
--verbose
Compiling rados.pyx because it changed.
Cythonizing rados.pyx
  CXXLD    libradosstriper.la
  CXXLD    librbd.la
  CXXLD    librgw.la
running build
running build_ext
building 'rados' extension
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -iquote /ceph/src/include -Wall -Wtype-limits -Wignored-qualifiers -Winit-self -Wpointer-arith -fno-strict-aliasing -fsigned-char -rdynamic -O2 -g -pipe -Wall -Wp,-U_FORTIFY_SOURCE -Wp,-D_FORTIFY_SOURCE=2 -fexceptions --param=ssp-buffer-size=4 -fPIE -fstack-protector-strong -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free -g -O2 -iquote /ceph/src/include -D__CEPH__ -D_FILE_OFFSET_BITS=64 -D_THREAD_SAFE -D__STDC_FORMAT_MACROS -D_GNU_SOURCE -DCEPH_LIBDIR=/usr/local/lib -DCEPH_PKGLIBDIR=/usr/local/lib/ceph -DGTEST_USE_OWN_TR1_TUPLE=0 -D_REENTRANT -fPIC -I/usr/include/python2.7 -c /ceph/src/build/rados.c -o /ceph/src/build/temp.linux-x86_64-2.7/ceph/src/build/rados.o
gcc: erreur: /usr/lib/rpm/redhat/redhat-hardened-cc1: Aucun fichier ou dossier de ce type
error: command 'gcc' failed with exit status 1

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-03-07 20:27:07 +01:00
Erwan Velu
7d48d21a53 packaging: Adding btrfs build require
When doing a 'make check', 'qa/workunits/ceph-helpers.sh' does expect the 'btrfs'
command to be available. If not, that make many tests failing.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-03-07 20:27:06 +01:00